2024-09-14T11:03:45.097 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T11:03:45.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:03:45.241 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175 branch: main description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904175' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu/WUZQ976J8HXlyzrjwIQ5A23w68+QlprRU6wmqlSxiZJANIiVDLTu4Rf38/8zejRovsn38FRGaUIIyuY8qPo= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEya4EjgDxKzi2sw/ayv7946DeZngcy6pueV257ZFPMkXpRlEfwESCGHS7k0cnf+5oEPYf4ZB3yIcGnV7ow5+M8= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T11:03:45.241 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T11:03:45.242 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T11:03:45.242 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T11:03:45.243 INFO:teuthology.task.internal:Checking packages... 2024-09-14T11:03:45.265 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T11:03:45.266 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T11:03:45.266 INFO:teuthology.packaging:ref: None 2024-09-14T11:03:45.266 INFO:teuthology.packaging:tag: None 2024-09-14T11:03:45.266 INFO:teuthology.packaging:branch: main 2024-09-14T11:03:45.266 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:03:45.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T11:03:45.485 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T11:03:45.486 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T11:03:45.503 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T11:03:45.504 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T11:03:45.518 INFO:teuthology.task.internal:Saving configuration 2024-09-14T11:03:45.535 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T11:03:45.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T11:03:45.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:58:54.653862', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu/WUZQ976J8HXlyzrjwIQ5A23w68+QlprRU6wmqlSxiZJANIiVDLTu4Rf38/8zejRovsn38FRGaUIIyuY8qPo='} 2024-09-14T11:03:45.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:58:54.656318', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEya4EjgDxKzi2sw/ayv7946DeZngcy6pueV257ZFPMkXpRlEfwESCGHS7k0cnf+5oEPYf4ZB3yIcGnV7ow5+M8='} 2024-09-14T11:03:45.594 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T11:03:45.606 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:03:45.606 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:03:45.606 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T11:03:45.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6fbc911b0>, signals=[15]) 2024-09-14T11:03:45.675 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T11:03:45.686 INFO:teuthology.task.internal:Opening connections... 2024-09-14T11:03:45.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:03:45.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:45.768 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:03:45.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:45.845 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T11:03:45.856 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-14T11:03:45.874 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-14T11:03:45.874 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-14T11:03:45.932 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-09-14T11:03:45.932 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:03:45.933 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:03:45.934 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:03:45.934 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:03:45.934 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:03:45.935 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-14T11:03:45.993 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-14T11:03:46.011 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-14T11:03:46.011 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-14T11:03:46.068 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-09-14T11:03:46.068 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-09-14T11:03:46.068 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:03:46.069 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:03:46.070 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-14T11:03:46.093 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T11:03:46.104 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T11:03:46.148 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T11:03:46.149 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:03:46.151 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:03:46.167 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T11:03:46.179 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T11:03:46.179 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:03:46.209 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:03:46.240 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T11:03:46.295 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T11:03:46.314 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T11:03:46.314 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T11:03:46.315 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:03:46.315 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:03:46.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:46.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:46.334 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-14T11:03:46.334 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-14T11:03:46.391 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:03:46.391 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.14.0-503.el9.x86_64 2024-09-14T11:03:46.391 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y kernel 2024-09-14T11:03:46.392 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:03:46.392 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.14.0-503.el9.x86_64 2024-09-14T11:03:46.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2024-09-14T11:03:48.935 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T11:03:49.960 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-14T11:03:50.907 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-14T11:03:51.845 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-14T11:03:55.172 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T11:03:56.204 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T11:03:56.806 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-14T11:03:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T11:03:57.896 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-14T11:03:58.817 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-14T11:04:02.983 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:04:04.165 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-14T11:04:05.006 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:04:05.006 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:04:05.092 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:04:05.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 79 M 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 126 M 2024-09-14T11:04:05.109 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-14T11:04:05.443 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 285 kB/s | 23 kB 00:00 2024-09-14T11:04:06.184 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:04:06.185 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:04:06.268 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-14T11:04:06.274 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:04:06.274 INFO:teuthology.orchestra.run.smithi094.stdout: Package Architecture Version Repository Size 2024-09-14T11:04:06.274 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:04:06.274 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-14T11:04:06.274 INFO:teuthology.orchestra.run.smithi094.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout:Install 4 Packages 2024-09-14T11:04:06.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:04:06.276 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 79 M 2024-09-14T11:04:06.276 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 126 M 2024-09-14T11:04:06.276 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-14T11:04:06.858 INFO:teuthology.orchestra.run.smithi094.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-14T11:04:07.733 INFO:teuthology.orchestra.run.smithi094.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-14T11:04:08.151 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-14T11:04:08.416 INFO:teuthology.orchestra.run.smithi094.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-14T11:04:09.093 INFO:teuthology.orchestra.run.smithi094.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-14T11:04:09.093 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:04:09.093 INFO:teuthology.orchestra.run.smithi094.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-14T11:04:09.778 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-14T11:04:10.149 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-14T11:04:10.149 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-14T11:04:10.451 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.7 MB/s | 29 MB 00:05 2024-09-14T11:04:11.123 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-14T11:04:11.123 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-14T11:04:12.201 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.1 MB/s | 35 MB 00:06 2024-09-14T11:04:12.201 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:04:12.201 INFO:teuthology.orchestra.run.smithi131.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-14T11:04:12.880 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-14T11:04:13.247 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-14T11:04:13.247 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-14T11:04:13.577 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-14T11:04:14.205 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-14T11:04:14.205 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-14T11:04:14.231 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:04:14.316 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:16.662 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-14T11:04:17.129 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:17.259 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:17.484 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:04:17.567 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:04:20.494 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:22.085 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:22.134 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:25.346 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:04:25.386 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:27.023 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:04:30.228 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:05.500 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:05.543 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:05.920 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:05.921 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:05:05.921 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:05:05.921 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:05:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:05:06.741 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-14T11:05:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:06.741 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:05:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:06.742 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:05:06.742 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-14T11:05:07.143 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:07.225 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:07.226 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:07.226 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:05:07.226 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:05:07.226 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:05:07.226 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T11:05:07.226 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:05:07.226 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:07.285 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:07.286 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:07.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2024-09-14T11:05:07.324 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 82.el9 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8274670 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2024-09-14T11:05:07.325 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2024-09-14T11:05:07.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:05:07.327 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:05:07.327 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:05:07.328 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:05:07.328 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:05:08.063 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-09-14T11:05:08.977 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:09.019 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:09.390 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:09.390 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:05:09.391 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:05:09.391 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:05:09.413 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:05:09.441 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-09-14T11:05:09.443 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-14T11:05:09.458 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.CXpXjE9xzm 2024-09-14T11:05:09.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CXpXjE9xzm 2024-09-14T11:05:09.525 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.CXpXjE9xzm 2024-09-14T11:05:09.657 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.CXpXjE9xzm is 6KB 2024-09-14T11:05:09.705 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.CXpXjE9xzm 2024-09-14T11:05:09.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:05:09.783 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:05:09.783 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:05:09.783 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:05:09.783 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:05:09.785 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:05:09.942 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:05:10.228 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-14T11:05:10.625 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:10.707 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.708 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:10.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:05:10.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:05:10.708 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:05:10.708 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T11:05:10.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:05:10.708 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:05:10.769 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:05:10.770 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:05:10.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-09-14T11:05:10.802 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-09-14T11:05:10.802 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-09-14T11:05:10.802 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2024-09-14T11:05:10.802 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 82.el9 2024-09-14T11:05:10.802 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8274670 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-09-14T11:05:10.803 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:05:10.804 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:05:10.805 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:05:10.806 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:05:10.806 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:05:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-14T11:05:12.803 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:05:12.836 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-14T11:05:12.844 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-14T11:05:12.860 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.SxCGY1xlzK 2024-09-14T11:05:12.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SxCGY1xlzK 2024-09-14T11:05:12.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.SxCGY1xlzK 2024-09-14T11:05:13.066 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.SxCGY1xlzK is 6KB 2024-09-14T11:05:13.114 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.SxCGY1xlzK 2024-09-14T11:05:13.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:05:13.191 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:05:13.192 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:05:13.192 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:05:13.192 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:05:13.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:05:13.344 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-09-14T11:05:39.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T11:05:39.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-14T11:05:39.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:05:43.349 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T11:05:43.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-14T11:05:43.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:40.029 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:06:43.356 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:06:49.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-14T11:06:49.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:49.396 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-14T11:06:49.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-14T11:06:49.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:06:49.803 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-14T11:06:49.818 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:06:49.818 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:06:49.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:06:49.818 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:06:50.819 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:06:50.819 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:06:50.906 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-09-14T11:06:50.926 DEBUG:teuthology.parallel:result is None 2024-09-14T11:06:52.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-14T11:06:52.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:52.702 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-14T11:06:53.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-14T11:06:53.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:06:53.031 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-14T11:06:53.045 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:06:53.045 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:06:53.046 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:06:53.046 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:06:54.046 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:06:54.046 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:06:54.133 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-09-14T11:06:54.157 DEBUG:teuthology.parallel:result is None 2024-09-14T11:06:54.157 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:06:54.164 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:06:54.164 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:06:54.171 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:06:54.216 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:06:54.224 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:06:54.239 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:06:54.239 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:06:54.245 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:06:54.308 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:06:54.319 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:06:54.320 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:06:54.322 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:06:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:06:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:06:54.390 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:06:54.408 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:06:54.411 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:06:54.417 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:06:54.417 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:06:54.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:06:54.480 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:06:54.490 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:06:54.490 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:06:54.493 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:06:54.531 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:06:54.637 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:06:54.715 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:06:54.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:06:54.850 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:06:54.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:06:54.922 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:06:54.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:06:55.033 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:06:55.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:06:55.141 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:06:55.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:06:55.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-14T11:06:55.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-14T11:06:55.423 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:06:55.506 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:06:56.052 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:06:56.061 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:06:56.061 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:06:56.119 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:06:56.132 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-09-14T11:06:56.175 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-09-14T11:06:56.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-09-14T11:06:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-09-14T11:06:56.254 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:06:56.254 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-09-14T11:06:56.302 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-09-14T11:06:56.302 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-09-14T11:06:56.322 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-09-14T11:06:56.322 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2024-09-14T11:06:56.322 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:06:56.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:06:56.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:06:56.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:06:56.392 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:06:56.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:06:56.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:06:56.541 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:06:56.551 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T11:06:56.555 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T11:06:56.666 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:06:56.679 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:06:56.680 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:10:39.478 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-09-14T11:10:39.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-14T11:10:39.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:10:39.560 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-14T11:10:39.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-14T11:10:39.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-14T11:10:39.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:10:39.709 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-14T11:10:39.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-14T11:10:39.788 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:10:39.799 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:10:39.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:10:39.800 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:10:39.802 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:10:39.803 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:10:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:10:39.842 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:10:39.860 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:10:39.866 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-09-14T11:10:39.873 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:10:39.877 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-09-14T11:10:39.891 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:10:39.897 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-09-14T11:10:39.905 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:10:39.908 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-09-14T11:10:39.922 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:10:39.936 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:10:39.966 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:10:39.969 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:10:39.969 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-14T11:10:39.969 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.969 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.970 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.970 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.990 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:10:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:10:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-14T11:10:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.994 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.995 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:10:39.995 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:10:40.004 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:10:40.004 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:10:40.004 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:10:40.004 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:10:40.009 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:10:40.009 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:10:40.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:10:40.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:10:40.013 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:10:40.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:10:40.170 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:10:40.170 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:10:40.174 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:10:40.174 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:10:40.279 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:10:40.279 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:10:40.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:10:40.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:10:40.287 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:10:40.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:10:40.305 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:10:40.306 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:10:40.313 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:10:40.313 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:10:40.372 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:10:40.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:10:40.450 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:10:40.454 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:10:40.514 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-09-14T11:10:40.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-09-14T11:10:40.518 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-09-14T11:10:40.520 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-09-14T11:10:40.753 INFO:teuthology.orchestra.run.smithi131.stdout:45 files removed 2024-09-14T11:10:40.756 INFO:teuthology.orchestra.run.smithi094.stdout:45 files removed 2024-09-14T11:10:40.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:10:40.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:10:41.333 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-14T11:10:41.333 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-14T11:10:41.634 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-14T11:10:41.634 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-14T11:10:41.910 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T11:10:41.920 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-14T11:10:43.402 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-14T11:10:43.501 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-14T11:10:46.494 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-14T11:10:46.629 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-14T11:10:51.553 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.5 MB 00:01 2024-09-14T11:10:52.996 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-14T11:10:53.487 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-14T11:10:54.250 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-14T11:10:54.580 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-14T11:10:55.384 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-14T11:10:59.747 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:11:00.890 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T11:11:02.116 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:11:02.117 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:11:02.208 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:11:02.225 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:11:02.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:11:02.227 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi131.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi131.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi131.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi131.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi131.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:11:02.233 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:11:02.234 INFO:teuthology.orchestra.run.smithi131.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:11:02.235 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:11:02.236 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:11:02.237 INFO:teuthology.orchestra.run.smithi131.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:11:02.238 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:11:02.239 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:11:02.240 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:11:02.241 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:11:02.242 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:11:02.243 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:11:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:11:02.245 INFO:teuthology.orchestra.run.smithi131.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:11:02.246 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:11:02.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:Install 284 Packages 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 327 M 2024-09-14T11:11:02.248 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-14T11:11:02.591 INFO:teuthology.orchestra.run.smithi131.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-14T11:11:02.774 INFO:teuthology.orchestra.run.smithi131.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-14T11:11:02.833 INFO:teuthology.orchestra.run.smithi131.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 2.4 MB/s | 145 kB 00:00 2024-09-14T11:11:02.992 INFO:teuthology.orchestra.run.smithi131.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-14T11:11:03.042 INFO:teuthology.orchestra.run.smithi131.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-14T11:11:03.125 INFO:teuthology.orchestra.run.smithi131.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-14T11:11:03.242 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:11:03.243 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:11:03.332 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:11:03.363 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:11:03.364 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:11:03.365 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:11:03.366 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:11:03.367 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:11:03.368 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:11:03.369 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:11:03.370 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:11:03.371 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:11:03.372 INFO:teuthology.orchestra.run.smithi094.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:11:03.374 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:11:03.375 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:11:03.376 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:11:03.377 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:11:03.378 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:11:03.379 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:11:03.380 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:11:03.381 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:11:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-14T11:11:03.383 INFO:teuthology.orchestra.run.smithi094.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:11:03.384 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout:Install 284 Packages 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 2 Packages 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:11:03.385 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 327 M 2024-09-14T11:11:03.386 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-14T11:11:03.443 INFO:teuthology.orchestra.run.smithi131.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-14T11:11:03.868 INFO:teuthology.orchestra.run.smithi131.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 16 MB/s | 22 MB 00:01 2024-09-14T11:11:03.918 INFO:teuthology.orchestra.run.smithi131.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 504 kB/s | 25 kB 00:00 2024-09-14T11:11:04.110 INFO:teuthology.orchestra.run.smithi131.stdout:(10/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 17 MB/s | 17 MB 00:00 2024-09-14T11:11:04.159 INFO:teuthology.orchestra.run.smithi094.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-14T11:11:04.244 INFO:teuthology.orchestra.run.smithi131.stdout:(11/286): ceph-radosgw-19.3.0-4907.ga2782315.el 14 MB/s | 11 MB 00:00 2024-09-14T11:11:04.269 INFO:teuthology.orchestra.run.smithi131.stdout:(12/286): libcephfs-devel-19.3.0-4907.ga2782315 200 kB/s | 32 kB 00:00 2024-09-14T11:11:04.303 INFO:teuthology.orchestra.run.smithi131.stdout:(13/286): libcephfs2-19.3.0-4907.ga2782315.el9. 13 MB/s | 756 kB 00:00 2024-09-14T11:11:04.327 INFO:teuthology.orchestra.run.smithi131.stdout:(14/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.7 MB/s | 161 kB 00:00 2024-09-14T11:11:04.342 INFO:teuthology.orchestra.run.smithi094.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 4.8 MB/s | 900 kB 00:00 2024-09-14T11:11:04.370 INFO:teuthology.orchestra.run.smithi131.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 1.9 MB/s | 127 kB 00:00 2024-09-14T11:11:04.412 INFO:teuthology.orchestra.run.smithi131.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 5.9 MB/s | 508 kB 00:00 2024-09-14T11:11:04.426 INFO:teuthology.orchestra.run.smithi094.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.7 MB/s | 145 kB 00:00 2024-09-14T11:11:04.520 INFO:teuthology.orchestra.run.smithi131.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 417 kB/s | 45 kB 00:00 2024-09-14T11:11:04.621 INFO:teuthology.orchestra.run.smithi131.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.4 MB/s | 143 kB 00:00 2024-09-14T11:11:04.704 INFO:teuthology.orchestra.run.smithi131.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 1.9 MB/s | 161 kB 00:00 2024-09-14T11:11:04.788 INFO:teuthology.orchestra.run.smithi131.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 3.8 MB/s | 320 kB 00:00 2024-09-14T11:11:04.818 INFO:teuthology.orchestra.run.smithi094.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 6.9 MB/s | 5.5 MB 00:00 2024-09-14T11:11:04.880 INFO:teuthology.orchestra.run.smithi131.stdout:(21/286): librgw2-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-14T11:11:04.905 INFO:teuthology.orchestra.run.smithi131.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.5 MB/s | 305 kB 00:00 2024-09-14T11:11:04.916 INFO:teuthology.orchestra.run.smithi094.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 4.9 MB/s | 2.4 MB 00:00 2024-09-14T11:11:04.931 INFO:teuthology.orchestra.run.smithi131.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T11:11:04.956 INFO:teuthology.orchestra.run.smithi131.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.6 MB/s | 85 kB 00:00 2024-09-14T11:11:04.977 INFO:teuthology.orchestra.run.smithi094.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-14T11:11:05.006 INFO:teuthology.orchestra.run.smithi131.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-14T11:11:05.090 INFO:teuthology.orchestra.run.smithi131.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 410 kB/s | 34 kB 00:00 2024-09-14T11:11:05.174 INFO:teuthology.orchestra.run.smithi131.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.8 MB/s | 154 kB 00:00 2024-09-14T11:11:05.332 INFO:teuthology.orchestra.run.smithi131.stdout:(28/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 8.0 MB/s | 3.2 MB 00:00 2024-09-14T11:11:05.777 INFO:teuthology.orchestra.run.smithi094.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 5.6 MB/s | 4.8 MB 00:00 2024-09-14T11:11:06.124 INFO:teuthology.orchestra.run.smithi131.stdout:(29/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 15 MB/s | 14 MB 00:00 2024-09-14T11:11:06.216 INFO:teuthology.orchestra.run.smithi131.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 3.1 MB/s | 291 kB 00:00 2024-09-14T11:11:06.316 INFO:teuthology.orchestra.run.smithi131.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 493 kB/s | 49 kB 00:00 2024-09-14T11:11:06.400 INFO:teuthology.orchestra.run.smithi131.stdout:(32/286): ceph-mgr-diskprediction-local-19.3.0- 6.9 MB/s | 7.4 MB 00:01 2024-09-14T11:11:06.425 INFO:teuthology.orchestra.run.smithi131.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 151 kB/s | 16 kB 00:00 2024-09-14T11:11:06.459 INFO:teuthology.orchestra.run.smithi131.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 4.8 MB/s | 285 kB 00:00 2024-09-14T11:11:06.501 INFO:teuthology.orchestra.run.smithi131.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T11:11:06.802 INFO:teuthology.orchestra.run.smithi094.stdout:(8/286): ceph-radosgw-19.3.0-4907.ga2782315.el9 11 MB/s | 11 MB 00:01 2024-09-14T11:11:06.951 INFO:teuthology.orchestra.run.smithi131.stdout:(36/286): ceph-test-19.3.0-4907.ga2782315.el9.x 17 MB/s | 50 MB 00:03 2024-09-14T11:11:07.036 INFO:teuthology.orchestra.run.smithi094.stdout:(9/286): ceph-common-19.3.0-4907.ga2782315.el9. 7.2 MB/s | 22 MB 00:03 2024-09-14T11:11:07.043 INFO:teuthology.orchestra.run.smithi131.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 156 kB/s | 85 kB 00:00 2024-09-14T11:11:07.061 INFO:teuthology.orchestra.run.smithi094.stdout:(10/286): ceph-selinux-19.3.0-4907.ga2782315.el 97 kB/s | 25 kB 00:00 2024-09-14T11:11:07.069 INFO:teuthology.orchestra.run.smithi131.stdout:(38/286): ModemManager-glib-1.20.2-1.el9.x86_64 550 kB/s | 335 kB 00:00 2024-09-14T11:11:07.085 INFO:teuthology.orchestra.run.smithi131.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 370 kB/s | 49 kB 00:00 2024-09-14T11:11:07.119 INFO:teuthology.orchestra.run.smithi131.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2024-09-14T11:11:07.144 INFO:teuthology.orchestra.run.smithi131.stdout:(41/286): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-14T11:11:07.170 INFO:teuthology.orchestra.run.smithi131.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 535 kB/s | 27 kB 00:00 2024-09-14T11:11:07.203 INFO:teuthology.orchestra.run.smithi131.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-14T11:11:07.228 INFO:teuthology.orchestra.run.smithi131.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-14T11:11:07.253 INFO:teuthology.orchestra.run.smithi094.stdout:(11/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 7.5 MB/s | 17 MB 00:02 2024-09-14T11:11:07.254 INFO:teuthology.orchestra.run.smithi131.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-14T11:11:07.278 INFO:teuthology.orchestra.run.smithi094.stdout:(12/286): libcephfs-devel-19.3.0-4907.ga2782315 146 kB/s | 32 kB 00:00 2024-09-14T11:11:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:(46/286): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-14T11:11:07.313 INFO:teuthology.orchestra.run.smithi131.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-14T11:11:07.329 INFO:teuthology.orchestra.run.smithi094.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 3.2 MB/s | 161 kB 00:00 2024-09-14T11:11:07.338 INFO:teuthology.orchestra.run.smithi131.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-14T11:11:07.362 INFO:teuthology.orchestra.run.smithi094.stdout:(14/286): libcephfs2-19.3.0-4907.ga2782315.el9. 6.8 MB/s | 756 kB 00:00 2024-09-14T11:11:07.363 INFO:teuthology.orchestra.run.smithi131.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-14T11:11:07.388 INFO:teuthology.orchestra.run.smithi094.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 2.1 MB/s | 127 kB 00:00 2024-09-14T11:11:07.389 INFO:teuthology.orchestra.run.smithi131.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 4.1 MB/s | 215 kB 00:00 2024-09-14T11:11:07.423 INFO:teuthology.orchestra.run.smithi131.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-14T11:11:07.446 INFO:teuthology.orchestra.run.smithi094.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 5.9 MB/s | 508 kB 00:00 2024-09-14T11:11:07.448 INFO:teuthology.orchestra.run.smithi131.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 7.5 MB/s | 650 kB 00:00 2024-09-14T11:11:07.481 INFO:teuthology.orchestra.run.smithi131.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 8.7 MB/s | 523 kB 00:00 2024-09-14T11:11:07.497 INFO:teuthology.orchestra.run.smithi094.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 903 kB/s | 45 kB 00:00 2024-09-14T11:11:07.507 INFO:teuthology.orchestra.run.smithi131.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-14T11:11:07.532 INFO:teuthology.orchestra.run.smithi131.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 302 kB 00:00 2024-09-14T11:11:07.547 INFO:teuthology.orchestra.run.smithi094.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.8 MB/s | 143 kB 00:00 2024-09-14T11:11:07.566 INFO:teuthology.orchestra.run.smithi131.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-14T11:11:07.599 INFO:teuthology.orchestra.run.smithi131.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 8.2 MB/s | 559 kB 00:00 2024-09-14T11:11:07.605 INFO:teuthology.orchestra.run.smithi094.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.7 MB/s | 161 kB 00:00 2024-09-14T11:11:07.625 INFO:teuthology.orchestra.run.smithi131.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2024-09-14T11:11:07.650 INFO:teuthology.orchestra.run.smithi131.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-09-14T11:11:07.664 INFO:teuthology.orchestra.run.smithi094.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 5.4 MB/s | 320 kB 00:00 2024-09-14T11:11:07.675 INFO:teuthology.orchestra.run.smithi131.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 462 kB/s | 23 kB 00:00 2024-09-14T11:11:07.701 INFO:teuthology.orchestra.run.smithi131.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:11:07.723 INFO:teuthology.orchestra.run.smithi094.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.1 MB/s | 305 kB 00:00 2024-09-14T11:11:07.726 INFO:teuthology.orchestra.run.smithi131.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 297 kB/s | 15 kB 00:00 2024-09-14T11:11:07.759 INFO:teuthology.orchestra.run.smithi131.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-14T11:11:07.785 INFO:teuthology.orchestra.run.smithi131.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 909 kB/s | 53 kB 00:00 2024-09-14T11:11:07.807 INFO:teuthology.orchestra.run.smithi094.stdout:(22/286): librgw2-19.3.0-4907.ga2782315.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-14T11:11:07.810 INFO:teuthology.orchestra.run.smithi131.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-14T11:11:07.832 INFO:teuthology.orchestra.run.smithi094.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 913 kB/s | 99 kB 00:00 2024-09-14T11:11:07.835 INFO:teuthology.orchestra.run.smithi131.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:11:07.852 INFO:teuthology.orchestra.run.smithi131.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 675 kB/s | 28 kB 00:00 2024-09-14T11:11:07.857 INFO:teuthology.orchestra.run.smithi094.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T11:11:07.878 INFO:teuthology.orchestra.run.smithi131.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 2.6 MB/s | 113 kB 00:00 2024-09-14T11:11:07.903 INFO:teuthology.orchestra.run.smithi131.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 525 kB 00:00 2024-09-14T11:11:07.907 INFO:teuthology.orchestra.run.smithi094.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-14T11:11:07.945 INFO:teuthology.orchestra.run.smithi131.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 14 MB/s | 980 kB 00:00 2024-09-14T11:11:07.958 INFO:teuthology.orchestra.run.smithi094.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 687 kB/s | 34 kB 00:00 2024-09-14T11:11:07.987 INFO:teuthology.orchestra.run.smithi131.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 9.1 MB/s | 781 kB 00:00 2024-09-14T11:11:08.008 INFO:teuthology.orchestra.run.smithi094.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 3.0 MB/s | 154 kB 00:00 2024-09-14T11:11:08.012 INFO:teuthology.orchestra.run.smithi131.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 325 kB 00:00 2024-09-14T11:11:08.038 INFO:teuthology.orchestra.run.smithi131.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 4.2 MB/s | 218 kB 00:00 2024-09-14T11:11:08.088 INFO:teuthology.orchestra.run.smithi131.stdout:(74/286): flatpak-1.12.9-1.el9.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-09-14T11:11:08.092 INFO:teuthology.orchestra.run.smithi094.stdout:(28/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 12 MB/s | 3.2 MB 00:00 2024-09-14T11:11:08.113 INFO:teuthology.orchestra.run.smithi131.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 287 kB/s | 22 kB 00:00 2024-09-14T11:11:08.151 INFO:teuthology.orchestra.run.smithi131.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-14T11:11:08.176 INFO:teuthology.orchestra.run.smithi131.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-09-14T11:11:08.306 INFO:teuthology.orchestra.run.smithi131.stdout:(78/286): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-09-14T11:11:08.332 INFO:teuthology.orchestra.run.smithi131.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 115 kB/s | 18 kB 00:00 2024-09-14T11:11:08.357 INFO:teuthology.orchestra.run.smithi131.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T11:11:08.382 INFO:teuthology.orchestra.run.smithi131.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-14T11:11:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-14T11:11:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:(83/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.6 MB/s | 3.0 MB 00:00 2024-09-14T11:11:08.483 INFO:teuthology.orchestra.run.smithi131.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 856 kB/s | 64 kB 00:00 2024-09-14T11:11:08.545 INFO:teuthology.orchestra.run.smithi131.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 394 kB/s | 34 kB 00:00 2024-09-14T11:11:08.601 INFO:teuthology.orchestra.run.smithi094.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-14T11:11:08.659 INFO:teuthology.orchestra.run.smithi131.stdout:(86/286): google-guice-4.2.3-9.el9.noarch.rpm 1.7 MB/s | 473 kB 00:00 2024-09-14T11:11:08.659 INFO:teuthology.orchestra.run.smithi094.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 4.9 MB/s | 291 kB 00:00 2024-09-14T11:11:08.710 INFO:teuthology.orchestra.run.smithi094.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 987 kB/s | 49 kB 00:00 2024-09-14T11:11:08.759 INFO:teuthology.orchestra.run.smithi131.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-14T11:11:08.760 INFO:teuthology.orchestra.run.smithi094.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 330 kB/s | 16 kB 00:00 2024-09-14T11:11:08.784 INFO:teuthology.orchestra.run.smithi131.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 264 kB/s | 33 kB 00:00 2024-09-14T11:11:08.843 INFO:teuthology.orchestra.run.smithi131.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 7.5 MB/s | 2.2 MB 00:00 2024-09-14T11:11:08.894 INFO:teuthology.orchestra.run.smithi094.stdout:(33/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 16 MB/s | 14 MB 00:00 2024-09-14T11:11:08.919 INFO:teuthology.orchestra.run.smithi094.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 1.8 MB/s | 285 kB 00:00 2024-09-14T11:11:08.926 INFO:teuthology.orchestra.run.smithi131.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 29 MB/s | 4.9 MB 00:00 2024-09-14T11:11:08.952 INFO:teuthology.orchestra.run.smithi131.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.0 MB/s | 219 kB 00:00 2024-09-14T11:11:08.969 INFO:teuthology.orchestra.run.smithi094.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T11:11:08.994 INFO:teuthology.orchestra.run.smithi131.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 9.6 MB/s | 657 kB 00:00 2024-09-14T11:11:09.044 INFO:teuthology.orchestra.run.smithi131.stdout:(93/286): guava-30.1-6.el9.noarch.rpm 8.9 MB/s | 2.3 MB 00:00 2024-09-14T11:11:09.061 INFO:teuthology.orchestra.run.smithi094.stdout:(36/286): ModemManager-glib-1.20.2-1.el9.x86_64 2.3 MB/s | 335 kB 00:00 2024-09-14T11:11:09.077 INFO:teuthology.orchestra.run.smithi131.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.9 MB/s | 632 kB 00:00 2024-09-14T11:11:09.087 INFO:teuthology.orchestra.run.smithi094.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 724 kB/s | 85 kB 00:00 2024-09-14T11:11:09.103 INFO:teuthology.orchestra.run.smithi131.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 774 kB/s | 45 kB 00:00 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi094.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 979 kB/s | 49 kB 00:00 2024-09-14T11:11:09.128 INFO:teuthology.orchestra.run.smithi131.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T11:11:09.153 INFO:teuthology.orchestra.run.smithi131.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.1 MB/s | 413 kB 00:00 2024-09-14T11:11:09.154 INFO:teuthology.orchestra.run.smithi094.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 1.9 MB/s | 80 kB 00:00 2024-09-14T11:11:09.179 INFO:teuthology.orchestra.run.smithi094.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.8 MB/s | 262 kB 00:00 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi131.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi094.stdout:(41/286): libgfortran-11.5.0-2.el9.x86_64.rpm 10 MB/s | 801 kB 00:00 2024-09-14T11:11:09.255 INFO:teuthology.orchestra.run.smithi094.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 357 kB/s | 27 kB 00:00 2024-09-14T11:11:09.280 INFO:teuthology.orchestra.run.smithi094.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:11:09.296 INFO:teuthology.orchestra.run.smithi131.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 20 MB/s | 3.3 MB 00:00 2024-09-14T11:11:09.305 INFO:teuthology.orchestra.run.smithi094.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-14T11:11:09.321 INFO:teuthology.orchestra.run.smithi131.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 141 kB/s | 13 kB 00:00 2024-09-14T11:11:09.331 INFO:teuthology.orchestra.run.smithi094.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-14T11:11:09.348 INFO:teuthology.orchestra.run.smithi131.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T11:11:09.372 INFO:teuthology.orchestra.run.smithi131.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 479 kB/s | 24 kB 00:00 2024-09-14T11:11:09.373 INFO:teuthology.orchestra.run.smithi094.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-14T11:11:09.397 INFO:teuthology.orchestra.run.smithi131.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-09-14T11:11:09.407 INFO:teuthology.orchestra.run.smithi094.stdout:(47/286): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-14T11:11:09.431 INFO:teuthology.orchestra.run.smithi131.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 602 kB/s | 35 kB 00:00 2024-09-14T11:11:09.432 INFO:teuthology.orchestra.run.smithi094.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-14T11:11:09.456 INFO:teuthology.orchestra.run.smithi131.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-14T11:11:09.457 INFO:teuthology.orchestra.run.smithi094.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-14T11:11:09.481 INFO:teuthology.orchestra.run.smithi131.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-14T11:11:09.482 INFO:teuthology.orchestra.run.smithi094.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-14T11:11:09.507 INFO:teuthology.orchestra.run.smithi131.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-14T11:11:09.532 INFO:teuthology.orchestra.run.smithi131.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 613 kB/s | 31 kB 00:00 2024-09-14T11:11:09.557 INFO:teuthology.orchestra.run.smithi131.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-14T11:11:09.583 INFO:teuthology.orchestra.run.smithi131.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-14T11:11:09.608 INFO:teuthology.orchestra.run.smithi131.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi131.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi094.stdout:(51/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.5 MB/s | 650 kB 00:00 2024-09-14T11:11:09.659 INFO:teuthology.orchestra.run.smithi131.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 565 kB/s | 28 kB 00:00 2024-09-14T11:11:09.684 INFO:teuthology.orchestra.run.smithi131.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 429 kB/s | 21 kB 00:00 2024-09-14T11:11:09.709 INFO:teuthology.orchestra.run.smithi131.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-14T11:11:09.762 INFO:teuthology.orchestra.run.smithi131.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 242 kB/s | 19 kB 00:00 2024-09-14T11:11:09.785 INFO:teuthology.orchestra.run.smithi131.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 404 kB/s | 30 kB 00:00 2024-09-14T11:11:09.800 INFO:teuthology.orchestra.run.smithi094.stdout:(52/286): adwaita-icon-theme-40.1.1-3.el9.noarc 38 MB/s | 12 MB 00:00 2024-09-14T11:11:09.810 INFO:teuthology.orchestra.run.smithi131.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.8 MB/s | 86 kB 00:00 2024-09-14T11:11:09.825 INFO:teuthology.orchestra.run.smithi094.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.8 MB/s | 523 kB 00:00 2024-09-14T11:11:09.836 INFO:teuthology.orchestra.run.smithi131.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 631 kB/s | 32 kB 00:00 2024-09-14T11:11:09.861 INFO:teuthology.orchestra.run.smithi131.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-14T11:11:09.876 INFO:teuthology.orchestra.run.smithi094.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 943 kB/s | 71 kB 00:00 2024-09-14T11:11:09.886 INFO:teuthology.orchestra.run.smithi131.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-14T11:11:09.901 INFO:teuthology.orchestra.run.smithi094.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 3.9 MB/s | 302 kB 00:00 2024-09-14T11:11:09.911 INFO:teuthology.orchestra.run.smithi131.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-14T11:11:09.937 INFO:teuthology.orchestra.run.smithi131.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 617 kB/s | 31 kB 00:00 2024-09-14T11:11:09.951 INFO:teuthology.orchestra.run.smithi094.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 3.7 MB/s | 283 kB 00:00 2024-09-14T11:11:09.962 INFO:teuthology.orchestra.run.smithi131.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T11:11:09.985 INFO:teuthology.orchestra.run.smithi094.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 6.5 MB/s | 559 kB 00:00 2024-09-14T11:11:09.996 INFO:teuthology.orchestra.run.smithi131.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-14T11:11:10.019 INFO:teuthology.orchestra.run.smithi094.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-14T11:11:10.021 INFO:teuthology.orchestra.run.smithi131.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 625 kB/s | 37 kB 00:00 2024-09-14T11:11:10.046 INFO:teuthology.orchestra.run.smithi131.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T11:11:10.060 INFO:teuthology.orchestra.run.smithi094.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-09-14T11:11:10.072 INFO:teuthology.orchestra.run.smithi131.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T11:11:10.086 INFO:teuthology.orchestra.run.smithi094.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 347 kB/s | 23 kB 00:00 2024-09-14T11:11:10.105 INFO:teuthology.orchestra.run.smithi131.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-14T11:11:10.128 INFO:teuthology.orchestra.run.smithi094.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-14T11:11:10.131 INFO:teuthology.orchestra.run.smithi131.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-14T11:11:10.153 INFO:teuthology.orchestra.run.smithi094.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 222 kB/s | 15 kB 00:00 2024-09-14T11:11:10.156 INFO:teuthology.orchestra.run.smithi131.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 818 kB/s | 41 kB 00:00 2024-09-14T11:11:10.181 INFO:teuthology.orchestra.run.smithi131.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T11:11:10.195 INFO:teuthology.orchestra.run.smithi094.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-14T11:11:10.207 INFO:teuthology.orchestra.run.smithi131.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-14T11:11:10.220 INFO:teuthology.orchestra.run.smithi094.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 796 kB/s | 53 kB 00:00 2024-09-14T11:11:10.232 INFO:teuthology.orchestra.run.smithi131.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 666 kB/s | 34 kB 00:00 2024-09-14T11:11:10.257 INFO:teuthology.orchestra.run.smithi131.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-14T11:11:10.283 INFO:teuthology.orchestra.run.smithi131.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-14T11:11:10.287 INFO:teuthology.orchestra.run.smithi094.stdout:(65/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 917 kB/s | 61 kB 00:00 2024-09-14T11:11:10.308 INFO:teuthology.orchestra.run.smithi131.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-14T11:11:10.313 INFO:teuthology.orchestra.run.smithi094.stdout:(66/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T11:11:10.342 INFO:teuthology.orchestra.run.smithi131.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-14T11:11:10.355 INFO:teuthology.orchestra.run.smithi094.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 420 kB/s | 28 kB 00:00 2024-09-14T11:11:10.367 INFO:teuthology.orchestra.run.smithi131.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-14T11:11:10.380 INFO:teuthology.orchestra.run.smithi094.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-14T11:11:10.392 INFO:teuthology.orchestra.run.smithi131.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:11:10.418 INFO:teuthology.orchestra.run.smithi131.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-14T11:11:10.430 INFO:teuthology.orchestra.run.smithi094.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-14T11:11:10.443 INFO:teuthology.orchestra.run.smithi131.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-14T11:11:10.469 INFO:teuthology.orchestra.run.smithi131.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 707 kB/s | 36 kB 00:00 2024-09-14T11:11:10.472 INFO:teuthology.orchestra.run.smithi094.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 980 kB 00:00 2024-09-14T11:11:10.506 INFO:teuthology.orchestra.run.smithi131.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 5.1 MB/s | 324 kB 00:00 2024-09-14T11:11:10.514 INFO:teuthology.orchestra.run.smithi094.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 9.1 MB/s | 781 kB 00:00 2024-09-14T11:11:10.531 INFO:teuthology.orchestra.run.smithi131.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.3 MB/s | 144 kB 00:00 2024-09-14T11:11:10.556 INFO:teuthology.orchestra.run.smithi131.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-14T11:11:10.565 INFO:teuthology.orchestra.run.smithi094.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 325 kB 00:00 2024-09-14T11:11:10.581 INFO:teuthology.orchestra.run.smithi131.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 663 kB/s | 33 kB 00:00 2024-09-14T11:11:10.590 INFO:teuthology.orchestra.run.smithi094.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.8 MB/s | 218 kB 00:00 2024-09-14T11:11:10.606 INFO:teuthology.orchestra.run.smithi131.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 386 kB/s | 19 kB 00:00 2024-09-14T11:11:10.632 INFO:teuthology.orchestra.run.smithi131.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-14T11:11:10.657 INFO:teuthology.orchestra.run.smithi131.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 826 kB/s | 42 kB 00:00 2024-09-14T11:11:10.691 INFO:teuthology.orchestra.run.smithi131.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-14T11:11:10.716 INFO:teuthology.orchestra.run.smithi131.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-14T11:11:10.742 INFO:teuthology.orchestra.run.smithi131.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-14T11:11:10.767 INFO:teuthology.orchestra.run.smithi131.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 713 kB/s | 36 kB 00:00 2024-09-14T11:11:10.817 INFO:teuthology.orchestra.run.smithi131.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-14T11:11:10.843 INFO:teuthology.orchestra.run.smithi131.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-14T11:11:10.868 INFO:teuthology.orchestra.run.smithi131.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-14T11:11:10.893 INFO:teuthology.orchestra.run.smithi131.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-14T11:11:10.935 INFO:teuthology.orchestra.run.smithi131.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-14T11:11:10.961 INFO:teuthology.orchestra.run.smithi131.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 134 kB/s | 9.0 kB 00:00 2024-09-14T11:11:10.997 INFO:teuthology.orchestra.run.smithi131.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 8.6 MB/s | 517 kB 00:00 2024-09-14T11:11:11.020 INFO:teuthology.orchestra.run.smithi131.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-14T11:11:11.032 INFO:teuthology.orchestra.run.smithi094.stdout:(74/286): ceph-test-19.3.0-4907.ga2782315.el9.x 13 MB/s | 50 MB 00:03 2024-09-14T11:11:11.045 INFO:teuthology.orchestra.run.smithi131.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T11:11:11.057 INFO:teuthology.orchestra.run.smithi094.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 46 kB/s | 22 kB 00:00 2024-09-14T11:11:11.087 INFO:teuthology.orchestra.run.smithi131.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 271 kB/s | 11 kB 00:00 2024-09-14T11:11:11.099 INFO:teuthology.orchestra.run.smithi094.stdout:(76/286): flatpak-1.12.9-1.el9.x86_64.rpm 3.2 MB/s | 1.7 MB 00:00 2024-09-14T11:11:11.129 INFO:teuthology.orchestra.run.smithi131.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 139 kB 00:00 2024-09-14T11:11:11.133 INFO:teuthology.orchestra.run.smithi094.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-14T11:11:11.167 INFO:teuthology.orchestra.run.smithi094.stdout:(78/286): flatpak-session-helper-1.12.9-1.el9.x 544 kB/s | 73 kB 00:00 2024-09-14T11:11:11.192 INFO:teuthology.orchestra.run.smithi094.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 309 kB/s | 18 kB 00:00 2024-09-14T11:11:11.229 INFO:teuthology.orchestra.run.smithi131.stdout:(166/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 42 MB/s | 8.8 MB 00:00 2024-09-14T11:11:11.254 INFO:teuthology.orchestra.run.smithi131.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-14T11:11:11.268 INFO:teuthology.orchestra.run.smithi094.stdout:(80/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-14T11:11:11.280 INFO:teuthology.orchestra.run.smithi131.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 724 kB/s | 36 kB 00:00 2024-09-14T11:11:11.293 INFO:teuthology.orchestra.run.smithi094.stdout:(81/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 708 kB/s | 89 kB 00:00 2024-09-14T11:11:11.305 INFO:teuthology.orchestra.run.smithi131.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 914 kB/s | 46 kB 00:00 2024-09-14T11:11:11.318 INFO:teuthology.orchestra.run.smithi094.stdout:(82/286): geoclue2-2.6.0-7.el9.x86_64.rpm 990 kB/s | 124 kB 00:00 2024-09-14T11:11:11.330 INFO:teuthology.orchestra.run.smithi131.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 641 kB/s | 32 kB 00:00 2024-09-14T11:11:11.344 INFO:teuthology.orchestra.run.smithi094.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-09-14T11:11:11.356 INFO:teuthology.orchestra.run.smithi131.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-14T11:11:11.386 INFO:teuthology.orchestra.run.smithi094.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 965 kB/s | 64 kB 00:00 2024-09-14T11:11:11.401 INFO:teuthology.orchestra.run.smithi131.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-14T11:11:11.411 INFO:teuthology.orchestra.run.smithi094.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 509 kB/s | 34 kB 00:00 2024-09-14T11:11:11.436 INFO:teuthology.orchestra.run.smithi094.stdout:(86/286): google-guice-4.2.3-9.el9.noarch.rpm 3.2 MB/s | 473 kB 00:00 2024-09-14T11:11:11.473 INFO:teuthology.orchestra.run.smithi131.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 35 MB/s | 4.9 MB 00:00 2024-09-14T11:11:11.478 INFO:teuthology.orchestra.run.smithi094.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-14T11:11:11.498 INFO:teuthology.orchestra.run.smithi131.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-09-14T11:11:11.524 INFO:teuthology.orchestra.run.smithi131.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-14T11:11:11.528 INFO:teuthology.orchestra.run.smithi094.stdout:(88/286): gstreamer1-plugins-base-1.22.1-2.el9. 19 MB/s | 2.2 MB 00:00 2024-09-14T11:11:11.554 INFO:teuthology.orchestra.run.smithi094.stdout:(89/286): gtk-update-icon-cache-3.24.31-5.el9.x 282 kB/s | 33 kB 00:00 2024-09-14T11:11:11.558 INFO:teuthology.orchestra.run.smithi131.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 8.8 MB/s | 531 kB 00:00 2024-09-14T11:11:11.583 INFO:teuthology.orchestra.run.smithi131.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-14T11:11:11.608 INFO:teuthology.orchestra.run.smithi131.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 9.1 MB/s | 468 kB 00:00 2024-09-14T11:11:11.634 INFO:teuthology.orchestra.run.smithi131.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-14T11:11:11.637 INFO:teuthology.orchestra.run.smithi094.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 31 MB/s | 4.9 MB 00:00 2024-09-14T11:11:11.659 INFO:teuthology.orchestra.run.smithi131.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-14T11:11:11.663 INFO:teuthology.orchestra.run.smithi094.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.0 MB/s | 219 kB 00:00 2024-09-14T11:11:11.676 INFO:teuthology.orchestra.run.smithi131.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.3 MB/s | 57 kB 00:00 2024-09-14T11:11:11.693 INFO:teuthology.orchestra.run.smithi131.stdout:(182/286): pipewire-jack-audio-connection-kit-1 272 kB/s | 9.1 kB 00:00 2024-09-14T11:11:11.713 INFO:teuthology.orchestra.run.smithi094.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 13 MB/s | 2.3 MB 00:00 2024-09-14T11:11:11.726 INFO:teuthology.orchestra.run.smithi131.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T11:11:11.777 INFO:teuthology.orchestra.run.smithi131.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 23 MB/s | 1.9 MB 00:00 2024-09-14T11:11:11.802 INFO:teuthology.orchestra.run.smithi131.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-09-14T11:11:11.827 INFO:teuthology.orchestra.run.smithi131.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 515 kB/s | 26 kB 00:00 2024-09-14T11:11:11.853 INFO:teuthology.orchestra.run.smithi131.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T11:11:11.861 INFO:teuthology.orchestra.run.smithi094.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 3.1 MB/s | 632 kB 00:00 2024-09-14T11:11:11.878 INFO:teuthology.orchestra.run.smithi131.stdout:(188/286): plexus-containers-component-annotati 367 kB/s | 18 kB 00:00 2024-09-14T11:11:11.903 INFO:teuthology.orchestra.run.smithi131.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-14T11:11:11.929 INFO:teuthology.orchestra.run.smithi131.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 668 kB/s | 34 kB 00:00 2024-09-14T11:11:11.954 INFO:teuthology.orchestra.run.smithi131.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 5.0 MB/s | 254 kB 00:00 2024-09-14T11:11:11.963 INFO:teuthology.orchestra.run.smithi094.stdout:(94/286): httpcomponents-client-4.5.13-3.el9.no 2.0 MB/s | 657 kB 00:00 2024-09-14T11:11:11.989 INFO:teuthology.orchestra.run.smithi094.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 353 kB/s | 45 kB 00:00 2024-09-14T11:11:11.996 INFO:teuthology.orchestra.run.smithi131.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-09-14T11:11:12.016 INFO:teuthology.orchestra.run.smithi094.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T11:11:12.046 INFO:teuthology.orchestra.run.smithi131.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-14T11:11:12.071 INFO:teuthology.orchestra.run.smithi131.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T11:11:12.081 INFO:teuthology.orchestra.run.smithi094.stdout:(97/286): iso-codes-4.6.0-3.el9.noarch.rpm 9.6 MB/s | 3.5 MB 00:00 2024-09-14T11:11:12.113 INFO:teuthology.orchestra.run.smithi131.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-14T11:11:12.115 INFO:teuthology.orchestra.run.smithi094.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.2 MB/s | 413 kB 00:00 2024-09-14T11:11:12.139 INFO:teuthology.orchestra.run.smithi131.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-14T11:11:12.173 INFO:teuthology.orchestra.run.smithi131.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-14T11:11:12.182 INFO:teuthology.orchestra.run.smithi094.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 20 MB/s | 3.3 MB 00:00 2024-09-14T11:11:12.207 INFO:teuthology.orchestra.run.smithi094.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 142 kB/s | 13 kB 00:00 2024-09-14T11:11:12.214 INFO:teuthology.orchestra.run.smithi131.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 5.7 MB/s | 245 kB 00:00 2024-09-14T11:11:12.249 INFO:teuthology.orchestra.run.smithi094.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 792 kB/s | 53 kB 00:00 2024-09-14T11:11:12.283 INFO:teuthology.orchestra.run.smithi094.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 319 kB/s | 24 kB 00:00 2024-09-14T11:11:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-14T11:11:12.350 INFO:teuthology.orchestra.run.smithi094.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 529 kB/s | 35 kB 00:00 2024-09-14T11:11:12.384 INFO:teuthology.orchestra.run.smithi094.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.4 MB/s | 168 kB 00:00 2024-09-14T11:11:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 166 kB/s | 11 kB 00:00 2024-09-14T11:11:12.451 INFO:teuthology.orchestra.run.smithi094.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 361 kB/s | 24 kB 00:00 2024-09-14T11:11:12.485 INFO:teuthology.orchestra.run.smithi094.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 460 kB/s | 31 kB 00:00 2024-09-14T11:11:12.518 INFO:teuthology.orchestra.run.smithi094.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 342 kB/s | 23 kB 00:00 2024-09-14T11:11:12.552 INFO:teuthology.orchestra.run.smithi094.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 296 kB/s | 20 kB 00:00 2024-09-14T11:11:12.577 INFO:teuthology.orchestra.run.smithi094.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 674 kB/s | 40 kB 00:00 2024-09-14T11:11:12.581 INFO:teuthology.orchestra.run.smithi131.stdout:(199/286): java-11-openjdk-headless-11.0.20.1.1 11 MB/s | 39 MB 00:03 2024-09-14T11:11:12.607 INFO:teuthology.orchestra.run.smithi131.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 634 kB/s | 248 kB 00:00 2024-09-14T11:11:12.611 INFO:teuthology.orchestra.run.smithi094.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 256 kB/s | 15 kB 00:00 2024-09-14T11:11:12.632 INFO:teuthology.orchestra.run.smithi131.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 512 kB/s | 26 kB 00:00 2024-09-14T11:11:12.644 INFO:teuthology.orchestra.run.smithi094.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 425 kB/s | 28 kB 00:00 2024-09-14T11:11:12.666 INFO:teuthology.orchestra.run.smithi131.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 326 kB/s | 19 kB 00:00 2024-09-14T11:11:12.670 INFO:teuthology.orchestra.run.smithi094.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 367 kB/s | 21 kB 00:00 2024-09-14T11:11:12.700 INFO:teuthology.orchestra.run.smithi131.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-14T11:11:12.703 INFO:teuthology.orchestra.run.smithi094.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 325 kB/s | 19 kB 00:00 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi131.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-14T11:11:12.729 INFO:teuthology.orchestra.run.smithi094.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 320 kB/s | 19 kB 00:00 2024-09-14T11:11:12.771 INFO:teuthology.orchestra.run.smithi094.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 455 kB/s | 30 kB 00:00 2024-09-14T11:11:12.809 INFO:teuthology.orchestra.run.smithi131.stdout:(205/286): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2024-09-14T11:11:12.813 INFO:teuthology.orchestra.run.smithi094.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-09-14T11:11:12.834 INFO:teuthology.orchestra.run.smithi131.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.3 MB/s | 250 kB 00:00 2024-09-14T11:11:12.838 INFO:teuthology.orchestra.run.smithi094.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 476 kB/s | 32 kB 00:00 2024-09-14T11:11:12.859 INFO:teuthology.orchestra.run.smithi131.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.3 MB/s | 222 kB 00:00 2024-09-14T11:11:12.884 INFO:teuthology.orchestra.run.smithi131.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T11:11:12.910 INFO:teuthology.orchestra.run.smithi131.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 839 kB/s | 42 kB 00:00 2024-09-14T11:11:12.935 INFO:teuthology.orchestra.run.smithi131.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-14T11:11:12.960 INFO:teuthology.orchestra.run.smithi131.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T11:11:12.986 INFO:teuthology.orchestra.run.smithi131.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T11:11:13.003 INFO:teuthology.orchestra.run.smithi131.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-14T11:11:13.019 INFO:teuthology.orchestra.run.smithi131.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.6 MB/s | 54 kB 00:00 2024-09-14T11:11:13.103 INFO:teuthology.orchestra.run.smithi131.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 13 MB/s | 5.1 MB 00:00 2024-09-14T11:11:13.120 INFO:teuthology.orchestra.run.smithi131.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-14T11:11:13.145 INFO:teuthology.orchestra.run.smithi131.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-14T11:11:13.163 INFO:teuthology.orchestra.run.smithi131.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 855 kB/s | 36 kB 00:00 2024-09-14T11:11:13.188 INFO:teuthology.orchestra.run.smithi131.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-14T11:11:13.205 INFO:teuthology.orchestra.run.smithi094.stdout:(120/286): java-11-openjdk-headless-11.0.20.1.1 35 MB/s | 39 MB 00:01 2024-09-14T11:11:13.213 INFO:teuthology.orchestra.run.smithi131.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T11:11:13.230 INFO:teuthology.orchestra.run.smithi094.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 385 kB/s | 161 kB 00:00 2024-09-14T11:11:13.238 INFO:teuthology.orchestra.run.smithi131.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 9.9 MB/s | 510 kB 00:00 2024-09-14T11:11:13.263 INFO:teuthology.orchestra.run.smithi131.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-14T11:11:13.264 INFO:teuthology.orchestra.run.smithi094.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 567 kB/s | 241 kB 00:00 2024-09-14T11:11:13.297 INFO:teuthology.orchestra.run.smithi131.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-14T11:11:13.298 INFO:teuthology.orchestra.run.smithi094.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 4.6 MB/s | 435 kB 00:00 2024-09-14T11:11:13.322 INFO:teuthology.orchestra.run.smithi131.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-14T11:11:13.323 INFO:teuthology.orchestra.run.smithi094.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 335 kB/s | 31 kB 00:00 2024-09-14T11:11:13.348 INFO:teuthology.orchestra.run.smithi131.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-14T11:11:13.348 INFO:teuthology.orchestra.run.smithi094.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 986 kB/s | 83 kB 00:00 2024-09-14T11:11:13.374 INFO:teuthology.orchestra.run.smithi094.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 135 kB 00:00 2024-09-14T11:11:13.381 INFO:teuthology.orchestra.run.smithi131.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.2 MB/s | 555 kB 00:00 2024-09-14T11:11:13.399 INFO:teuthology.orchestra.run.smithi094.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 485 kB/s | 37 kB 00:00 2024-09-14T11:11:13.415 INFO:teuthology.orchestra.run.smithi131.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-14T11:11:13.433 INFO:teuthology.orchestra.run.smithi094.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 142 kB 00:00 2024-09-14T11:11:13.440 INFO:teuthology.orchestra.run.smithi131.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 910 kB/s | 53 kB 00:00 2024-09-14T11:11:13.458 INFO:teuthology.orchestra.run.smithi094.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-09-14T11:11:13.466 INFO:teuthology.orchestra.run.smithi131.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T11:11:13.483 INFO:teuthology.orchestra.run.smithi094.stdout:(130/286): libgxps-0.3.2-3.el9.x86_64.rpm 941 kB/s | 79 kB 00:00 2024-09-14T11:11:13.508 INFO:teuthology.orchestra.run.smithi131.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.5 MB/s | 173 kB 00:00 2024-09-14T11:11:13.509 INFO:teuthology.orchestra.run.smithi094.stdout:(131/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 808 kB/s | 61 kB 00:00 2024-09-14T11:11:13.533 INFO:teuthology.orchestra.run.smithi131.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 4.4 MB/s | 306 kB 00:00 2024-09-14T11:11:13.534 INFO:teuthology.orchestra.run.smithi094.stdout:(132/286): libldac-2.0.2.3-10.el9.x86_64.rpm 544 kB/s | 41 kB 00:00 2024-09-14T11:11:13.559 INFO:teuthology.orchestra.run.smithi094.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-14T11:11:13.567 INFO:teuthology.orchestra.run.smithi131.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-14T11:11:13.585 INFO:teuthology.orchestra.run.smithi094.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 578 kB/s | 44 kB 00:00 2024-09-14T11:11:13.592 INFO:teuthology.orchestra.run.smithi131.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-14T11:11:13.610 INFO:teuthology.orchestra.run.smithi094.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 444 kB/s | 34 kB 00:00 2024-09-14T11:11:13.618 INFO:teuthology.orchestra.run.smithi131.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 845 kB/s | 42 kB 00:00 2024-09-14T11:11:13.635 INFO:teuthology.orchestra.run.smithi094.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-14T11:11:13.643 INFO:teuthology.orchestra.run.smithi131.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-14T11:11:13.660 INFO:teuthology.orchestra.run.smithi094.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-14T11:11:13.677 INFO:teuthology.orchestra.run.smithi131.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-14T11:11:13.694 INFO:teuthology.orchestra.run.smithi094.stdout:(138/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-14T11:11:13.718 INFO:teuthology.orchestra.run.smithi131.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 11 MB/s | 859 kB 00:00 2024-09-14T11:11:13.720 INFO:teuthology.orchestra.run.smithi094.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-14T11:11:13.740 INFO:teuthology.orchestra.run.smithi094.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 566 kB/s | 45 kB 00:00 2024-09-14T11:11:13.744 INFO:teuthology.orchestra.run.smithi131.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-14T11:11:13.765 INFO:teuthology.orchestra.run.smithi094.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 2.8 MB/s | 206 kB 00:00 2024-09-14T11:11:13.786 INFO:teuthology.orchestra.run.smithi131.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.4 MB/s | 505 kB 00:00 2024-09-14T11:11:13.791 INFO:teuthology.orchestra.run.smithi094.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.3 MB/s | 164 kB 00:00 2024-09-14T11:11:13.816 INFO:teuthology.orchestra.run.smithi094.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-14T11:11:13.836 INFO:teuthology.orchestra.run.smithi131.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-14T11:11:13.850 INFO:teuthology.orchestra.run.smithi094.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 424 kB/s | 36 kB 00:00 2024-09-14T11:11:13.875 INFO:teuthology.orchestra.run.smithi094.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 3.8 MB/s | 324 kB 00:00 2024-09-14T11:11:13.900 INFO:teuthology.orchestra.run.smithi094.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-14T11:11:13.926 INFO:teuthology.orchestra.run.smithi094.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-14T11:11:13.951 INFO:teuthology.orchestra.run.smithi094.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 442 kB/s | 33 kB 00:00 2024-09-14T11:11:13.976 INFO:teuthology.orchestra.run.smithi094.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-14T11:11:14.001 INFO:teuthology.orchestra.run.smithi094.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 171 kB/s | 13 kB 00:00 2024-09-14T11:11:14.003 INFO:teuthology.orchestra.run.smithi131.stdout:(241/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-14T11:11:14.035 INFO:teuthology.orchestra.run.smithi094.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 496 kB/s | 42 kB 00:00 2024-09-14T11:11:14.045 INFO:teuthology.orchestra.run.smithi131.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-14T11:11:14.061 INFO:teuthology.orchestra.run.smithi094.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-14T11:11:14.079 INFO:teuthology.orchestra.run.smithi131.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 622 kB/s | 19 kB 00:00 2024-09-14T11:11:14.086 INFO:teuthology.orchestra.run.smithi094.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.5 MB/s | 133 kB 00:00 2024-09-14T11:11:14.111 INFO:teuthology.orchestra.run.smithi094.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-14T11:11:14.112 INFO:teuthology.orchestra.run.smithi131.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-14T11:11:14.128 INFO:teuthology.orchestra.run.smithi094.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 534 kB/s | 36 kB 00:00 2024-09-14T11:11:14.153 INFO:teuthology.orchestra.run.smithi094.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-14T11:11:14.163 INFO:teuthology.orchestra.run.smithi131.stdout:(245/286): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-14T11:11:14.180 INFO:teuthology.orchestra.run.smithi131.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-09-14T11:11:14.195 INFO:teuthology.orchestra.run.smithi094.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-14T11:11:14.213 INFO:teuthology.orchestra.run.smithi131.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T11:11:14.221 INFO:teuthology.orchestra.run.smithi094.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.6 MB/s | 151 kB 00:00 2024-09-14T11:11:14.230 INFO:teuthology.orchestra.run.smithi131.stdout:(248/286): liboath-2.6.7-2.el9.x86_64.rpm 723 kB/s | 49 kB 00:00 2024-09-14T11:11:14.238 INFO:teuthology.orchestra.run.smithi094.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 210 kB/s | 18 kB 00:00 2024-09-14T11:11:14.256 INFO:teuthology.orchestra.run.smithi131.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-14T11:11:14.296 INFO:teuthology.orchestra.run.smithi094.stdout:(160/286): maven-lib-3.6.3-15.el9.noarch.rpm 15 MB/s | 1.5 MB 00:00 2024-09-14T11:11:14.297 INFO:teuthology.orchestra.run.smithi131.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-14T11:11:14.314 INFO:teuthology.orchestra.run.smithi131.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-14T11:11:14.321 INFO:teuthology.orchestra.run.smithi094.stdout:(161/286): maven-openjdk11-3.6.3-15.el9.noarch. 90 kB/s | 9.0 kB 00:00 2024-09-14T11:11:14.331 INFO:teuthology.orchestra.run.smithi131.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-14T11:11:14.355 INFO:teuthology.orchestra.run.smithi094.stdout:(162/286): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-14T11:11:14.365 INFO:teuthology.orchestra.run.smithi131.stdout:(253/286): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-14T11:11:14.380 INFO:teuthology.orchestra.run.smithi094.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 151 kB 00:00 2024-09-14T11:11:14.391 INFO:teuthology.orchestra.run.smithi131.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-14T11:11:14.414 INFO:teuthology.orchestra.run.smithi094.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-14T11:11:14.416 INFO:teuthology.orchestra.run.smithi131.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-14T11:11:14.439 INFO:teuthology.orchestra.run.smithi094.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 192 kB/s | 11 kB 00:00 2024-09-14T11:11:14.450 INFO:teuthology.orchestra.run.smithi131.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T11:11:14.476 INFO:teuthology.orchestra.run.smithi131.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T11:11:14.481 INFO:teuthology.orchestra.run.smithi094.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-14T11:11:14.507 INFO:teuthology.orchestra.run.smithi094.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-14T11:11:14.508 INFO:teuthology.orchestra.run.smithi131.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T11:11:14.534 INFO:teuthology.orchestra.run.smithi131.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-14T11:11:14.559 INFO:teuthology.orchestra.run.smithi131.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-14T11:11:14.584 INFO:teuthology.orchestra.run.smithi131.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-14T11:11:14.610 INFO:teuthology.orchestra.run.smithi131.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-14T11:11:14.615 INFO:teuthology.orchestra.run.smithi094.stdout:(168/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 34 MB/s | 8.8 MB 00:00 2024-09-14T11:11:14.635 INFO:teuthology.orchestra.run.smithi131.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-14T11:11:14.641 INFO:teuthology.orchestra.run.smithi094.stdout:(169/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 228 kB/s | 36 kB 00:00 2024-09-14T11:11:14.666 INFO:teuthology.orchestra.run.smithi094.stdout:(170/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 289 kB/s | 46 kB 00:00 2024-09-14T11:11:14.691 INFO:teuthology.orchestra.run.smithi094.stdout:(171/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 429 kB/s | 32 kB 00:00 2024-09-14T11:11:14.710 INFO:teuthology.orchestra.run.smithi131.stdout:(264/286): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-14T11:11:14.725 INFO:teuthology.orchestra.run.smithi094.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-14T11:11:14.735 INFO:teuthology.orchestra.run.smithi131.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:11:14.761 INFO:teuthology.orchestra.run.smithi131.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:11:14.767 INFO:teuthology.orchestra.run.smithi094.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-09-14T11:11:14.786 INFO:teuthology.orchestra.run.smithi131.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:11:14.792 INFO:teuthology.orchestra.run.smithi094.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-09-14T11:11:14.820 INFO:teuthology.orchestra.run.smithi131.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-14T11:11:14.845 INFO:teuthology.orchestra.run.smithi131.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-14T11:11:14.867 INFO:teuthology.orchestra.run.smithi094.stdout:(175/286): openblas-openmp-0.3.26-2.el9.x86_64. 25 MB/s | 4.9 MB 00:00 2024-09-14T11:11:14.870 INFO:teuthology.orchestra.run.smithi131.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-14T11:11:14.892 INFO:teuthology.orchestra.run.smithi094.stdout:(176/286): orc-0.4.31-8.el9.x86_64.rpm 1.4 MB/s | 183 kB 00:00 2024-09-14T11:11:14.912 INFO:teuthology.orchestra.run.smithi131.stdout:(271/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-14T11:11:14.926 INFO:teuthology.orchestra.run.smithi094.stdout:(177/286): osinfo-db-20240701-2.el9.noarch.rpm 3.9 MB/s | 531 kB 00:00 2024-09-14T11:11:14.938 INFO:teuthology.orchestra.run.smithi131.stdout:(272/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-14T11:11:14.951 INFO:teuthology.orchestra.run.smithi094.stdout:(178/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 882 kB/s | 74 kB 00:00 2024-09-14T11:11:14.963 INFO:teuthology.orchestra.run.smithi131.stdout:(273/286): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-14T11:11:14.977 INFO:teuthology.orchestra.run.smithi094.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 5.4 MB/s | 468 kB 00:00 2024-09-14T11:11:14.988 INFO:teuthology.orchestra.run.smithi131.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-14T11:11:15.003 INFO:teuthology.orchestra.run.smithi094.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 3.2 MB/s | 246 kB 00:00 2024-09-14T11:11:15.014 INFO:teuthology.orchestra.run.smithi131.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T11:11:15.028 INFO:teuthology.orchestra.run.smithi094.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-14T11:11:15.039 INFO:teuthology.orchestra.run.smithi131.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-14T11:11:15.053 INFO:teuthology.orchestra.run.smithi094.stdout:(182/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 758 kB/s | 57 kB 00:00 2024-09-14T11:11:15.064 INFO:teuthology.orchestra.run.smithi131.stdout:(277/286): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-14T11:11:15.078 INFO:teuthology.orchestra.run.smithi094.stdout:(183/286): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-14T11:11:15.089 INFO:teuthology.orchestra.run.smithi131.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T11:11:15.103 INFO:teuthology.orchestra.run.smithi094.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-09-14T11:11:15.114 INFO:teuthology.orchestra.run.smithi131.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T11:11:15.140 INFO:teuthology.orchestra.run.smithi131.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-14T11:11:15.154 INFO:teuthology.orchestra.run.smithi094.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 19 MB/s | 1.9 MB 00:00 2024-09-14T11:11:15.165 INFO:teuthology.orchestra.run.smithi131.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:11:15.179 INFO:teuthology.orchestra.run.smithi094.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 343 kB/s | 26 kB 00:00 2024-09-14T11:11:15.190 INFO:teuthology.orchestra.run.smithi131.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:11:15.204 INFO:teuthology.orchestra.run.smithi094.stdout:(187/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.5 MB/s | 192 kB 00:00 2024-09-14T11:11:15.216 INFO:teuthology.orchestra.run.smithi131.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-14T11:11:15.230 INFO:teuthology.orchestra.run.smithi094.stdout:(188/286): plexus-classworlds-2.6.0-11.el9.noar 797 kB/s | 60 kB 00:00 2024-09-14T11:11:15.255 INFO:teuthology.orchestra.run.smithi094.stdout:(189/286): plexus-containers-component-annotati 243 kB/s | 18 kB 00:00 2024-09-14T11:11:15.266 INFO:teuthology.orchestra.run.smithi131.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:11:15.280 INFO:teuthology.orchestra.run.smithi094.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-14T11:11:15.297 INFO:teuthology.orchestra.run.smithi094.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 502 kB/s | 34 kB 00:00 2024-09-14T11:11:15.322 INFO:teuthology.orchestra.run.smithi094.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-14T11:11:15.365 INFO:teuthology.orchestra.run.smithi094.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-14T11:11:15.390 INFO:teuthology.orchestra.run.smithi094.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-14T11:11:15.440 INFO:teuthology.orchestra.run.smithi094.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 13 MB/s | 1.9 MB 00:00 2024-09-14T11:11:15.465 INFO:teuthology.orchestra.run.smithi094.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-14T11:11:15.467 INFO:teuthology.orchestra.run.smithi131.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-14T11:11:15.499 INFO:teuthology.orchestra.run.smithi094.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-14T11:11:15.517 INFO:teuthology.orchestra.run.smithi131.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 11 MB/s | 3.5 MB 00:00 2024-09-14T11:11:15.523 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:11:15.523 INFO:teuthology.orchestra.run.smithi131.stdout:Total 25 MB/s | 327 MB 00:13 2024-09-14T11:11:15.524 INFO:teuthology.orchestra.run.smithi094.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.9 MB/s | 679 kB 00:00 2024-09-14T11:11:15.558 INFO:teuthology.orchestra.run.smithi094.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-14T11:11:15.583 INFO:teuthology.orchestra.run.smithi094.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-14T11:11:15.608 INFO:teuthology.orchestra.run.smithi094.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 512 kB/s | 26 kB 00:00 2024-09-14T11:11:15.684 INFO:teuthology.orchestra.run.smithi094.stdout:(202/286): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-09-14T11:11:15.709 INFO:teuthology.orchestra.run.smithi094.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 153 kB/s | 19 kB 00:00 2024-09-14T11:11:15.735 INFO:teuthology.orchestra.run.smithi094.stdout:(204/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-14T11:11:15.760 INFO:teuthology.orchestra.run.smithi094.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 460 kB/s | 35 kB 00:00 2024-09-14T11:11:15.802 INFO:teuthology.orchestra.run.smithi094.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.7 MB/s | 250 kB 00:00 2024-09-14T11:11:15.827 INFO:teuthology.orchestra.run.smithi094.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.2 MB/s | 222 kB 00:00 2024-09-14T11:11:15.903 INFO:teuthology.orchestra.run.smithi094.stdout:(208/286): python3-numpy-1.20.1-5.el9.x86_64.rp 26 MB/s | 5.1 MB 00:00 2024-09-14T11:11:15.928 INFO:teuthology.orchestra.run.smithi094.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 421 kB/s | 42 kB 00:00 2024-09-14T11:11:15.953 INFO:teuthology.orchestra.run.smithi094.stdout:(210/286): python3-packaging-20.9-5.el9.noarch. 511 kB/s | 77 kB 00:00 2024-09-14T11:11:15.978 INFO:teuthology.orchestra.run.smithi094.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 3.5 MB/s | 269 kB 00:00 2024-09-14T11:11:16.004 INFO:teuthology.orchestra.run.smithi094.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.1 MB/s | 159 kB 00:00 2024-09-14T11:11:16.029 INFO:teuthology.orchestra.run.smithi094.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-09-14T11:11:16.054 INFO:teuthology.orchestra.run.smithi094.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-14T11:11:16.080 INFO:teuthology.orchestra.run.smithi094.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 712 kB/s | 54 kB 00:00 2024-09-14T11:11:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-14T11:11:16.147 INFO:teuthology.orchestra.run.smithi094.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-14T11:11:16.181 INFO:teuthology.orchestra.run.smithi094.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-14T11:11:16.214 INFO:teuthology.orchestra.run.smithi094.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-14T11:11:16.248 INFO:teuthology.orchestra.run.smithi094.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 838 kB/s | 56 kB 00:00 2024-09-14T11:11:16.281 INFO:teuthology.orchestra.run.smithi094.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-14T11:11:16.307 INFO:teuthology.orchestra.run.smithi094.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 69 kB 00:00 2024-09-14T11:11:16.516 INFO:teuthology.orchestra.run.smithi094.stdout:(223/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-14T11:11:16.541 INFO:teuthology.orchestra.run.smithi094.stdout:(224/286): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-14T11:11:16.566 INFO:teuthology.orchestra.run.smithi094.stdout:(225/286): sound-theme-freedesktop-0.8-17.el9.n 1.4 MB/s | 383 kB 00:00 2024-09-14T11:11:16.591 INFO:teuthology.orchestra.run.smithi094.stdout:(226/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.0 MB/s | 152 kB 00:00 2024-09-14T11:11:16.617 INFO:teuthology.orchestra.run.smithi094.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 7.2 MB/s | 555 kB 00:00 2024-09-14T11:11:16.650 INFO:teuthology.orchestra.run.smithi094.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 11 MB/s | 944 kB 00:00 2024-09-14T11:11:16.676 INFO:teuthology.orchestra.run.smithi094.stdout:(229/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 632 kB/s | 53 kB 00:00 2024-09-14T11:11:16.701 INFO:teuthology.orchestra.run.smithi094.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-14T11:11:16.726 INFO:teuthology.orchestra.run.smithi094.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-14T11:11:16.752 INFO:teuthology.orchestra.run.smithi094.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-14T11:11:16.777 INFO:teuthology.orchestra.run.smithi094.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-14T11:11:16.811 INFO:teuthology.orchestra.run.smithi094.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 4.1 MB/s | 358 kB 00:00 2024-09-14T11:11:16.836 INFO:teuthology.orchestra.run.smithi094.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 505 kB/s | 42 kB 00:00 2024-09-14T11:11:16.861 INFO:teuthology.orchestra.run.smithi094.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.5 MB/s | 385 kB 00:00 2024-09-14T11:11:16.887 INFO:teuthology.orchestra.run.smithi094.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-14T11:11:16.920 INFO:teuthology.orchestra.run.smithi094.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 10 MB/s | 859 kB 00:00 2024-09-14T11:11:16.946 INFO:teuthology.orchestra.run.smithi094.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 758 kB/s | 64 kB 00:00 2024-09-14T11:11:16.971 INFO:teuthology.orchestra.run.smithi094.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.9 MB/s | 505 kB 00:00 2024-09-14T11:11:16.996 INFO:teuthology.orchestra.run.smithi094.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-09-14T11:11:17.055 INFO:teuthology.orchestra.run.smithi094.stdout:(242/286): protobuf-compiler-3.14.0-13.el9.x86_ 7.7 MB/s | 863 kB 00:00 2024-09-14T11:11:17.097 INFO:teuthology.orchestra.run.smithi094.stdout:(243/286): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-14T11:11:17.122 INFO:teuthology.orchestra.run.smithi094.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 2.4 MB/s | 308 kB 00:00 2024-09-14T11:11:17.147 INFO:teuthology.orchestra.run.smithi094.stdout:(245/286): grpc-data-1.46.7-10.el9.noarch.rpm 216 kB/s | 19 kB 00:00 2024-09-14T11:11:17.173 INFO:teuthology.orchestra.run.smithi094.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-14T11:11:17.198 INFO:teuthology.orchestra.run.smithi094.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-14T11:11:17.223 INFO:teuthology.orchestra.run.smithi094.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T11:11:17.249 INFO:teuthology.orchestra.run.smithi094.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-14T11:11:17.291 INFO:teuthology.orchestra.run.smithi094.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-14T11:11:17.315 INFO:teuthology.orchestra.run.smithi094.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T11:11:17.345 INFO:teuthology.orchestra.run.smithi094.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T11:11:17.433 INFO:teuthology.orchestra.run.smithi094.stdout:(253/286): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-14T11:11:17.458 INFO:teuthology.orchestra.run.smithi094.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 121 kB/s | 14 kB 00:00 2024-09-14T11:11:17.484 INFO:teuthology.orchestra.run.smithi094.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-14T11:11:17.517 INFO:teuthology.orchestra.run.smithi094.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-14T11:11:17.543 INFO:teuthology.orchestra.run.smithi094.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-14T11:11:17.576 INFO:teuthology.orchestra.run.smithi094.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-14T11:11:17.593 INFO:teuthology.orchestra.run.smithi094.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 648 kB/s | 11 kB 00:00 2024-09-14T11:11:17.610 INFO:teuthology.orchestra.run.smithi094.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-14T11:11:17.627 INFO:teuthology.orchestra.run.smithi094.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2024-09-14T11:11:17.644 INFO:teuthology.orchestra.run.smithi094.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-14T11:11:17.661 INFO:teuthology.orchestra.run.smithi094.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-14T11:11:17.720 INFO:teuthology.orchestra.run.smithi094.stdout:(264/286): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-14T11:11:17.737 INFO:teuthology.orchestra.run.smithi094.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-14T11:11:17.779 INFO:teuthology.orchestra.run.smithi094.stdout:(266/286): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-14T11:11:17.804 INFO:teuthology.orchestra.run.smithi094.stdout:(267/286): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-14T11:11:17.821 INFO:teuthology.orchestra.run.smithi094.stdout:(268/286): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-14T11:11:17.838 INFO:teuthology.orchestra.run.smithi094.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 989 kB/s | 16 kB 00:00 2024-09-14T11:11:17.897 INFO:teuthology.orchestra.run.smithi094.stdout:(270/286): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-09-14T11:11:17.922 INFO:teuthology.orchestra.run.smithi094.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-14T11:11:17.939 INFO:teuthology.orchestra.run.smithi094.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 740 kB/s | 31 kB 00:00 2024-09-14T11:11:17.973 INFO:teuthology.orchestra.run.smithi094.stdout:(273/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-14T11:11:17.998 INFO:teuthology.orchestra.run.smithi094.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-14T11:11:18.023 INFO:teuthology.orchestra.run.smithi094.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-14T11:11:18.049 INFO:teuthology.orchestra.run.smithi094.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-14T11:11:18.082 INFO:teuthology.orchestra.run.smithi094.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-14T11:11:18.108 INFO:teuthology.orchestra.run.smithi094.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-14T11:11:18.133 INFO:teuthology.orchestra.run.smithi094.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-14T11:11:18.158 INFO:teuthology.orchestra.run.smithi094.stdout:(280/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-14T11:11:18.184 INFO:teuthology.orchestra.run.smithi094.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:11:18.209 INFO:teuthology.orchestra.run.smithi094.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:11:18.242 INFO:teuthology.orchestra.run.smithi094.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-14T11:11:18.293 INFO:teuthology.orchestra.run.smithi094.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-14T11:11:18.493 INFO:teuthology.orchestra.run.smithi094.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 12 MB/s | 3.5 MB 00:00 2024-09-14T11:11:18.576 INFO:teuthology.orchestra.run.smithi094.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 9.7 MB/s | 3.2 MB 00:00 2024-09-14T11:11:18.584 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:11:18.584 INFO:teuthology.orchestra.run.smithi094.stdout:Total 22 MB/s | 327 MB 00:15 2024-09-14T11:11:18.707 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-14T11:11:18.890 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-14T11:11:18.890 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-14T11:11:21.752 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-14T11:11:21.935 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-14T11:11:21.935 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-14T11:11:22.158 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-14T11:11:22.158 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-14T11:11:25.147 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-14T11:11:25.148 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-14T11:11:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:11:32.472 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:11:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-14T11:11:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:11:32.729 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:11:32.917 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:11:33.032 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:11:33.091 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:11:33.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:11:33.165 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:11:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:11:33.588 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:11:33.708 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:11:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:11:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:11:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:11:33.963 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:11:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:11:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:11:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:11:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:11:34.157 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:11:34.197 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:11:34.233 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:11:34.261 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:11:34.434 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:11:34.575 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:11:34.613 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:11:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:11:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:11:34.800 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:11:34.829 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:11:34.892 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:11:34.916 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:11:34.938 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:11:34.964 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:11:35.133 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:11:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:11:35.279 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:11:35.312 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:11:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:11:35.346 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:11:35.412 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:11:35.456 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:11:35.498 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:11:35.498 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:11:35.549 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:11:35.581 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:11:35.608 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:11:35.634 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:11:35.653 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-14T11:11:35.668 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:11:35.697 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:11:35.729 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:11:35.742 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:11:35.767 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:11:35.833 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:11:35.865 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:11:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:11:35.943 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:11:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:11:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:11:36.085 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:11:36.125 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:11:36.128 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:11:36.172 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:11:36.180 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:11:36.235 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:11:36.280 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:11:36.284 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:11:36.309 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:11:36.323 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:11:36.361 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:11:36.372 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:11:36.434 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:11:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:11:36.704 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:11:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:11:36.827 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:11:36.841 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:11:36.949 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:11:36.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:11:37.069 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:11:37.099 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:11:37.138 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:11:37.166 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:11:37.192 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:11:37.250 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:11:37.291 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:11:37.346 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:11:37.380 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:11:37.381 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:11:37.472 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:11:37.507 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:11:37.540 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:11:37.578 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:11:37.613 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:11:37.649 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:11:37.674 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:11:37.678 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:11:37.722 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:11:37.750 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:11:37.760 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:11:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:11:37.796 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:11:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:11:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:11:37.893 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:11:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:11:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:11:37.986 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:11:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:11:38.019 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:11:38.041 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:11:38.043 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:11:38.061 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:11:38.103 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:11:38.138 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:11:38.175 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:11:38.227 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:11:38.267 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:11:38.267 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:11:38.340 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:11:38.381 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:11:38.414 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:11:38.415 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:11:38.450 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:11:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:11:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:11:38.523 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:11:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:11:38.576 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:11:38.580 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:11:38.617 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:11:38.623 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:11:38.669 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:11:38.701 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:11:38.728 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:11:38.753 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:11:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:11:38.779 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:11:38.808 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:11:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:11:38.841 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:11:38.857 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:11:38.890 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:11:38.944 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:11:38.962 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:11:38.977 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:11:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:11:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:11:39.048 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:11:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:11:39.104 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:11:39.106 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:11:39.144 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:11:39.187 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:11:39.192 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:11:39.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:11:39.254 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:11:39.326 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:11:39.341 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:11:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:11:39.381 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:11:39.425 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:11:39.466 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:11:39.544 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:11:39.578 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:11:39.618 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:11:39.650 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:11:39.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:11:39.690 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:11:39.733 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:11:39.749 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:11:39.766 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:11:39.781 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:11:39.781 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:11:39.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:11:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:11:40.048 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:11:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:11:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:11:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:11:40.191 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:11:40.296 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:11:40.384 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:11:40.428 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:11:40.507 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:11:40.586 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:11:40.615 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:11:40.649 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:40.687 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:11:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:40.693 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:11:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:11:40.718 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:11:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:11:40.751 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:11:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:11:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:11:40.820 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:11:40.833 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:11:40.861 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:11:40.873 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:11:40.896 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:11:40.906 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:11:40.948 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:11:40.984 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:11:41.007 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:11:41.041 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:11:41.043 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:11:41.078 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:11:41.082 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:11:41.172 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:11:41.188 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:11:41.250 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:11:41.251 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:11:41.326 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:11:41.364 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:11:41.400 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:11:41.448 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:11:41.501 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:11:41.551 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:11:41.692 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:11:41.744 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:11:41.794 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:11:41.900 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:11:41.945 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:11:41.991 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:11:41.995 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:11:42.035 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:11:42.040 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:11:42.060 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:11:42.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:11:42.160 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:11:42.175 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:11:42.216 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:11:42.289 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:11:42.335 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:11:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:11:42.447 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:11:42.491 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:11:42.552 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:11:42.598 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:11:42.629 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:11:42.659 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:11:42.700 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:11:42.737 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:11:42.751 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:11:42.752 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:11:42.752 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:11:42.944 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:11:43.005 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:11:43.015 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:11:43.072 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:11:43.077 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:11:43.102 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:11:43.118 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:11:43.133 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:11:43.160 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:11:43.162 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:11:43.193 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:11:43.377 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:11:43.407 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:11:43.485 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:11:43.561 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:43.591 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:43.606 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:11:43.606 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:11:43.606 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:11:43.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:11:43.682 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:11:43.715 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:11:43.757 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:11:43.792 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:11:43.880 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:11:43.930 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:11:43.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:11:44.067 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:11:44.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:11:44.173 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:11:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:11:44.880 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:11:44.927 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:11:44.960 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:11:45.065 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:11:45.110 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:11:45.302 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:11:45.342 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:11:45.390 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:11:45.644 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:11:45.704 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:11:45.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:11:45.765 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:11:45.795 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:11:45.807 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:11:45.807 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:11:45.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:11:45.860 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:11:45.915 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:11:45.927 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:11:45.971 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:11:46.004 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:11:46.039 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:11:46.072 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:11:46.256 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:11:46.262 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:11:46.286 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:11:46.315 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:11:46.364 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:11:46.406 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:11:46.439 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:11:46.471 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:11:46.509 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:11:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:11:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:11:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:11:46.672 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:11:46.699 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:11:47.025 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:11:47.048 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:11:47.054 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:11:47.079 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:11:47.105 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:11:47.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:11:47.155 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:11:47.170 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:11:47.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:11:47.220 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:11:47.264 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:11:47.304 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:11:47.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:11:47.379 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:11:47.841 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:11:47.980 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:11:48.046 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:11:48.079 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:11:48.107 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:11:48.176 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:11:48.215 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:11:48.239 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:11:48.258 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:11:48.285 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:11:48.311 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:11:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:11:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:11:48.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:11:48.582 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:11:48.637 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:11:48.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:11:48.703 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:11:48.733 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:11:48.745 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:11:48.745 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:11:48.745 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:11:48.808 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:11:48.837 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:11:48.865 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:11:49.185 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:11:49.228 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:11:49.328 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:11:49.360 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:11:49.392 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:11:49.422 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:11:49.486 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:11:49.521 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:11:49.547 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:11:49.589 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:11:49.612 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:11:49.914 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:11:49.963 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:11:49.992 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:11:50.017 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:11:50.043 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:11:50.077 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:11:50.110 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:11:50.139 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:11:50.174 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:11:50.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:11:50.258 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:11:50.314 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:11:50.341 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:11:50.795 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:11:50.934 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:11:50.984 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:11:51.009 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:11:51.038 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:11:51.113 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:11:51.153 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:11:51.177 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:11:51.197 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:11:51.232 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:11:51.266 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:11:51.307 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:11:51.338 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:11:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:11:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:12:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:12:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:12:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:12:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:12:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:12:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:12:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:12:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:12:03.001 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:12:03.067 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:12:03.103 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:12:03.146 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:12:03.163 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:03.177 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:12:03.197 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:03.214 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:12:03.729 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:12:03.759 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:03.760 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:12:03.801 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:12:03.841 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:12:03.871 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:12:03.876 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:12:03.876 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:12:03.876 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:12:03.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:03.910 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:12:06.210 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:06.245 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:06.805 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:12:06.840 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:12:06.916 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:12:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:12:06.917 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:12:06.917 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:06.950 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:12:13.341 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:12:13.341 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-09-14T11:12:13.341 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-09-14T11:12:13.341 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-09-14T11:12:13.342 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-09-14T11:12:13.342 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-09-14T11:12:13.342 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-09-14T11:12:13.342 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-09-14T11:12:13.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:13.518 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:12:13.534 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:12:13.534 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:13.534 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:12:13.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:12:15.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:15.253 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:12:15.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:15.729 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:12:15.752 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:12:15.753 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:15.753 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:12:15.753 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:12:15.753 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:12:15.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:15.855 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:12:16.418 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-09-14T11:12:16.419 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:16.593 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:12:16.609 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:12:16.609 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:16.609 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:12:16.609 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:18.061 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:12:18.087 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:12:18.087 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:18.087 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:12:18.088 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:12:18.088 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:12:18.088 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:18.311 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:12:18.335 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:18.702 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:12:18.778 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:12:18.802 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:18.808 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:12:18.862 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:12:18.905 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:12:18.927 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:12:19.123 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:12:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:12:19.249 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:12:19.336 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:12:19.484 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:12:19.528 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:12:19.561 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:12:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:12:20.476 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:12:20.837 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:12:20.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:12:20.930 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:12:20.957 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:12:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:12:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:12:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:12:21.082 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:12:21.108 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:12:21.133 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:12:21.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:12:21.185 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:12:21.212 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:12:21.242 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:12:21.270 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:12:21.305 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:12:21.349 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:12:21.388 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:12:21.423 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:12:21.465 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:12:21.502 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:12:21.540 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:12:21.583 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:12:21.627 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:12:21.658 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:12:21.691 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:12:21.743 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:12:21.784 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:12:21.790 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:12:21.814 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:12:21.843 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:12:21.869 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:12:21.904 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:12:21.968 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:12:22.034 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:12:22.036 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:12:22.069 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:12:22.096 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:12:22.123 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:12:22.155 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:12:22.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:12:22.273 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:12:22.294 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:12:22.361 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:12:22.371 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:12:22.440 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:12:22.457 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:12:22.468 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:12:22.591 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:12:22.598 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:12:22.632 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:12:22.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:12:22.651 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:12:22.685 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:12:22.691 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:12:22.717 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:12:23.097 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:23.137 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:23.137 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:12:23.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:23.371 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:12:23.449 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:12:23.496 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:12:23.540 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:12:23.548 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:12:23.566 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:12:23.605 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:12:23.974 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:12:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:24.019 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:12:24.050 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:12:24.053 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:24.070 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:24.078 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:12:24.113 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:12:24.150 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:12:24.177 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:12:24.203 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:12:24.237 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:12:24.262 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:12:24.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:12:24.314 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:12:24.340 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:12:24.371 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:12:24.399 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:12:24.434 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:12:24.478 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:12:24.509 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:12:24.543 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:12:24.559 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:12:24.577 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:12:24.622 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:12:24.649 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:12:24.660 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:12:24.694 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:12:24.703 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:12:24.722 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:12:24.747 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:12:24.779 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:12:24.802 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:12:24.855 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:12:24.888 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:12:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:12:24.919 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:12:24.956 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:12:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:12:24.990 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:12:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:12:25.016 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:12:25.053 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:12:25.119 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:12:25.148 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:12:25.157 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:12:25.158 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:12:25.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:12:25.190 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:12:25.208 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:12:25.216 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:12:25.232 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:12:25.243 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:12:25.276 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:12:25.399 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:12:25.458 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:12:25.527 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:12:25.555 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:12:25.678 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:12:25.681 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:12:25.705 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:12:25.735 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:12:25.738 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:12:25.757 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:12:25.789 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:12:25.804 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:12:25.812 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:12:25.837 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:12:26.267 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:26.299 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:26.314 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:12:26.314 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:12:26.314 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:26.567 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:12:26.645 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:12:26.690 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:12:26.727 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:12:26.752 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:12:27.192 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:27.231 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:27.247 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:12:27.797 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:12:27.885 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:12:27.931 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:12:27.960 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:12:28.163 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:12:28.228 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:12:28.255 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:12:28.277 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:12:28.309 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:12:28.381 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:12:28.417 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:12:28.427 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:12:28.450 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:12:28.472 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:12:28.501 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:12:28.914 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:12:28.948 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:12:28.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:12:29.026 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:12:29.049 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:12:29.073 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:12:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:12:30.312 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:12:30.344 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:12:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:12:30.623 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:12:30.654 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:12:30.677 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:12:30.677 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:30.678 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:12:30.678 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:12:30.678 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:12:30.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:30.730 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:12:30.741 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:12:30.764 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:12:30.793 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:12:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:12:30.865 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:12:30.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:31.841 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:12:31.864 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:12:31.865 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:31.865 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:12:31.865 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:12:31.865 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:12:31.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:31.917 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:12:31.940 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:12:31.940 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:31.940 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:12:31.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:32.259 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:12:32.266 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:12:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:12:32.282 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:32.282 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:12:32.282 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:12:32.282 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:12:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:32.329 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:12:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:12:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:12:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:12:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:12:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:12:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:12:33.664 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:33.664 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:12:33.664 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:12:33.664 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:12:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:12:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:12:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:12:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:12:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:12:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:12:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:12:33.875 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:12:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:34.835 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:12:34.858 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:12:34.858 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:34.858 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:12:34.859 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:12:34.859 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:12:34.859 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:34.902 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:12:34.925 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:12:34.925 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:34.925 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:12:34.925 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:35.244 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:12:35.268 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:37.079 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:12:37.119 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:12:37.160 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:12:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:12:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:12:37.368 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:12:37.368 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:12:37.460 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:12:37.461 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:37.551 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:37.574 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:12:37.581 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:12:37.590 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:12:37.600 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:12:37.600 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:12:37.600 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:12:37.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:37.649 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:12:37.718 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:12:39.956 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:12:39.997 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:12:40.028 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:12:40.157 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:12:40.213 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:12:40.245 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:12:40.245 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:12:40.337 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:12:40.337 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:40.437 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:40.460 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:12:40.466 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:12:40.475 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:12:40.485 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:12:40.485 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:12:40.485 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:12:40.485 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:40.546 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:12:40.617 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:12:48.082 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:48.083 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:12:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:12:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:12:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:12:48.087 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:12:48.088 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:12:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:12:48.090 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:12:48.091 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:12:48.092 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:12:48.093 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:12:48.094 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:12:48.095 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:12:48.096 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:12:48.097 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:12:48.098 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:12:48.099 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:12:48.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:12:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:12:48.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:12:48.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:12:48.104 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:12:51.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:12:51.377 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:12:51.378 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:12:51.378 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:12:51.378 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:12:51.378 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:12:51.378 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:12:51.399 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:12:51.400 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:12:51.401 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:12:51.402 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:12:51.403 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:12:51.404 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:12:51.405 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:12:51.406 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:12:51.407 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:12:51.408 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:12:51.409 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:12:51.410 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:12:51.411 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:12:51.412 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:12:51.413 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:12:51.414 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:12:51.415 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:12:51.416 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:12:51.417 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:12:51.418 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:12:51.419 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:12:51.516 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:51.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:51.516 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-09-14T11:12:51.516 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.516 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:12:51.517 INFO:teuthology.orchestra.run.smithi131.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.518 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:12:51.519 INFO:teuthology.orchestra.run.smithi131.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:12:51.520 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:12:51.521 INFO:teuthology.orchestra.run.smithi131.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:12:51.522 INFO:teuthology.orchestra.run.smithi131.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:12:51.523 INFO:teuthology.orchestra.run.smithi131.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:51.524 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:12:51.525 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:12:51.526 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:12:51.527 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:12:51.528 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.529 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:12:51.530 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:12:51.531 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:12:51.532 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:12:51.533 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:12:51.534 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:12:51.535 INFO:teuthology.orchestra.run.smithi131.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:12:51.536 INFO:teuthology.orchestra.run.smithi131.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:51.537 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-14T11:12:51.963 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:12:54.815 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:12:54.816 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.817 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:12:54.818 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:12:54.819 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:12:54.820 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:54.821 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:12:54.822 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.823 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:12:54.824 INFO:teuthology.orchestra.run.smithi094.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.825 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:12:54.826 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:12:54.827 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:12:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:12:54.829 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:12:54.830 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:12:54.831 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:12:54.832 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:12:54.833 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:12:54.834 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.835 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:12:54.836 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:12:54.837 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:12:54.838 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:12:54.838 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:12:54.838 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:54.838 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-14T11:12:55.248 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:55.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:12:55.408 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:12:55.471 INFO:teuthology.orchestra.run.smithi094.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:12:55.472 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:12:55.472 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:12:55.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:12:55.614 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:12:55.678 INFO:teuthology.orchestra.run.smithi131.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:12:55.678 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:12:55.678 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:12:55.680 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:12:55.681 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:55.681 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:12:55.722 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:55.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:12:55.768 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:12:55.768 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:55.768 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:12:55.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:12:55.885 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:55.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:12:55.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:12:56.007 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:12:56.007 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:56.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:12:56.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:12:56.125 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:56.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:12:56.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:12:56.244 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:12:56.244 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:56.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:12:56.283 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:12:56.361 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:56.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:12:56.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:12:56.477 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:12:56.564 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:12:56.565 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-09-14T11:12:56.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-09-14T11:12:56.606 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:12:56.606 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:12:56.646 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:12:56.683 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:12:56.683 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:12:56.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:12:56.773 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:12:56.773 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:12:56.773 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904175', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKu/WUZQ976J8HXlyzrjwIQ5A23w68+QlprRU6wmqlSxiZJANIiVDLTu4Rf38/8zejRovsn38FRGaUIIyuY8qPo=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEya4EjgDxKzi2sw/ayv7946DeZngcy6pueV257ZFPMkXpRlEfwESCGHS7k0cnf+5oEPYf4ZB3yIcGnV7ow5+M8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:12:56.774 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:12:56.804 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:12:56.833 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:12:56.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:12:56.911 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:56.912 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:12:56.979 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:12:56.979 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-14 11:12:41.688950703 +0000 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-14 11:10:19.492173046 +0000 2024-09-14T11:12:57.048 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-14 11:10:19.492173046 +0000 2024-09-14T11:12:57.049 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-14 11:10:19.492173046 +0000 2024-09-14T11:12:57.049 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:12:57.125 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-14T11:12:57.126 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000105466 s, 4.9 MB/s 2024-09-14T11:12:57.127 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:12:57.197 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-14 11:12:41.689950687 +0000 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-14 11:10:19.802168238 +0000 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-14 11:10:19.802168238 +0000 2024-09-14T11:12:57.267 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-14 11:10:19.802168238 +0000 2024-09-14T11:12:57.268 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:12:57.343 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-14T11:12:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-14T11:12:57.344 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000101941 s, 5.0 MB/s 2024-09-14T11:12:57.345 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:12:57.415 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-14 11:12:41.689950687 +0000 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-14 11:10:20.138163027 +0000 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-14 11:10:20.138163027 +0000 2024-09-14T11:12:57.484 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-14 11:10:20.138163027 +0000 2024-09-14T11:12:57.485 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:12:57.560 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-14T11:12:57.561 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-14T11:12:57.561 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000102218 s, 5.0 MB/s 2024-09-14T11:12:57.562 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:12:57.631 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-14T11:12:57.700 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:12:57.700 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:57.700 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T11:12:57.700 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:57.700 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:57.701 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-14 11:12:41.689950687 +0000 2024-09-14T11:12:57.701 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-14 11:10:20.452158157 +0000 2024-09-14T11:12:57.701 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-14 11:10:20.452158157 +0000 2024-09-14T11:12:57.701 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-14 11:10:20.452158157 +0000 2024-09-14T11:12:57.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:12:57.777 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-14T11:12:57.777 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-14T11:12:57.777 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000103442 s, 4.9 MB/s 2024-09-14T11:12:57.778 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:12:57.848 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:12:57.848 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:57.848 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:12:57.883 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:12:57.883 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-14 11:12:38.785574595 +0000 2024-09-14T11:12:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-14 11:10:19.506640924 +0000 2024-09-14T11:12:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-14 11:10:19.506640924 +0000 2024-09-14T11:12:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-14 11:10:19.506640924 +0000 2024-09-14T11:12:57.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:12:58.036 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-14T11:12:58.036 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-14T11:12:58.036 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000193375 s, 2.6 MB/s 2024-09-14T11:12:58.037 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:12:58.109 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-14T11:12:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-14 11:12:38.785574595 +0000 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-14 11:10:19.829634036 +0000 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-14 11:10:19.829634036 +0000 2024-09-14T11:12:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-14 11:10:19.829634036 +0000 2024-09-14T11:12:58.179 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:12:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-14T11:12:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-14T11:12:58.256 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000212479 s, 2.4 MB/s 2024-09-14T11:12:58.257 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:12:58.328 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-14T11:12:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-14 11:12:38.785574595 +0000 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-14 11:10:20.149627212 +0000 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-14 11:10:20.149627212 +0000 2024-09-14T11:12:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-14 11:10:20.149627212 +0000 2024-09-14T11:12:58.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:12:58.475 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-14T11:12:58.475 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-14T11:12:58.475 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000212466 s, 2.4 MB/s 2024-09-14T11:12:58.477 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:12:58.547 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-14T11:12:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-14 11:12:38.786574573 +0000 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-14 11:10:20.455620687 +0000 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-14 11:10:20.455620687 +0000 2024-09-14T11:12:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-14 11:10:20.455620687 +0000 2024-09-14T11:12:58.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:12:58.692 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-14T11:12:58.692 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-14T11:12:58.693 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000213347 s, 2.4 MB/s 2024-09-14T11:12:58.694 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:12:58.763 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:12:58.763 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:12:58.763 INFO:tasks.ceph:Generating config... 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T11:12:58.765 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:12:58.766 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:12:58.766 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:12:58.766 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:12:58.766 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:12:58.766 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:12:58.767 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:12:58.767 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:12:58.768 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:12:58.768 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:12:58.769 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:12:58.839 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:12:58.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:12:58.899 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:12:58.937 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]'), ('mon.b', '172.21.15.131')] 2024-09-14T11:12:58.938 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.131', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:12:58.939 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:58.939 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:12:59.006 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --add b 172.21.15.131 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:12:59.105 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:59.105 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:12:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:12:59.107 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:12:59.108 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:12:59.136 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2... 2024-09-14T11:12:59.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:12:59.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.233 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:12:59.234 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:12:59.235 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.131" 2024-09-14T11:12:59.236 INFO:teuthology.orchestra.run.smithi094.stdout: mon client directed command retry = 5 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject socket failures = 5000 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:12:59.237 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:12:59.238 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-14T11:12:59.239 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug objclass = 20 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: lockdep = True 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: osd shutdown pgref assert = True 2024-09-14T11:12:59.240 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-14T11:12:59.241 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.242 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: lockdep = True 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = True 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-14T11:12:59.243 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw = 20 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw notification = 20 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw bucket counters cache = True 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt require ssl = False 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw max chunk size = 4194304 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw obj stripe size = 6291456 2024-09-14T11:12:59.244 INFO:teuthology.orchestra.run.smithi094.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: rgw s3 auth use sts = True 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: rgw torrent flag = True 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: rgw user counters cache = True 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: setgroup = ceph 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout: setuser = ceph 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-14T11:12:59.245 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:12:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-09-14T11:12:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.131" 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: mon client directed command retry = 5 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject socket failures = 5000 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-09-14T11:12:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.250 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-09-14T11:12:59.251 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug objclass = 20 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: lockdep = True 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: osd shutdown pgref assert = True 2024-09-14T11:12:59.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-09-14T11:12:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:12:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: lockdep = True 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = True 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: debug rgw = 20 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: debug rgw notification = 20 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: rgw bucket counters cache = True 2024-09-14T11:12:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt require ssl = False 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw max chunk size = 4194304 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw obj stripe size = 6291456 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw s3 auth use sts = True 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw torrent flag = True 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: rgw user counters cache = True 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: setgroup = ceph 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: setuser = ceph 2024-09-14T11:12:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-09-14T11:12:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-09-14T11:12:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-09-14T11:12:59.258 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:12:59.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:12:59.326 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:12:59.326 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:59.326 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:12:59.354 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:59.354 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:12:59.424 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:12:59.424 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:59.424 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:12:59.424 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:12:59.513 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:12:59.513 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:12:59.582 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:12:59.582 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:59.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:12:59.582 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:12:59.631 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:12:59.631 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:12:59.700 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:12:59.700 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:12:59.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:12:59.765 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:12:59.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:12:59.841 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:12:59.844 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:12:59.844 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:12:59.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:12:59.900 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:12:59.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:12:59.969 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:12:59.982 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:12:59.983 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:12:59.983 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:13:00.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:00.022 INFO:tasks.ceph:role: osd.0 2024-09-14T11:13:00.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:13:00.022 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:00.100 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:00.101 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:00.132 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-14T11:13:00.134 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-14T11:13:00.134 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:13:00.216 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:13:00.300 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:13:00.380 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:00.380 INFO:tasks.ceph:role: osd.1 2024-09-14T11:13:00.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:13:00.381 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:00.458 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:00.490 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-14T11:13:00.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-14T11:13:00.492 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:13:00.577 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:13:00.660 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:13:00.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:00.738 INFO:tasks.ceph:role: osd.2 2024-09-14T11:13:00.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:13:00.738 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:13:00.818 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:00.818 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:00.818 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:00.818 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:00.818 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:00.819 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:00.819 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:00.819 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:00.819 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:00.819 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:00.850 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-14T11:13:00.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-14T11:13:00.852 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:13:00.934 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:13:01.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:13:01.096 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:01.096 INFO:tasks.ceph:role: osd.3 2024-09-14T11:13:01.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:13:01.097 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:13:01.173 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:01.173 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:01.174 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:01.206 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-14T11:13:01.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-14T11:13:01.208 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:13:01.291 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:13:01.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:01.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:01.485+0000 7fc78cef1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:13:01.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:01.485+0000 7fc78cef1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:13:01.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:01.485+0000 7fc78cef1640 -1 bdev(0x55e5c4cc3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:01.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:01.486+0000 7fc78cef1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:13:04.400 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:13:04.441 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:04.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:04.542+0000 7f368dc16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:13:04.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:04.542+0000 7f368dc16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:13:04.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:04.542+0000 7f368dc16640 -1 bdev(0x563f1fb9b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:04.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:04.542+0000 7f368dc16640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:13:07.946 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:13:07.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:08.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:08.055+0000 7f7ae880d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:13:08.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:08.055+0000 7f7ae880d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:13:08.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:08.055+0000 7f7ae880d640 -1 bdev(0x55f922e03800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:08.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:08.055+0000 7f7ae880d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:13:10.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:13:11.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:11.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:11.108+0000 7fdcd741e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:13:11.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:11.108+0000 7fdcd741e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:13:11.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:11.108+0000 7fdcd741e640 -1 bdev(0x561e8ba89800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:11.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:13:11.108+0000 7fdcd741e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:13:14.270 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:13:14.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:13:14.360 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:14.360 INFO:tasks.ceph:role: osd.4 2024-09-14T11:13:14.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:13:14.361 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:13:14.409 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:14.409 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:14.410 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:14.916 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-14T11:13:14.919 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-14T11:13:14.919 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:13:15.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:13:15.051 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:13:15.091 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:15.091 INFO:tasks.ceph:role: osd.5 2024-09-14T11:13:15.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:13:15.091 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:15.177 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:15.178 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:15.178 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:15.178 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:15.178 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:15.628 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-14T11:13:15.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-14T11:13:15.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:13:15.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:13:15.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:13:15.800 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:15.800 INFO:tasks.ceph:role: osd.6 2024-09-14T11:13:15.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:13:15.800 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:13:15.886 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:15.887 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:16.364 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-14T11:13:16.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-14T11:13:16.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:13:16.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:13:16.471 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:13:16.550 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:13:16.550 INFO:tasks.ceph:role: osd.7 2024-09-14T11:13:16.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:13:16.550 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:13:16.636 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:13:16.637 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:13:17.171 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-09-14T11:13:17.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-09-14T11:13:17.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:13:17.268 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:13:17.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:17.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:17.380+0000 7f5da540b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:13:17.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:17.385+0000 7f5da540b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:13:17.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:17.385+0000 7f5da540b640 -1 bdev(0x5568ae5db800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:17.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:17.385+0000 7f5da540b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:13:20.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:13:20.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:20.648+0000 7fa4f734d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:13:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:20.648+0000 7fa4f734d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:13:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:20.648+0000 7fa4f734d640 -1 bdev(0x5608ac90d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:20.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:20.648+0000 7fa4f734d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:13:23.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:13:23.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:23.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:23.699+0000 7fb687c16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:13:23.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:23.699+0000 7fb687c16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:13:23.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:23.699+0000 7fb687c16640 -1 bdev(0x564bae009800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:23.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:23.699+0000 7fb687c16640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:13:26.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:13:26.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:26.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:26.997+0000 7f95baddd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:13:26.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:26.998+0000 7f95baddd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:13:26.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:26.998+0000 7f95baddd640 -1 bdev(0x559ba7d3f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:13:26.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:26.998+0000 7f95baddd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:13:29.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:13:29.957 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:13:29.957 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:29.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:13:30.002 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:30.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:13:30.086 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:30.086 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:13:30.167 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:30.167 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:13:30.248 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:30.248 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:13:30.328 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:13:30.374 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.374 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:13:30.456 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.456 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:13:30.536 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.537 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:13:30.616 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:13:30.694 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:30.695 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:13:30.723 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:30.723 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:13:30.764 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:13:30.765 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:13:30.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:13:30.808 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC7b+Vmfhy+LRAAmsi/Gy+48oF1rczIgQ22ww== 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC9b+Vmzi4BHRAAMetOiZo6ttu2MtqL4KGPBg== 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDAb+VmKltjIBAAHaCVsJxNKr9O4jS4Czuxkw== 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDEb+Vmm81YAxAA+4gJx/MBdLhHWXzG0Wn5SA== 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDHb+VmT/WFBhAAn8e6vf5SnMHPL9fIngTQUQ== 2024-09-14T11:13:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC7b+VmCvdVMhAAyQxC/BBlJdn3SUm3DX80oQ== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDNb+VmeYTFFhAAfOct1FcaTomesfX+FW1xfw== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDQb+VmfPC9JhAAFp1CaPPf1LPeorfycso8Jg== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDTb+VmYuq8KRAAznrO+gGvmkh+0zpjN1HGJA== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDWb+VmblWDOxAAZ0u6RoXPFunXllEeWDUk5g== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC7b+Vm6VTLNRAAW6xq49qlpBXG+XWxI/eCqA== 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-09-14T11:13:30.810 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC7b+VmSTPyORAAO2eWf/py/nceBF0kn3lIxg== 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC7b+Vmfhy+LRAAmsi/Gy+48oF1rczIgQ22ww== 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC9b+Vmzi4BHRAAMetOiZo6ttu2MtqL4KGPBg== 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDAb+VmKltjIBAAHaCVsJxNKr9O4jS4Czuxkw== 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-09-14T11:13:30.841 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDEb+Vmm81YAxAA+4gJx/MBdLhHWXzG0Wn5SA== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDHb+VmT/WFBhAAn8e6vf5SnMHPL9fIngTQUQ== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC7b+VmCvdVMhAAyQxC/BBlJdn3SUm3DX80oQ== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDNb+VmeYTFFhAAfOct1FcaTomesfX+FW1xfw== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQb+VmfPC9JhAAFp1CaPPf1LPeorfycso8Jg== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDTb+VmYuq8KRAAznrO+gGvmkh+0zpjN1HGJA== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDWb+VmblWDOxAAZ0u6RoXPFunXllEeWDUk5g== 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-09-14T11:13:30.842 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC7b+Vm6VTLNRAAW6xq49qlpBXG+XWxI/eCqA== 2024-09-14T11:13:30.843 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-09-14T11:13:30.843 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC7b+VmSTPyORAAO2eWf/py/nceBF0kn3lIxg== 2024-09-14T11:13:30.843 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:13:30.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:13:30.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:30.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.016 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.082 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.216 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:13:31.218 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:13:31.282 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.284 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.352 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.486 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.488 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:13:31.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:13:31.554 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:13:31.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:13:31.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:13:31.692 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:13:31.692 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:13:31.730 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:13:31.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:13:31.878 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:13:31.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:13:32.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:13:32.103 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:13:32.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:13:32.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:13:32.293 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:32.295 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:13:32.361 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:13:32.361 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:13:32.362 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:13:32.364 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:13:32.364 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:13:32.364 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:13:32.366 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:13:32.366 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:13:32.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:13:32.403 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:13:32.403 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:13:32.404 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:13:32.404 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:13:32.406 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:13:32.406 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:13:32.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:13:32.408 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:13:32.408 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:13:32.409 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:13:32.409 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:13:32.798 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-09-14T11:13:32.810 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:13:32.810 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:13:32.810 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:32.810 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:13:32.849 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:32.849 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:13:32.928 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:32.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:13:33.008 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:13:33.008 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:13:33.087 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:33.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:13:33.126 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:33.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:13:33.204 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:33.205 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:13:33.283 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-14T11:13:33.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:13:33.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 69b24cba-07e3-488d-9165-d9252455bb4e 0 2024-09-14T11:13:33.600 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-09-14T11:13:33.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1 1 2024-09-14T11:13:33.806 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-14T11:13:33.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 3bfb670b-c35c-4f4b-8784-63031ad32917 2 2024-09-14T11:13:34.017 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-09-14T11:13:34.028 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 46d5e363-d726-4e2b-9546-25fabe47cb70 3 2024-09-14T11:13:34.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-14T11:13:34.348+0000 7f631659c640 0 --2- 172.21.15.131:0/315138868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6318068f00 0x7f63181440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:13:34.428 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-09-14T11:13:34.440 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f6318ce5-62e1-4efa-a89c-c60c56eaa758 4 2024-09-14T11:13:34.638 INFO:teuthology.orchestra.run.smithi131.stdout:4 2024-09-14T11:13:34.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 40ebe9c1-15f5-4c34-a254-a0848dbb06e3 5 2024-09-14T11:13:34.847 INFO:teuthology.orchestra.run.smithi131.stdout:5 2024-09-14T11:13:34.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new b2d113ce-dff0-4150-92bd-8a71cbd7838f 6 2024-09-14T11:13:35.053 INFO:teuthology.orchestra.run.smithi131.stdout:6 2024-09-14T11:13:35.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new fcbd82ba-349b-4e8a-b912-4149d35fe84d 7 2024-09-14T11:13:35.260 INFO:teuthology.orchestra.run.smithi131.stdout:7 2024-09-14T11:13:35.272 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:13:35.272 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:13:35.274 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:13:35.274 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:13:35.275 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:13:35.277 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:13:35.277 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:13:35.277 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:13:35.279 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:13:35.279 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:13:35.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:13:35.281 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:13:35.281 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:13:35.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:13:35.283 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:13:35.283 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:13:35.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:13:35.285 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:13:35.286 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:13:35.286 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:13:35.287 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:13:35.288 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:13:35.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:13:35.290 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:13:35.290 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:35.496 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:35.496 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:35.258429+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:35.507 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:13:35.507 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:13:36.274 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-14T11:13:36.276+0000 7fd171618640 -1 Falling back to public interface 2024-09-14T11:13:36.313 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:36.485 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-14T11:13:36.486 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:35.258429+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:36.495 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:13:36.530 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-14T11:13:36.531+0000 7fd14aa1e640 -1 Falling back to public interface 2024-09-14T11:13:36.538 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-14T11:13:36.540+0000 7f0d25f45640 -1 Falling back to public interface 2024-09-14T11:13:36.797 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-14T11:13:36.798+0000 7f1148262640 -1 Falling back to public interface 2024-09-14T11:13:36.809 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-14T11:13:36.811+0000 7fd11a1fd640 -1 Falling back to public interface 2024-09-14T11:13:36.814 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-14T11:13:36.815+0000 7f24c0b25640 -1 Falling back to public interface 2024-09-14T11:13:37.030 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-14T11:13:37.032+0000 7ff7087d9640 -1 Falling back to public interface 2024-09-14T11:13:37.053 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-14T11:13:37.055+0000 7f447ca31640 -1 Falling back to public interface 2024-09-14T11:13:37.944 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-14T11:13:37.946+0000 7f460ad7d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:13:37.945 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-09-14T11:13:37.946+0000 7f460ad7d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:13:40.073 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-14T11:13:40.075+0000 7fd171618640 -1 osd.7 0 log_to_monitors true 2024-09-14T11:13:40.288 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-14T11:13:40.290+0000 7f0d25f45640 -1 osd.2 0 log_to_monitors true 2024-09-14T11:13:40.350 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-14T11:13:40.352+0000 7fd14aa1e640 -1 osd.6 0 log_to_monitors true 2024-09-14T11:13:40.662 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-14T11:13:40.663+0000 7fd11a1fd640 -1 osd.0 0 log_to_monitors true 2024-09-14T11:13:40.663 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-14T11:13:40.665+0000 7f24c0b25640 -1 osd.3 0 log_to_monitors true 2024-09-14T11:13:40.835 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-14T11:13:40.837+0000 7f1148262640 -1 osd.4 0 log_to_monitors true 2024-09-14T11:13:41.017 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-14T11:13:41.018+0000 7ff7087d9640 -1 osd.1 0 log_to_monitors true 2024-09-14T11:13:41.046 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-14T11:13:41.048+0000 7f447ca31640 -1 osd.5 0 log_to_monitors true 2024-09-14T11:13:42.865 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-14T11:13:42.866+0000 7fd1169a5640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:13:42.880 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-14T11:13:42.882+0000 7fd10dfb0640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:42.881 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-14T11:13:42.882+0000 7f24bcab9640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:13:42.896 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-14T11:13:42.898+0000 7f24b48d8640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:42.933 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-14T11:13:42.934+0000 7f0d21ed9640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:13:42.945 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-14T11:13:42.947+0000 7f0d19cf8640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:42.966 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-14T11:13:42.968+0000 7fd16cf81640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:13:43.102 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-09-14T11:13:43.104+0000 7fd164da0640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:43.301 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:43.559 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-14T11:13:43.560+0000 7ff704f81640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:13:43.573 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-14T11:13:43.574+0000 7ff6fc58c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:43.620 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-14T11:13:43.620 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":13,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:42.698817+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:43.632 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:13:44.010 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-14T11:13:44.012+0000 7fd14646d640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:13:44.021 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-09-14T11:13:44.023+0000 7fd13e28c640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:44.045 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-14T11:13:44.047+0000 7f44789c5640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:13:44.060 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-09-14T11:13:44.062+0000 7f44707e4640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:44.083 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-14T11:13:44.085+0000 7f1144a0a640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:13:44.097 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-09-14T11:13:44.099+0000 7f113c015640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:13:50.438 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:50.740 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-14T11:13:50.740 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":17,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:47.020150+0000","last_up_change":"2024-09-14T11:13:45.016880+0000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:13:44.957911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6809","nonce":1380065119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6811","nonce":1380065119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6815","nonce":1380065119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6813","nonce":1380065119}]},"public_addr":"172.21.15.94:6809/1380065119","cluster_addr":"172.21.15.94:6811/1380065119","heartbeat_back_addr":"172.21.15.94:6815/1380065119","heartbeat_front_addr":"172.21.15.94:6813/1380065119","state":["exists","up"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6825","nonce":3025939706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6827","nonce":3025939706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6831","nonce":3025939706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6829","nonce":3025939706}]},"public_addr":"172.21.15.94:6825/3025939706","cluster_addr":"172.21.15.94:6827/3025939706","heartbeat_back_addr":"172.21.15.94:6831/3025939706","heartbeat_front_addr":"172.21.15.94:6829/3025939706","state":["exists","up"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6801","nonce":3451614010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6803","nonce":3451614010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6807","nonce":3451614010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6805","nonce":3451614010}]},"public_addr":"172.21.15.94:6801/3451614010","cluster_addr":"172.21.15.94:6803/3451614010","heartbeat_back_addr":"172.21.15.94:6807/3451614010","heartbeat_front_addr":"172.21.15.94:6805/3451614010","state":["exists","up"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6817","nonce":3920654385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6819","nonce":3920654385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6823","nonce":3920654385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6821","nonce":3920654385}]},"public_addr":"172.21.15.94:6817/3920654385","cluster_addr":"172.21.15.94:6819/3920654385","heartbeat_back_addr":"172.21.15.94:6823/3920654385","heartbeat_front_addr":"172.21.15.94:6821/3920654385","state":["exists","up"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6817","nonce":3011823175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6819","nonce":3011823175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6823","nonce":3011823175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6821","nonce":3011823175}]},"public_addr":"172.21.15.131:6817/3011823175","cluster_addr":"172.21.15.131:6819/3011823175","heartbeat_back_addr":"172.21.15.131:6823/3011823175","heartbeat_front_addr":"172.21.15.131:6821/3011823175","state":["exists","up"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6827","nonce":3170580125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6829","nonce":3170580125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6833","nonce":3170580125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6831","nonce":3170580125}]},"public_addr":"172.21.15.131:6827/3170580125","cluster_addr":"172.21.15.131:6829/3170580125","heartbeat_back_addr":"172.21.15.131:6833/3170580125","heartbeat_front_addr":"172.21.15.131:6831/3170580125","state":["exists","up"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6809","nonce":340730180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6811","nonce":340730180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6815","nonce":340730180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6813","nonce":340730180}]},"public_addr":"172.21.15.131:6809/340730180","cluster_addr":"172.21.15.131:6811/340730180","heartbeat_back_addr":"172.21.15.131:6815/340730180","heartbeat_front_addr":"172.21.15.131:6813/340730180","state":["exists","up"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6801","nonce":2577403967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6803","nonce":2577403967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6807","nonce":2577403967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6805","nonce":2577403967}]},"public_addr":"172.21.15.131:6801/2577403967","cluster_addr":"172.21.15.131:6803/2577403967","heartbeat_back_addr":"172.21.15.131:6807/2577403967","heartbeat_front_addr":"172.21.15.131:6805/2577403967","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.623890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.022312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.331272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.651698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.848409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.086848+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.338391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.068013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:50.752 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:13:50.752 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:13:50.752 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:13:52.035 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'rbd' created 2024-09-14T11:13:52.052 DEBUG:teuthology.orchestra.run.smithi094:> rbd --cluster ceph pool init rbd 2024-09-14T11:13:52.113 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:52.113 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:55.065 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:13:55.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:13:55.067 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:13:55.378 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:55.391 INFO:teuthology.orchestra.run.smithi094.stdout:[{"version":9,"timestamp":"2024-09-14T11:13:44.086985+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5592.459220"}]}] 2024-09-14T11:13:55.392 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:13:55.392 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:13:55.392 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:13:55.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:13:55.739 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:55.749 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":513960180},{"type":"v1","addr":"172.21.15.131:6825","nonce":513960180}]},"active_addr":"172.21.15.131:6825/513960180","active_change":"2024-09-14T11:13:36.933637+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":2591965087}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1082511590}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":4223015145}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1596122578}]}]} 2024-09-14T11:13:55.753 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:13:55.754 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:13:55.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:56.053 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:56.053 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:55.049540+0000","last_up_change":"2024-09-14T11:13:45.016880+0000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:13:44.957911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:13:51.059126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6809","nonce":1380065119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6811","nonce":1380065119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6815","nonce":1380065119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6813","nonce":1380065119}]},"public_addr":"172.21.15.94:6809/1380065119","cluster_addr":"172.21.15.94:6811/1380065119","heartbeat_back_addr":"172.21.15.94:6815/1380065119","heartbeat_front_addr":"172.21.15.94:6813/1380065119","state":["exists","up"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6825","nonce":3025939706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6827","nonce":3025939706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6831","nonce":3025939706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6829","nonce":3025939706}]},"public_addr":"172.21.15.94:6825/3025939706","cluster_addr":"172.21.15.94:6827/3025939706","heartbeat_back_addr":"172.21.15.94:6831/3025939706","heartbeat_front_addr":"172.21.15.94:6829/3025939706","state":["exists","up"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6801","nonce":3451614010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6803","nonce":3451614010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6807","nonce":3451614010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6805","nonce":3451614010}]},"public_addr":"172.21.15.94:6801/3451614010","cluster_addr":"172.21.15.94:6803/3451614010","heartbeat_back_addr":"172.21.15.94:6807/3451614010","heartbeat_front_addr":"172.21.15.94:6805/3451614010","state":["exists","up"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6817","nonce":3920654385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6819","nonce":3920654385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6823","nonce":3920654385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6821","nonce":3920654385}]},"public_addr":"172.21.15.94:6817/3920654385","cluster_addr":"172.21.15.94:6819/3920654385","heartbeat_back_addr":"172.21.15.94:6823/3920654385","heartbeat_front_addr":"172.21.15.94:6821/3920654385","state":["exists","up"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6817","nonce":3011823175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6819","nonce":3011823175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6823","nonce":3011823175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6821","nonce":3011823175}]},"public_addr":"172.21.15.131:6817/3011823175","cluster_addr":"172.21.15.131:6819/3011823175","heartbeat_back_addr":"172.21.15.131:6823/3011823175","heartbeat_front_addr":"172.21.15.131:6821/3011823175","state":["exists","up"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6827","nonce":3170580125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6829","nonce":3170580125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6833","nonce":3170580125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6831","nonce":3170580125}]},"public_addr":"172.21.15.131:6827/3170580125","cluster_addr":"172.21.15.131:6829/3170580125","heartbeat_back_addr":"172.21.15.131:6833/3170580125","heartbeat_front_addr":"172.21.15.131:6831/3170580125","state":["exists","up"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6809","nonce":340730180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6811","nonce":340730180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6815","nonce":340730180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6813","nonce":340730180}]},"public_addr":"172.21.15.131:6809/340730180","cluster_addr":"172.21.15.131:6811/340730180","heartbeat_back_addr":"172.21.15.131:6815/340730180","heartbeat_front_addr":"172.21.15.131:6813/340730180","state":["exists","up"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6801","nonce":2577403967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6803","nonce":2577403967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6807","nonce":2577403967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6805","nonce":2577403967}]},"public_addr":"172.21.15.131:6801/2577403967","cluster_addr":"172.21.15.131:6803/2577403967","heartbeat_back_addr":"172.21.15.131:6807/2577403967","heartbeat_front_addr":"172.21.15.131:6805/2577403967","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.623890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.022312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.331272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.651698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.848409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.086848+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.338391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.068013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:56.066 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:13:56.066 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:13:56.365 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:56.365 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:13:55.049540+0000","last_up_change":"2024-09-14T11:13:45.016880+0000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:13:44.957911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:13:51.059126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6809","nonce":1380065119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6811","nonce":1380065119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6815","nonce":1380065119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6813","nonce":1380065119}]},"public_addr":"172.21.15.94:6809/1380065119","cluster_addr":"172.21.15.94:6811/1380065119","heartbeat_back_addr":"172.21.15.94:6815/1380065119","heartbeat_front_addr":"172.21.15.94:6813/1380065119","state":["exists","up"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6825","nonce":3025939706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6827","nonce":3025939706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6831","nonce":3025939706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6829","nonce":3025939706}]},"public_addr":"172.21.15.94:6825/3025939706","cluster_addr":"172.21.15.94:6827/3025939706","heartbeat_back_addr":"172.21.15.94:6831/3025939706","heartbeat_front_addr":"172.21.15.94:6829/3025939706","state":["exists","up"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6801","nonce":3451614010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6803","nonce":3451614010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6807","nonce":3451614010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6805","nonce":3451614010}]},"public_addr":"172.21.15.94:6801/3451614010","cluster_addr":"172.21.15.94:6803/3451614010","heartbeat_back_addr":"172.21.15.94:6807/3451614010","heartbeat_front_addr":"172.21.15.94:6805/3451614010","state":["exists","up"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6817","nonce":3920654385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6819","nonce":3920654385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6823","nonce":3920654385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6821","nonce":3920654385}]},"public_addr":"172.21.15.94:6817/3920654385","cluster_addr":"172.21.15.94:6819/3920654385","heartbeat_back_addr":"172.21.15.94:6823/3920654385","heartbeat_front_addr":"172.21.15.94:6821/3920654385","state":["exists","up"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6817","nonce":3011823175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6819","nonce":3011823175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6823","nonce":3011823175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6821","nonce":3011823175}]},"public_addr":"172.21.15.131:6817/3011823175","cluster_addr":"172.21.15.131:6819/3011823175","heartbeat_back_addr":"172.21.15.131:6823/3011823175","heartbeat_front_addr":"172.21.15.131:6821/3011823175","state":["exists","up"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6827","nonce":3170580125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6829","nonce":3170580125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6833","nonce":3170580125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6831","nonce":3170580125}]},"public_addr":"172.21.15.131:6827/3170580125","cluster_addr":"172.21.15.131:6829/3170580125","heartbeat_back_addr":"172.21.15.131:6833/3170580125","heartbeat_front_addr":"172.21.15.131:6831/3170580125","state":["exists","up"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6809","nonce":340730180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6811","nonce":340730180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6815","nonce":340730180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6813","nonce":340730180}]},"public_addr":"172.21.15.131:6809/340730180","cluster_addr":"172.21.15.131:6811/340730180","heartbeat_back_addr":"172.21.15.131:6815/340730180","heartbeat_front_addr":"172.21.15.131:6813/340730180","state":["exists","up"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6801","nonce":2577403967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6803","nonce":2577403967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6807","nonce":2577403967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6805","nonce":2577403967}]},"public_addr":"172.21.15.131:6801/2577403967","cluster_addr":"172.21.15.131:6803/2577403967","heartbeat_back_addr":"172.21.15.131:6807/2577403967","heartbeat_front_addr":"172.21.15.131:6805/2577403967","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.623890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.022312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.331272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.651698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.848409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.086848+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.338391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.068013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:13:56.378 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:13:56.378 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:13:56.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:13:56.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:13:56.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:13:56.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:13:56.380 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:13:56.381 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:13:56.627 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-09-14T11:13:56.627 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:13:56.636 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-09-14T11:13:56.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:13:56.637 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-14T11:13:56.637 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:13:56.642 INFO:teuthology.orchestra.run.smithi094.stdout:64424509445 2024-09-14T11:13:56.642 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:13:56.643 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:56.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:13:56.644 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:56.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:13:56.649 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:56.649 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:13:56.650 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-09-14T11:13:56.651 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:13:57.204 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-09-14T11:13:57.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-14T11:13:57.224 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.247 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-14T11:13:57.253 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-09-14T11:13:57.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-14T11:13:57.266 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-14T11:13:57.272 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.272 INFO:teuthology.orchestra.run.smithi094.stdout:64424509445 2024-09-14T11:13:57.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-14T11:13:57.286 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.311 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-09-14T11:13:57.311 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:57.316 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:57.326 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-14T11:13:57.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-14T11:13:57.332 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-14T11:13:57.333 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-14T11:13:57.333 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-14T11:13:57.340 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:57.340 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:13:57.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:13:57.679 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:57.680 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:13:57.692 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:13:57.469845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239852,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734868,"statfs":{"total":773094113280,"available":772848504832,"internally_reserved":0,"allocated":2867200,"data_stored":1750462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443870+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:13:55.443870+0000","last_peered":"2024-09-14T11:13:55.443870+0000","last_clean":"2024-09-14T11:13:55.443870+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:13:55.443870+0000","last_undegraded":"2024-09-14T11:13:55.443870+0000","last_fullsized":"2024-09-14T11:13:55.443870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.056337+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:13:55.056337+0000","last_peered":"2024-09-14T11:13:55.056337+0000","last_clean":"2024-09-14T11:13:55.056337+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:13:55.056337+0000","last_undegraded":"2024-09-14T11:13:55.056337+0000","last_fullsized":"2024-09-14T11:13:55.056337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443775+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:13:55.443775+0000","last_peered":"2024-09-14T11:13:55.443775+0000","last_clean":"2024-09-14T11:13:55.443775+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:13:55.443775+0000","last_undegraded":"2024-09-14T11:13:55.443775+0000","last_fullsized":"2024-09-14T11:13:55.443775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.056300+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:13:55.056300+0000","last_peered":"2024-09-14T11:13:55.056300+0000","last_clean":"2024-09-14T11:13:55.056300+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:13:55.056300+0000","last_undegraded":"2024-09-14T11:13:55.056300+0000","last_fullsized":"2024-09-14T11:13:55.056300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.062807+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:13:55.062807+0000","last_peered":"2024-09-14T11:13:55.062807+0000","last_clean":"2024-09-14T11:13:55.062807+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:13:55.062807+0000","last_undegraded":"2024-09-14T11:13:55.062807+0000","last_fullsized":"2024-09-14T11:13:55.062807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.235321+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:13:55.235321+0000","last_peered":"2024-09-14T11:13:55.235321+0000","last_clean":"2024-09-14T11:13:55.235321+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:13:55.235321+0000","last_undegraded":"2024-09-14T11:13:55.235321+0000","last_fullsized":"2024-09-14T11:13:55.235321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443837+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:13:55.443837+0000","last_peered":"2024-09-14T11:13:55.443837+0000","last_clean":"2024-09-14T11:13:55.443837+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:13:55.443837+0000","last_undegraded":"2024-09-14T11:13:55.443837+0000","last_fullsized":"2024-09-14T11:13:55.443837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.061443+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:13:55.061443+0000","last_peered":"2024-09-14T11:13:55.061443+0000","last_clean":"2024-09-14T11:13:55.061443+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:13:55.061443+0000","last_undegraded":"2024-09-14T11:13:55.061443+0000","last_fullsized":"2024-09-14T11:13:55.061443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443597+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:13:55.443597+0000","last_peered":"2024-09-14T11:13:55.443597+0000","last_clean":"2024-09-14T11:13:55.443597+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:13:55.443597+0000","last_undegraded":"2024-09-14T11:13:55.443597+0000","last_fullsized":"2024-09-14T11:13:55.443597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:13:57.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:13:57.988 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:57.989 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:13:58.000 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:13:57.469845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239852,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734868,"statfs":{"total":773094113280,"available":772848504832,"internally_reserved":0,"allocated":2867200,"data_stored":1750462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443870+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:13:55.443870+0000","last_peered":"2024-09-14T11:13:55.443870+0000","last_clean":"2024-09-14T11:13:55.443870+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:13:55.443870+0000","last_undegraded":"2024-09-14T11:13:55.443870+0000","last_fullsized":"2024-09-14T11:13:55.443870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.056337+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:13:55.056337+0000","last_peered":"2024-09-14T11:13:55.056337+0000","last_clean":"2024-09-14T11:13:55.056337+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:13:55.056337+0000","last_undegraded":"2024-09-14T11:13:55.056337+0000","last_fullsized":"2024-09-14T11:13:55.056337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443775+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:13:55.443775+0000","last_peered":"2024-09-14T11:13:55.443775+0000","last_clean":"2024-09-14T11:13:55.443775+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:13:55.443775+0000","last_undegraded":"2024-09-14T11:13:55.443775+0000","last_fullsized":"2024-09-14T11:13:55.443775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.056300+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:13:55.056300+0000","last_peered":"2024-09-14T11:13:55.056300+0000","last_clean":"2024-09-14T11:13:55.056300+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:13:55.056300+0000","last_undegraded":"2024-09-14T11:13:55.056300+0000","last_fullsized":"2024-09-14T11:13:55.056300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.062807+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:13:55.062807+0000","last_peered":"2024-09-14T11:13:55.062807+0000","last_clean":"2024-09-14T11:13:55.062807+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:13:55.062807+0000","last_undegraded":"2024-09-14T11:13:55.062807+0000","last_fullsized":"2024-09-14T11:13:55.062807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.235321+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:13:55.235321+0000","last_peered":"2024-09-14T11:13:55.235321+0000","last_clean":"2024-09-14T11:13:55.235321+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:13:55.235321+0000","last_undegraded":"2024-09-14T11:13:55.235321+0000","last_fullsized":"2024-09-14T11:13:55.235321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443837+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:13:55.443837+0000","last_peered":"2024-09-14T11:13:55.443837+0000","last_clean":"2024-09-14T11:13:55.443837+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:13:55.443837+0000","last_undegraded":"2024-09-14T11:13:55.443837+0000","last_fullsized":"2024-09-14T11:13:55.443837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.061443+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:13:55.061443+0000","last_peered":"2024-09-14T11:13:55.061443+0000","last_clean":"2024-09-14T11:13:55.061443+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:13:55.061443+0000","last_undegraded":"2024-09-14T11:13:55.061443+0000","last_fullsized":"2024-09-14T11:13:55.061443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:13:55.443597+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:13:55.443597+0000","last_peered":"2024-09-14T11:13:55.443597+0000","last_clean":"2024-09-14T11:13:55.443597+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:13:55.443597+0000","last_undegraded":"2024-09-14T11:13:55.443597+0000","last_fullsized":"2024-09-14T11:13:55.443597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:13:58.001 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:13:58.001 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:13:58.001 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:13:58.001 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:13:58.340 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:13:58.340 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:13:58.353 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:13:58.353 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:13:58.367 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T11:13:58.367 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:13:58.395 DEBUG:teuthology.orchestra.run.smithi094:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T11:13:58.551 INFO:teuthology.orchestra.run.smithi094.stderr:..........+..........+.....+.+......+...+......+.....+.......+............+.....+.......+...+++++++++++++++++++++++++++++++++++++++++++++*..+...+...+..............+...+++++++++++++++++++++++++++++++++++++++++++++*..........+......+....+........+...+....+......+...+.....+.........+.......+++++ 2024-09-14T11:13:58.726 INFO:teuthology.orchestra.run.smithi094.stderr:......+..+.+..+..................+..........+++++++++++++++++++++++++++++++++++++++++++++*..+..........+++++++++++++++++++++++++++++++++++++++++++++*.......................+.....+.+......+...........+....+......+...+.....+.........+......+.......+...............+...+..............+.+......+..................+...........+..........+.....+.........+...+...+....+.....+...+...+..........+..+.........+...............+................+...+.........+...+..+...............+..........+..+.+.........+...........+.......+..+......+...................+........+...+.......+..+.+..............+....+..+.......+...+..+......+......+....+.................+....+.......................+...+...+.........+...............+.+............+.........+...+...+........+......+.+.....+...............+...+.+.........+..+++++ 2024-09-14T11:13:58.741 INFO:teuthology.orchestra.run.smithi094.stderr:----- 2024-09-14T11:13:58.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:13:58.785 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-ca-trust 2024-09-14T11:13:59.892 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:13:59.921 DEBUG:teuthology.orchestra.run.smithi094:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi094.front.sepia.ceph.com 2024-09-14T11:14:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:....+.........+..+..........+.....+.........+.......+.........+...+..+++++++++++++++++++++++++++++++++++++++*....+.+......+..+.+..+....+...+...+........+......+......+...+.+++++++++++++++++++++++++++++++++++++++*.....................+..+.+....................+...+.......+.....+.......+......+..............+......+.+...+..+...+............+.........+....+...+........+............+.......+..+.+...++++++ 2024-09-14T11:14:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:...+........+....+.....+....+...........+.+..+...+++++++++++++++++++++++++++++++++++++++*..+++++++++++++++++++++++++++++++++++++++*......+...............+.........+...+........+.+........+......+...............+....+........+..........+............+..+.........+....+...+...+......+.........+......+.....+...+...+..........+..+...........................+..........+........+...+....+...+.....+.+.........+...+..+............+.+...+..+...+....+..+......+...+..........+.....+............+.........+...+...+....+.........+.....++++++ 2024-09-14T11:14:00.041 INFO:teuthology.orchestra.run.smithi094.stderr:----- 2024-09-14T11:14:00.041 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:14:00.041 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:14:00.111 DEBUG:teuthology.orchestra.run.smithi094:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:14:00.188 INFO:teuthology.orchestra.run.smithi094.stderr:Certificate request self-signature ok 2024-09-14T11:14:00.188 INFO:teuthology.orchestra.run.smithi094.stderr:subject=CN=smithi094.front.sepia.ceph.com 2024-09-14T11:14:00.195 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:14:00.265 DEBUG:teuthology.orchestra.run.smithi094:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:14:00.336 INFO:teuthology.orchestra.run.smithi094.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T11:14:00.336 DEBUG:teuthology.orchestra.run.smithi094:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:14:00.405 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:14:00.419 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-14T11:14:00.419 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:14:00.419 INFO:tasks.rgw:Creating data pools 2024-09-14T11:14:00.419 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:14:00.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-14T11:14:01.097 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T11:14:03.093 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:14:03.118 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:14:04.098 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:14:04.128 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:14:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:14:05.127 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:14:06.110 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:14:06.140 DEBUG:tasks.rgw:Pools created 2024-09-14T11:14:06.140 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:14:06.140 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:14:06.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:14:06.141 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:14:06.260 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:06.260 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:08.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.170+0000 7f1760faf640 0 -- 172.21.15.94:0/2310025436 >> [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] conn(0x7f163c077140 msgr2=0x7f163c079600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:08.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.174+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.175+0000 7f1760faf640 0 -- 172.21.15.94:0/2286316331 >> [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] conn(0x7f1628077230 msgr2=0x7f16280796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:08.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:08.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 realm 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:08.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.176+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.177+0000 7f1764b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:08.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.177+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.177+0000 7f1764b25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:14:08.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.177+0000 7f1764b25800 20 searching for the correct realm 2024-09-14T11:14:08.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:14:08.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:14:08.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.188+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:08.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 zone default found 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 4 Realm: () 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:08.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 zonegroup default 2024-09-14T11:14:08.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.189+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:08.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.190+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:08.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:08.190+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:10.151+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:10.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:10.152+0000 7f1764b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:10.153+0000 7f1764b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:10.154+0000 7f1764b25800 20 started sync module instance, tier type = 2024-09-14T11:14:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:10.154+0000 7f1764b25800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:14:12.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=0 2024-09-14T11:14:12.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=1 2024-09-14T11:14:12.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=2 2024-09-14T11:14:12.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=3 2024-09-14T11:14:12.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=4 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=5 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.172+0000 7f1764b25800 20 add_watcher() i=6 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.173+0000 7f1764b25800 20 add_watcher() i=7 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.173+0000 7f1764b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.173+0000 7f1764b25800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.173+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:14:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.173+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:14:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:14:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:14:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.174+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:14:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:14:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.175+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.176+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:14:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.177+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:14:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.178+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:14:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.179+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:14:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:14:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:14:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:14:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.180+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:14:12.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.181+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:14:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.182+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:14:12.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.183+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:14:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.184+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:14:12.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:14:12.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.185+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:14:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.186+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.187+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.188+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:14:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:14:12.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:14:12.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.189+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:14:12.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.190+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.191+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:14:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.192+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.193+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.194+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:14:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.195+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:14:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.196+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:14:12.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:14:12.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.197+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:14:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.198+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.199+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:14:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.200+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.201+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:14:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.202+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:14:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.203+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:14:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.204+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:14:12.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.205+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.206+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.206+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.206+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.206+0000 7f1764b25800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.206+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.207+0000 7f1764b25800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:14:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.213+0000 7f16127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.213+0000 7f1764b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:12.213+0000 7f1764b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.144+0000 7f1764b25800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:14:15.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.144+0000 7f1764b25800 5 note: GC not initialized 2024-09-14T11:14:15.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.145+0000 7f1764b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.145+0000 7f1764b25800 20 Filter name: none 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.145+0000 7f16117e2640 20 reqs_thread_entry: start 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.145+0000 7f157affd640 20 reqs_thread_entry: start 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.169+0000 7f16127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.172+0000 7f1764b25800 20 remove_watcher() i=0 2024-09-14T11:14:15.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.172+0000 7f1764b25800 2 removed watcher, disabling cache 2024-09-14T11:14:15.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.173+0000 7f1764b25800 20 remove_watcher() i=1 2024-09-14T11:14:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.174+0000 7f1764b25800 20 remove_watcher() i=2 2024-09-14T11:14:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.178+0000 7f1764b25800 20 remove_watcher() i=3 2024-09-14T11:14:15.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.179+0000 7f1764b25800 20 remove_watcher() i=4 2024-09-14T11:14:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.180+0000 7f1764b25800 20 remove_watcher() i=5 2024-09-14T11:14:15.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.181+0000 7f1764b25800 20 remove_watcher() i=6 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.182+0000 7f1764b25800 20 remove_watcher() i=7 2024-09-14T11:14:15.284 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-14T11:14:15.284 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:14:15.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:14:15.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:14:15.285 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:14:15.350 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.350 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.377+0000 7f7c42e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.377+0000 7f7c42e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.381+0000 7f7a8effd640 20 reqs_thread_entry: start 2024-09-14T11:14:15.395 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"3aea5d71-db92-43f3-82b7-23225f4a0092","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:14:15.395 DEBUG:tasks.util.rgw: json result: {'id': '3aea5d71-db92-43f3-82b7-23225f4a0092', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:14:15.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:14:15.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:14:15.396 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.485+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 20 realm 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.487+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.488+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.488+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.488+0000 7ff7d211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.488+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.489+0000 7ff7d211f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:14:15.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.489+0000 7ff7d211f800 20 searching for the correct realm 2024-09-14T11:14:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.491+0000 7ff7cdd8b640 0 -- 172.21.15.94:0/3238843783 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7ff7bc003cb0 msgr2=0x7ff7c8025920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.495+0000 7ff7cdd8b640 0 -- 172.21.15.94:0/3238843783 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7ff6980849b0 msgr2=0x7ff698086dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.501+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 zone default found 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 4 Realm: () 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 zonegroup default 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.502+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.503+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.503+0000 7ff7d211f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.503+0000 7ff7d211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.503+0000 7ff7d211f800 20 started sync module instance, tier type = 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.503+0000 7ff7d211f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=0 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=1 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=2 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=3 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=4 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=5 2024-09-14T11:14:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.513+0000 7ff7d211f800 20 add_watcher() i=6 2024-09-14T11:14:15.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.514+0000 7ff7d211f800 20 add_watcher() i=7 2024-09-14T11:14:15.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.514+0000 7ff7d211f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.515+0000 7ff67f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff7d211f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff7d211f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff7d211f800 5 note: GC not initialized 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff67e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff7d211f800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:15.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff7d211f800 20 Filter name: none 2024-09-14T11:14:15.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.516+0000 7ff5effff640 20 reqs_thread_entry: start 2024-09-14T11:14:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.526+0000 7ff67f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.528+0000 7ff7d211f800 20 remove_watcher() i=0 2024-09-14T11:14:15.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.528+0000 7ff7d211f800 2 removed watcher, disabling cache 2024-09-14T11:14:15.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.529+0000 7ff7d211f800 20 remove_watcher() i=1 2024-09-14T11:14:15.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.530+0000 7ff7d211f800 20 remove_watcher() i=2 2024-09-14T11:14:15.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.531+0000 7ff7d211f800 20 remove_watcher() i=3 2024-09-14T11:14:15.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.532+0000 7ff7d211f800 20 remove_watcher() i=4 2024-09-14T11:14:15.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.533+0000 7ff7d211f800 20 remove_watcher() i=5 2024-09-14T11:14:15.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.534+0000 7ff7d211f800 20 remove_watcher() i=6 2024-09-14T11:14:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.535+0000 7ff7d211f800 20 remove_watcher() i=7 2024-09-14T11:14:15.544 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-14T11:14:15.544 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:14:15.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:14:15.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:14:15.544 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T11:14:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.633+0000 7fa422413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.633+0000 7fa422413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.637+0000 7fa253fff640 20 reqs_thread_entry: start 2024-09-14T11:14:15.650 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"3aea5d71-db92-43f3-82b7-23225f4a0092","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:14:15.650 DEBUG:tasks.util.rgw: json result: {'id': '3aea5d71-db92-43f3-82b7-23225f4a0092', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:14:15.651 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T11:14:15.651 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p /tmp/rgw_datacache 2024-09-14T11:14:15.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T11:14:15.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:14:15.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:14:15.758 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:14:15.854 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.854 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.888+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 realm 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.890+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.891+0000 7f3b4612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.891+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.892+0000 7f3b4612c800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:14:15.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.892+0000 7f3b4612c800 20 searching for the correct realm 2024-09-14T11:14:15.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.895+0000 7f3b42650640 0 -- 172.21.15.94:0/225482753 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55b674559dd0 msgr2=0x55b67455c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.899+0000 7f3b41e4f640 0 -- 172.21.15.94:0/225482753 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f3b38075850 msgr2=0x7f3b3806c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.903+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 zone default found 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 4 Realm: () 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 zonegroup default 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.904+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.905+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.905+0000 7f3b4612c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.905+0000 7f3b4612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.905+0000 7f3b4612c800 20 started sync module instance, tier type = 2024-09-14T11:14:15.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.905+0000 7f3b4612c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=0 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=1 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=2 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=3 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=4 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=5 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.915+0000 7f3b4612c800 20 add_watcher() i=6 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.916+0000 7f3b4612c800 20 add_watcher() i=7 2024-09-14T11:14:15.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.916+0000 7f3b4612c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f39f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3b4612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3b4612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3b4612c800 5 note: GC not initialized 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f39f27fc640 20 reqs_thread_entry: start 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3b4612c800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3b4612c800 20 Filter name: none 2024-09-14T11:14:15.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.918+0000 7f3963fff640 20 reqs_thread_entry: start 2024-09-14T11:14:15.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.928+0000 7f39f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.930+0000 7f3b4612c800 20 remove_watcher() i=0 2024-09-14T11:14:15.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.930+0000 7f3b4612c800 2 removed watcher, disabling cache 2024-09-14T11:14:15.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.931+0000 7f3b4612c800 20 remove_watcher() i=1 2024-09-14T11:14:15.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.932+0000 7f3b4612c800 20 remove_watcher() i=2 2024-09-14T11:14:15.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.934+0000 7f3b4612c800 20 remove_watcher() i=3 2024-09-14T11:14:15.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.934+0000 7f3b4612c800 20 remove_watcher() i=4 2024-09-14T11:14:15.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.935+0000 7f3b4612c800 20 remove_watcher() i=5 2024-09-14T11:14:15.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.936+0000 7f3b4612c800 20 remove_watcher() i=6 2024-09-14T11:14:15.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:15.937+0000 7f3b4612c800 20 remove_watcher() i=7 2024-09-14T11:14:15.946 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-14T11:14:15.946 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:14:15.946 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:14:15.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:14:15.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:14:15.947 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:14:16.009 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:16.009 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.036+0000 7f1477013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.036+0000 7f1477013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.039+0000 7f13357e2640 20 reqs_thread_entry: start 2024-09-14T11:14:16.052 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:14:16.052 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:14:16.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:14:16.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:14:16.052 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:14:16.117 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:16.117 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:16.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.145+0000 7efd3ad35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.145+0000 7efd3ad35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.148+0000 7efbe4ff9640 20 reqs_thread_entry: start 2024-09-14T11:14:16.163 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"3aea5d71-db92-43f3-82b7-23225f4a0092","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:14:16.163 DEBUG:tasks.util.rgw: json result: {'id': '3aea5d71-db92-43f3-82b7-23225f4a0092', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:14:16.163 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:14:16.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:14:16.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:14:16.163 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:14:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:16.225 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:16.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.252+0000 7faab4d36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.252+0000 7faab4d36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.255+0000 7fa8f6ffd640 20 reqs_thread_entry: start 2024-09-14T11:14:16.270 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:14:16.270 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:14:16.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:14:16.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:14:16.270 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:14:16.334 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:16.335 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:16.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.361+0000 7f64e232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.361+0000 7f64e232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:14:16.365+0000 7f6313fff640 20 reqs_thread_entry: start 2024-09-14T11:14:16.378 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"3aea5d71-db92-43f3-82b7-23225f4a0092","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:14:16.379 DEBUG:tasks.util.rgw: json result: {'id': '3aea5d71-db92-43f3-82b7-23225f4a0092', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:14:16.379 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:14:16.379 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-14T11:14:16.379 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:14:16.379 DEBUG:teuthology.orchestra.run.smithi094:> sudo echo -n https://smithi094.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:14:16.418 INFO:teuthology.orchestra.run.smithi094.stdout:https://smithi094.front.sepia.ceph.com:443 2024-09-14T11:14:16.419 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:14:16.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo keytool -import -alias smithi094.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T11:14:16.699 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T11:14:16.847 INFO:teuthology.orchestra.run.smithi094.stderr:Certificate was added to keystore 2024-09-14T11:14:16.870 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:14:16.870 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:14:16.873 INFO:tasks.rgw.client.0:Started 2024-09-14T11:14:16.873 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi094.front.sepia.ceph.com:443/ 2024-09-14T11:14:16.873 DEBUG:teuthology.orchestra.run.smithi094:> curl https://smithi094.front.sepia.ceph.com:443/ 2024-09-14T11:14:16.910 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:14:16.911 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:14:16.911 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:14:16.911 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:14:16.911 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 443: Connection refused 2024-09-14T11:14:17.310 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-14T11:14:17.312+0000 7f7fa62f1880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T11:14:17.911 DEBUG:teuthology.orchestra.run.smithi094:> curl https://smithi094.front.sepia.ceph.com:443/ 2024-09-14T11:14:17.945 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:14:17.945 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:14:17.996 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3666 0 --:--:-- --:--:-- --:--:-- 3666 2024-09-14T11:14:17.997 INFO:teuthology.orchestra.run.smithi094.stdout:anonymous 2024-09-14T11:14:17.998 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:14:18.008 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:14:18.008 DEBUG:teuthology.orchestra.run.smithi094:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:14:20.405 DEBUG:teuthology.orchestra.run.smithi094:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:14:20.919 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting tox==3.15.0 2024-09-14T11:14:20.967 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:14:21.116 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:14:21.130 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:14:21.227 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:14:21.242 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:14:21.504 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:14:21.519 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:14:21.759 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:14:21.772 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:14:21.877 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting packaging>=14 2024-09-14T11:14:21.891 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:14:21.968 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting toml>=0.9.4 2024-09-14T11:14:21.982 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:14:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:14:22.081 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:14:22.228 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:14:22.242 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:14:22.324 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:14:22.339 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:14:22.465 INFO:teuthology.orchestra.run.smithi094.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T11:14:23.572 INFO:teuthology.orchestra.run.smithi094.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:14:23.795 INFO:teuthology.orchestra.run.smithi094.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T11:14:23.795 INFO:teuthology.orchestra.run.smithi094.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T11:14:23.855 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:14:23.873 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:23.873 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:14:23.873 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:23.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:14:23.902 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:14:23.902 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:23.970 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:23.970 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:14:24.039 INFO:tasks.workunit:timeout=3h 2024-09-14T11:14:24.039 INFO:tasks.workunit:cleanup=True 2024-09-14T11:14:24.039 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:24.108 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:15:20.598 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.599 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:15:20.600 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:15:20.601 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:15:20.679 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:15:20.681 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:20.681 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:15:21.281 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:15:21.343 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:15:21.382 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:21.383 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:21.384 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:15:21.421 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:21.425 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:15:21.425 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:15:21.494 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T11:15:21.495 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T11:15:21.495 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:15:21.568 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:15:21.568 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:21.568 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:15:23.930 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:15:23.931 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-14T11:15:24.162 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:15:24.342 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-14T11:15:24.392 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:15:24.540 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-14T11:15:24.541 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-14T11:15:24.541 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:15:24.688 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:15:24.694 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:15:25.419 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-14T11:15:25.657 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install configobj 2024-09-14T11:15:26.035 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting configobj 2024-09-14T11:15:26.075 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T11:15:26.184 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six (from configobj) 2024-09-14T11:15:26.198 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:15:26.263 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T11:15:26.334 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:15:26.398 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: six, configobj 2024-09-14T11:15:26.507 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T11:15:26.552 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T11:15:26.584 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T11:15:26.584 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T11:15:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T11:15:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:26.586 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 44933/radosgw \ntcp6 0 0 :::443 :::* LISTEN 44933/radosgw \n' 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:radosgw port: 443 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T11:15:26.657 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:26.657 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'' 2024-09-14T11:15:26.657 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T11:15:26.763594Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T11:15:26.763583Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:Creating s3cmd config... 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:proto for s3cmd config is https 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:s3cmd config written 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T11:15:26.979 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:26.980 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T11:15:26.980 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T11:15:27.250 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:27.251 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 80.61 MB/s) [1 of 1]\n" 2024-09-14T11:15:27.251 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T11:15:27.461 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:27.461 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 185.14 MB/s)\n" 2024-09-14T11:15:27.461 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T11:15:27.782 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:27.782 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "62c50a29702838a0ffbe1ecd100a2723",\n "tag": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1521609558413457889",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".P_C6iuX1ntIzKHHRrn_Tmuva5zVf1Nk_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "bucket_id": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "bucket_id": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".P_C6iuX1ntIzKHHRrn_Tmuva5zVf1Nk_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340228,\n "stripe_size": 1048772,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "bucket_id": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".P_C6iuX1ntIzKHHRrn_Tmuva5zVf1Nk_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T11:15:27.234396Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1521609558413457889",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726312526/ctime:1726312526/gid:1333/gname:ubuntu/md5:62c50a29702838a0ffbe1ecd100a2723/mode:33188/mtime:1726312526/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T11:15:27.783 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:Cached object name is: .P_C6iuX1ntIzKHHRrn_Tmuva5zVf1Nk_ 2024-09-14T11:15:27.783 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T11:15:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-14T11:15:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'0\n' 2024-09-14T11:15:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T11:15:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T11:15:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:Completed Datacache tests 2024-09-14T11:15:27.801 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-14T11:15:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-14T11:15:27.803 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-14T11:15:27.803 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:27.804 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:27.883 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T11:15:27.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:15:28.214 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:28.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:15:28.254 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:15:28.254 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:28.329 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:15:28.329 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:15:28.339 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:28.339 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:15:28.339 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:28.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:15:28.397 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:15:28.398 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:28.466 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:28.467 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:15:28.536 INFO:tasks.workunit:timeout=3h 2024-09-14T11:15:28.536 INFO:tasks.workunit:cleanup=True 2024-09-14T11:15:28.536 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:28.605 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.353 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:35.354 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:16:35.355 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:16:35.424 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:16:35.629 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:16:35.721 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:16:35.760 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:35.762 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:35.762 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:16:35.801 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:35.804 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:16:35.937 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:16:35.967 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:16:35.968 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:16:35.969 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:16:36.040 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:16:36.041 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:36.041 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:16:38.324 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:16:38.325 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:16:38.325 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:16:38.325 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-14T11:16:38.326 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-14T11:16:38.327 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:38.327 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:16:38.327 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-14T11:16:38.550 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:16:38.731 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-14T11:16:38.737 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:16:38.781 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-14T11:16:38.781 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-14T11:16:38.781 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:16:38.929 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:16:38.934 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:16:39.659 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-14T11:16:39.709 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-14T11:16:40.541 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-14T11:16:40.596 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:16:41.199 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:16:41.213 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:16:41.332 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:16:41.345 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:16:41.471 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:16:41.486 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:16:41.615 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:41.628 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:16:41.783 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:41.796 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:16:42.005 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:42.006 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:16:42.023 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:16:42.105 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:16:42.328 INFO:tasks.workunit.client.0.smithi094.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 58.6 MB/s eta 0:00:00 2024-09-14T11:16:42.342 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:16:42.407 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:16:42.490 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:16:42.558 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:16:42.613 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:16:42.686 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:16:43.712 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:16:43.830 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:16:43.967 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:16:44.003 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:44.003 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:44.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.042+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 realm 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.043+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.044+0000 7f7660746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:44.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.044+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.045+0000 7f7660746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:44.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.045+0000 7f7660746800 20 searching for the correct realm 2024-09-14T11:16:44.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.048+0000 7f7657fff640 0 -- 172.21.15.94:0/2258552317 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f7650060240 msgr2=0x7f7650087a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:44.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.051+0000 7f765e237640 0 -- 172.21.15.94:0/2258552317 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f7648027420 msgr2=0x7f76480278a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.257+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 zone default found 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 4 Realm: () 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 zonegroup default 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.258+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 started sync module instance, tier type = 2024-09-14T11:16:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.259+0000 7f7660746800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=0 2024-09-14T11:16:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=1 2024-09-14T11:16:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=2 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=3 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=4 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=5 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.269+0000 7f7660746800 20 add_watcher() i=6 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.270+0000 7f7660746800 20 add_watcher() i=7 2024-09-14T11:16:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.270+0000 7f7660746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:44.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7660746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7660746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7660746800 5 note: GC not initialized 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f748f7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7660746800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f7660746800 20 Filter name: none 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.272+0000 7f748d7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:16:44.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:16:44.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:16:44.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:16:44.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.273+0000 7f7660746800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.277+0000 7f7660746800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.277+0000 7f7660746800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.277+0000 7f7660746800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.278+0000 7f7541ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724545 cookie 93825302510528 notifier 4571 bl.length()=593 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.278+0000 7f7541ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:16:44.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.278+0000 7f7541ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7660746800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7660746800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7660746800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7541ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 93825302501600 notifier 4571 bl.length()=186 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7541ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:16:44.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.280+0000 7f7541ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:16:44.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.281+0000 7f7514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:44.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.283+0000 7f7660746800 20 remove_watcher() i=0 2024-09-14T11:16:44.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.283+0000 7f7660746800 2 removed watcher, disabling cache 2024-09-14T11:16:44.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.285+0000 7f7660746800 20 remove_watcher() i=1 2024-09-14T11:16:44.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.286+0000 7f7660746800 20 remove_watcher() i=2 2024-09-14T11:16:44.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.287+0000 7f7660746800 20 remove_watcher() i=3 2024-09-14T11:16:44.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.288+0000 7f7660746800 20 remove_watcher() i=4 2024-09-14T11:16:44.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.289+0000 7f7660746800 20 remove_watcher() i=5 2024-09-14T11:16:44.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.290+0000 7f7660746800 20 remove_watcher() i=6 2024-09-14T11:16:44.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.291+0000 7f7660746800 20 remove_watcher() i=7 2024-09-14T11:16:44.444 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.444 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.490 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.490 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.535 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.535 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.550 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.551 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.565 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.565 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.568 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.568 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.577 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.577 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.580 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.580 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.584 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.584 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.600 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.601 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.604 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.604 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.618 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.618 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.622 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.622 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.636 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.636 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.640 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.640 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.654 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:44.654 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:16:44.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:44.658 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:16:44.689 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:44.690 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:44.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.728+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 realm 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.729+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.730+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:44.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.730+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.730+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:44.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.730+0000 7fecfc4bb800 20 searching for the correct realm 2024-09-14T11:16:44.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.733+0000 7fecf97a4640 0 -- 172.21.15.94:0/2355846483 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fecec0c8bd0 msgr2=0x7fecec057aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:44.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.737+0000 7fecf9fa5640 0 -- 172.21.15.94:0/2355846483 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fecf0085bb0 msgr2=0x7fecf0067c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:44.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:44.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:44.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:44.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.943+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:44.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:44.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 zone default found 2024-09-14T11:16:44.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 4 Realm: () 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 zonegroup default 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.944+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 started sync module instance, tier type = 2024-09-14T11:16:44.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.945+0000 7fecfc4bb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:44.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=0 2024-09-14T11:16:44.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=1 2024-09-14T11:16:44.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=2 2024-09-14T11:16:44.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=3 2024-09-14T11:16:44.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=4 2024-09-14T11:16:44.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=5 2024-09-14T11:16:44.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.955+0000 7fecfc4bb800 20 add_watcher() i=6 2024-09-14T11:16:44.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.956+0000 7fecfc4bb800 20 add_watcher() i=7 2024-09-14T11:16:44.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.956+0000 7fecfc4bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:44.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7febab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7fecfc4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7fecfc4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7fecfc4bb800 5 note: GC not initialized 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7febaa7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7fecfc4bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.958+0000 7fecfc4bb800 20 Filter name: none 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7feb1bfff640 20 reqs_thread_entry: start 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:44.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.959+0000 7fecfc4bb800 20 rados->read ofs=0 len=0 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:44.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:44.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.960+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:44.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.961+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:44.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.962+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:44.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.962+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:44.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.963+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:44.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.963+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:44.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.964+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:44.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.964+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:44.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.965+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:44.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.965+0000 7fecfc4bb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:44.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.970+0000 7febab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:44.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.973+0000 7fecfc4bb800 20 remove_watcher() i=0 2024-09-14T11:16:44.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.973+0000 7fecfc4bb800 2 removed watcher, disabling cache 2024-09-14T11:16:44.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.974+0000 7fecfc4bb800 20 remove_watcher() i=1 2024-09-14T11:16:44.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.975+0000 7fecfc4bb800 20 remove_watcher() i=2 2024-09-14T11:16:44.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.976+0000 7fecfc4bb800 20 remove_watcher() i=3 2024-09-14T11:16:44.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.977+0000 7fecfc4bb800 20 remove_watcher() i=4 2024-09-14T11:16:44.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.978+0000 7fecfc4bb800 20 remove_watcher() i=5 2024-09-14T11:16:44.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.979+0000 7fecfc4bb800 20 remove_watcher() i=6 2024-09-14T11:16:44.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:44.980+0000 7fecfc4bb800 20 remove_watcher() i=7 2024-09-14T11:16:44.990 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:16:45.019 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:45.019 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:45.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.056+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 realm 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.058+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.059+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:45.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.059+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.059+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:45.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.059+0000 7ff05920e800 20 searching for the correct realm 2024-09-14T11:16:45.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.062+0000 7ff04ffff640 0 -- 172.21.15.94:0/2823907704 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff0480cc070 msgr2=0x7ff0480bf450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:45.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.066+0000 7ff0549bc640 0 -- 172.21.15.94:0/2823907704 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7ff040025920 msgr2=0x7ff040024400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.272+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 zone default found 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 4 Realm: () 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 zonegroup default 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.273+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 started sync module instance, tier type = 2024-09-14T11:16:45.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.274+0000 7ff05920e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:45.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=0 2024-09-14T11:16:45.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=1 2024-09-14T11:16:45.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=2 2024-09-14T11:16:45.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=3 2024-09-14T11:16:45.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=4 2024-09-14T11:16:45.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=5 2024-09-14T11:16:45.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.285+0000 7ff05920e800 20 add_watcher() i=6 2024-09-14T11:16:45.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.286+0000 7ff05920e800 20 add_watcher() i=7 2024-09-14T11:16:45.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.286+0000 7ff05920e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7fef0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7ff05920e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7ff05920e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7ff05920e800 5 note: GC not initialized 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7fef09fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7ff05920e800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7ff05920e800 20 Filter name: none 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.288+0000 7fee7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:45.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:45.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.289+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.290+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.290+0000 7ff05920e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.290+0000 7ff05920e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:45.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.290+0000 7ff05920e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:45.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.292+0000 7fef0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:45.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.294+0000 7ff05920e800 20 remove_watcher() i=0 2024-09-14T11:16:45.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.294+0000 7ff05920e800 2 removed watcher, disabling cache 2024-09-14T11:16:45.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.295+0000 7ff05920e800 20 remove_watcher() i=1 2024-09-14T11:16:45.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.296+0000 7ff05920e800 20 remove_watcher() i=2 2024-09-14T11:16:45.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.297+0000 7ff05920e800 20 remove_watcher() i=3 2024-09-14T11:16:45.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.298+0000 7ff05920e800 20 remove_watcher() i=4 2024-09-14T11:16:45.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.299+0000 7ff05920e800 20 remove_watcher() i=5 2024-09-14T11:16:45.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.300+0000 7ff05920e800 20 remove_watcher() i=6 2024-09-14T11:16:45.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.301+0000 7ff05920e800 20 remove_watcher() i=7 2024-09-14T11:16:45.310 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 86, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:16:45.310 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:16:45.310 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:45.311 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:16:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:45.344 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:45.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.382+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 20 realm 2024-09-14T11:16:45.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:45.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.384+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.385+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.385+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.385+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:45.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.385+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.386+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:45.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.386+0000 7f6d4c122800 20 searching for the correct realm 2024-09-14T11:16:45.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.389+0000 7f6d475ad640 0 -- 172.21.15.94:0/662128166 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x556541fa24f0 msgr2=0x556541fa4990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:45.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.393+0000 7f6d475ad640 0 -- 172.21.15.94:0/662128166 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f6d38042430 msgr2=0x7f6d38042850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:45.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:45.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 zone default found 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 4 Realm: () 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 zonegroup default 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.397+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:45.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 started sync module instance, tier type = 2024-09-14T11:16:45.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.398+0000 7f6d4c122800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:45.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=0 2024-09-14T11:16:45.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=1 2024-09-14T11:16:45.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=2 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=3 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=4 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=5 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.409+0000 7f6d4c122800 20 add_watcher() i=6 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.410+0000 7f6d4c122800 20 add_watcher() i=7 2024-09-14T11:16:45.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.410+0000 7f6d4c122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6d4c122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6d4c122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6d4c122800 5 note: GC not initialized 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6bfcfe1640 20 reqs_thread_entry: start 2024-09-14T11:16:45.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6d4c122800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6d4c122800 20 Filter name: none 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.412+0000 7f6b767fc640 20 reqs_thread_entry: start 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:45.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:45.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:45.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:45.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.413+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.414+0000 7f6d4c122800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.414+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:16:45.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:45.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:16:45.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.415+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:45.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.416+0000 7f6d4c122800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:16:45.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.416+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:45.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.416+0000 7f6d4c122800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:16:45.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.416+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:45.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.417+0000 7f6d4c122800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:16:45.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.417+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:45.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.417+0000 7f6d4c122800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.417+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.418+0000 7f6d4c122800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.418+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.418+0000 7f6d4c122800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.418+0000 7f6d4c122800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.419+0000 7f6d4c122800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:16:45.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.419+0000 7f6d4c122800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:16:45.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.420+0000 7f6bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:45.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.422+0000 7f6d4c122800 20 remove_watcher() i=0 2024-09-14T11:16:45.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.422+0000 7f6d4c122800 2 removed watcher, disabling cache 2024-09-14T11:16:45.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.423+0000 7f6d4c122800 20 remove_watcher() i=1 2024-09-14T11:16:45.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.424+0000 7f6d4c122800 20 remove_watcher() i=2 2024-09-14T11:16:45.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.429+0000 7f6d4c122800 20 remove_watcher() i=3 2024-09-14T11:16:45.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.430+0000 7f6d4c122800 20 remove_watcher() i=4 2024-09-14T11:16:45.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.431+0000 7f6d4c122800 20 remove_watcher() i=5 2024-09-14T11:16:45.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.432+0000 7f6d4c122800 20 remove_watcher() i=6 2024-09-14T11:16:45.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:45.433+0000 7f6d4c122800 20 remove_watcher() i=7 2024-09-14T11:16:45.444 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:16:45.828 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:16:47.224 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:47.224 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:47.285 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:47.287 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:16:47.322 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:47.322 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:47.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.369+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 realm 2024-09-14T11:16:47.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:47.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.371+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.372+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.373+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:47.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.373+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.373+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:47.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.373+0000 7f533e140800 20 searching for the correct realm 2024-09-14T11:16:47.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.376+0000 7f53396bf640 0 -- 172.21.15.94:0/2099264865 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f532c03f400 msgr2=0x7f532c03f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:47.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.381+0000 7f5339ec0640 0 -- 172.21.15.94:0/2099264865 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f533009e960 msgr2=0x7f53300723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:47.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:47.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:47.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.588+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 zone default found 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 4 Realm: () 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 zonegroup default 2024-09-14T11:16:47.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.589+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.590+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.590+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.590+0000 7f533e140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.590+0000 7f533e140800 20 started sync module instance, tier type = 2024-09-14T11:16:47.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.590+0000 7f533e140800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=0 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=1 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=2 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=3 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=4 2024-09-14T11:16:47.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=5 2024-09-14T11:16:47.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.604+0000 7f533e140800 20 add_watcher() i=6 2024-09-14T11:16:47.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.605+0000 7f533e140800 20 add_watcher() i=7 2024-09-14T11:16:47.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.605+0000 7f533e140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:47.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.607+0000 7f51eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:47.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:47.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:47.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 5 note: GC not initialized 2024-09-14T11:16:47.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f51ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:47.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:47.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 20 Filter name: none 2024-09-14T11:16:47.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f515bfff640 20 reqs_thread_entry: start 2024-09-14T11:16:47.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.608+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.609+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.609+0000 7f533e140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 INFO: main: starting shard=0 2024-09-14T11:16:47.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 INFO: main: starting shard=1 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.610+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 INFO: main: starting shard=2 2024-09-14T11:16:47.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 INFO: main: starting shard=3 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.611+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.612+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.612+0000 7f533e140800 20 INFO: main: starting shard=4 2024-09-14T11:16:47.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.612+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 INFO: main: starting shard=5 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 INFO: main: starting shard=6 2024-09-14T11:16:47.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.613+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:47.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 INFO: main: starting shard=7 2024-09-14T11:16:47.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:47.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 INFO: main: starting shard=8 2024-09-14T11:16:47.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.614+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:47.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.615+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:16:47.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.615+0000 7f533e140800 20 INFO: main: starting shard=9 2024-09-14T11:16:47.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.615+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:47.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.616+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.616+0000 7f533e140800 20 INFO: main: starting shard=10 2024-09-14T11:16:47.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.616+0000 7f533e140800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:47.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.616+0000 7f533e140800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:47.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.616+0000 7f533e140800 20 INFO: main: done 2024-09-14T11:16:47.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.617+0000 7f51eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:47.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.620+0000 7f533e140800 20 remove_watcher() i=0 2024-09-14T11:16:47.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.620+0000 7f533e140800 2 removed watcher, disabling cache 2024-09-14T11:16:47.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.621+0000 7f533e140800 20 remove_watcher() i=1 2024-09-14T11:16:47.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.622+0000 7f533e140800 20 remove_watcher() i=2 2024-09-14T11:16:47.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.624+0000 7f533e140800 20 remove_watcher() i=3 2024-09-14T11:16:47.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.625+0000 7f533e140800 20 remove_watcher() i=4 2024-09-14T11:16:47.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.626+0000 7f533e140800 20 remove_watcher() i=5 2024-09-14T11:16:47.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.627+0000 7f533e140800 20 remove_watcher() i=6 2024-09-14T11:16:47.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.628+0000 7f533e140800 20 remove_watcher() i=7 2024-09-14T11:16:47.642 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:47.642 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:47.646 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:47.646 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:47.700 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:47.702 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:16:47.735 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:47.735 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:47.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.775+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 realm 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.777+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.778+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:47.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.778+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.778+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:47.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.778+0000 7fde52d39800 20 searching for the correct realm 2024-09-14T11:16:47.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.781+0000 7fde47fff640 0 -- 172.21.15.94:0/388315601 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fde40017050 msgr2=0x7fde40072390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:47.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.784+0000 7fde4ea25640 0 -- 172.21.15.94:0/388315601 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fde3801c910 msgr2=0x7fde380383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:47.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:47.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.991+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 zone default found 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 4 Realm: () 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 zonegroup default 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.992+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:47.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.993+0000 7fde52d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:47.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.993+0000 7fde52d39800 20 started sync module instance, tier type = 2024-09-14T11:16:47.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:47.993+0000 7fde52d39800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=0 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=1 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=2 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=3 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=4 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=5 2024-09-14T11:16:48.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.003+0000 7fde52d39800 20 add_watcher() i=6 2024-09-14T11:16:48.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.004+0000 7fde52d39800 20 add_watcher() i=7 2024-09-14T11:16:48.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.004+0000 7fde52d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:48.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.005+0000 7fdd057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:48.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:48.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 5 note: GC not initialized 2024-09-14T11:16:48.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fdc7ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:48.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:48.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 Filter name: none 2024-09-14T11:16:48.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fdc7dffb640 20 reqs_thread_entry: start 2024-09-14T11:16:48.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.006+0000 7fde52d39800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.007+0000 7fde52d39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.007+0000 7fde52d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.007+0000 7fde52d39800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.007+0000 7fde52d39800 20 INFO: main: starting shard=0 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.007+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 INFO: main: starting shard=1 2024-09-14T11:16:48.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 INFO: main: starting shard=2 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.008+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 INFO: main: starting shard=3 2024-09-14T11:16:48.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 INFO: main: starting shard=4 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.009+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 INFO: main: starting shard=5 2024-09-14T11:16:48.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 INFO: main: starting shard=6 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.010+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 INFO: main: starting shard=7 2024-09-14T11:16:48.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 INFO: main: starting shard=8 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.011+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 INFO: main: starting shard=9 2024-09-14T11:16:48.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:48.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 INFO: main: starting shard=10 2024-09-14T11:16:48.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.012+0000 7fde52d39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:48.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.013+0000 7fde52d39800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.013+0000 7fde52d39800 20 INFO: main: done 2024-09-14T11:16:48.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.014+0000 7fdd057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.016+0000 7fde52d39800 20 remove_watcher() i=0 2024-09-14T11:16:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.016+0000 7fde52d39800 2 removed watcher, disabling cache 2024-09-14T11:16:48.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.017+0000 7fde52d39800 20 remove_watcher() i=1 2024-09-14T11:16:48.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.019+0000 7fde52d39800 20 remove_watcher() i=2 2024-09-14T11:16:48.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.020+0000 7fde52d39800 20 remove_watcher() i=3 2024-09-14T11:16:48.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.021+0000 7fde52d39800 20 remove_watcher() i=4 2024-09-14T11:16:48.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.022+0000 7fde52d39800 20 remove_watcher() i=5 2024-09-14T11:16:48.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.023+0000 7fde52d39800 20 remove_watcher() i=6 2024-09-14T11:16:48.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.024+0000 7fde52d39800 20 remove_watcher() i=7 2024-09-14T11:16:48.034 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:48.034 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:48.038 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:48.038 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:48.090 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:48.092 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:16:48.121 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:48.122 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:48.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.161+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 realm 2024-09-14T11:16:48.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.163+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.164+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:48.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.164+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.164+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:48.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.164+0000 7fb320c63800 20 searching for the correct realm 2024-09-14T11:16:48.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.167+0000 7fb31ef55640 0 -- 172.21.15.94:0/1577279183 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fb30808b060 msgr2=0x7fb3080b5930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:48.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.170+0000 7fb31e754640 0 -- 172.21.15.94:0/1577279183 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb3080ade70 msgr2=0x7fb3080b7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.375+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 zone default found 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 4 Realm: () 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 zonegroup default 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.376+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 started sync module instance, tier type = 2024-09-14T11:16:48.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.377+0000 7fb320c63800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=0 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=1 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=2 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=3 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=4 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=5 2024-09-14T11:16:48.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.386+0000 7fb320c63800 20 add_watcher() i=6 2024-09-14T11:16:48.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.387+0000 7fb320c63800 20 add_watcher() i=7 2024-09-14T11:16:48.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.387+0000 7fb320c63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:48.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb1d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb320c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb320c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb320c63800 5 note: GC not initialized 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb14f7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb320c63800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.389+0000 7fb320c63800 20 Filter name: none 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb14d7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:48.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 INFO: main: starting shard=0 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.390+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 INFO: main: starting shard=1 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 INFO: main: starting shard=2 2024-09-14T11:16:48.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.391+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.392+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.392+0000 7fb320c63800 20 INFO: main: starting shard=3 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.392+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 INFO: main: starting shard=4 2024-09-14T11:16:48.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 INFO: main: starting shard=5 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.393+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 INFO: main: starting shard=6 2024-09-14T11:16:48.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 INFO: main: starting shard=7 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.394+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: starting shard=8 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: starting shard=9 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 INFO: main: starting shard=10 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.395+0000 7fb320c63800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.396+0000 7fb320c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.396+0000 7fb320c63800 20 INFO: main: done 2024-09-14T11:16:48.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.397+0000 7fb1d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.399+0000 7fb320c63800 20 remove_watcher() i=0 2024-09-14T11:16:48.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.399+0000 7fb320c63800 2 removed watcher, disabling cache 2024-09-14T11:16:48.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.400+0000 7fb320c63800 20 remove_watcher() i=1 2024-09-14T11:16:48.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.401+0000 7fb320c63800 20 remove_watcher() i=2 2024-09-14T11:16:48.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.403+0000 7fb320c63800 20 remove_watcher() i=3 2024-09-14T11:16:48.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.404+0000 7fb320c63800 20 remove_watcher() i=4 2024-09-14T11:16:48.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.405+0000 7fb320c63800 20 remove_watcher() i=5 2024-09-14T11:16:48.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.406+0000 7fb320c63800 20 remove_watcher() i=6 2024-09-14T11:16:48.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.407+0000 7fb320c63800 20 remove_watcher() i=7 2024-09-14T11:16:48.417 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:48.417 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:48.421 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:48.421 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:48.472 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:48.474 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:16:48.504 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:48.504 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:48.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.542+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 realm 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.543+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.544+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:48.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.544+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.544+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:48.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.544+0000 7fb87ffad800 20 searching for the correct realm 2024-09-14T11:16:48.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.548+0000 7fb87e298640 0 -- 172.21.15.94:0/3034909009 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x56490dfed2e0 msgr2=0x56490dfef710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:48.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.551+0000 7fb87da97640 0 -- 172.21.15.94:0/3034909009 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb86807db70 msgr2=0x7fb868063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:48.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:48.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.555+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 zone default found 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 4 Realm: () 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:48.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 zonegroup default 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 started sync module instance, tier type = 2024-09-14T11:16:48.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.556+0000 7fb87ffad800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:48.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=0 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=1 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=2 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=3 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=4 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=5 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.565+0000 7fb87ffad800 20 add_watcher() i=6 2024-09-14T11:16:48.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.566+0000 7fb87ffad800 20 add_watcher() i=7 2024-09-14T11:16:48.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.566+0000 7fb87ffad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:48.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb72f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb87ffad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb87ffad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb87ffad800 5 note: GC not initialized 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb72e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb87ffad800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.568+0000 7fb87ffad800 20 Filter name: none 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb69ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:48.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:48.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 rados->read ofs=0 len=0 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 INFO: main: starting shard=0 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.569+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 INFO: main: starting shard=1 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 INFO: main: starting shard=2 2024-09-14T11:16:48.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.570+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 INFO: main: starting shard=3 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 INFO: main: starting shard=4 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.571+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:48.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 INFO: main: starting shard=5 2024-09-14T11:16:48.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:48.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 INFO: main: starting shard=6 2024-09-14T11:16:48.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.572+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:48.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.573+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.573+0000 7fb87ffad800 20 INFO: main: starting shard=7 2024-09-14T11:16:48.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.573+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 INFO: main: starting shard=8 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 INFO: main: starting shard=9 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.574+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.575+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.575+0000 7fb87ffad800 20 INFO: main: starting shard=10 2024-09-14T11:16:48.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.575+0000 7fb87ffad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:48.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.575+0000 7fb87ffad800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:48.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.575+0000 7fb87ffad800 20 INFO: main: done 2024-09-14T11:16:48.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.576+0000 7fb72f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.579+0000 7fb87ffad800 20 remove_watcher() i=0 2024-09-14T11:16:48.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.579+0000 7fb87ffad800 2 removed watcher, disabling cache 2024-09-14T11:16:48.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.580+0000 7fb87ffad800 20 remove_watcher() i=1 2024-09-14T11:16:48.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.582+0000 7fb87ffad800 20 remove_watcher() i=2 2024-09-14T11:16:48.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.583+0000 7fb87ffad800 20 remove_watcher() i=3 2024-09-14T11:16:48.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.584+0000 7fb87ffad800 20 remove_watcher() i=4 2024-09-14T11:16:48.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.585+0000 7fb87ffad800 20 remove_watcher() i=5 2024-09-14T11:16:48.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.586+0000 7fb87ffad800 20 remove_watcher() i=6 2024-09-14T11:16:48.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:48.587+0000 7fb87ffad800 20 remove_watcher() i=7 2024-09-14T11:16:48.597 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:48.597 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:48.601 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:16:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:16:49.378 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:16:49.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:49.379 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:16:49.411 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:49.411 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:49.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.451+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 realm 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.452+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.453+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:49.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.453+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.453+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:49.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.453+0000 7ff6a9975800 20 searching for the correct realm 2024-09-14T11:16:49.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.455+0000 7ff6a745f640 0 -- 172.21.15.94:0/4177201710 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7ff6a0090150 msgr2=0x7ff6a0062070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:49.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.661+0000 7ff6a7c60640 0 -- 172.21.15.94:0/4177201710 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ff6900235e0 msgr2=0x7ff6900416b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.666+0000 7ff6a9975800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.666+0000 7ff6a9975800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.666+0000 7ff6a9975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.666+0000 7ff6a9975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:49.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:49.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 zone default found 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 4 Realm: () 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 zonegroup default 2024-09-14T11:16:49.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.667+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 started sync module instance, tier type = 2024-09-14T11:16:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.668+0000 7ff6a9975800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=0 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=1 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=2 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=3 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=4 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=5 2024-09-14T11:16:49.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=6 2024-09-14T11:16:49.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 20 add_watcher() i=7 2024-09-14T11:16:49.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.679+0000 7ff6a9975800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:49.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.681+0000 7ff55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:49.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 5 note: GC not initialized 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff55cfe1640 20 reqs_thread_entry: start 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 20 Filter name: none 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff4d67fc640 20 reqs_thread_entry: start 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:49.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.682+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:49.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:49.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:49.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.683+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.684+0000 7ff6a9975800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:16:49.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.684+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:49.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.685+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:49.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.685+0000 7ff6a9975800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:16:49.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.685+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:49.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.686+0000 7ff6a9975800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:16:49.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.686+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:49.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.686+0000 7ff6a9975800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:16:49.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.686+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:49.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.687+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:49.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.688+0000 7ff6a9975800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:16:49.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.688+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:49.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.688+0000 7ff6a9975800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:16:49.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.688+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:49.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.689+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:49.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.689+0000 7ff6a9975800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:16:49.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.689+0000 7ff6a9975800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:49.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.690+0000 7ff6a9975800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:16:49.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.690+0000 7ff6a9975800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:16:49.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.690+0000 7ff6a9975800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:16:49.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.690+0000 7ff6a9975800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:16:49.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.690+0000 7ff6a9975800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:16:49.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.691+0000 7ff55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:49.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.693+0000 7ff6a9975800 20 remove_watcher() i=0 2024-09-14T11:16:49.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.693+0000 7ff6a9975800 2 removed watcher, disabling cache 2024-09-14T11:16:49.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.695+0000 7ff6a9975800 20 remove_watcher() i=1 2024-09-14T11:16:49.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.696+0000 7ff6a9975800 20 remove_watcher() i=2 2024-09-14T11:16:49.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.697+0000 7ff6a9975800 20 remove_watcher() i=3 2024-09-14T11:16:49.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.698+0000 7ff6a9975800 20 remove_watcher() i=4 2024-09-14T11:16:49.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.699+0000 7ff6a9975800 20 remove_watcher() i=5 2024-09-14T11:16:49.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.700+0000 7ff6a9975800 20 remove_watcher() i=6 2024-09-14T11:16:49.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.701+0000 7ff6a9975800 20 remove_watcher() i=7 2024-09-14T11:16:49.712 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: unlinked entries are not listable 2024-09-14T11:16:49.713 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:49.713 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:49.713 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:49.718 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:16:49.718 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:49.720 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:49.721 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:49.765 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:49.807 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:16:49.807 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:49.809 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:16:49.843 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:49.843 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:49.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.882+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 20 realm 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.883+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.884+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:49.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.884+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.885+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:49.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.885+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:49.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.885+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:49.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.885+0000 7f7b36092800 20 searching for the correct realm 2024-09-14T11:16:49.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:49.889+0000 7f7b3437d640 0 -- 172.21.15.94:0/4242209322 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f7b280a5070 msgr2=0x7f7b280af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:50.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.097+0000 7f7b33b7c640 0 -- 172.21.15.94:0/4242209322 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x560d63ab83f0 msgr2=0x560d63aba820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.100+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 zone default found 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 4 Realm: () 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 zonegroup default 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 started sync module instance, tier type = 2024-09-14T11:16:50.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.101+0000 7f7b36092800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=0 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=1 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=2 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=3 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=4 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=5 2024-09-14T11:16:50.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.112+0000 7f7b36092800 20 add_watcher() i=6 2024-09-14T11:16:50.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.113+0000 7f7b36092800 20 add_watcher() i=7 2024-09-14T11:16:50.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.113+0000 7f7b36092800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:50.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.114+0000 7f79e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 5 note: GC not initialized 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f79e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 20 Filter name: none 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f79627fc640 20 reqs_thread_entry: start 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:50.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.115+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:50.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.116+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.117+0000 7f7b36092800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.117+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.118+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:50.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.118+0000 7f7b36092800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:16:50.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.118+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:50.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.119+0000 7f7b36092800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:16:50.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.119+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:50.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.120+0000 7f7b36092800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:16:50.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.120+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.120+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:50.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.121+0000 7f7b36092800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:16:50.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.121+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:50.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.121+0000 7f7b36092800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:16:50.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.121+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.122+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:50.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.122+0000 7f7b36092800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:16:50.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.122+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.123+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.123+0000 7f7b36092800 20 get_obj_state: octx=0x560d63829380 obj=check-bucket:e state=0x560d63aedab8 s->prefetch_data=0 2024-09-14T11:16:50.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.123+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 get_obj_state: octx=0x560d638519e0 obj=check-bucket:d state=0x560d63af0878 s->prefetch_data=0 2024-09-14T11:16:50.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 get_obj_state: octx=0x560d63aece30 obj=check-bucket:c state=0x560d63b8b248 s->prefetch_data=0 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 get_obj_state: octx=0x560d63af11f0 obj=check-bucket:f state=0x560d63aea778 s->prefetch_data=0 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to mb2hkcd7qev8okjoeu99whhe7k6yy81m 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 get_obj_state_impl: setting s->olh_tag to it0e5qst4q5uexr914uh0ky2mq26zfhz 2024-09-14T11:16:50.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.124+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=it0e5qst4q5uexr914uh0ky2mq26zfhz 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to ylj1aapuvkjwdiok3axatnfsusyhq5sd 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state_impl: setting s->olh_tag to l2enuv9mdylkhyncx9f0twnjr891r7h6 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l2enuv9mdylkhyncx9f0twnjr891r7h6 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to rmu4mec479xhvgeb048sk8us2ifw43p8 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state_impl: setting s->olh_tag to o9h8xdxv0dlsp2wmzhg43uh13sx94zp5 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o9h8xdxv0dlsp2wmzhg43uh13sx94zp5 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to ss3la70tb7sg0r7akg29vcw13a39sd3w 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 get_obj_state_impl: setting s->olh_tag to 2jdaa4tbjn0wuo0g923wod416tt8636x 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.125+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2jdaa4tbjn0wuo0g923wod416tt8636x 2024-09-14T11:16:50.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.126+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.127+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.127+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.128+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.128+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 olh_log_entry: epoch=3 op=3 key=d[dejrDMazutDPTdpgUS7tuPQYxivBHtN] 2024-09-14T11:16:50.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 get_obj_state: octx=0x560d638519e0 obj=check-bucket:_:dejrDMazutDPTdpgUS7tuPQYxivBHtN_d state=0x560d63ba6038 s->prefetch_data=0 2024-09-14T11:16:50.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 10 manifest: total_size = 12 2024-09-14T11:16:50.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10210341203169511846 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 get_obj_state: octx=0x560d638519e0 obj=check-bucket:_:dejrDMazutDPTdpgUS7tuPQYxivBHtN_d state=0x560d63ba6038 s->prefetch_data=0 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 prepare_atomic_modification: state is not atomic. state=0x560d63ba6038 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.129+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 olh_log_entry: epoch=3 op=3 key=c[XyMDH8Y2CcDexVw4N.6uJImv-JNvidA] 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: octx=0x560d63aece30 obj=check-bucket:_:XyMDH8Y2CcDexVw4N.6uJImv-JNvidA_c state=0x560d63b9e4a8 s->prefetch_data=0 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 olh_log_entry: epoch=2 op=3 key=e[jUqFXDeJacSS3D03TGn7clCLh3o5BR5] 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: octx=0x560d63829380 obj=check-bucket:_:jUqFXDeJacSS3D03TGn7clCLh3o5BR5_e state=0x560d63bb4748 s->prefetch_data=0 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 10 manifest: total_size = 22 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2661421344243487723 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: octx=0x560d63aece30 obj=check-bucket:_:XyMDH8Y2CcDexVw4N.6uJImv-JNvidA_c state=0x560d63b9e4a8 s->prefetch_data=0 2024-09-14T11:16:50.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 prepare_atomic_modification: state is not atomic. state=0x560d63b9e4a8 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 10 manifest: total_size = 11 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2846874572042392568 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 get_obj_state: octx=0x560d63829380 obj=check-bucket:_:jUqFXDeJacSS3D03TGn7clCLh3o5BR5_e state=0x560d63bb4748 s->prefetch_data=0 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 prepare_atomic_modification: state is not atomic. state=0x560d63bb4748 2024-09-14T11:16:50.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.130+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 olh_log_entry: epoch=2 op=3 key=f[rZ4NmVlSOLQLvnge479PsZmaJhcmd95] 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 get_obj_state: octx=0x560d63af11f0 obj=check-bucket:_:rZ4NmVlSOLQLvnge479PsZmaJhcmd95_f state=0x560d63bbfc38 s->prefetch_data=0 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 10 manifest: total_size = 22 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4487262019738464545 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 get_obj_state: octx=0x560d63af11f0 obj=check-bucket:_:rZ4NmVlSOLQLvnge479PsZmaJhcmd95_f state=0x560d63bbfc38 s->prefetch_data=0 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 prepare_atomic_modification: state is not atomic. state=0x560d63bbfc38 2024-09-14T11:16:50.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.131+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.134+0000 7f7b36092800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:50.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.134+0000 7f7b36092800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:50.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.134+0000 7f7b36092800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:50.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.134+0000 7f7b36092800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:XyMDH8Y2CcDexVw4N.6uJImv-JNvidA_.nKMXu56vd9tBfSn_8tYvcy-QWeOBpu0_0 2024-09-14T11:16:50.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.136+0000 7f7a12ffd640 20 handle_completion(): completion ok for obj=c[XyMDH8Y2CcDexVw4N.6uJImv-JNvidA] 2024-09-14T11:16:50.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:50.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:16:50.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:dejrDMazutDPTdpgUS7tuPQYxivBHtN_.EoBGScmW9mtokUkumobHiJyFT5ZgtQ0_0 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.137+0000 7f7b36092800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:jUqFXDeJacSS3D03TGn7clCLh3o5BR5_.Tz24J50KLYUFKOz9cCsMTOeoY_lxJOq_0 2024-09-14T11:16:50.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.138+0000 7f7b36092800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:50.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.139+0000 7f7b36092800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:50.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.139+0000 7f7b36092800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:50.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.139+0000 7f7b36092800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:50.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.139+0000 7f7b36092800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:rZ4NmVlSOLQLvnge479PsZmaJhcmd95_.PoUmuljgfVAnZTdbNQtxDf55FB7m92e_0 2024-09-14T11:16:50.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.140+0000 7f7a127fc640 20 handle_completion(): completion ok for obj=d[dejrDMazutDPTdpgUS7tuPQYxivBHtN] 2024-09-14T11:16:50.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.140+0000 7f7b36092800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:50.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.141+0000 7f7b36092800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:50.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7a127fc640 20 handle_completion(): completion ok for obj=e[jUqFXDeJacSS3D03TGn7clCLh3o5BR5] 2024-09-14T11:16:50.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7a12ffd640 20 handle_completion(): completion ok for obj=f[rZ4NmVlSOLQLvnge479PsZmaJhcmd95] 2024-09-14T11:16:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.143+0000 7f7b36092800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.144+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.144+0000 7f7b36092800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:16:50.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.146+0000 7f7b36092800 20 get_obj_state: octx=0x560d63829380 obj=check-bucket:e state=0x560d63aedab8 s->prefetch_data=0 2024-09-14T11:16:50.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.146+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=it0e5qst4q5uexr914uh0ky2mq26zfhz 2024-09-14T11:16:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.148+0000 7f7b36092800 20 get_obj_state: octx=0x560d63af11f0 obj=check-bucket:f state=0x560d63aea778 s->prefetch_data=0 2024-09-14T11:16:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.148+0000 7f7b36092800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2jdaa4tbjn0wuo0g923wod416tt8636x 2024-09-14T11:16:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.148+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.148+0000 7f7b36092800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:16:50.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.152+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.152+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.154+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.154+0000 7f7b36092800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:16:50.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.154+0000 7f7b36092800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.154+0000 7f7b36092800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:16:50.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.154+0000 7f7b36092800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:16:50.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.155+0000 7f79e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.157+0000 7f7b36092800 20 remove_watcher() i=0 2024-09-14T11:16:50.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.157+0000 7f7b36092800 2 removed watcher, disabling cache 2024-09-14T11:16:50.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.158+0000 7f7b36092800 20 remove_watcher() i=1 2024-09-14T11:16:50.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.159+0000 7f7b36092800 20 remove_watcher() i=2 2024-09-14T11:16:50.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.160+0000 7f7b36092800 20 remove_watcher() i=3 2024-09-14T11:16:50.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.162+0000 7f7b36092800 20 remove_watcher() i=4 2024-09-14T11:16:50.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.162+0000 7f7b36092800 20 remove_watcher() i=5 2024-09-14T11:16:50.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.163+0000 7f7b36092800 20 remove_watcher() i=6 2024-09-14T11:16:50.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.164+0000 7f7b36092800 20 remove_watcher() i=7 2024-09-14T11:16:50.175 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.175 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.178 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.180 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.181 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.183 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.183 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.184 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:16:50.184 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:50.185 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.185 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.230 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.230 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.232 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.232 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.235 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.236 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.238 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.238 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.240 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:16:50.240 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:50.242 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:16:50.274 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:50.274 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:50.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.312+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 realm 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:50.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.314+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.315+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.315+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.315+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:50.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.315+0000 7f0798420800 20 searching for the correct realm 2024-09-14T11:16:50.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.318+0000 7f079670b640 0 -- 172.21.15.94:0/3424079052 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f0780038020 msgr2=0x7f0780069020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:50.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.322+0000 7f0795f0a640 0 -- 172.21.15.94:0/3424079052 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f07800737a0 msgr2=0x7f0780092780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:50.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:50.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.326+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 zone default found 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 4 Realm: () 2024-09-14T11:16:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 zonegroup default 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.327+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.328+0000 7f0798420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.328+0000 7f0798420800 20 started sync module instance, tier type = 2024-09-14T11:16:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.328+0000 7f0798420800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:50.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=0 2024-09-14T11:16:50.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=1 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=2 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=3 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=4 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=5 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.337+0000 7f0798420800 20 add_watcher() i=6 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.338+0000 7f0798420800 20 add_watcher() i=7 2024-09-14T11:16:50.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.338+0000 7f0798420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:50.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f064bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f0798420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f0798420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f0798420800 5 note: GC not initialized 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f064afe5640 20 reqs_thread_entry: start 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f0798420800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.340+0000 7f0798420800 20 Filter name: none 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0648fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.341+0000 7f0798420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:50.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.342+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.342+0000 7f0798420800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.342+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.343+0000 7f0798420800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.343+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.343+0000 7f0798420800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.343+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:50.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.344+0000 7f0798420800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.344+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.344+0000 7f0798420800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.344+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.345+0000 7f0798420800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.345+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:50.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.345+0000 7f0798420800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:16:50.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.345+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:50.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.346+0000 7f0798420800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:16:50.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.346+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.347+0000 7f0798420800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:16:50.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.347+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:50.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.347+0000 7f0798420800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:16:50.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.347+0000 7f0798420800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.348+0000 7f0798420800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:16:50.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.348+0000 7f0798420800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:16:50.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.348+0000 7f064bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.351+0000 7f0798420800 20 remove_watcher() i=0 2024-09-14T11:16:50.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.351+0000 7f0798420800 2 removed watcher, disabling cache 2024-09-14T11:16:50.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.352+0000 7f0798420800 20 remove_watcher() i=1 2024-09-14T11:16:50.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.353+0000 7f0798420800 20 remove_watcher() i=2 2024-09-14T11:16:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.354+0000 7f0798420800 20 remove_watcher() i=3 2024-09-14T11:16:50.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.355+0000 7f0798420800 20 remove_watcher() i=4 2024-09-14T11:16:50.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.356+0000 7f0798420800 20 remove_watcher() i=5 2024-09-14T11:16:50.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.357+0000 7f0798420800 20 remove_watcher() i=6 2024-09-14T11:16:50.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.358+0000 7f0798420800 20 remove_watcher() i=7 2024-09-14T11:16:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.370 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.386 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:50.400 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:16:50.430 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:50.430 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.467+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 realm 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.469+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.470+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.470+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.471+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.471+0000 7f6884d26800 20 searching for the correct realm 2024-09-14T11:16:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.475+0000 7f688110a640 0 -- 172.21.15.94:0/121576084 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f686c044490 msgr2=0x7f686c054910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:50.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.680+0000 7f6880909640 0 -- 172.21.15.94:0/121576084 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x55b982381e70 msgr2=0x55b982384260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:50.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:50.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:50.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.683+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:50.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 zone default found 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 4 Realm: () 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 zonegroup default 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 started sync module instance, tier type = 2024-09-14T11:16:50.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.684+0000 7f6884d26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:50.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=0 2024-09-14T11:16:50.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=1 2024-09-14T11:16:50.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=2 2024-09-14T11:16:50.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=3 2024-09-14T11:16:50.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=4 2024-09-14T11:16:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=5 2024-09-14T11:16:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.695+0000 7f6884d26800 20 add_watcher() i=6 2024-09-14T11:16:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.696+0000 7f6884d26800 20 add_watcher() i=7 2024-09-14T11:16:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.696+0000 7f6884d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f67377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f6884d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f6884d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f6884d26800 5 note: GC not initialized 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f67367e4640 20 reqs_thread_entry: start 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f6884d26800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.698+0000 7f6884d26800 20 Filter name: none 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f672ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 INFO: main: starting shard=0 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.699+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 INFO: main: starting shard=1 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 INFO: main: starting shard=2 2024-09-14T11:16:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.700+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.701+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.701+0000 7f6884d26800 20 INFO: main: starting shard=3 2024-09-14T11:16:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.701+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 INFO: main: starting shard=4 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 INFO: main: starting shard=5 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.702+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 INFO: main: starting shard=6 2024-09-14T11:16:50.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:50.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 INFO: main: starting shard=7 2024-09-14T11:16:50.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.703+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:50.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: starting shard=8 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: starting shard=9 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 INFO: main: starting shard=10 2024-09-14T11:16:50.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.704+0000 7f6884d26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:50.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.705+0000 7f6884d26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:50.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.705+0000 7f6884d26800 20 INFO: main: done 2024-09-14T11:16:50.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.706+0000 7f67377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:50.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.708+0000 7f6884d26800 20 remove_watcher() i=0 2024-09-14T11:16:50.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.708+0000 7f6884d26800 2 removed watcher, disabling cache 2024-09-14T11:16:50.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.709+0000 7f6884d26800 20 remove_watcher() i=1 2024-09-14T11:16:50.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.710+0000 7f6884d26800 20 remove_watcher() i=2 2024-09-14T11:16:50.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.712+0000 7f6884d26800 20 remove_watcher() i=3 2024-09-14T11:16:50.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.713+0000 7f6884d26800 20 remove_watcher() i=4 2024-09-14T11:16:50.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.714+0000 7f6884d26800 20 remove_watcher() i=5 2024-09-14T11:16:50.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.715+0000 7f6884d26800 20 remove_watcher() i=6 2024-09-14T11:16:50.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.716+0000 7f6884d26800 20 remove_watcher() i=7 2024-09-14T11:16:50.726 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:16:50.757 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:50.757 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:50.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.795+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 realm 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:50.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.797+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.798+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.798+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.798+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.798+0000 7f677510c800 20 searching for the correct realm 2024-09-14T11:16:50.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:50.800+0000 7f6772bf6640 0 -- 172.21.15.94:0/1970700954 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f6760003ab0 msgr2=0x7f676c018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.006+0000 7f67733f7640 0 -- 172.21.15.94:0/1970700954 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f675c079070 msgr2=0x7f675c0867c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.214+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 zone default found 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 4 Realm: () 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 zonegroup default 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 started sync module instance, tier type = 2024-09-14T11:16:51.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.215+0000 7f677510c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:51.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=0 2024-09-14T11:16:51.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=1 2024-09-14T11:16:51.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=2 2024-09-14T11:16:51.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=3 2024-09-14T11:16:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=4 2024-09-14T11:16:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=5 2024-09-14T11:16:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.226+0000 7f677510c800 20 add_watcher() i=6 2024-09-14T11:16:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.227+0000 7f677510c800 20 add_watcher() i=7 2024-09-14T11:16:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.227+0000 7f677510c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f66297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f677510c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f677510c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f677510c800 5 note: GC not initialized 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f65a3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f677510c800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f677510c800 20 Filter name: none 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.229+0000 7f65a1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:51.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 INFO: main: starting shard=0 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.230+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 INFO: main: starting shard=1 2024-09-14T11:16:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 INFO: main: starting shard=2 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.231+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.232+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.232+0000 7f677510c800 20 INFO: main: starting shard=3 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.232+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 INFO: main: starting shard=4 2024-09-14T11:16:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 INFO: main: starting shard=5 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.233+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 INFO: main: starting shard=6 2024-09-14T11:16:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 INFO: main: starting shard=7 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.234+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 INFO: main: starting shard=8 2024-09-14T11:16:51.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 INFO: main: starting shard=9 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.235+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.236+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.236+0000 7f677510c800 20 INFO: main: starting shard=10 2024-09-14T11:16:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.236+0000 7f677510c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.237+0000 7f677510c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.237+0000 7f677510c800 20 INFO: main: done 2024-09-14T11:16:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.237+0000 7f66297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.240+0000 7f677510c800 20 remove_watcher() i=0 2024-09-14T11:16:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.240+0000 7f677510c800 2 removed watcher, disabling cache 2024-09-14T11:16:51.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.241+0000 7f677510c800 20 remove_watcher() i=1 2024-09-14T11:16:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.242+0000 7f677510c800 20 remove_watcher() i=2 2024-09-14T11:16:51.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.244+0000 7f677510c800 20 remove_watcher() i=3 2024-09-14T11:16:51.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.245+0000 7f677510c800 20 remove_watcher() i=4 2024-09-14T11:16:51.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.246+0000 7f677510c800 20 remove_watcher() i=5 2024-09-14T11:16:51.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.247+0000 7f677510c800 20 remove_watcher() i=6 2024-09-14T11:16:51.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.248+0000 7f677510c800 20 remove_watcher() i=7 2024-09-14T11:16:51.256 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:16:51.257 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:51.258 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:16:51.288 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:51.288 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:51.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.326+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 realm 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.328+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.329+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.329+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.329+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:51.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.329+0000 7f492732e800 20 searching for the correct realm 2024-09-14T11:16:51.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.334+0000 7f4923765640 0 -- 172.21.15.94:0/455302844 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f490c0a9be0 msgr2=0x7f490c068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.540+0000 7f4922f64640 0 -- 172.21.15.94:0/455302844 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x560dc731ec30 msgr2=0x560dc7321020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:51.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:51.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.542+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 zone default found 2024-09-14T11:16:51.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 4 Realm: () 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 zonegroup default 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.543+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.544+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.544+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.544+0000 7f492732e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.544+0000 7f492732e800 20 started sync module instance, tier type = 2024-09-14T11:16:51.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.544+0000 7f492732e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:51.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=0 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=1 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=2 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=3 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=4 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=5 2024-09-14T11:16:51.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.555+0000 7f492732e800 20 add_watcher() i=6 2024-09-14T11:16:51.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.556+0000 7f492732e800 20 add_watcher() i=7 2024-09-14T11:16:51.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.556+0000 7f492732e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f47d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f492732e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f492732e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f492732e800 5 note: GC not initialized 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f4753fff640 20 reqs_thread_entry: start 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f492732e800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.558+0000 7f492732e800 20 Filter name: none 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f4751ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:51.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:51.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.559+0000 7f492732e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:16:51.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.560+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:51.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.561+0000 7f492732e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:16:51.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.561+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:51.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.561+0000 7f492732e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:16:51.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.561+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:51.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.562+0000 7f492732e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.562+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.562+0000 7f492732e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.562+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.563+0000 7f492732e800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.563+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.563+0000 7f492732e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:16:51.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.563+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:51.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.564+0000 7f492732e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:16:51.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.564+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:51.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.564+0000 7f492732e800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:16:51.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.564+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:51.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.565+0000 7f492732e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:16:51.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.565+0000 7f492732e800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:51.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.565+0000 7f492732e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:16:51.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.565+0000 7f492732e800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:16:51.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.566+0000 7f47d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.569+0000 7f492732e800 20 remove_watcher() i=0 2024-09-14T11:16:51.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.569+0000 7f492732e800 2 removed watcher, disabling cache 2024-09-14T11:16:51.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.570+0000 7f492732e800 20 remove_watcher() i=1 2024-09-14T11:16:51.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.571+0000 7f492732e800 20 remove_watcher() i=2 2024-09-14T11:16:51.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.572+0000 7f492732e800 20 remove_watcher() i=3 2024-09-14T11:16:51.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.573+0000 7f492732e800 20 remove_watcher() i=4 2024-09-14T11:16:51.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.574+0000 7f492732e800 20 remove_watcher() i=5 2024-09-14T11:16:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.575+0000 7f492732e800 20 remove_watcher() i=6 2024-09-14T11:16:51.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.576+0000 7f492732e800 20 remove_watcher() i=7 2024-09-14T11:16:51.584 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:16:51.584 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:51.586 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:16:51.619 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:51.619 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:51.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.657+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 realm 2024-09-14T11:16:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.659+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.660+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.660+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.660+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.660+0000 7f3522b22800 20 searching for the correct realm 2024-09-14T11:16:51.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.663+0000 7f351dfad640 0 -- 172.21.15.94:0/3685123362 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55caa307dc70 msgr2=0x55caa3080130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:51.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.667+0000 7f351e7ae640 0 -- 172.21.15.94:0/3685123362 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f3514080300 msgr2=0x7f3514080810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:51.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 zone default found 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 4 Realm: () 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 zonegroup default 2024-09-14T11:16:51.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.672+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 started sync module instance, tier type = 2024-09-14T11:16:51.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.673+0000 7f3522b22800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:51.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=0 2024-09-14T11:16:51.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=1 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=2 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=3 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=4 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=5 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.683+0000 7f3522b22800 20 add_watcher() i=6 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.684+0000 7f3522b22800 20 add_watcher() i=7 2024-09-14T11:16:51.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.684+0000 7f3522b22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f33d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f3522b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f3522b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f3522b22800 5 note: GC not initialized 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f334f7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f3522b22800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.686+0000 7f3522b22800 20 Filter name: none 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f334d7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:51.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:51.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.687+0000 7f3522b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.688+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:51.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.688+0000 7f3522b22800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.688+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.688+0000 7f3522b22800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.688+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.689+0000 7f3522b22800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.689+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.689+0000 7f3522b22800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:16:51.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.689+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.690+0000 7f3522b22800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.690+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.691+0000 7f3522b22800 20 get_obj_state: octx=0x55caa2de9360 obj=check-bucket:d state=0x55caa30b1048 s->prefetch_data=0 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.691+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.691+0000 7f3522b22800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:16:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.691+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:51.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.692+0000 7f3522b22800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:16:51.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.692+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:51.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.692+0000 7f3522b22800 20 get_obj_state: octx=0x55caa2e119c0 obj=check-bucket:c state=0x55caa30b1ff8 s->prefetch_data=0 2024-09-14T11:16:51.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.692+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:51.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:16:51.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:51.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:16:51.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 get_obj_state: setting s->obj_tag to ylj1aapuvkjwdiok3axatnfsusyhq5sd 2024-09-14T11:16:51.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 get_obj_state_impl: setting s->olh_tag to l2enuv9mdylkhyncx9f0twnjr891r7h6 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 get_obj_state: setting s->obj_tag to rmu4mec479xhvgeb048sk8us2ifw43p8 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 get_obj_state_impl: setting s->olh_tag to o9h8xdxv0dlsp2wmzhg43uh13sx94zp5 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.693+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 olh_log_entry: epoch=4 op=3 key=d[jbCnBd3N6wPb3VbE8rjEUFPC4GVDo55] 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 get_obj_state: octx=0x55caa30e9cb0 obj=check-bucket:_:jbCnBd3N6wPb3VbE8rjEUFPC4GVDo55_d state=0x55caa3110738 s->prefetch_data=0 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 olh_log_entry: epoch=4 op=3 key=c[tHRiNl-LRtnAdUE9EI7dFatdWQRY.B1] 2024-09-14T11:16:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.694+0000 7f3522b22800 20 get_obj_state: octx=0x55caa3109cb0 obj=check-bucket:_:tHRiNl-LRtnAdUE9EI7dFatdWQRY.B1_c state=0x55caa3118308 s->prefetch_data=0 2024-09-14T11:16:51.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.695+0000 7f3522b22800 20 get_obj_state: octx=0x55caa3109cb0 obj=check-bucket:c state=0x55caa310a6d8 s->prefetch_data=0 2024-09-14T11:16:51.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 get_obj_state: octx=0x55caa30e9cb0 obj=check-bucket:d state=0x55caa30ab198 s->prefetch_data=0 2024-09-14T11:16:51.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 get_obj_state: setting s->obj_tag to rmu4mec479xhvgeb048sk8us2ifw43p8 2024-09-14T11:16:51.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 get_obj_state_impl: setting s->olh_tag to o9h8xdxv0dlsp2wmzhg43uh13sx94zp5 2024-09-14T11:16:51.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o9h8xdxv0dlsp2wmzhg43uh13sx94zp5 2024-09-14T11:16:51.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 get_obj_state: setting s->obj_tag to ylj1aapuvkjwdiok3axatnfsusyhq5sd 2024-09-14T11:16:51.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 get_obj_state_impl: setting s->olh_tag to l2enuv9mdylkhyncx9f0twnjr891r7h6 2024-09-14T11:16:51.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.696+0000 7f3522b22800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l2enuv9mdylkhyncx9f0twnjr891r7h6 2024-09-14T11:16:51.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.699+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:51.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.700+0000 7f3522b22800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:16:51.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.702+0000 7f3522b22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:51.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.704+0000 7f3522b22800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:16:51.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.704+0000 7f3522b22800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:16:51.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.704+0000 7f33d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:51.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.707+0000 7f3522b22800 20 remove_watcher() i=0 2024-09-14T11:16:51.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.707+0000 7f3522b22800 2 removed watcher, disabling cache 2024-09-14T11:16:51.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.708+0000 7f3522b22800 20 remove_watcher() i=1 2024-09-14T11:16:51.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.709+0000 7f3522b22800 20 remove_watcher() i=2 2024-09-14T11:16:51.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.710+0000 7f3522b22800 20 remove_watcher() i=3 2024-09-14T11:16:51.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.711+0000 7f3522b22800 20 remove_watcher() i=4 2024-09-14T11:16:51.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.712+0000 7f3522b22800 20 remove_watcher() i=5 2024-09-14T11:16:51.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.713+0000 7f3522b22800 20 remove_watcher() i=6 2024-09-14T11:16:51.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.714+0000 7f3522b22800 20 remove_watcher() i=7 2024-09-14T11:16:51.725 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:16:51.756 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:51.756 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:51.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.794+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.795+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.795+0000 7fad0ad2a800 20 realm 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.795+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.796+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.796+0000 7fad0ad2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.796+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.796+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.796+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.797+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:51.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.797+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:51.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.797+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:51.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.797+0000 7fad0ad2a800 20 searching for the correct realm 2024-09-14T11:16:51.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.800+0000 7fad0624e640 0 -- 172.21.15.94:0/1641518818 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7facf808b030 msgr2=0x7facf808d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:51.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:51.803+0000 7fad06a4f640 0 -- 172.21.15.94:0/1641518818 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7facfc06b570 msgr2=0x7facfc00ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:52.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:52.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:52.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:52.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:52.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.009+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:52.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 zone default found 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 4 Realm: () 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:52.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 zonegroup default 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.010+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 started sync module instance, tier type = 2024-09-14T11:16:52.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.011+0000 7fad0ad2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=0 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=1 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=2 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=3 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=4 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=5 2024-09-14T11:16:52.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.020+0000 7fad0ad2a800 20 add_watcher() i=6 2024-09-14T11:16:52.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.021+0000 7fad0ad2a800 20 add_watcher() i=7 2024-09-14T11:16:52.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.021+0000 7fad0ad2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:52.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.023+0000 7fabbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:52.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 5 note: GC not initialized 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fab37fff640 20 reqs_thread_entry: start 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 Filter name: none 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fab35ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:52.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.024+0000 7fad0ad2a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.025+0000 7fad0ad2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.025+0000 7fad0ad2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.025+0000 7fad0ad2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.025+0000 7fad0ad2a800 20 INFO: main: starting shard=0 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.025+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 INFO: main: starting shard=1 2024-09-14T11:16:52.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 INFO: main: starting shard=2 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.026+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 INFO: main: starting shard=3 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 INFO: main: starting shard=4 2024-09-14T11:16:52.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.027+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:52.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 INFO: main: starting shard=5 2024-09-14T11:16:52.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 INFO: main: starting shard=6 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.028+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 INFO: main: starting shard=7 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:52.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 INFO: main: starting shard=8 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.029+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 INFO: main: starting shard=9 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 INFO: main: starting shard=10 2024-09-14T11:16:52.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.030+0000 7fad0ad2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:52.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.031+0000 7fad0ad2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.031+0000 7fad0ad2a800 20 INFO: main: done 2024-09-14T11:16:52.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.031+0000 7fabbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.034+0000 7fad0ad2a800 20 remove_watcher() i=0 2024-09-14T11:16:52.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.034+0000 7fad0ad2a800 2 removed watcher, disabling cache 2024-09-14T11:16:52.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.035+0000 7fad0ad2a800 20 remove_watcher() i=1 2024-09-14T11:16:52.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.036+0000 7fad0ad2a800 20 remove_watcher() i=2 2024-09-14T11:16:52.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.038+0000 7fad0ad2a800 20 remove_watcher() i=3 2024-09-14T11:16:52.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.039+0000 7fad0ad2a800 20 remove_watcher() i=4 2024-09-14T11:16:52.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.040+0000 7fad0ad2a800 20 remove_watcher() i=5 2024-09-14T11:16:52.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.041+0000 7fad0ad2a800 20 remove_watcher() i=6 2024-09-14T11:16:52.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.042+0000 7fad0ad2a800 20 remove_watcher() i=7 2024-09-14T11:16:52.052 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:16:52.082 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:52.082 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:52.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.121+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 20 realm 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.123+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.124+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.124+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.125+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.125+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.125+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:52.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.125+0000 7f0c00126800 20 searching for the correct realm 2024-09-14T11:16:52.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.129+0000 7f0bfc64c640 0 -- 172.21.15.94:0/21301888 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f0bf0024070 msgr2=0x7f0bf0061d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:52.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.132+0000 7f0bfbe4b640 0 -- 172.21.15.94:0/21301888 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f0bf0075000 msgr2=0x7f0bf004e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.337+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 zone default found 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 4 Realm: () 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 zonegroup default 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.338+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 started sync module instance, tier type = 2024-09-14T11:16:52.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.339+0000 7f0c00126800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=0 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=1 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=2 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=3 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=4 2024-09-14T11:16:52.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=5 2024-09-14T11:16:52.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.349+0000 7f0c00126800 20 add_watcher() i=6 2024-09-14T11:16:52.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.350+0000 7f0c00126800 20 add_watcher() i=7 2024-09-14T11:16:52.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.350+0000 7f0c00126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:52.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.351+0000 7f0ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.351+0000 7f0c00126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.351+0000 7f0c00126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.351+0000 7f0c00126800 5 note: GC not initialized 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0ab0fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0c00126800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0c00126800 20 Filter name: none 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0a2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:52.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.352+0000 7f0c00126800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 INFO: main: starting shard=0 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 INFO: main: starting shard=1 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.353+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 INFO: main: starting shard=2 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 INFO: main: starting shard=3 2024-09-14T11:16:52.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.354+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:52.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 INFO: main: starting shard=4 2024-09-14T11:16:52.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:52.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 INFO: main: starting shard=5 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.355+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.356+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.356+0000 7f0c00126800 20 INFO: main: starting shard=6 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.356+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:52.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 INFO: main: starting shard=7 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 INFO: main: starting shard=8 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.357+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:52.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 INFO: main: starting shard=9 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 INFO: main: starting shard=10 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.358+0000 7f0c00126800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.359+0000 7f0c00126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:52.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.359+0000 7f0c00126800 20 INFO: main: done 2024-09-14T11:16:52.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.360+0000 7f0ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.362+0000 7f0c00126800 20 remove_watcher() i=0 2024-09-14T11:16:52.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.362+0000 7f0c00126800 2 removed watcher, disabling cache 2024-09-14T11:16:52.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.363+0000 7f0c00126800 20 remove_watcher() i=1 2024-09-14T11:16:52.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.365+0000 7f0c00126800 20 remove_watcher() i=2 2024-09-14T11:16:52.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.366+0000 7f0c00126800 20 remove_watcher() i=3 2024-09-14T11:16:52.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.366+0000 7f0c00126800 20 remove_watcher() i=4 2024-09-14T11:16:52.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.367+0000 7f0c00126800 20 remove_watcher() i=5 2024-09-14T11:16:52.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.368+0000 7f0c00126800 20 remove_watcher() i=6 2024-09-14T11:16:52.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.369+0000 7f0c00126800 20 remove_watcher() i=7 2024-09-14T11:16:52.378 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:16:52.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:52.379 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:16:52.410 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:52.410 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:52.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.449+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 realm 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.450+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.451+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:52.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.451+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.452+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:52.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.452+0000 7f6144d23800 20 searching for the correct realm 2024-09-14T11:16:52.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.453+0000 7f6140a0c640 0 -- 172.21.15.94:0/2716694613 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55bc1c79ec60 msgr2=0x7f61380a3860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:52.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.457+0000 7f614120d640 0 -- 172.21.15.94:0/2716694613 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f613400f400 msgr2=0x7f613400f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:52.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:52.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:52.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:52.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:52.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.462+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:52.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 zone default found 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 4 Realm: () 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 zonegroup default 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.463+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.464+0000 7f6144d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:52.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.464+0000 7f6144d23800 20 started sync module instance, tier type = 2024-09-14T11:16:52.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.464+0000 7f6144d23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=0 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=1 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=2 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=3 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=4 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=5 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.472+0000 7f6144d23800 20 add_watcher() i=6 2024-09-14T11:16:52.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.473+0000 7f6144d23800 20 add_watcher() i=7 2024-09-14T11:16:52.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.473+0000 7f6144d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:52.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.475+0000 7f5ff6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 5 note: GC not initialized 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f5ff5fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 Filter name: none 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f5f677fe640 20 reqs_thread_entry: start 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:52.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:52.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.476+0000 7f6144d23800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:52.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:52.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 20 rados->read ofs=0 len=0 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:52.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.477+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.478+0000 7f6144d23800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.478+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.478+0000 7f6144d23800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.478+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.479+0000 7f6144d23800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:16:52.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.479+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.479+0000 7f6144d23800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.479+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:16:52.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.480+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:52.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.481+0000 7f6144d23800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:16:52.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.481+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:52.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.481+0000 7f6144d23800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:16:52.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.481+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:52.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.482+0000 7f6144d23800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:16:52.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.482+0000 7f6144d23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:52.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.482+0000 7f6144d23800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:16:52.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.482+0000 7f6144d23800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:16:52.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.483+0000 7f5ff6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:52.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.485+0000 7f6144d23800 20 remove_watcher() i=0 2024-09-14T11:16:52.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.485+0000 7f6144d23800 2 removed watcher, disabling cache 2024-09-14T11:16:52.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.486+0000 7f6144d23800 20 remove_watcher() i=1 2024-09-14T11:16:52.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.487+0000 7f6144d23800 20 remove_watcher() i=2 2024-09-14T11:16:52.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.488+0000 7f6144d23800 20 remove_watcher() i=3 2024-09-14T11:16:52.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.489+0000 7f6144d23800 20 remove_watcher() i=4 2024-09-14T11:16:52.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.490+0000 7f6144d23800 20 remove_watcher() i=5 2024-09-14T11:16:52.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.491+0000 7f6144d23800 20 remove_watcher() i=6 2024-09-14T11:16:52.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:52.492+0000 7f6144d23800 20 remove_watcher() i=7 2024-09-14T11:16:52.501 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:16:52.501 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:52.503 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.503 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.506 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.506 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.509 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.509 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.553 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:16:52.554 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:16:52.554 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.554 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.600 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.600 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.665 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.665 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.682 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.682 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.685 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.685 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.699 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.699 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.702 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.702 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.718 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.718 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.721 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.721 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.736 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.736 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.738 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.739 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.753 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.753 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.756 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.756 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.776 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:52.776 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:52.780 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:16:53.169 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:16:54.559 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:54.559 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:54.626 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:16:54.655 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:54.655 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:54.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.693+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 realm 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.695+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.696+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:54.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.696+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.697+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:54.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.697+0000 7faa03087800 20 searching for the correct realm 2024-09-14T11:16:54.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.700+0000 7fa9fbfff640 0 -- 172.21.15.94:0/1161459928 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x561cef49b800 msgr2=0x561cef49dc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:54.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.704+0000 7faa00b78640 0 -- 172.21.15.94:0/1161459928 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa9ec03eb40 msgr2=0x7fa9ec066280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:54.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:54.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:54.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.709+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 zone default found 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 4 Realm: () 2024-09-14T11:16:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 zonegroup default 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.710+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.711+0000 7faa03087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.711+0000 7faa03087800 20 started sync module instance, tier type = 2024-09-14T11:16:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.711+0000 7faa03087800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=0 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=1 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=2 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=3 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=4 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=5 2024-09-14T11:16:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.723+0000 7faa03087800 20 add_watcher() i=6 2024-09-14T11:16:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.724+0000 7faa03087800 20 add_watcher() i=7 2024-09-14T11:16:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.724+0000 7faa03087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:54.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7fa8b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 5 note: GC not initialized 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7fa8b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 20 Filter name: none 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7fa8277fe640 20 reqs_thread_entry: start 2024-09-14T11:16:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.726+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:54.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:54.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 INFO: main: starting shard=0 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.727+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 INFO: main: starting shard=1 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 INFO: main: starting shard=2 2024-09-14T11:16:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.728+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 INFO: main: starting shard=3 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 INFO: main: starting shard=4 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.729+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 INFO: main: starting shard=5 2024-09-14T11:16:54.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:54.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 INFO: main: starting shard=6 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.730+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 INFO: main: starting shard=7 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 INFO: main: starting shard=8 2024-09-14T11:16:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.731+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 INFO: main: starting shard=9 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 INFO: main: starting shard=10 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.732+0000 7faa03087800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.733+0000 7faa03087800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:54.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.733+0000 7faa03087800 20 INFO: main: done 2024-09-14T11:16:54.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.734+0000 7fa8b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:54.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.737+0000 7faa03087800 20 remove_watcher() i=0 2024-09-14T11:16:54.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.737+0000 7faa03087800 2 removed watcher, disabling cache 2024-09-14T11:16:54.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.738+0000 7faa03087800 20 remove_watcher() i=1 2024-09-14T11:16:54.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.739+0000 7faa03087800 20 remove_watcher() i=2 2024-09-14T11:16:54.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.741+0000 7faa03087800 20 remove_watcher() i=3 2024-09-14T11:16:54.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.742+0000 7faa03087800 20 remove_watcher() i=4 2024-09-14T11:16:54.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.743+0000 7faa03087800 20 remove_watcher() i=5 2024-09-14T11:16:54.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.744+0000 7faa03087800 20 remove_watcher() i=6 2024-09-14T11:16:54.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.745+0000 7faa03087800 20 remove_watcher() i=7 2024-09-14T11:16:54.757 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:54.757 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:54.760 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:54.760 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:54.813 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:54.815 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:16:54.844 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:54.844 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:54.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:54.881+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 realm 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.083+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.085+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.085+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.085+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.085+0000 7fb670520800 20 searching for the correct realm 2024-09-14T11:16:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.088+0000 7fb663a67640 0 -- 172.21.15.94:0/1872388471 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb65c003bf0 msgr2=0x7fb65c0618f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:55.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.295+0000 7fb66c268640 0 -- 172.21.15.94:0/1872388471 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb65402b3f0 msgr2=0x7fb65402b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:55.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:55.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:55.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:55.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.501+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 zone default found 2024-09-14T11:16:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 4 Realm: () 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 zonegroup default 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.502+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.503+0000 7fb670520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.503+0000 7fb670520800 20 started sync module instance, tier type = 2024-09-14T11:16:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.503+0000 7fb670520800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=0 2024-09-14T11:16:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=1 2024-09-14T11:16:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=2 2024-09-14T11:16:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=3 2024-09-14T11:16:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=4 2024-09-14T11:16:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=5 2024-09-14T11:16:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.513+0000 7fb670520800 20 add_watcher() i=6 2024-09-14T11:16:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.514+0000 7fb670520800 20 add_watcher() i=7 2024-09-14T11:16:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.514+0000 7fb670520800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:55.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb522fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:55.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 5 note: GC not initialized 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb521fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 20 Filter name: none 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb4937fe640 20 reqs_thread_entry: start 2024-09-14T11:16:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.516+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 INFO: main: starting shard=0 2024-09-14T11:16:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.517+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 INFO: main: starting shard=1 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 INFO: main: starting shard=2 2024-09-14T11:16:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.518+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 INFO: main: starting shard=3 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 INFO: main: starting shard=4 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.519+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.520+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.520+0000 7fb670520800 20 INFO: main: starting shard=5 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.520+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 INFO: main: starting shard=6 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 INFO: main: starting shard=7 2024-09-14T11:16:55.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.521+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:55.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 INFO: main: starting shard=8 2024-09-14T11:16:55.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 INFO: main: starting shard=9 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.522+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.523+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.523+0000 7fb670520800 20 INFO: main: starting shard=10 2024-09-14T11:16:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.523+0000 7fb670520800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:55.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.524+0000 7fb670520800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:55.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.524+0000 7fb670520800 20 INFO: main: done 2024-09-14T11:16:55.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.525+0000 7fb522fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:55.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.528+0000 7fb670520800 20 remove_watcher() i=0 2024-09-14T11:16:55.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.528+0000 7fb670520800 2 removed watcher, disabling cache 2024-09-14T11:16:55.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.529+0000 7fb670520800 20 remove_watcher() i=1 2024-09-14T11:16:55.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.530+0000 7fb670520800 20 remove_watcher() i=2 2024-09-14T11:16:55.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.531+0000 7fb670520800 20 remove_watcher() i=3 2024-09-14T11:16:55.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.533+0000 7fb670520800 20 remove_watcher() i=4 2024-09-14T11:16:55.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.533+0000 7fb670520800 20 remove_watcher() i=5 2024-09-14T11:16:55.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.534+0000 7fb670520800 20 remove_watcher() i=6 2024-09-14T11:16:55.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.536+0000 7fb670520800 20 remove_watcher() i=7 2024-09-14T11:16:55.547 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:55.548 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:55.551 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:55.551 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:16:55.638 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:55.638 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:55.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.676+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.677+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.677+0000 7f23e013b800 20 realm 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.677+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.677+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.677+0000 7f23e013b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.678+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.678+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.678+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.679+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:55.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.679+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:55.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.679+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:55.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.679+0000 7f23e013b800 20 searching for the correct realm 2024-09-14T11:16:55.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.681+0000 7f23d3624640 0 -- 172.21.15.94:0/899098647 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f23cc081040 msgr2=0x7f23cc07e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:55.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:55.887+0000 7f23dbe25640 0 -- 172.21.15.94:0/899098647 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f23c407d1d0 msgr2=0x7f23c4061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.093+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 zone default found 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 4 Realm: () 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 zonegroup default 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.094+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.095+0000 7f23e013b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.095+0000 7f23e013b800 20 started sync module instance, tier type = 2024-09-14T11:16:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.095+0000 7f23e013b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.104+0000 7f23e013b800 20 add_watcher() i=0 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=1 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=2 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=3 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=4 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=5 2024-09-14T11:16:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=6 2024-09-14T11:16:56.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 20 add_watcher() i=7 2024-09-14T11:16:56.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.105+0000 7f23e013b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:56.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.107+0000 7f2291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.107+0000 7f23e013b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.107+0000 7f23e013b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.107+0000 7f23e013b800 5 note: GC not initialized 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f2290fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f23e013b800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f23e013b800 20 Filter name: none 2024-09-14T11:16:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f220a7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:56.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.108+0000 7f23e013b800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 INFO: main: starting shard=0 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 INFO: main: starting shard=1 2024-09-14T11:16:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.109+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.110+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.110+0000 7f23e013b800 20 INFO: main: starting shard=2 2024-09-14T11:16:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.110+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 INFO: main: starting shard=3 2024-09-14T11:16:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 INFO: main: starting shard=4 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.111+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 INFO: main: starting shard=5 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 INFO: main: starting shard=6 2024-09-14T11:16:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.112+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.113+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.113+0000 7f23e013b800 20 INFO: main: starting shard=7 2024-09-14T11:16:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.113+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 INFO: main: starting shard=8 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 INFO: main: starting shard=9 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.114+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.115+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.115+0000 7f23e013b800 20 INFO: main: starting shard=10 2024-09-14T11:16:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.115+0000 7f23e013b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:56.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.116+0000 7f23e013b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.116+0000 7f23e013b800 20 INFO: main: done 2024-09-14T11:16:56.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.116+0000 7f2291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.119+0000 7f23e013b800 20 remove_watcher() i=0 2024-09-14T11:16:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.119+0000 7f23e013b800 2 removed watcher, disabling cache 2024-09-14T11:16:56.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.120+0000 7f23e013b800 20 remove_watcher() i=1 2024-09-14T11:16:56.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.121+0000 7f23e013b800 20 remove_watcher() i=2 2024-09-14T11:16:56.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.122+0000 7f23e013b800 20 remove_watcher() i=3 2024-09-14T11:16:56.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.124+0000 7f23e013b800 20 remove_watcher() i=4 2024-09-14T11:16:56.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.125+0000 7f23e013b800 20 remove_watcher() i=5 2024-09-14T11:16:56.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.126+0000 7f23e013b800 20 remove_watcher() i=6 2024-09-14T11:16:56.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.127+0000 7f23e013b800 20 remove_watcher() i=7 2024-09-14T11:16:56.139 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:56.139 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:56.142 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:56.143 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:56.197 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:16:56.199 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:16:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:56.228 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:56.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.265+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 realm 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.267+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.268+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:56.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.268+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.268+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:56.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.268+0000 7f60d2725800 20 searching for the correct realm 2024-09-14T11:16:56.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.271+0000 7f60ceb34640 0 -- 172.21.15.94:0/3825448339 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f60b80a0040 msgr2=0x7f60b80678f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:56.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.275+0000 7f60ce333640 0 -- 172.21.15.94:0/3825448339 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f60b8072070 msgr2=0x7f60b8071a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:56.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:56.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.481+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 zone default found 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 4 Realm: () 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 zonegroup default 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.482+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.483+0000 7f60d2725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.483+0000 7f60d2725800 20 started sync module instance, tier type = 2024-09-14T11:16:56.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.483+0000 7f60d2725800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=0 2024-09-14T11:16:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=1 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=2 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=3 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=4 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=5 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.493+0000 7f60d2725800 20 add_watcher() i=6 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.494+0000 7f60d2725800 20 add_watcher() i=7 2024-09-14T11:16:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.494+0000 7f60d2725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.496+0000 7f5f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.496+0000 7f60d2725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.496+0000 7f60d2725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.496+0000 7f60d2725800 5 note: GC not initialized 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.496+0000 7f5eff7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f60d2725800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f60d2725800 20 Filter name: none 2024-09-14T11:16:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f5efd7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:56.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:56.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.497+0000 7f60d2725800 20 rados->read ofs=0 len=0 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 INFO: main: starting shard=0 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 INFO: main: starting shard=1 2024-09-14T11:16:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.498+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 INFO: main: starting shard=2 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 INFO: main: starting shard=3 2024-09-14T11:16:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.499+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 INFO: main: starting shard=4 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 INFO: main: starting shard=5 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.500+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 INFO: main: starting shard=6 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 INFO: main: starting shard=7 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.501+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 INFO: main: starting shard=8 2024-09-14T11:16:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 INFO: main: starting shard=9 2024-09-14T11:16:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.502+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.503+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:16:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.503+0000 7f60d2725800 20 INFO: main: starting shard=10 2024-09-14T11:16:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.503+0000 7f60d2725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.503+0000 7f60d2725800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:16:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.503+0000 7f60d2725800 20 INFO: main: done 2024-09-14T11:16:56.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.504+0000 7f5f84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:56.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.507+0000 7f60d2725800 20 remove_watcher() i=0 2024-09-14T11:16:56.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.507+0000 7f60d2725800 2 removed watcher, disabling cache 2024-09-14T11:16:56.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.508+0000 7f60d2725800 20 remove_watcher() i=1 2024-09-14T11:16:56.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.509+0000 7f60d2725800 20 remove_watcher() i=2 2024-09-14T11:16:56.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.511+0000 7f60d2725800 20 remove_watcher() i=3 2024-09-14T11:16:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.512+0000 7f60d2725800 20 remove_watcher() i=4 2024-09-14T11:16:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.513+0000 7f60d2725800 20 remove_watcher() i=5 2024-09-14T11:16:56.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.514+0000 7f60d2725800 20 remove_watcher() i=6 2024-09-14T11:16:56.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:56.515+0000 7f60d2725800 20 remove_watcher() i=7 2024-09-14T11:16:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:56.527 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:56.531 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:16:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:16:57.309 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:16:57.338 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:57.338 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:57.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.375+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 realm 2024-09-14T11:16:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.377+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.378+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.378+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.378+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:57.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.378+0000 7fd5747af800 20 searching for the correct realm 2024-09-14T11:16:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.381+0000 7fd572a9a640 0 -- 172.21.15.94:0/3074994904 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fd55c009620 msgr2=0x7fd55c009d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.385+0000 7fd572299640 0 -- 172.21.15.94:0/3074994904 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd55c0ddb90 msgr2=0x7fd55c0dd050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.592+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 zone default found 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 4 Realm: () 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 zonegroup default 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.593+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 started sync module instance, tier type = 2024-09-14T11:16:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.594+0000 7fd5747af800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:57.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=0 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=1 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=2 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=3 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=4 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=5 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.604+0000 7fd5747af800 20 add_watcher() i=6 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.605+0000 7fd5747af800 20 add_watcher() i=7 2024-09-14T11:16:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.605+0000 7fd5747af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:57.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.607+0000 7fd428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.607+0000 7fd5747af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.607+0000 7fd5747af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 5 note: GC not initialized 2024-09-14T11:16:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd3a37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 20 Filter name: none 2024-09-14T11:16:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd3a17fa640 20 reqs_thread_entry: start 2024-09-14T11:16:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:57.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.608+0000 7fd5747af800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.609+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:57.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.610+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.610+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.611+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.612+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.612+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.613+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.613+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:57.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.614+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.615+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:57.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.615+0000 7fd5747af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.625+0000 7fd428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.628+0000 7fd5747af800 20 remove_watcher() i=0 2024-09-14T11:16:57.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.628+0000 7fd5747af800 2 removed watcher, disabling cache 2024-09-14T11:16:57.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.629+0000 7fd5747af800 20 remove_watcher() i=1 2024-09-14T11:16:57.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.630+0000 7fd5747af800 20 remove_watcher() i=2 2024-09-14T11:16:57.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.631+0000 7fd5747af800 20 remove_watcher() i=3 2024-09-14T11:16:57.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.632+0000 7fd5747af800 20 remove_watcher() i=4 2024-09-14T11:16:57.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.633+0000 7fd5747af800 20 remove_watcher() i=5 2024-09-14T11:16:57.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.634+0000 7fd5747af800 20 remove_watcher() i=6 2024-09-14T11:16:57.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.635+0000 7fd5747af800 20 remove_watcher() i=7 2024-09-14T11:16:57.647 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:16:57.681 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:57.681 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:57.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.718+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 20 realm 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.719+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.720+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.720+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.720+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.720+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.721+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.721+0000 7f2e11240800 20 searching for the correct realm 2024-09-14T11:16:57.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.724+0000 7f2e0e529640 0 -- 172.21.15.94:0/2516999712 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5619d1ee8680 msgr2=0x5619d1eeaaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.728+0000 7f2e0e529640 0 -- 172.21.15.94:0/2516999712 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f2e000b7040 msgr2=0x7f2e0008b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.731+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 zone default found 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 4 Realm: () 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 zonegroup default 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.732+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 started sync module instance, tier type = 2024-09-14T11:16:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.733+0000 7f2e11240800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:57.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=0 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=1 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=2 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=3 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=4 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=5 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.744+0000 7f2e11240800 20 add_watcher() i=6 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.745+0000 7f2e11240800 20 add_watcher() i=7 2024-09-14T11:16:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.745+0000 7f2e11240800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:57.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.747+0000 7f2cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.747+0000 7f2e11240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.747+0000 7f2e11240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.747+0000 7f2e11240800 5 note: GC not initialized 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.747+0000 7f2c3ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 20 Filter name: none 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2c3dffb640 20 reqs_thread_entry: start 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 : miss 2024-09-14T11:16:57.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.748+0000 7f2e11240800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 info.flags=0x17 2024-09-14T11:16:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 to cache LRU end 2024-09-14T11:16:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.0 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.749+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.750+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.2 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.751+0000 7f2e11240800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:16:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.751+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.3 2024-09-14T11:16:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.751+0000 7f2e11240800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:16:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.751+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.4 2024-09-14T11:16:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.752+0000 7f2e11240800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:16:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.752+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.752+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.6 2024-09-14T11:16:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.753+0000 7f2e11240800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:16:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.753+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.7 2024-09-14T11:16:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.753+0000 7f2e11240800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:16:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.753+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.754+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.9 2024-09-14T11:16:57.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.754+0000 7f2e11240800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:16:57.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.754+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.755+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.755+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c5d380 obj=check-bucket:e state=0x5619d1f220e8 s->prefetch_data=0 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.755+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.755+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c859e0 obj=check-bucket:d state=0x5619d1f1e8d8 s->prefetch_data=0 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.755+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1f210d0 obj=check-bucket:c state=0x5619d1f28b48 s->prefetch_data=0 2024-09-14T11:16:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1fbfbd0 obj=check-bucket:f state=0x5619d1fbe2f8 s->prefetch_data=0 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to z5kc57omu3oks5n3hzhzuavinki2ichb 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state_impl: setting s->olh_tag to as6k3fgf4niea9k4en0mt32cz3zn2sq8 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=as6k3fgf4niea9k4en0mt32cz3zn2sq8 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to v6qsher12583srcqeagsl46ohmi1o9cc 2024-09-14T11:16:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state_impl: setting s->olh_tag to o5d704rq5x4rbb7757yx9f8idmaw9dvc 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o5d704rq5x4rbb7757yx9f8idmaw9dvc 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to m6zsggaemm44850supf7zmz6e78y2lk7 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state_impl: setting s->olh_tag to yycsgk0kce6l25rg3t8feipbgxxgihhf 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yycsgk0kce6l25rg3t8feipbgxxgihhf 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to z1b6p0nj8i88uejk1t3hmxopyqnkfyeu 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 get_obj_state_impl: setting s->olh_tag to yn407hb3mnz5zteap9zhxbwuccpg2qjv 2024-09-14T11:16:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.756+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yn407hb3mnz5zteap9zhxbwuccpg2qjv 2024-09-14T11:16:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.758+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.758+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.758+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.759+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.759+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 olh_log_entry: epoch=3 op=3 key=d[70wIH2wkcKawQgWcTORXwFs1KdTB1zT] 2024-09-14T11:16:57.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c859e0 obj=check-bucket:_:70wIH2wkcKawQgWcTORXwFs1KdTB1zT_d state=0x5619d1fd9ae8 s->prefetch_data=0 2024-09-14T11:16:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 10 manifest: total_size = 22 2024-09-14T11:16:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12769742697243883418 2024-09-14T11:16:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c859e0 obj=check-bucket:_:70wIH2wkcKawQgWcTORXwFs1KdTB1zT_d state=0x5619d1fd9ae8 s->prefetch_data=0 2024-09-14T11:16:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 prepare_atomic_modification: state is not atomic. state=0x5619d1fd9ae8 2024-09-14T11:16:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.760+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.763+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:70wIH2wkcKawQgWcTORXwFs1KdTB1zT_.c-bBy-F3RDxRY3mZEdgLkUIeuy5TISw_0 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 olh_log_entry: epoch=3 op=3 key=c[Eyq975s4YizAWWsP3-1ScrhuvMntNvX] 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1f210d0 obj=check-bucket:_:Eyq975s4YizAWWsP3-1ScrhuvMntNvX_c state=0x5619d1fc24c8 s->prefetch_data=0 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 olh_log_entry: epoch=2 op=3 key=e[bGjs9Sfu7VCV.dSQwWSEQzktyETRSMf] 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c5d380 obj=check-bucket:_:bGjs9Sfu7VCV.dSQwWSEQzktyETRSMf_e state=0x5619d1fe69e8 s->prefetch_data=0 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 olh_log_entry: epoch=2 op=3 key=f[S-d9ACxX78difwVYN494tf.bWJB3rAJ] 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1fbfbd0 obj=check-bucket:_:S-d9ACxX78difwVYN494tf.bWJB3rAJ_f state=0x5619d1ff0cf8 s->prefetch_data=0 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 10 manifest: total_size = 22 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3783793190846110400 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1f210d0 obj=check-bucket:_:Eyq975s4YizAWWsP3-1ScrhuvMntNvX_c state=0x5619d1fc24c8 s->prefetch_data=0 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 prepare_atomic_modification: state is not atomic. state=0x5619d1fc24c8 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.764+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 10 manifest: total_size = 9 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7159151576133302862 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1fbfbd0 obj=check-bucket:_:S-d9ACxX78difwVYN494tf.bWJB3rAJ_f state=0x5619d1ff0cf8 s->prefetch_data=0 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 prepare_atomic_modification: state is not atomic. state=0x5619d1ff0cf8 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 10 manifest: total_size = 22 2024-09-14T11:16:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8477772375832767554 2024-09-14T11:16:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c5d380 obj=check-bucket:_:bGjs9Sfu7VCV.dSQwWSEQzktyETRSMf_e state=0x5619d1fe69e8 s->prefetch_data=0 2024-09-14T11:16:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 prepare_atomic_modification: state is not atomic. state=0x5619d1fe69e8 2024-09-14T11:16:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2cf27fc640 20 handle_completion(): completion ok for obj=d[70wIH2wkcKawQgWcTORXwFs1KdTB1zT] 2024-09-14T11:16:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.765+0000 7f2e11240800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:57.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.768+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.768+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.770+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.5 2024-09-14T11:16:57.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.770+0000 7f2e11240800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:16:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:Eyq975s4YizAWWsP3-1ScrhuvMntNvX_.xuoHPVc0hqXDEYJxD2w7gJPke1ZVEJK_0 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.773+0000 7f2e11240800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:bGjs9Sfu7VCV.dSQwWSEQzktyETRSMf_.l0KpgJWERd4qFH6tAXHR3ffEf9hQpE3_0 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.774+0000 7f2e11240800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.774+0000 7f2e11240800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.774+0000 7f2e11240800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.774+0000 7f2e11240800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2__shadow:S-d9ACxX78difwVYN494tf.bWJB3rAJ_.mulii6fB-y5i23KV_gqS6FL6V-zxivy_0 2024-09-14T11:16:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.775+0000 7f2e11240800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:57.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2cf1ffb640 20 handle_completion(): completion ok for obj=c[Eyq975s4YizAWWsP3-1ScrhuvMntNvX] 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2e11240800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2e11240800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2cf1ffb640 20 handle_completion(): completion ok for obj=e[bGjs9Sfu7VCV.dSQwWSEQzktyETRSMf] 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2cf27fc640 20 handle_completion(): completion ok for obj=f[S-d9ACxX78difwVYN494tf.bWJB3rAJ] 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1c5d380 obj=check-bucket:e state=0x5619d1f220e8 s->prefetch_data=0 2024-09-14T11:16:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.777+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=as6k3fgf4niea9k4en0mt32cz3zn2sq8 2024-09-14T11:16:57.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.780+0000 7f2e11240800 20 get_obj_state: octx=0x5619d1fbfbd0 obj=check-bucket:f state=0x5619d1fbe2f8 s->prefetch_data=0 2024-09-14T11:16:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.780+0000 7f2e11240800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yn407hb3mnz5zteap9zhxbwuccpg2qjv 2024-09-14T11:16:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.780+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.780+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.785+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.8 2024-09-14T11:16:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.785+0000 7f2e11240800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:16:57.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.788+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.791+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.792+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.1 2024-09-14T11:16:57.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.792+0000 7f2e11240800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:16:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.793+0000 7f2e11240800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2.10 2024-09-14T11:16:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.793+0000 7f2e11240800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:16:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.793+0000 7f2e11240800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:16:57.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.794+0000 7f2cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.796+0000 7f2e11240800 20 remove_watcher() i=0 2024-09-14T11:16:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.796+0000 7f2e11240800 2 removed watcher, disabling cache 2024-09-14T11:16:57.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.797+0000 7f2e11240800 20 remove_watcher() i=1 2024-09-14T11:16:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.798+0000 7f2e11240800 20 remove_watcher() i=2 2024-09-14T11:16:57.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.799+0000 7f2e11240800 20 remove_watcher() i=3 2024-09-14T11:16:57.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.800+0000 7f2e11240800 20 remove_watcher() i=4 2024-09-14T11:16:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.802+0000 7f2e11240800 20 remove_watcher() i=5 2024-09-14T11:16:57.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.803+0000 7f2e11240800 20 remove_watcher() i=6 2024-09-14T11:16:57.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.804+0000 7f2e11240800 20 remove_watcher() i=7 2024-09-14T11:16:57.815 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:57.815 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:57.820 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:57.820 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:57.867 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:16:57.894 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:57.894 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:57.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.931+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.933+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.933+0000 7f386d528800 20 realm 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.933+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.934+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.934+0000 7f386d528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.934+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.934+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.934+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.935+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.935+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.935+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.935+0000 7f386d528800 20 searching for the correct realm 2024-09-14T11:16:57.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.938+0000 7f3869a70640 0 -- 172.21.15.94:0/2887021022 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5600cc98d6c0 msgr2=0x5600cc98fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.942+0000 7f3868a6e640 0 -- 172.21.15.94:0/2887021022 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f385c051070 msgr2=0x7f385c016040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:57.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 zone default found 2024-09-14T11:16:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 4 Realm: () 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 zonegroup default 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.946+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.947+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.947+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.947+0000 7f386d528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.947+0000 7f386d528800 20 started sync module instance, tier type = 2024-09-14T11:16:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.947+0000 7f386d528800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:16:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=0 2024-09-14T11:16:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=1 2024-09-14T11:16:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=2 2024-09-14T11:16:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=3 2024-09-14T11:16:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=4 2024-09-14T11:16:57.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=5 2024-09-14T11:16:57.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.958+0000 7f386d528800 20 add_watcher() i=6 2024-09-14T11:16:57.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.959+0000 7f386d528800 20 add_watcher() i=7 2024-09-14T11:16:57.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.959+0000 7f386d528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:57.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.960+0000 7f371ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 5 note: GC not initialized 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f371efe5640 20 reqs_thread_entry: start 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 20 Filter name: none 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f371cfe1640 20 reqs_thread_entry: start 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.961+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.962+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.962+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.962+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.962+0000 7f386d528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.962+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.963+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.963+0000 7f386d528800 20 rados->read ofs=0 len=0 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.963+0000 7f386d528800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:16:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.963+0000 7f386d528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:57.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.964+0000 7f371ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.967+0000 7f386d528800 20 remove_watcher() i=0 2024-09-14T11:16:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.967+0000 7f386d528800 2 removed watcher, disabling cache 2024-09-14T11:16:57.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.968+0000 7f386d528800 20 remove_watcher() i=1 2024-09-14T11:16:57.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.969+0000 7f386d528800 20 remove_watcher() i=2 2024-09-14T11:16:57.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.970+0000 7f386d528800 20 remove_watcher() i=3 2024-09-14T11:16:57.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.971+0000 7f386d528800 20 remove_watcher() i=4 2024-09-14T11:16:57.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.972+0000 7f386d528800 20 remove_watcher() i=5 2024-09-14T11:16:57.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.973+0000 7f386d528800 20 remove_watcher() i=6 2024-09-14T11:16:57.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:16:57.974+0000 7f386d528800 20 remove_watcher() i=7 2024-09-14T11:16:57.983 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:16:57.984 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket check-bucket 2024-09-14T11:16:57.985 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:57.985 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:57.990 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:57.990 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:16:58.014 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket check tests 2024-09-14T11:16:58.014 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:16:58.015 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:16:58.015 INFO:tasks.workunit.client.0.smithi094.stdout:connected to https://localhost:443 2024-09-14T11:16:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-14T11:16:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:16:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-14T11:16:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-14T11:16:58.079 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-14T11:16:58.079 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:58.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:58.158 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:16:58.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:16:58.527 DEBUG:teuthology.parallel:result is None 2024-09-14T11:16:58.528 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:58.566 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:58.566 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:58.636 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:16:58.637 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:16:58.649 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:16:58.649 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:16:58.650 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:58.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:16:58.707 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:16:58.707 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:58.776 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:16:58.776 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:16:58.845 INFO:tasks.workunit:timeout=3h 2024-09-14T11:16:58.845 INFO:tasks.workunit:cleanup=True 2024-09-14T11:16:58.846 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:16:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:17:55.554 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:17:55.554 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.554 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:17:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:17:55.556 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:17:55.624 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:17:55.626 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:17:55.627 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:17:55.676 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:17:55.724 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:17:55.763 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:17:55.764 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:17:55.765 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:17:55.802 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:17:55.806 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:17:55.806 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:17:55.876 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:17:55.877 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:17:55.877 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:17:57.198 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:17:57.198 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-14T11:17:57.198 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:17:57.198 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:17:57.198 INFO:tasks.workunit.client.0.smithi094.stdout: client.5021 expiration=2024-09-14T11:19:57.196168+0000 addr=v1:172.21.15.94:0/3289300621 cookie= 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout: client.5021 expiration=2024-09-14T11:19:57.203841+0000 addr=v1:172.21.15.94:0/3289300621 cookie= 2024-09-14T11:17:57.202 INFO:tasks.workunit.client.0.smithi094.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.94:0/1339115194 cookie= 2024-09-14T11:17:57.204 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:17:57.204 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-14T11:17:57.204 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:17:57.204 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:17:57.204 INFO:tasks.workunit.client.0.smithi094.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.94:0/1339115194 cookie= 2024-09-14T11:17:58.152 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultiLocking (2193 ms) 2024-09-14T11:17:58.152 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:18:00.404 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:18:00.405 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-14T11:18:00.405 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:18:00.405 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:18:00.405 INFO:tasks.workunit.client.0.smithi094.stdout: client.5187 expiration=0.000000 addr=v1:172.21.15.94:0/1238509554 cookie= 2024-09-14T11:18:00.407 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:18:00.407 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-14T11:18:00.407 INFO:tasks.workunit.client.0.smithi094.stdout: tag: new_tag 2024-09-14T11:18:00.407 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:18:00.407 INFO:tasks.workunit.client.0.smithi094.stdout: client.5030 expiration=0.000000 addr=v1:172.21.15.94:0/2603596824 cookie= 2024-09-14T11:18:01.169 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMeta (3017 ms) 2024-09-14T11:18:01.169 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:18:03.192 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:18:03.192 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-14T11:18:03.193 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:18:03.193 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.94:0/2177149443 cookie= 2024-09-14T11:18:03.195 INFO:tasks.workunit.client.0.smithi094.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.94:0/2177149443 cookie=new cookie 2024-09-14T11:18:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestCookie (3011 ms) 2024-09-14T11:18:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:18:07.197 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultipleLocks (3016 ms) 2024-09-14T11:18:07.198 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:18:14.232 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestLockDuration (7036 ms) 2024-09-14T11:18:14.233 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestAssertLocked (3024 ms) 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:18:20.274 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestSetCookie (3017 ms) 2024-09-14T11:18:20.274 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:18:41.317 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestRenew (21043 ms) 2024-09-14T11:18:41.317 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:18:47.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6077 ms) 2024-09-14T11:18:47.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:18:55.423 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8029 ms) 2024-09-14T11:18:55.423 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8033 ms) 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock (67496 ms total) 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (67496 ms total) 2024-09-14T11:19:03.456 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-14T11:19:03.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:03.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:03.543 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:19:03.544 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:19:03.544 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:19:03.630 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:03.630 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:03.630 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:03.630 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log 2024-09-14T11:19:03.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:19:06.467 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_same_time (2837 ms) 2024-09-14T11:19:06.467 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:19:09.481 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_different_time (3015 ms) 2024-09-14T11:19:09.482 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:19:12.513 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_time (3031 ms) 2024-09-14T11:19:12.513 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_marker (3019 ms) 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log (11902 ms total) 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (11902 ms total) 2024-09-14T11:19:15.532 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:15.535 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:15.535 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:15.577 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:19:15.579 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:19:15.579 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:19:15.664 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:15.664 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:19:15.664 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:15.664 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:19:15.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:19:18.592 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit (2927 ms) 2024-09-14T11:19:18.592 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:19:21.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3015 ms) 2024-09-14T11:19:21.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:19:30.638 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap (9031 ms) 2024-09-14T11:19:30.638 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:19:33.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit (3032 ms) 2024-09-14T11:19:33.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:19:36.676 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set (3006 ms) 2024-09-14T11:19:36.676 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:19:43.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_ec (7027 ms) 2024-09-14T11:19:43.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:19:50.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7046 ms) 2024-09-14T11:19:50.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:20:03.817 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap_ec (13068 ms) 2024-09-14T11:20:03.817 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:20:10.857 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit_ec (7040 ms) 2024-09-14T11:20:10.857 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set_ec (7043 ms) 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount (62235 ms total) 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (62235 ms total) 2024-09-14T11:20:17.900 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-14T11:20:17.902 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:17.902 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:17.946 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:20:17.947 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:20:17.947 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:20:17.995 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:20:17.995 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:20:17.995 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:17.995 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:20:19.912 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:20:19.952 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_basic (40 ms) 2024-09-14T11:20:19.952 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:20:19.986 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (34 ms) 2024-09-14T11:20:19.986 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:20:20.029 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-14T11:20:20.029 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:20:21.516 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest (1487 ms) 2024-09-14T11:20:21.516 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:20:21.523 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-14T11:20:21.523 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:20:21.544 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list (21 ms) 2024-09-14T11:20:21.544 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:20:39.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list_delimited (18266 ms) 2024-09-14T11:20:39.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:20:39.879 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_list (69 ms) 2024-09-14T11:20:39.879 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:20:39.888 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_set (9 ms) 2024-09-14T11:20:39.889 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:20:39.897 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-09-14T11:20:39.898 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:20:47.169 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_defer (7272 ms) 2024-09-14T11:20:47.170 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:20:47.477 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_basic (308 ms) 2024-09-14T11:20:47.477 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:20:47.479 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-14T11:20:47.479 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:20:47.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear (94 ms) 2024-09-14T11:20:47.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:20:47.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_log_trim (40 ms) 2024-09-14T11:20:47.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:20:47.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2024-09-14T11:20:47.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:20:47.641 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_list (12 ms) 2024-09-14T11:20:47.641 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:20:47.650 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-14T11:20:48.175 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw (27739 ms total) 2024-09-14T11:20:48.175 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:20:48.175 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:48.175 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 18 tests from 1 test suite ran. (30180 ms total) 2024-09-14T11:20:48.175 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 18 tests. 2024-09-14T11:20:48.177 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:48.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:48.217 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:20:48.218 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:20:48.218 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:20:48.301 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:20:48.301 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:20:48.301 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:48.301 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:20:48.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:20:50.179 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.init (1878 ms) 2024-09-14T11:20:50.179 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:20:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] list info tag = chain-0 2024-09-14T11:20:50.205 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (26 ms) 2024-09-14T11:20:50.205 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:20:50.214 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:20:50.214 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (10 ms) 2024-09-14T11:20:50.214 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:20:50.222 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T11:20:50.222 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:20:50.328 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (106 ms) 2024-09-14T11:20:50.329 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:20:50.337 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-14T11:20:50.337 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:20:50.345 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-14T11:20:50.345 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:20:50.352 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-14T11:20:50.352 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.finalize (845 ms) 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc (2897 ms total) 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (2897 ms total) 2024-09-14T11:20:51.198 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-14T11:20:51.200 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:51.201 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:51.286 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:20:51.287 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:20:51.288 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:20:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:51.345 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:20:51.345 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:20:53.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.222+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=CKGK9IUCUWPH type=del size=1390171 2024-09-14T11:20:53.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.224+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=GFI4ZYM91I8U type=del size=2896123 2024-09-14T11:20:53.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.225+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=73RAVFRGM859 type=del size=2069552 2024-09-14T11:20:53.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.226+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=ISLGCMHLQLJN type=del size=2285956 2024-09-14T11:20:53.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.229+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~FWYA9GDUB1HQ.0 size=1048576 2024-09-14T11:20:53.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.230+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~FWYA9GDUB1HQ.1 size=1042223 2024-09-14T11:20:53.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.230+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=FWYA9GDUB1HQ tag=LDRTAWD08P2W type=write size=3139375 2024-09-14T11:20:53.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.232+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.0 size=1048576 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.233+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.1 size=1048576 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.235+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.2 size=966156 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.235+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=6DBOB5TL5PSI tag=1TC0DH4DASE3 type=write size=4111884 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.236+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=ZPD5GX25YCKP type=del size=1894238 2024-09-14T11:20:53.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.237+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=T92TLZG0HSP0 type=del size=3682346 2024-09-14T11:20:53.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.239+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=YHH2851DZB67 type=del size=2185577 2024-09-14T11:20:53.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.240+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=V805IVVZCZAM type=del size=1632462 2024-09-14T11:20:53.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.241+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=WLKKHJ9K6IXA type=del size=1357000 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.244+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~LMAWHA4DY5WN.0 size=234491 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.244+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=LMAWHA4DY5WN tag=N0TWIAEO7HXL type=write size=1283067 2024-09-14T11:20:53.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.245+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=5GVFQ0MG85D8 type=del size=761470 2024-09-14T11:20:53.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.246+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=EP2B5UQY2FLN type=del size=1959850 2024-09-14T11:20:53.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.248+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=RYIM9XFIMGGI type=write size=338957 2024-09-14T11:20:53.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.250+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.0 size=1048576 2024-09-14T11:20:53.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.251+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.1 size=1048576 2024-09-14T11:20:53.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.252+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.2 size=750376 2024-09-14T11:20:53.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.252+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=KIBFXNVCKE87 tag=13UPZY1AASS6 type=write size=3896104 2024-09-14T11:20:53.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.253+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=CKGK9IUCUWPH type=del 2024-09-14T11:20:53.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.255+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=6Z4CTNIL8QKU type=del size=3289569 2024-09-14T11:20:53.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.256+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=GFI4ZYM91I8U type=del 2024-09-14T11:20:53.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.257+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=59KPJKPA7M0J type=del size=1715260 2024-09-14T11:20:53.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.258+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=73RAVFRGM859 type=del 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.261+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.0 size=1048576 2024-09-14T11:20:53.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.262+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.1 size=1048576 2024-09-14T11:20:53.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.263+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.2 size=830483 2024-09-14T11:20:53.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.263+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=TW1P7MXA1IE0 tag=6B061Y73Q57Q type=write size=3976211 2024-09-14T11:20:53.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.264+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=ISLGCMHLQLJN type=del 2024-09-14T11:20:53.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.266+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~A2NWDJ88LGMQ.0 size=1048576 2024-09-14T11:20:53.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.267+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~A2NWDJ88LGMQ.1 size=837403 2024-09-14T11:20:53.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.267+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=A2NWDJ88LGMQ tag=Y18JRCWB65XA type=write size=2934555 2024-09-14T11:20:53.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.267+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~FWYA9GDUB1HQ.0 size=1048576 2024-09-14T11:20:53.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.267+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~FWYA9GDUB1HQ.1 size=1042223 2024-09-14T11:20:53.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.269+0000 7fc354693780 1 < canceled multipart upload key=QWMHFF32M37W upload=FWYA9GDUB1HQ tag=LDRTAWD08P2W type=write size=3139375 2024-09-14T11:20:53.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.272+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~V5B4UI8BMV35.0 size=901179 2024-09-14T11:20:53.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.272+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=V5B4UI8BMV35 tag=6QS72K86HJYS type=write size=1949755 2024-09-14T11:20:53.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.273+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.0 size=1048576 2024-09-14T11:20:53.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.274+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.1 size=1048576 2024-09-14T11:20:53.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.275+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6DBOB5TL5PSI.2 size=966156 2024-09-14T11:20:53.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.277+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=6DBOB5TL5PSI tag=1TC0DH4DASE3 type=write size=4111884 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.279+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=YQMB9Y2TMT3R type=del size=3003024 2024-09-14T11:20:53.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.280+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=ZPD5GX25YCKP type=del 2024-09-14T11:20:53.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.281+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=M1O2R6NHICJR type=del size=3952752 2024-09-14T11:20:53.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.284+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=T92TLZG0HSP0 type=del size=3682346 2024-09-14T11:20:53.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.286+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.0 size=1048576 2024-09-14T11:20:53.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.287+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.1 size=1048576 2024-09-14T11:20:53.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.288+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.2 size=525193 2024-09-14T11:20:53.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.288+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=GVNJ9OL1S74V tag=BHZMH7NBAJ70 type=write size=3670921 2024-09-14T11:20:53.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.289+0000 7fc354693780 1 < canceled operation key=GE83T07IQG0S tag=YHH2851DZB67 type=del size=2185577 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.292+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~D34OPDZJ68VS.0 size=1048576 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.293+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~D34OPDZJ68VS.1 size=250040 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.293+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=D34OPDZJ68VS tag=TYQ4H2D8OIFG type=write size=2347192 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.294+0000 7fc354693780 1 < canceled operation key=X4VH2WYJJ8GI tag=V805IVVZCZAM type=del size=1632462 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.296+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=LBOZJ210QTRK type=write size=13893 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.298+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=WLKKHJ9K6IXA type=del 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.300+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.0 size=1048576 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.301+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.1 size=1048576 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.302+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.2 size=938555 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.302+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=4VDKCN8WHQK3 tag=3HP4NKJMASL1 type=write size=4084283 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.304+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~LMAWHA4DY5WN.0 size=234491 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.305+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=LMAWHA4DY5WN tag=N0TWIAEO7HXL type=write size=1283067 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.306+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=YUGWZPQ2GLKF type=del size=922397 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.308+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=5GVFQ0MG85D8 type=del 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.309+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=9MFW2EJY949Q type=del size=325200 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.310+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=EP2B5UQY2FLN type=del 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.311+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=1UI5FJH2L4DW type=write size=991577 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.312+0000 7fc354693780 1 < completed write operation key=JF6PHF17N5WE tag=RYIM9XFIMGGI type=write size=338957 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.314+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~C3ACTRQL51EJ.0 size=1048576 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.315+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~C3ACTRQL51EJ.1 size=287122 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.315+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=C3ACTRQL51EJ tag=VQ7K8KRMSMTC type=write size=2384274 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.316+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.0 size=1048576 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.317+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.1 size=1048576 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.318+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~KIBFXNVCKE87.2 size=750376 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.320+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=KIBFXNVCKE87 tag=13UPZY1AASS6 type=write size=3896104 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.321+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=S33AFGD02A60 type=write size=265392 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.322+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=6Z4CTNIL8QKU type=del 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.324+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.0 size=1048576 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.325+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.1 size=1048576 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.326+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.2 size=272317 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.326+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=WWOPE0JASWIS tag=6FVJ8IUZY70P type=write size=3418045 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.327+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=59KPJKPA7M0J type=del 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.329+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.0 size=1048576 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.330+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.1 size=1048576 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.331+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.2 size=495262 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.331+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=UUUT0A3TMR7X tag=JYQ13PY9ODY6 type=write size=3640990 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.332+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.0 size=1048576 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.333+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.1 size=1048576 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.334+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TW1P7MXA1IE0.2 size=830483 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.335+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=TW1P7MXA1IE0 tag=6B061Y73Q57Q type=write size=3976211 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.337+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=X8KRF8RSPO9G type=del size=3624807 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.338+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~A2NWDJ88LGMQ.0 size=1048576 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.339+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~A2NWDJ88LGMQ.1 size=837403 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.341+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=A2NWDJ88LGMQ tag=Y18JRCWB65XA type=write size=2934555 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.342+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=D7J2POVXLP5H type=del size=635238 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.343+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~V5B4UI8BMV35.0 size=901179 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.345+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=V5B4UI8BMV35 tag=6QS72K86HJYS type=write size=1949755 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.347+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=0NRII4GVL5WM type=del size=3642184 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.348+0000 7fc354693780 1 < canceled operation key=4IDBIAE3VAY4 tag=YQMB9Y2TMT3R type=del size=3003024 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.349+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=HRFB0S0QUYWE type=del size=1126500 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.352+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=M1O2R6NHICJR type=del size=3952752 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.354+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~AG9C3I68PVQU.0 size=1048576 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.355+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~AG9C3I68PVQU.1 size=258782 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.355+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=AG9C3I68PVQU tag=AH7ZAGXME606 type=write size=2355934 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.355+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.0 size=1048576 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.355+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.1 size=1048576 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.356+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~GVNJ9OL1S74V.2 size=525193 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.358+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=GVNJ9OL1S74V tag=BHZMH7NBAJ70 type=write size=3670921 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.360+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.0 size=1048576 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.361+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.1 size=1048576 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.361+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.2 size=619350 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.361+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=Y1HBRN623JEN tag=TSLJYQU8FPNK type=write size=3765078 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.362+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~D34OPDZJ68VS.0 size=1048576 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.362+0000 7fc354693780 1 < canceled part key=_multipart_FMG2DNGS0LZ3.2~D34OPDZJ68VS.1 size=250040 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.364+0000 7fc354693780 1 < canceled multipart upload key=FMG2DNGS0LZ3 upload=D34OPDZJ68VS tag=TYQ4H2D8OIFG type=write size=2347192 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.365+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=X9R58L02OBXF type=del size=154426 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.366+0000 7fc354693780 1 < completed write operation key=54EUIL28P2H1 tag=LBOZJ210QTRK type=write size=13893 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.367+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=IAQDW4CF9HG0 type=del size=3372842 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.369+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.0 size=1048576 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.369+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.1 size=1048576 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.370+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~4VDKCN8WHQK3.2 size=938555 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.372+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=4VDKCN8WHQK3 tag=3HP4NKJMASL1 type=write size=4084283 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.373+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=B6AA6HIKPL5A type=del size=1375989 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.374+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=YUGWZPQ2GLKF type=del 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.376+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=IVLNI86QBODY type=del size=710359 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.377+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=9MFW2EJY949Q type=del 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.378+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=6DDR5SSKWX42 type=del size=1834806 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.379+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=1UI5FJH2L4DW type=write size=991577 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.381+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~B02NQYRCUSEM.0 size=65009 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.381+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=B02NQYRCUSEM tag=0M4ZEYNGXQ79 type=write size=1113585 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.382+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~C3ACTRQL51EJ.0 size=1048576 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.383+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~C3ACTRQL51EJ.1 size=287122 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.385+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=C3ACTRQL51EJ tag=VQ7K8KRMSMTC type=write size=2384274 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.387+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~J98SH8B1POD6.0 size=1048576 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.388+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~J98SH8B1POD6.1 size=680477 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.388+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=J98SH8B1POD6 tag=3L4808M0121T type=write size=2777629 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.389+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=S33AFGD02A60 type=write size=265392 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.391+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=UH1PAZTQS4XZ type=del size=150561 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.392+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.0 size=1048576 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.393+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.1 size=1048576 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.393+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~WWOPE0JASWIS.2 size=272317 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.395+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=WWOPE0JASWIS tag=6FVJ8IUZY70P type=write size=3418045 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.396+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=YRCMLUF3YRWG type=del size=2585113 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.398+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.0 size=1048576 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.398+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.1 size=1048576 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.399+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~UUUT0A3TMR7X.2 size=495262 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.401+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=UUUT0A3TMR7X tag=JYQ13PY9ODY6 type=write size=3640990 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.402+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=5IQGRKGYKS05 type=del size=2778374 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.404+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=X8KRF8RSPO9G type=del 2024-09-14T11:20:53.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.406+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~DGE2VLX3RW8X.0 size=299255 2024-09-14T11:20:53.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.406+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=DGE2VLX3RW8X tag=5QKR3U27ZK5L type=write size=1347831 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.407+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=D7J2POVXLP5H type=del 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.408+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=RZ0AXKK9G1NX type=del size=829433 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.410+0000 7fc354693780 1 < suggested update operation key=977GI7HKD9JJ tag=0NRII4GVL5WM type=del size=3642184 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.411+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=FJCQJP8AAJKZ type=del size=559172 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.413+0000 7fc354693780 1 < suggested remove operation key=BTET4HD5NY0D tag=HRFB0S0QUYWE type=del 2024-09-14T11:20:53.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.415+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=S6MM3LL3890J type=del size=3913724 2024-09-14T11:20:53.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.415+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~AG9C3I68PVQU.0 size=1048576 2024-09-14T11:20:53.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.416+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~AG9C3I68PVQU.1 size=258782 2024-09-14T11:20:53.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.418+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=AG9C3I68PVQU tag=AH7ZAGXME606 type=write size=2355934 2024-09-14T11:20:53.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.420+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~MMARPM8TS3DV.0 size=1048576 2024-09-14T11:20:53.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.421+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~MMARPM8TS3DV.1 size=317535 2024-09-14T11:20:53.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.421+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=MMARPM8TS3DV tag=9MS4CVMFEH85 type=write size=2414687 2024-09-14T11:20:53.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.422+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.0 size=1048576 2024-09-14T11:20:53.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.423+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.1 size=1048576 2024-09-14T11:20:53.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.424+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~Y1HBRN623JEN.2 size=619350 2024-09-14T11:20:53.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.426+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=Y1HBRN623JEN tag=TSLJYQU8FPNK type=write size=3765078 2024-09-14T11:20:53.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.427+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=H18SBXIMQG25 type=del size=1244454 2024-09-14T11:20:53.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.428+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=X9R58L02OBXF type=del 2024-09-14T11:20:53.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.430+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.0 size=1048576 2024-09-14T11:20:53.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.431+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.1 size=1048576 2024-09-14T11:20:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.432+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.2 size=639088 2024-09-14T11:20:53.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.432+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=2X7Z55JJDF2Z tag=XG1UFMIBB24N type=write size=3784816 2024-09-14T11:20:53.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.433+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=IAQDW4CF9HG0 type=del 2024-09-14T11:20:53.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.435+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=9KSOTS0BR4XT type=del size=1600847 2024-09-14T11:20:53.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.437+0000 7fc354693780 1 < suggested remove operation key=Z3ZFX1354IRF tag=B6AA6HIKPL5A type=del 2024-09-14T11:20:53.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.438+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=794EQHUMUHW3 type=del size=367102 2024-09-14T11:20:53.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.440+0000 7fc354693780 1 < suggested update operation key=EFX0VXGHRUDR tag=IVLNI86QBODY type=del size=710359 2024-09-14T11:20:53.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.442+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~4XC9HWZ7NG0H.0 size=1048576 2024-09-14T11:20:53.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.443+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~4XC9HWZ7NG0H.1 size=760925 2024-09-14T11:20:53.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.443+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=4XC9HWZ7NG0H tag=PVHIKE7UTSH6 type=write size=2858077 2024-09-14T11:20:53.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.445+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=6DDR5SSKWX42 type=del 2024-09-14T11:20:53.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.447+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=XM2QK0BC3HOZ type=write size=62541 2024-09-14T11:20:53.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.448+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~B02NQYRCUSEM.0 size=65009 2024-09-14T11:20:53.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.449+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=B02NQYRCUSEM tag=0M4ZEYNGXQ79 type=write size=1113585 2024-09-14T11:20:53.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.451+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.0 size=1048576 2024-09-14T11:20:53.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.453+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.1 size=1048576 2024-09-14T11:20:53.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.454+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.2 size=136530 2024-09-14T11:20:53.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.454+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=QJT3AFHNQNBJ tag=2NSCXU3A6XW1 type=write size=3282258 2024-09-14T11:20:53.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.455+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~J98SH8B1POD6.0 size=1048576 2024-09-14T11:20:53.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.456+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~J98SH8B1POD6.1 size=680477 2024-09-14T11:20:53.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.457+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=J98SH8B1POD6 tag=3L4808M0121T type=write size=2777629 2024-09-14T11:20:53.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.458+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=NXCBKV9409C3 type=del size=1964116 2024-09-14T11:20:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.460+0000 7fc354693780 -1 < failed to complete operation key=EFX0VXGHRUDR tag=UH1PAZTQS4XZ type=del size=150561: (22) Invalid argument 2024-09-14T11:20:53.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.461+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~1J0W0M2ACSC0.0 size=1048576 2024-09-14T11:20:53.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.462+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~1J0W0M2ACSC0.1 size=540318 2024-09-14T11:20:53.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.462+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=1J0W0M2ACSC0 tag=4BSS2MOAWU3V type=write size=2637470 2024-09-14T11:20:53.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.463+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=YRCMLUF3YRWG type=del 2024-09-14T11:20:53.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.465+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=HBPWLQ4AZ8PA type=del size=551702 2024-09-14T11:20:53.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.466+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=5IQGRKGYKS05 type=del 2024-09-14T11:20:53.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.467+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=JBPKSEOCJOZA type=del size=2186652 2024-09-14T11:20:53.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.467+0000 7fc354693780 1 < canceled part key=_multipart_IGZK9BWJFCV3.2~DGE2VLX3RW8X.0 size=299255 2024-09-14T11:20:53.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.469+0000 7fc354693780 1 < canceled multipart upload key=IGZK9BWJFCV3 upload=DGE2VLX3RW8X tag=5QKR3U27ZK5L type=write size=1347831 2024-09-14T11:20:53.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.470+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=4IQI73WJAR1J type=del size=435221 2024-09-14T11:20:53.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.471+0000 7fc354693780 -1 < failed to complete operation key=EFX0VXGHRUDR tag=RZ0AXKK9G1NX type=del size=829433: (22) Invalid argument 2024-09-14T11:20:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.472+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=2716143FU4MW type=del size=194070 2024-09-14T11:20:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.475+0000 7fc354693780 1 < suggested update operation key=GE83T07IQG0S tag=FJCQJP8AAJKZ type=del size=559172 2024-09-14T11:20:53.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.476+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=S7NP6X3R0PD4 type=write size=70682 2024-09-14T11:20:53.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.477+0000 7fc354693780 -1 < failed to complete operation key=Z3ZFX1354IRF tag=S6MM3LL3890J type=del size=3913724: (22) Invalid argument 2024-09-14T11:20:53.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.479+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~G0J4D4P0A1A6.0 size=1048576 2024-09-14T11:20:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.480+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~G0J4D4P0A1A6.1 size=493306 2024-09-14T11:20:53.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.480+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=G0J4D4P0A1A6 tag=U9NF29FGN9IB type=write size=2590458 2024-09-14T11:20:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.481+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~MMARPM8TS3DV.0 size=1048576 2024-09-14T11:20:53.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.482+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~MMARPM8TS3DV.1 size=317535 2024-09-14T11:20:53.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.484+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=MMARPM8TS3DV tag=9MS4CVMFEH85 type=write size=2414687 2024-09-14T11:20:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.486+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~JCMJ4QR33FR6.0 size=219993 2024-09-14T11:20:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.486+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=JCMJ4QR33FR6 tag=1GTOIBGVOGBF type=write size=1268569 2024-09-14T11:20:53.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.487+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=H18SBXIMQG25 type=del 2024-09-14T11:20:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.489+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=4PLL94IWOXOH type=del size=3008417 2024-09-14T11:20:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.490+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.0 size=1048576 2024-09-14T11:20:53.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.491+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.1 size=1048576 2024-09-14T11:20:53.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.491+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~2X7Z55JJDF2Z.2 size=639088 2024-09-14T11:20:53.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.493+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=2X7Z55JJDF2Z tag=XG1UFMIBB24N type=write size=3784816 2024-09-14T11:20:53.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.494+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=IZY64N1SUEPY type=del size=2181928 2024-09-14T11:20:53.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.496+0000 7fc354693780 1 < suggested update operation key=WBT3M1NMEEAY tag=9KSOTS0BR4XT type=del size=1600847 2024-09-14T11:20:53.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.498+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.0 size=1048576 2024-09-14T11:20:53.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.499+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.1 size=1048576 2024-09-14T11:20:53.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.500+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.2 size=54897 2024-09-14T11:20:53.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.500+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=OFSUMR1ZW9E9 tag=96WTYK5FRNCY type=write size=3200625 2024-09-14T11:20:53.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.502+0000 7fc354693780 1 < suggested update operation key=WBT3M1NMEEAY tag=794EQHUMUHW3 type=del size=367102 2024-09-14T11:20:53.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.504+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.0 size=1048576 2024-09-14T11:20:53.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.505+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.1 size=1048576 2024-09-14T11:20:53.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.506+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.2 size=368407 2024-09-14T11:20:53.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.506+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=3K0P7T9QDN2D tag=L991T6PXNM5S type=write size=3514135 2024-09-14T11:20:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.508+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~4XC9HWZ7NG0H.0 size=1048576 2024-09-14T11:20:53.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.509+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~4XC9HWZ7NG0H.1 size=760925 2024-09-14T11:20:53.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.511+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=4XC9HWZ7NG0H tag=PVHIKE7UTSH6 type=write size=2858077 2024-09-14T11:20:53.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.512+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=V97M68OGNFF0 type=del size=1177038 2024-09-14T11:20:53.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.515+0000 7fc354693780 1 < suggested remove operation key=4Z3KI5X3WQ0I tag=XM2QK0BC3HOZ type=write 2024-09-14T11:20:53.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.516+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=7VTCB2IUEIM8 type=del size=2843596 2024-09-14T11:20:53.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.517+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.0 size=1048576 2024-09-14T11:20:53.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.518+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.1 size=1048576 2024-09-14T11:20:53.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.519+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~QJT3AFHNQNBJ.2 size=136530 2024-09-14T11:20:53.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.521+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=QJT3AFHNQNBJ tag=2NSCXU3A6XW1 type=write size=3282258 2024-09-14T11:20:53.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.522+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=FXJ13H8MRTZU type=write size=766669 2024-09-14T11:20:53.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.524+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=NXCBKV9409C3 type=del size=1964116 2024-09-14T11:20:53.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.525+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=RJMNONJRRWVE type=del size=3960200 2024-09-14T11:20:53.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.526+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~1J0W0M2ACSC0.0 size=1048576 2024-09-14T11:20:53.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.526+0000 7fc354693780 1 < canceled part key=_multipart_X4VH2WYJJ8GI.2~1J0W0M2ACSC0.1 size=540318 2024-09-14T11:20:53.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.528+0000 7fc354693780 1 < canceled multipart upload key=X4VH2WYJJ8GI upload=1J0W0M2ACSC0 tag=4BSS2MOAWU3V type=write size=2637470 2024-09-14T11:20:53.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.529+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=35B106ST3E2G type=del size=1517191 2024-09-14T11:20:53.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.530+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=HBPWLQ4AZ8PA type=del 2024-09-14T11:20:53.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.532+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=YJCA1KLD74F2 type=del size=788104 2024-09-14T11:20:53.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.533+0000 7fc354693780 -1 < failed to complete operation key=GE83T07IQG0S tag=JBPKSEOCJOZA type=del size=2186652: (22) Invalid argument 2024-09-14T11:20:53.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.535+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~YBYQVSGY8RE2.0 size=1048576 2024-09-14T11:20:53.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.536+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~YBYQVSGY8RE2.1 size=888239 2024-09-14T11:20:53.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.536+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=YBYQVSGY8RE2 tag=6XLA3TQWLHWO type=write size=2985391 2024-09-14T11:20:53.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.537+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=4IQI73WJAR1J type=del 2024-09-14T11:20:53.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.538+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=GVJOZ6PFYHMV type=del size=1244595 2024-09-14T11:20:53.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.539+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=2716143FU4MW type=del 2024-09-14T11:20:53.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.541+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~DSDI2O75DWEO.0 size=1048576 2024-09-14T11:20:53.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.542+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~DSDI2O75DWEO.1 size=693400 2024-09-14T11:20:53.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.542+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=DSDI2O75DWEO tag=0GM96MR4CJ7B type=write size=2790552 2024-09-14T11:20:53.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.544+0000 7fc354693780 1 < suggested update operation key=54EUIL28P2H1 tag=S7NP6X3R0PD4 type=write size=70682 2024-09-14T11:20:53.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.546+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=P65Z2QX4SMM4 type=del size=2500554 2024-09-14T11:20:53.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.547+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~G0J4D4P0A1A6.0 size=1048576 2024-09-14T11:20:53.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.548+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~G0J4D4P0A1A6.1 size=493306 2024-09-14T11:20:53.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.550+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=G0J4D4P0A1A6 tag=U9NF29FGN9IB type=write size=2590458 2024-09-14T11:20:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.551+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~BSXE0WY2D3W3.0 size=919404 2024-09-14T11:20:53.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.551+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=BSXE0WY2D3W3 tag=E7ORDFJQPZJU type=write size=1967980 2024-09-14T11:20:53.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.553+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~JCMJ4QR33FR6.0 size=219993 2024-09-14T11:20:53.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.555+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=JCMJ4QR33FR6 tag=1GTOIBGVOGBF type=write size=1268569 2024-09-14T11:20:53.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.556+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=JD66XZDKNIYB type=write size=338938 2024-09-14T11:20:53.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.557+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=4PLL94IWOXOH type=del 2024-09-14T11:20:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.560+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~022T93LTCF2Z.0 size=894824 2024-09-14T11:20:53.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.560+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=022T93LTCF2Z tag=XELZFG4NV8TJ type=write size=1943400 2024-09-14T11:20:53.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.562+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=IZY64N1SUEPY type=del size=2181928 2024-09-14T11:20:53.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.564+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~9HYZ23IWRTQM.0 size=119008 2024-09-14T11:20:53.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.564+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=9HYZ23IWRTQM tag=4SQMUXCUYP89 type=write size=1167584 2024-09-14T11:20:53.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.565+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.0 size=1048576 2024-09-14T11:20:53.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.566+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.1 size=1048576 2024-09-14T11:20:53.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.567+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~OFSUMR1ZW9E9.2 size=54897 2024-09-14T11:20:53.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.569+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=OFSUMR1ZW9E9 tag=96WTYK5FRNCY type=write size=3200625 2024-09-14T11:20:53.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.570+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=MJPWJA2GAR61 type=del size=2872644 2024-09-14T11:20:53.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.571+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.0 size=1048576 2024-09-14T11:20:53.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.572+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.1 size=1048576 2024-09-14T11:20:53.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.573+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~3K0P7T9QDN2D.2 size=368407 2024-09-14T11:20:53.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.574+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=3K0P7T9QDN2D tag=L991T6PXNM5S type=write size=3514135 2024-09-14T11:20:53.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.576+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=IRA05MTP4R69 type=del size=3644770 2024-09-14T11:20:53.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.577+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=V97M68OGNFF0 type=del 2024-09-14T11:20:53.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.579+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.0 size=1048576 2024-09-14T11:20:53.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.579+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.1 size=1048576 2024-09-14T11:20:53.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.580+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.2 size=595819 2024-09-14T11:20:53.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.580+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=KJ0HK8D7H2EA tag=89W0GM5VJQ1R type=write size=3741547 2024-09-14T11:20:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.581+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=7VTCB2IUEIM8 type=del 2024-09-14T11:20:53.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.583+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.0 size=1048576 2024-09-14T11:20:53.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.584+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.1 size=1048576 2024-09-14T11:20:53.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.585+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.2 size=931966 2024-09-14T11:20:53.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.585+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=1UK77HJOGSW8 tag=MK2TSEP9KF18 type=write size=4077694 2024-09-14T11:20:53.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.586+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=FXJ13H8MRTZU type=write size=766669 2024-09-14T11:20:53.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.588+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~OLR9UF60XLKO.0 size=1048576 2024-09-14T11:20:53.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.589+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~OLR9UF60XLKO.1 size=521541 2024-09-14T11:20:53.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.589+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=OLR9UF60XLKO tag=L4JF7DX829UN type=write size=2618693 2024-09-14T11:20:53.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.590+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=RJMNONJRRWVE type=del 2024-09-14T11:20:53.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.591+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=GN1HTCCQIO2W type=del size=3834901 2024-09-14T11:20:53.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.592+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=35B106ST3E2G type=del 2024-09-14T11:20:53.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.593+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=TMN0X2ED0EDW type=del size=431467 2024-09-14T11:20:53.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.594+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=YJCA1KLD74F2 type=del 2024-09-14T11:20:53.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.596+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=ZK25BF51SIEJ type=del size=3545443 2024-09-14T11:20:53.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.597+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~YBYQVSGY8RE2.0 size=1048576 2024-09-14T11:20:53.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.598+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~YBYQVSGY8RE2.1 size=888239 2024-09-14T11:20:53.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.600+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=YBYQVSGY8RE2 tag=6XLA3TQWLHWO type=write size=2985391 2024-09-14T11:20:53.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.601+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=P5B4PQ804189 type=del size=864199 2024-09-14T11:20:53.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.603+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=GVJOZ6PFYHMV type=del size=1244595 2024-09-14T11:20:53.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.604+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=8HN4BOE1FJ5H type=del size=3563141 2024-09-14T11:20:53.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.605+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~DSDI2O75DWEO.0 size=1048576 2024-09-14T11:20:53.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.606+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~DSDI2O75DWEO.1 size=693400 2024-09-14T11:20:53.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.608+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=DSDI2O75DWEO tag=0GM96MR4CJ7B type=write size=2790552 2024-09-14T11:20:53.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.609+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=2S00FHF1EAOD type=write size=871961 2024-09-14T11:20:53.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.611+0000 7fc354693780 1 < suggested remove operation key=RHVF0Z2PRDA8 tag=P65Z2QX4SMM4 type=del 2024-09-14T11:20:53.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.612+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=91J9MYVIPDBX type=del size=2187701 2024-09-14T11:20:53.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.613+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~BSXE0WY2D3W3.0 size=919404 2024-09-14T11:20:53.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.615+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=BSXE0WY2D3W3 tag=E7ORDFJQPZJU type=write size=1967980 2024-09-14T11:20:53.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.616+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=3Z6EZBI7OK2L type=del size=1186895 2024-09-14T11:20:53.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.618+0000 7fc354693780 1 < completed write operation key=GE83T07IQG0S tag=JD66XZDKNIYB type=write size=338938 2024-09-14T11:20:53.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.619+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=MJQDIQU7GIYK type=write size=29919 2024-09-14T11:20:53.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.620+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~022T93LTCF2Z.0 size=894824 2024-09-14T11:20:53.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.622+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=022T93LTCF2Z tag=XELZFG4NV8TJ type=write size=1943400 2024-09-14T11:20:53.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.624+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.0 size=1048576 2024-09-14T11:20:53.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.625+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.1 size=1048576 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.626+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.2 size=394040 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.626+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=06KZ4O8ZZQI4 tag=OATYUWV67TSQ type=write size=3539768 2024-09-14T11:20:53.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.627+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~9HYZ23IWRTQM.0 size=119008 2024-09-14T11:20:53.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.629+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=9HYZ23IWRTQM tag=4SQMUXCUYP89 type=write size=1167584 2024-09-14T11:20:53.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.630+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=4MSJGJUJ9ZQ3 type=del size=2613588 2024-09-14T11:20:53.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.631+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=MJPWJA2GAR61 type=del 2024-09-14T11:20:53.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.632+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=ZVQQSAQCG393 type=del size=777710 2024-09-14T11:20:53.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.635+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=IRA05MTP4R69 type=del 2024-09-14T11:20:53.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.636+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=6748S10TESJC type=del size=1332132 2024-09-14T11:20:53.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.637+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.0 size=1048576 2024-09-14T11:20:53.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.638+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.1 size=1048576 2024-09-14T11:20:53.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.639+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~KJ0HK8D7H2EA.2 size=595819 2024-09-14T11:20:53.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.640+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=KJ0HK8D7H2EA tag=89W0GM5VJQ1R type=write size=3741547 2024-09-14T11:20:53.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.642+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=4CMD60Q1626N type=del size=792432 2024-09-14T11:20:53.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.643+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.0 size=1048576 2024-09-14T11:20:53.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.644+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.1 size=1048576 2024-09-14T11:20:53.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.644+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~1UK77HJOGSW8.2 size=931966 2024-09-14T11:20:53.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.646+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=1UK77HJOGSW8 tag=MK2TSEP9KF18 type=write size=4077694 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.648+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=3ETE33EW33R9 type=del size=199763 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.649+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~OLR9UF60XLKO.0 size=1048576 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.650+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~OLR9UF60XLKO.1 size=521541 2024-09-14T11:20:53.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.651+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=OLR9UF60XLKO tag=L4JF7DX829UN type=write size=2618693 2024-09-14T11:20:53.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.654+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~BN2FNBX6NQSV.0 size=205972 2024-09-14T11:20:53.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.654+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=BN2FNBX6NQSV tag=L333MU17VT0V type=write size=1254548 2024-09-14T11:20:53.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.656+0000 7fc354693780 1 < suggested remove operation key=Z3ZFX1354IRF tag=GN1HTCCQIO2W type=del 2024-09-14T11:20:53.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.657+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=OEW4KY75Z38B type=del size=3995487 2024-09-14T11:20:53.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.658+0000 7fc354693780 -1 < failed to complete operation key=RHVF0Z2PRDA8 tag=TMN0X2ED0EDW type=del size=431467: (22) Invalid argument 2024-09-14T11:20:53.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.660+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~VLPMDTCCTFJ7.0 size=256127 2024-09-14T11:20:53.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.660+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=VLPMDTCCTFJ7 tag=6SW7IYDYGSVB type=write size=1304703 2024-09-14T11:20:53.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.662+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=ZK25BF51SIEJ type=del 2024-09-14T11:20:53.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.664+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.0 size=1048576 2024-09-14T11:20:53.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.665+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.1 size=1048576 2024-09-14T11:20:53.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.666+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.2 size=939904 2024-09-14T11:20:53.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.666+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=DT12BBSMD21R tag=1CRDQDD36FDK type=write size=4085632 2024-09-14T11:20:53.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.667+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=P5B4PQ804189 type=del 2024-09-14T11:20:53.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.668+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=OSJUTL1STSC9 type=del size=4055583 2024-09-14T11:20:53.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.669+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=8HN4BOE1FJ5H type=del 2024-09-14T11:20:53.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.671+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~6S9LFYXN3TBG.0 size=1048576 2024-09-14T11:20:53.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.672+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~6S9LFYXN3TBG.1 size=847792 2024-09-14T11:20:53.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.672+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=6S9LFYXN3TBG tag=1HCX8M6LS5N8 type=write size=2944944 2024-09-14T11:20:53.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.673+0000 7fc354693780 -1 < failed to complete operation key=977GI7HKD9JJ tag=2S00FHF1EAOD type=write size=871961: (22) Invalid argument 2024-09-14T11:20:53.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.675+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~W9JPP22TYLZK.0 size=684434 2024-09-14T11:20:53.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.675+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=W9JPP22TYLZK tag=6YJCK39RQVE8 type=write size=1733010 2024-09-14T11:20:53.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.676+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=91J9MYVIPDBX type=del 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.679+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~SZZTZ3BJX4BI.0 size=1048576 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.679+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~SZZTZ3BJX4BI.1 size=921347 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.679+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=SZZTZ3BJX4BI tag=UZ2E5A3RNCFF type=write size=3018499 2024-09-14T11:20:53.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.681+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=3Z6EZBI7OK2L type=del 2024-09-14T11:20:53.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.682+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=4S4GQHX68AWJ type=del size=1339787 2024-09-14T11:20:53.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.684+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=MJQDIQU7GIYK type=write size=29919 2024-09-14T11:20:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.686+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=P5UF4VWKF982 type=write size=706145 2024-09-14T11:20:53.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.686+0000 7fc354693780 1 < canceled part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.0 size=1048576 2024-09-14T11:20:53.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.687+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.1 size=1048576 2024-09-14T11:20:53.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.688+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~06KZ4O8ZZQI4.2 size=394040 2024-09-14T11:20:53.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.689+0000 7fc354693780 1 < canceled multipart upload key=ICNEXZMA3VQV upload=06KZ4O8ZZQI4 tag=OATYUWV67TSQ type=write size=3539768 2024-09-14T11:20:53.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.691+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=2JIAHZVI2AF1 type=del size=3928386 2024-09-14T11:20:53.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.692+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=4MSJGJUJ9ZQ3 type=del 2024-09-14T11:20:53.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.693+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=ZF48AJCRWNAV type=del size=2521236 2024-09-14T11:20:53.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.695+0000 7fc354693780 1 < suggested update operation key=54EUIL28P2H1 tag=ZVQQSAQCG393 type=del size=777710 2024-09-14T11:20:53.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.696+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=YRAJQMHDF7C7 type=del size=2944603 2024-09-14T11:20:53.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.699+0000 7fc354693780 1 < suggested remove operation key=MQ5V2G5U43J1 tag=6748S10TESJC type=del 2024-09-14T11:20:53.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.701+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.0 size=1048576 2024-09-14T11:20:53.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.702+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.1 size=1048576 2024-09-14T11:20:53.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.702+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.2 size=719197 2024-09-14T11:20:53.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.702+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=FVTS3DHH1I59 tag=MM372S4FOW2X type=write size=3864925 2024-09-14T11:20:53.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.704+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=4CMD60Q1626N type=del 2024-09-14T11:20:53.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.705+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=2717WQYT532Q type=del size=2717608 2024-09-14T11:20:53.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.706+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=3ETE33EW33R9 type=del 2024-09-14T11:20:53.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.707+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=K2EXBP3C88TG type=del size=2230180 2024-09-14T11:20:53.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.708+0000 7fc354693780 1 < canceled part key=_multipart_IGZK9BWJFCV3.2~BN2FNBX6NQSV.0 size=205972 2024-09-14T11:20:53.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.710+0000 7fc354693780 1 < canceled multipart upload key=IGZK9BWJFCV3 upload=BN2FNBX6NQSV tag=L333MU17VT0V type=write size=1254548 2024-09-14T11:20:53.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.711+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=HX98LEK3M5DB type=del size=452677 2024-09-14T11:20:53.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.712+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=OEW4KY75Z38B type=del 2024-09-14T11:20:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.714+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~JAT8PPHGI08I.0 size=932923 2024-09-14T11:20:53.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.714+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=JAT8PPHGI08I tag=0U7LD24PY198 type=write size=1981499 2024-09-14T11:20:53.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.715+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~VLPMDTCCTFJ7.0 size=256127 2024-09-14T11:20:53.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.717+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=VLPMDTCCTFJ7 tag=6SW7IYDYGSVB type=write size=1304703 2024-09-14T11:20:53.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.720+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~PPLZL76LT85T.0 size=1048576 2024-09-14T11:20:53.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.720+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~PPLZL76LT85T.1 size=33956 2024-09-14T11:20:53.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.721+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=PPLZL76LT85T tag=KQ1ARSVY6JQD type=write size=2131108 2024-09-14T11:20:53.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.722+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.0 size=1048576 2024-09-14T11:20:53.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.722+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.1 size=1048576 2024-09-14T11:20:53.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.723+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~DT12BBSMD21R.2 size=939904 2024-09-14T11:20:53.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.725+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=DT12BBSMD21R tag=1CRDQDD36FDK type=write size=4085632 2024-09-14T11:20:53.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.728+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~HYJMERFGV02Y.0 size=998883 2024-09-14T11:20:53.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.728+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=HYJMERFGV02Y tag=Z2YWY9F7WGH0 type=write size=2047459 2024-09-14T11:20:53.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.729+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=OSJUTL1STSC9 type=del 2024-09-14T11:20:53.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.730+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=GDMVP2OFFKTA type=write size=641719 2024-09-14T11:20:53.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.731+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~6S9LFYXN3TBG.0 size=1048576 2024-09-14T11:20:53.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.731+0000 7fc354693780 1 < canceled part key=_multipart_GE83T07IQG0S.2~6S9LFYXN3TBG.1 size=847792 2024-09-14T11:20:53.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.733+0000 7fc354693780 1 < canceled multipart upload key=GE83T07IQG0S upload=6S9LFYXN3TBG tag=1HCX8M6LS5N8 type=write size=2944944 2024-09-14T11:20:53.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.735+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~T4E1SOI554RZ.0 size=380455 2024-09-14T11:20:53.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.735+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=T4E1SOI554RZ tag=XMDE3AZZ5J05 type=write size=1429031 2024-09-14T11:20:53.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.735+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~W9JPP22TYLZK.0 size=684434 2024-09-14T11:20:53.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.737+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=W9JPP22TYLZK tag=6YJCK39RQVE8 type=write size=1733010 2024-09-14T11:20:53.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.738+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=6TM7Y80VS219 type=write size=102099 2024-09-14T11:20:53.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.739+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~SZZTZ3BJX4BI.0 size=1048576 2024-09-14T11:20:53.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.740+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~SZZTZ3BJX4BI.1 size=921347 2024-09-14T11:20:53.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.742+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=SZZTZ3BJX4BI tag=UZ2E5A3RNCFF type=write size=3018499 2024-09-14T11:20:53.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.744+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~GJJB6CJR05ZR.0 size=1015650 2024-09-14T11:20:53.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.744+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=GJJB6CJR05ZR tag=62V9BPLAD5DF type=write size=2064226 2024-09-14T11:20:53.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.746+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=4S4GQHX68AWJ type=del 2024-09-14T11:20:53.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.747+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=HMD24Y2BZERS type=del size=4089115 2024-09-14T11:20:53.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.748+0000 7fc354693780 1 < completed write operation key=H1S2CBHNW6GI tag=P5UF4VWKF982 type=write size=706145 2024-09-14T11:20:53.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.749+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=S8HJJTP4OKYM type=del size=2609606 2024-09-14T11:20:53.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.751+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=2JIAHZVI2AF1 type=del 2024-09-14T11:20:53.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.753+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~HCAE7R3J6MKW.0 size=636168 2024-09-14T11:20:53.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.753+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=HCAE7R3J6MKW tag=KWHJ6Q7UNB0H type=write size=1684744 2024-09-14T11:20:53.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.754+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=ZF48AJCRWNAV type=del 2024-09-14T11:20:53.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.756+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.0 size=1048576 2024-09-14T11:20:53.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.757+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.1 size=1048576 2024-09-14T11:20:53.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.758+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.2 size=327585 2024-09-14T11:20:53.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.758+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=K2GFND57RD49 tag=TCK8GNVC6X14 type=write size=3473313 2024-09-14T11:20:53.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.759+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=YRAJQMHDF7C7 type=del 2024-09-14T11:20:53.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.760+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=QFQX46UCEQDV type=del size=2009641 2024-09-14T11:20:53.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.761+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.0 size=1048576 2024-09-14T11:20:53.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.762+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.1 size=1048576 2024-09-14T11:20:53.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.763+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~FVTS3DHH1I59.2 size=719197 2024-09-14T11:20:53.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.765+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=FVTS3DHH1I59 tag=MM372S4FOW2X type=write size=3864925 2024-09-14T11:20:53.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.767+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~CQ52AI8WJJPI.0 size=1048576 2024-09-14T11:20:53.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.768+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~CQ52AI8WJJPI.1 size=686878 2024-09-14T11:20:53.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.768+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=CQ52AI8WJJPI tag=5KFWWQ3AVYDZ type=write size=2784030 2024-09-14T11:20:53.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.770+0000 7fc354693780 1 < canceled operation key=IJZB38U355GG tag=2717WQYT532Q type=del size=2717608 2024-09-14T11:20:53.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.771+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=POZOAN4WGH7K type=del size=3976740 2024-09-14T11:20:53.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.772+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=K2EXBP3C88TG type=del size=2230180 2024-09-14T11:20:53.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.773+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=8BONIFK3JDTN type=del size=40137 2024-09-14T11:20:53.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.775+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=HX98LEK3M5DB type=del 2024-09-14T11:20:53.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.776+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=GA7UU3Y5ITPC type=del size=415369 2024-09-14T11:20:53.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.777+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~JAT8PPHGI08I.0 size=932923 2024-09-14T11:20:53.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.779+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=JAT8PPHGI08I tag=0U7LD24PY198 type=write size=1981499 2024-09-14T11:20:53.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.781+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.0 size=1048576 2024-09-14T11:20:53.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.782+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.1 size=1048576 2024-09-14T11:20:53.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.783+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.2 size=869424 2024-09-14T11:20:53.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.783+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=AT6XS2QWPUKZ tag=B1Y3OEL7PV06 type=write size=4015152 2024-09-14T11:20:53.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.784+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~PPLZL76LT85T.0 size=1048576 2024-09-14T11:20:53.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.785+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~PPLZL76LT85T.1 size=33956 2024-09-14T11:20:53.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.787+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=PPLZL76LT85T tag=KQ1ARSVY6JQD type=write size=2131108 2024-09-14T11:20:53.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.789+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~HFFYNVYMIJQ6.0 size=1048576 2024-09-14T11:20:53.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.790+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~HFFYNVYMIJQ6.1 size=113442 2024-09-14T11:20:53.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.790+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=HFFYNVYMIJQ6 tag=Q1FMJU49H7ZY type=write size=2210594 2024-09-14T11:20:53.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.791+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~HYJMERFGV02Y.0 size=998883 2024-09-14T11:20:53.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.792+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=HYJMERFGV02Y tag=Z2YWY9F7WGH0 type=write size=2047459 2024-09-14T11:20:53.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.793+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=H0X47ZRBTB3B type=del size=413373 2024-09-14T11:20:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.796+0000 7fc354693780 1 < suggested update operation key=T0Z8NK20DS5K tag=GDMVP2OFFKTA type=write size=641719 2024-09-14T11:20:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.797+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=QQLDHWGIYFQU type=del size=2249217 2024-09-14T11:20:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.798+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~T4E1SOI554RZ.0 size=380455 2024-09-14T11:20:53.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.800+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=T4E1SOI554RZ tag=XMDE3AZZ5J05 type=write size=1429031 2024-09-14T11:20:53.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.801+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=UPGYW5GNST61 type=write size=302830 2024-09-14T11:20:53.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.802+0000 7fc354693780 1 < canceled operation key=OOFM3K1KEB9V tag=6TM7Y80VS219 type=write size=102099 2024-09-14T11:20:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.804+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~QQQAIDNB8OJ7.0 size=1048576 2024-09-14T11:20:53.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.805+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~QQQAIDNB8OJ7.1 size=866944 2024-09-14T11:20:53.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.805+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=QQQAIDNB8OJ7 tag=NGSNPP4BT5X1 type=write size=2964096 2024-09-14T11:20:53.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.806+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~GJJB6CJR05ZR.0 size=1015650 2024-09-14T11:20:53.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.808+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=GJJB6CJR05ZR tag=62V9BPLAD5DF type=write size=2064226 2024-09-14T11:20:53.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.810+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.0 size=1048576 2024-09-14T11:20:53.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.811+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.1 size=1048576 2024-09-14T11:20:53.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.812+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.2 size=256618 2024-09-14T11:20:53.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.812+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=4D1YW4GMWA40 tag=U80FWKOK5H1W type=write size=3402346 2024-09-14T11:20:53.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.813+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=HMD24Y2BZERS type=del 2024-09-14T11:20:53.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.815+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~EQM6BQWSPRFE.0 size=295746 2024-09-14T11:20:53.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.815+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=EQM6BQWSPRFE tag=UAC4E0OJKTCA type=write size=1344322 2024-09-14T11:20:53.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.816+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=S8HJJTP4OKYM type=del 2024-09-14T11:20:53.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.817+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=IMALPJK8WXDQ type=del size=2867909 2024-09-14T11:20:53.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.818+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~HCAE7R3J6MKW.0 size=636168 2024-09-14T11:20:53.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.820+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=HCAE7R3J6MKW tag=KWHJ6Q7UNB0H type=write size=1684744 2024-09-14T11:20:53.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.821+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=3TSWXQFCIDND type=del size=1706152 2024-09-14T11:20:53.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.822+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.0 size=1048576 2024-09-14T11:20:53.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.823+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.1 size=1048576 2024-09-14T11:20:53.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.824+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~K2GFND57RD49.2 size=327585 2024-09-14T11:20:53.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.826+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=K2GFND57RD49 tag=TCK8GNVC6X14 type=write size=3473313 2024-09-14T11:20:53.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.828+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~49QG7DE02JLR.0 size=666847 2024-09-14T11:20:53.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.828+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=49QG7DE02JLR tag=LV0CMRDS00KP type=write size=1715423 2024-09-14T11:20:53.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.829+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=QFQX46UCEQDV type=del 2024-09-14T11:20:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.830+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=VHQEWVX0NQE6 type=write size=967823 2024-09-14T11:20:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.832+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~CQ52AI8WJJPI.0 size=1048576 2024-09-14T11:20:53.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.832+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~CQ52AI8WJJPI.1 size=686878 2024-09-14T11:20:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.835+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=CQ52AI8WJJPI tag=5KFWWQ3AVYDZ type=write size=2784030 2024-09-14T11:20:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.836+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=FLJ3CAI4C4BD type=del size=4006387 2024-09-14T11:20:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.837+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=POZOAN4WGH7K type=del 2024-09-14T11:20:53.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.839+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.0 size=1048576 2024-09-14T11:20:53.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.840+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.1 size=1048576 2024-09-14T11:20:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.841+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.2 size=1043278 2024-09-14T11:20:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.841+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=2IJE13KOSVIH tag=ADPQ470BIPAJ type=write size=4189006 2024-09-14T11:20:53.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.842+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=8BONIFK3JDTN type=del 2024-09-14T11:20:53.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.843+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=2EEEX7Y65IH2 type=write size=505408 2024-09-14T11:20:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.846+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=GA7UU3Y5ITPC type=del 2024-09-14T11:20:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.847+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=DR9BK1FT542V type=del size=1232417 2024-09-14T11:20:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.848+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.0 size=1048576 2024-09-14T11:20:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.849+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.1 size=1048576 2024-09-14T11:20:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.850+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~AT6XS2QWPUKZ.2 size=869424 2024-09-14T11:20:53.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.852+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=AT6XS2QWPUKZ tag=B1Y3OEL7PV06 type=write size=4015152 2024-09-14T11:20:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.853+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=XJ8MXG0YUJS0 type=del size=69605 2024-09-14T11:20:53.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.854+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~HFFYNVYMIJQ6.0 size=1048576 2024-09-14T11:20:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.854+0000 7fc354693780 1 < canceled part key=_multipart_X4VH2WYJJ8GI.2~HFFYNVYMIJQ6.1 size=113442 2024-09-14T11:20:53.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.856+0000 7fc354693780 1 < canceled multipart upload key=X4VH2WYJJ8GI upload=HFFYNVYMIJQ6 tag=Q1FMJU49H7ZY type=write size=2210594 2024-09-14T11:20:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.857+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=AH6KUCA6A46R type=write size=467171 2024-09-14T11:20:53.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.858+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=H0X47ZRBTB3B type=del 2024-09-14T11:20:53.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.860+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~T86NQGLM8BBN.0 size=1048576 2024-09-14T11:20:53.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.861+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~T86NQGLM8BBN.1 size=696 2024-09-14T11:20:53.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.861+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=T86NQGLM8BBN tag=UII0I3R412IV type=write size=2097848 2024-09-14T11:20:53.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.862+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=QQLDHWGIYFQU type=del 2024-09-14T11:20:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.865+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~SKVZVDXXSL2L.0 size=1048576 2024-09-14T11:20:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.866+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~SKVZVDXXSL2L.1 size=375069 2024-09-14T11:20:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.866+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=SKVZVDXXSL2L tag=UIHQZOLIU71Y type=write size=2472221 2024-09-14T11:20:53.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.867+0000 7fc354693780 1 < canceled operation key=GE83T07IQG0S tag=UPGYW5GNST61 type=write size=302830 2024-09-14T11:20:53.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.868+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=7S1XWOI4327F type=del size=1451522 2024-09-14T11:20:53.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.868+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~QQQAIDNB8OJ7.0 size=1048576 2024-09-14T11:20:53.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.869+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~QQQAIDNB8OJ7.1 size=866944 2024-09-14T11:20:53.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.871+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=QQQAIDNB8OJ7 tag=NGSNPP4BT5X1 type=write size=2964096 2024-09-14T11:20:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.872+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=CH67KSA27Z0U type=del size=3132454 2024-09-14T11:20:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.873+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.0 size=1048576 2024-09-14T11:20:53.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.875+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.1 size=1048576 2024-09-14T11:20:53.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.875+0000 7fc354693780 1 < canceled part key=_multipart_PRBZQWTFXQ7R.2~4D1YW4GMWA40.2 size=256618 2024-09-14T11:20:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.877+0000 7fc354693780 1 < canceled multipart upload key=PRBZQWTFXQ7R upload=4D1YW4GMWA40 tag=U80FWKOK5H1W type=write size=3402346 2024-09-14T11:20:53.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.878+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=2ALU5YOOQ7YI type=del size=269583 2024-09-14T11:20:53.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.879+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~EQM6BQWSPRFE.0 size=295746 2024-09-14T11:20:53.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.881+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=EQM6BQWSPRFE tag=UAC4E0OJKTCA type=write size=1344322 2024-09-14T11:20:53.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.882+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=Q9B1J87P5941 type=del size=1909627 2024-09-14T11:20:53.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.884+0000 7fc354693780 1 < suggested update operation key=JF6PHF17N5WE tag=IMALPJK8WXDQ type=del size=2867909 2024-09-14T11:20:53.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.886+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=AQYE6U6985TD type=del size=4147480 2024-09-14T11:20:53.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.887+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=3TSWXQFCIDND type=del 2024-09-14T11:20:53.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.888+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=DUB5KU44F1VN type=del size=3315661 2024-09-14T11:20:53.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.889+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~49QG7DE02JLR.0 size=666847 2024-09-14T11:20:53.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.891+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=49QG7DE02JLR tag=LV0CMRDS00KP type=write size=1715423 2024-09-14T11:20:53.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.892+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=EOAGMQHW1Q1E type=write size=541951 2024-09-14T11:20:53.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.893+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=VHQEWVX0NQE6 type=write size=967823 2024-09-14T11:20:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.895+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.0 size=1048576 2024-09-14T11:20:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.896+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.1 size=1048576 2024-09-14T11:20:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.897+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.2 size=822676 2024-09-14T11:20:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.897+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=UUX6EVUVWKWR tag=2CCFP98XPVSQ type=write size=3968404 2024-09-14T11:20:53.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.898+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=FLJ3CAI4C4BD type=del 2024-09-14T11:20:53.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.900+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.0 size=1048576 2024-09-14T11:20:53.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.901+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.1 size=1048576 2024-09-14T11:20:53.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.902+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.2 size=924131 2024-09-14T11:20:53.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.902+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=XFJHXHD2A0RR tag=DIYOHZHOHZ2B type=write size=4069859 2024-09-14T11:20:53.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.903+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.0 size=1048576 2024-09-14T11:20:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.904+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.1 size=1048576 2024-09-14T11:20:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.905+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~2IJE13KOSVIH.2 size=1043278 2024-09-14T11:20:53.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.907+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=2IJE13KOSVIH tag=ADPQ470BIPAJ type=write size=4189006 2024-09-14T11:20:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.908+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=NVKFRWD2VIOD type=del size=3451176 2024-09-14T11:20:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.911+0000 7fc354693780 1 < suggested update operation key=54EUIL28P2H1 tag=2EEEX7Y65IH2 type=write size=505408 2024-09-14T11:20:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.912+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=237WJUM2AWBP type=write size=843111 2024-09-14T11:20:53.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.913+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=DR9BK1FT542V type=del 2024-09-14T11:20:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.914+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=J9155M9ZRAWP type=write size=238136 2024-09-14T11:20:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.915+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=XJ8MXG0YUJS0 type=del 2024-09-14T11:20:53.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.916+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=ITW7MLSRQ6QP type=del size=14841 2024-09-14T11:20:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.917+0000 7fc354693780 1 < completed write operation key=N23XJJD7YYG0 tag=AH6KUCA6A46R type=write size=467171 2024-09-14T11:20:53.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.918+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=MM2CF2W1SD46 type=del size=2451876 2024-09-14T11:20:53.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.919+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~T86NQGLM8BBN.0 size=1048576 2024-09-14T11:20:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.920+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~T86NQGLM8BBN.1 size=696 2024-09-14T11:20:53.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.922+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=T86NQGLM8BBN tag=UII0I3R412IV type=write size=2097848 2024-09-14T11:20:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.924+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.0 size=1048576 2024-09-14T11:20:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.925+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.1 size=1048576 2024-09-14T11:20:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.926+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.2 size=846447 2024-09-14T11:20:53.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.926+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=SV5ISVWJQFRB tag=48T811XHI1HD type=write size=3992175 2024-09-14T11:20:53.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.927+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~SKVZVDXXSL2L.0 size=1048576 2024-09-14T11:20:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.929+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~SKVZVDXXSL2L.1 size=375069 2024-09-14T11:20:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.930+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=SKVZVDXXSL2L tag=UIHQZOLIU71Y type=write size=2472221 2024-09-14T11:20:53.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.932+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.0 size=1048576 2024-09-14T11:20:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.933+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.1 size=1048576 2024-09-14T11:20:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.934+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.2 size=360916 2024-09-14T11:20:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.934+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=I1LF44G8P0FH tag=GPOVBUG23V8C type=write size=3506644 2024-09-14T11:20:53.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.935+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=7S1XWOI4327F type=del size=1451522 2024-09-14T11:20:53.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.937+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=LZEK6RAM4RND type=del size=2434420 2024-09-14T11:20:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.938+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=CH67KSA27Z0U type=del 2024-09-14T11:20:53.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.940+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.0 size=1048576 2024-09-14T11:20:53.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.941+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.1 size=1048576 2024-09-14T11:20:53.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.942+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.2 size=730539 2024-09-14T11:20:53.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.942+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=2VSJABBC660U tag=DHNGBWJCK1YW type=write size=3876267 2024-09-14T11:20:53.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.944+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=2ALU5YOOQ7YI type=del 2024-09-14T11:20:53.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.945+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=UT55I41HUQ1M type=del size=968774 2024-09-14T11:20:53.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.946+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=Q9B1J87P5941 type=del 2024-09-14T11:20:53.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.947+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=IF1QWY8DGWQY type=del size=3268391 2024-09-14T11:20:53.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.950+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=AQYE6U6985TD type=del size=4147480 2024-09-14T11:20:53.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.952+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~DZNOBII8SBI4.0 size=390957 2024-09-14T11:20:53.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.952+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=DZNOBII8SBI4 tag=G5H6UM2BH66R type=write size=1439533 2024-09-14T11:20:53.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.953+0000 7fc354693780 1 < canceled operation key=P061QWG9J16V tag=DUB5KU44F1VN type=del size=3315661 2024-09-14T11:20:53.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.954+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=DMABA0Y1Z8MQ type=del size=1711993 2024-09-14T11:20:53.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.955+0000 7fc354693780 1 < completed write operation key=JF6PHF17N5WE tag=EOAGMQHW1Q1E type=write size=541951 2024-09-14T11:20:53.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.957+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=6AZA81Q7W50M type=del size=2065459 2024-09-14T11:20:53.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.958+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.0 size=1048576 2024-09-14T11:20:53.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.959+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.1 size=1048576 2024-09-14T11:20:53.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.960+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~UUX6EVUVWKWR.2 size=822676 2024-09-14T11:20:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.962+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=UUX6EVUVWKWR tag=2CCFP98XPVSQ type=write size=3968404 2024-09-14T11:20:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.964+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~HJ3QMGRA7IQK.0 size=1048576 2024-09-14T11:20:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.964+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~HJ3QMGRA7IQK.1 size=983211 2024-09-14T11:20:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.964+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=HJ3QMGRA7IQK tag=JRNCO9MSVHAI type=write size=3080363 2024-09-14T11:20:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.966+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.0 size=1048576 2024-09-14T11:20:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.967+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.1 size=1048576 2024-09-14T11:20:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.967+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~XFJHXHD2A0RR.2 size=924131 2024-09-14T11:20:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.969+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=XFJHXHD2A0RR tag=DIYOHZHOHZ2B type=write size=4069859 2024-09-14T11:20:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.971+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=TLF3604T18K3 type=write size=129831 2024-09-14T11:20:53.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.973+0000 7fc354693780 1 < suggested remove operation key=PRBZQWTFXQ7R tag=NVKFRWD2VIOD type=del 2024-09-14T11:20:53.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.974+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=P0EUCBDUXLOJ type=del size=2675211 2024-09-14T11:20:53.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.975+0000 7fc354693780 1 < completed write operation key=GE83T07IQG0S tag=237WJUM2AWBP type=write size=843111 2024-09-14T11:20:53.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.976+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=JAOEZ6GA9D5O type=write size=43959 2024-09-14T11:20:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.977+0000 7fc354693780 1 < completed write operation key=JGVLT0K0CEGQ tag=J9155M9ZRAWP type=write size=238136 2024-09-14T11:20:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.978+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=MVJLYJIB8BJM type=del size=2825908 2024-09-14T11:20:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.980+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=ITW7MLSRQ6QP type=del 2024-09-14T11:20:53.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.982+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=YA7YP338E22Z type=write size=890711 2024-09-14T11:20:53.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.982+0000 7fc354693780 -1 < no bi entry to suggest for operation key=PRBZQWTFXQ7R tag=MM2CF2W1SD46 type=del size=2451876: (2) No such file or directory 2024-09-14T11:20:53.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.983+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=OCLGU5JPZ2U0 type=del size=1957851 2024-09-14T11:20:53.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.984+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.0 size=1048576 2024-09-14T11:20:53.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.985+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.1 size=1048576 2024-09-14T11:20:53.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.986+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~SV5ISVWJQFRB.2 size=846447 2024-09-14T11:20:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.988+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=SV5ISVWJQFRB tag=48T811XHI1HD type=write size=3992175 2024-09-14T11:20:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.990+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~QPJ5PHF3BCC8.0 size=1048576 2024-09-14T11:20:53.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.991+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~QPJ5PHF3BCC8.1 size=272846 2024-09-14T11:20:53.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.991+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=QPJ5PHF3BCC8 tag=UQJQ34HY82YI type=write size=2369998 2024-09-14T11:20:53.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.992+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.0 size=1048576 2024-09-14T11:20:53.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.993+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.1 size=1048576 2024-09-14T11:20:53.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.994+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~I1LF44G8P0FH.2 size=360916 2024-09-14T11:20:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.996+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=I1LF44G8P0FH tag=GPOVBUG23V8C type=write size=3506644 2024-09-14T11:20:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.997+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=FGN7HS40T7SF type=del size=614038 2024-09-14T11:20:53.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.998+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=LZEK6RAM4RND type=del 2024-09-14T11:20:53.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:53.999+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=9AIYZIRDY1BO type=del size=1245903 2024-09-14T11:20:53.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.000+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.0 size=1048576 2024-09-14T11:20:53.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.001+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.1 size=1048576 2024-09-14T11:20:54.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.001+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~2VSJABBC660U.2 size=730539 2024-09-14T11:20:54.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.003+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=2VSJABBC660U tag=DHNGBWJCK1YW type=write size=3876267 2024-09-14T11:20:54.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.004+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=U6N2EY3FFFG3 type=del size=2028007 2024-09-14T11:20:54.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.006+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=UT55I41HUQ1M type=del 2024-09-14T11:20:54.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.007+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=YTE39OHYU2XQ type=del size=3511816 2024-09-14T11:20:54.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.008+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=IF1QWY8DGWQY type=del 2024-09-14T11:20:54.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.010+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.0 size=1048576 2024-09-14T11:20:54.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.011+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.1 size=1048576 2024-09-14T11:20:54.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.012+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.2 size=537978 2024-09-14T11:20:54.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.012+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=R61DYNJGJ2FI tag=MLMQ6GWEOWNW type=write size=3683706 2024-09-14T11:20:54.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.013+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~DZNOBII8SBI4.0 size=390957 2024-09-14T11:20:54.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.015+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=DZNOBII8SBI4 tag=G5H6UM2BH66R type=write size=1439533 2024-09-14T11:20:54.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.016+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=1W9T0J5CIGP5 type=del size=2109787 2024-09-14T11:20:54.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.017+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=DMABA0Y1Z8MQ type=del 2024-09-14T11:20:54.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.018+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=J5OPYLR8ECH8 type=del size=1911159 2024-09-14T11:20:54.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.020+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=6AZA81Q7W50M type=del 2024-09-14T11:20:54.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.021+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=MQZ0Y496M1EM type=del size=161086 2024-09-14T11:20:54.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.022+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~HJ3QMGRA7IQK.0 size=1048576 2024-09-14T11:20:54.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.022+0000 7fc354693780 1 < canceled part key=_multipart_N23XJJD7YYG0.2~HJ3QMGRA7IQK.1 size=983211 2024-09-14T11:20:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.024+0000 7fc354693780 1 < canceled multipart upload key=N23XJJD7YYG0 upload=HJ3QMGRA7IQK tag=JRNCO9MSVHAI type=write size=3080363 2024-09-14T11:20:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.025+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=9CU3QTTTF0VR type=del size=3945279 2024-09-14T11:20:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.027+0000 7fc354693780 1 < suggested remove operation key=H1S2CBHNW6GI tag=TLF3604T18K3 type=write 2024-09-14T11:20:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.029+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=4WR1HUHX5FX1 type=del size=845678 2024-09-14T11:20:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.030+0000 7fc354693780 1 < canceled operation key=RHVF0Z2PRDA8 tag=P0EUCBDUXLOJ type=del size=2675211 2024-09-14T11:20:54.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.032+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~6XNV88T0X8RB.0 size=1048576 2024-09-14T11:20:54.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.033+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~6XNV88T0X8RB.1 size=646514 2024-09-14T11:20:54.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.033+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=6XNV88T0X8RB tag=BAY2H67G08A5 type=write size=2743666 2024-09-14T11:20:54.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.034+0000 7fc354693780 1 < completed write operation key=X4VH2WYJJ8GI tag=JAOEZ6GA9D5O type=write size=43959 2024-09-14T11:20:54.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.035+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=4YSQ8CAISJQ2 type=del size=3771560 2024-09-14T11:20:54.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.036+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=MVJLYJIB8BJM type=del 2024-09-14T11:20:54.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.037+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=UZ4FPWNABH2U type=write size=590790 2024-09-14T11:20:54.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.038+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=YA7YP338E22Z type=write size=890711 2024-09-14T11:20:54.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.040+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~G0HTZND0758Q.0 size=781607 2024-09-14T11:20:54.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.040+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=G0HTZND0758Q tag=PD2ST49DCGB2 type=write size=1830183 2024-09-14T11:20:54.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.041+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=OCLGU5JPZ2U0 type=del 2024-09-14T11:20:54.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.042+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=PFZSUQM53OS1 type=del size=2266541 2024-09-14T11:20:54.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.043+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~QPJ5PHF3BCC8.0 size=1048576 2024-09-14T11:20:54.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.044+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~QPJ5PHF3BCC8.1 size=272846 2024-09-14T11:20:54.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.046+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=QPJ5PHF3BCC8 tag=UQJQ34HY82YI type=write size=2369998 2024-09-14T11:20:54.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.047+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=5ZCLXL372SB4 type=write size=15351 2024-09-14T11:20:54.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.049+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=FGN7HS40T7SF type=del 2024-09-14T11:20:54.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.050+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=YC0KJN2683VZ type=del size=3113156 2024-09-14T11:20:54.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.051+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=9AIYZIRDY1BO type=del 2024-09-14T11:20:54.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.052+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=GSD5U3COXAG1 type=del size=2725971 2024-09-14T11:20:54.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.053+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=U6N2EY3FFFG3 type=del 2024-09-14T11:20:54.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.055+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~16CZGKXRBPQ8.0 size=901493 2024-09-14T11:20:54.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.055+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=16CZGKXRBPQ8 tag=R3DXS1L9U8JV type=write size=1950069 2024-09-14T11:20:54.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.056+0000 7fc354693780 -1 < failed to complete operation key=H1S2CBHNW6GI tag=YTE39OHYU2XQ type=del size=3511816: (22) Invalid argument 2024-09-14T11:20:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.057+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=2D3TV2V5O4UJ type=del size=3553898 2024-09-14T11:20:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.057+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.0 size=1048576 2024-09-14T11:20:54.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.058+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.1 size=1048576 2024-09-14T11:20:54.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.059+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~R61DYNJGJ2FI.2 size=537978 2024-09-14T11:20:54.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.061+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=R61DYNJGJ2FI tag=MLMQ6GWEOWNW type=write size=3683706 2024-09-14T11:20:54.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.062+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=QJJI1CR9KFAY type=del size=2398023 2024-09-14T11:20:54.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.063+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=1W9T0J5CIGP5 type=del 2024-09-14T11:20:54.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.064+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=6UVJMN9031LE type=del size=1252046 2024-09-14T11:20:54.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.066+0000 7fc354693780 1 < suggested remove operation key=MQ5V2G5U43J1 tag=J5OPYLR8ECH8 type=del 2024-09-14T11:20:54.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.068+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~X8DED2ZIN6PB.0 size=483300 2024-09-14T11:20:54.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.068+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=X8DED2ZIN6PB tag=X41Q43QVM3AL type=write size=1531876 2024-09-14T11:20:54.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.070+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=MQZ0Y496M1EM type=del 2024-09-14T11:20:54.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.071+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=V53W43YILVJO type=del size=1180146 2024-09-14T11:20:54.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.072+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=9CU3QTTTF0VR type=del 2024-09-14T11:20:54.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.074+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~4FQQ762LVMN5.0 size=645590 2024-09-14T11:20:54.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.074+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=4FQQ762LVMN5 tag=HWQCRXDSCG9J type=write size=1694166 2024-09-14T11:20:54.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.075+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=4WR1HUHX5FX1 type=del 2024-09-14T11:20:54.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.077+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.0 size=1048576 2024-09-14T11:20:54.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.078+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.1 size=1048576 2024-09-14T11:20:54.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.079+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.2 size=648181 2024-09-14T11:20:54.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.079+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=CJHBSOMONZSY tag=1DO249JFR2V0 type=write size=3793909 2024-09-14T11:20:54.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.080+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~6XNV88T0X8RB.0 size=1048576 2024-09-14T11:20:54.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.081+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~6XNV88T0X8RB.1 size=646514 2024-09-14T11:20:54.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.082+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=6XNV88T0X8RB tag=BAY2H67G08A5 type=write size=2743666 2024-09-14T11:20:54.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.083+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=PPZNRHC9J6SF type=del size=3995053 2024-09-14T11:20:54.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.084+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=4YSQ8CAISJQ2 type=del 2024-09-14T11:20:54.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.086+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=ZWRWTR8P6YGL type=del size=2673221 2024-09-14T11:20:54.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.087+0000 7fc354693780 1 < completed write operation key=JGVLT0K0CEGQ tag=UZ4FPWNABH2U type=write size=590790 2024-09-14T11:20:54.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.089+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~70OL4CI3EPZ9.0 size=752071 2024-09-14T11:20:54.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.089+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=70OL4CI3EPZ9 tag=0PRZNE7L8A4W type=write size=1800647 2024-09-14T11:20:54.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.091+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~G0HTZND0758Q.0 size=781607 2024-09-14T11:20:54.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.092+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=G0HTZND0758Q tag=PD2ST49DCGB2 type=write size=1830183 2024-09-14T11:20:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.094+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.0 size=1048576 2024-09-14T11:20:54.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.095+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.1 size=1048576 2024-09-14T11:20:54.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.096+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.2 size=714442 2024-09-14T11:20:54.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.096+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=U1G18NVAA212 tag=5J9XHRUT2PE3 type=write size=3860170 2024-09-14T11:20:54.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.097+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=PFZSUQM53OS1 type=del 2024-09-14T11:20:54.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.099+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.0 size=1048576 2024-09-14T11:20:54.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.100+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.1 size=1048576 2024-09-14T11:20:54.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.101+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.2 size=931050 2024-09-14T11:20:54.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.101+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=P5A1JE50KFF0 tag=S2GXJVUCQUNM type=write size=4076778 2024-09-14T11:20:54.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.103+0000 7fc354693780 1 < suggested update operation key=JGVLT0K0CEGQ tag=5ZCLXL372SB4 type=write size=15351 2024-09-14T11:20:54.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.105+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~7L531JUAPJJP.0 size=1048576 2024-09-14T11:20:54.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.106+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~7L531JUAPJJP.1 size=180573 2024-09-14T11:20:54.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.106+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=7L531JUAPJJP tag=4ASXE8AKEE1O type=write size=2277725 2024-09-14T11:20:54.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.107+0000 7fc354693780 -1 < no bi entry to suggest for operation key=MQ5V2G5U43J1 tag=YC0KJN2683VZ type=del size=3113156: (2) No such file or directory 2024-09-14T11:20:54.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.108+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=HCANI92LLX46 type=del size=399570 2024-09-14T11:20:54.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.109+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=GSD5U3COXAG1 type=del 2024-09-14T11:20:54.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.110+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=VU1759GDBCD1 type=del size=398656 2024-09-14T11:20:54.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.111+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~16CZGKXRBPQ8.0 size=901493 2024-09-14T11:20:54.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.113+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=16CZGKXRBPQ8 tag=R3DXS1L9U8JV type=write size=1950069 2024-09-14T11:20:54.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.114+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=1AR7PUHUSGKB type=del size=1933055 2024-09-14T11:20:54.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.115+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=2D3TV2V5O4UJ type=del 2024-09-14T11:20:54.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.117+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~S8NZ1PIL8ZY3.0 size=926317 2024-09-14T11:20:54.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.117+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=S8NZ1PIL8ZY3 tag=AHWROA0LOJK9 type=write size=1974893 2024-09-14T11:20:54.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.120+0000 7fc354693780 1 < suggested update operation key=EFX0VXGHRUDR tag=QJJI1CR9KFAY type=del size=2398023 2024-09-14T11:20:54.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.122+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~RS842190NRDJ.0 size=1048576 2024-09-14T11:20:54.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.123+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~RS842190NRDJ.1 size=188257 2024-09-14T11:20:54.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.123+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=RS842190NRDJ tag=VTQGO041HG01 type=write size=2285409 2024-09-14T11:20:54.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.124+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=6UVJMN9031LE type=del 2024-09-14T11:20:54.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.125+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=3MK11YDYHS4P type=del size=4055392 2024-09-14T11:20:54.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.126+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~X8DED2ZIN6PB.0 size=483300 2024-09-14T11:20:54.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.129+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=X8DED2ZIN6PB tag=X41Q43QVM3AL type=write size=1531876 2024-09-14T11:20:54.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.131+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.0 size=1048576 2024-09-14T11:20:54.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.132+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.1 size=1048576 2024-09-14T11:20:54.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.133+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.2 size=793760 2024-09-14T11:20:54.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.133+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=RW3770YPEKWU tag=LAB1MWCO1I31 type=write size=3939488 2024-09-14T11:20:54.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.134+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=V53W43YILVJO type=del size=1180146 2024-09-14T11:20:54.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.137+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~G4A3T4283UXC.0 size=442867 2024-09-14T11:20:54.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.137+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=G4A3T4283UXC tag=AYY7D8YK85K7 type=write size=1491443 2024-09-14T11:20:54.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.138+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~4FQQ762LVMN5.0 size=645590 2024-09-14T11:20:54.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.140+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=4FQQ762LVMN5 tag=HWQCRXDSCG9J type=write size=1694166 2024-09-14T11:20:54.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.141+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=L3BYERL17YMA type=del size=614039 2024-09-14T11:20:54.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.142+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.0 size=1048576 2024-09-14T11:20:54.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.143+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.1 size=1048576 2024-09-14T11:20:54.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.144+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~CJHBSOMONZSY.2 size=648181 2024-09-14T11:20:54.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.146+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=CJHBSOMONZSY tag=1DO249JFR2V0 type=write size=3793909 2024-09-14T11:20:54.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.147+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=17R5YPOOPBUV type=write size=198598 2024-09-14T11:20:54.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.149+0000 7fc354693780 1 < suggested remove operation key=JGVLT0K0CEGQ tag=PPZNRHC9J6SF type=del 2024-09-14T11:20:54.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.152+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~L9C7DFRXAH77.0 size=154048 2024-09-14T11:20:54.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.152+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=L9C7DFRXAH77 tag=IBX1KGZLO8JB type=write size=1202624 2024-09-14T11:20:54.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.153+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=ZWRWTR8P6YGL type=del 2024-09-14T11:20:54.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.154+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=Z1P3BIN0G20V type=del size=3696939 2024-09-14T11:20:54.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.154+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~70OL4CI3EPZ9.0 size=752071 2024-09-14T11:20:54.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.156+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=70OL4CI3EPZ9 tag=0PRZNE7L8A4W type=write size=1800647 2024-09-14T11:20:54.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.157+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=3VH4V96M0BCP type=del size=2823056 2024-09-14T11:20:54.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.159+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.0 size=1048576 2024-09-14T11:20:54.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.160+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.1 size=1048576 2024-09-14T11:20:54.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.160+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~U1G18NVAA212.2 size=714442 2024-09-14T11:20:54.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.163+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=U1G18NVAA212 tag=5J9XHRUT2PE3 type=write size=3860170 2024-09-14T11:20:54.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.164+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=3ZMX5IQMPVM5 type=del size=3402131 2024-09-14T11:20:54.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.164+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.0 size=1048576 2024-09-14T11:20:54.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.165+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.1 size=1048576 2024-09-14T11:20:54.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.166+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~P5A1JE50KFF0.2 size=931050 2024-09-14T11:20:54.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.168+0000 7fc354693780 1 < canceled multipart upload key=BKW08T86L2ZF upload=P5A1JE50KFF0 tag=S2GXJVUCQUNM type=write size=4076778 2024-09-14T11:20:54.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.169+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=JUM9CUKKPRUE type=del size=3048057 2024-09-14T11:20:54.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.170+0000 7fc354693780 1 < canceled part key=_multipart_WYD70VR8OKAN.2~7L531JUAPJJP.0 size=1048576 2024-09-14T11:20:54.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.171+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~7L531JUAPJJP.1 size=180573 2024-09-14T11:20:54.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.172+0000 7fc354693780 1 < canceled multipart upload key=WYD70VR8OKAN upload=7L531JUAPJJP tag=4ASXE8AKEE1O type=write size=2277725 2024-09-14T11:20:54.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.174+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.0 size=1048576 2024-09-14T11:20:54.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.175+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.1 size=1048576 2024-09-14T11:20:54.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.176+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.2 size=330421 2024-09-14T11:20:54.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.176+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=ZBR33V5KCEVV tag=U9XRL32KUE3M type=write size=3476149 2024-09-14T11:20:54.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.177+0000 7fc354693780 1 < canceled operation key=QWMHFF32M37W tag=HCANI92LLX46 type=del size=399570 2024-09-14T11:20:54.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.179+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=MTLAMLSJUJEY type=del size=3289149 2024-09-14T11:20:54.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.181+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=VU1759GDBCD1 type=del 2024-09-14T11:20:54.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.182+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=R95WCLEBNSSG type=del size=3884974 2024-09-14T11:20:54.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.183+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=1AR7PUHUSGKB type=del size=1933055 2024-09-14T11:20:54.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.185+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=UM7IMZ4MWXGQ type=del size=1232890 2024-09-14T11:20:54.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.186+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~S8NZ1PIL8ZY3.0 size=926317 2024-09-14T11:20:54.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.188+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=S8NZ1PIL8ZY3 tag=AHWROA0LOJK9 type=write size=1974893 2024-09-14T11:20:54.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.189+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=DTB788YSKO2D type=write size=94580 2024-09-14T11:20:54.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.190+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~RS842190NRDJ.0 size=1048576 2024-09-14T11:20:54.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.190+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~RS842190NRDJ.1 size=188257 2024-09-14T11:20:54.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.192+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=RS842190NRDJ tag=VTQGO041HG01 type=write size=2285409 2024-09-14T11:20:54.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.193+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=TT3JL8ORDY4E type=del size=2062275 2024-09-14T11:20:54.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.195+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=3MK11YDYHS4P type=del 2024-09-14T11:20:54.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.196+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=7GBV1KI0RBPQ type=del size=1588510 2024-09-14T11:20:54.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.197+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.0 size=1048576 2024-09-14T11:20:54.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.198+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.1 size=1048576 2024-09-14T11:20:54.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.199+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~RW3770YPEKWU.2 size=793760 2024-09-14T11:20:54.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.201+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=RW3770YPEKWU tag=LAB1MWCO1I31 type=write size=3939488 2024-09-14T11:20:54.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.207+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=UQQ8RKRHK1YD type=del size=2701676 2024-09-14T11:20:54.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.212+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~G4A3T4283UXC.0 size=442867 2024-09-14T11:20:54.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.214+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=G4A3T4283UXC tag=AYY7D8YK85K7 type=write size=1491443 2024-09-14T11:20:54.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.215+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=8F2RIYCY2UFJ type=del size=2792849 2024-09-14T11:20:54.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.216+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=L3BYERL17YMA type=del 2024-09-14T11:20:54.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.217+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=FFJ4TYDA2DU4 type=del size=1388580 2024-09-14T11:20:54.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.218+0000 7fc354693780 1 < completed write operation key=T0Z8NK20DS5K tag=17R5YPOOPBUV type=write size=198598 2024-09-14T11:20:54.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.219+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=28CK7MW5D6LT type=del size=1447849 2024-09-14T11:20:54.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.221+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~L9C7DFRXAH77.0 size=154048 2024-09-14T11:20:54.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.222+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=L9C7DFRXAH77 tag=IBX1KGZLO8JB type=write size=1202624 2024-09-14T11:20:54.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.224+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.0 size=1048576 2024-09-14T11:20:54.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.225+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.1 size=1048576 2024-09-14T11:20:54.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.226+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.2 size=806744 2024-09-14T11:20:54.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.226+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=DZAIKXA77NGW tag=3509CYFJG1VO type=write size=3952472 2024-09-14T11:20:54.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.227+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=Z1P3BIN0G20V type=del size=3696939 2024-09-14T11:20:54.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.228+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=WGGSJ5L1MUFE type=del size=3931540 2024-09-14T11:20:54.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.229+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=3VH4V96M0BCP type=del 2024-09-14T11:20:54.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.230+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=CKX1ZZM9T7OQ type=del size=1529837 2024-09-14T11:20:54.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.232+0000 7fc354693780 1 < suggested remove operation key=EFX0VXGHRUDR tag=3ZMX5IQMPVM5 type=del 2024-09-14T11:20:54.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.234+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~3QTA83OK6T9Y.0 size=667938 2024-09-14T11:20:54.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.234+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=3QTA83OK6T9Y tag=JH929ARFXF28 type=write size=1716514 2024-09-14T11:20:54.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.236+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=JUM9CUKKPRUE type=del 2024-09-14T11:20:54.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.237+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=VCR99FZKN6TP type=del size=611737 2024-09-14T11:20:54.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.238+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.0 size=1048576 2024-09-14T11:20:54.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.239+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.1 size=1048576 2024-09-14T11:20:54.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.240+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~ZBR33V5KCEVV.2 size=330421 2024-09-14T11:20:54.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.241+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=ZBR33V5KCEVV tag=U9XRL32KUE3M type=write size=3476149 2024-09-14T11:20:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.244+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~KQRU41DE1X6T.0 size=1048576 2024-09-14T11:20:54.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.244+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~KQRU41DE1X6T.1 size=476803 2024-09-14T11:20:54.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.244+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=KQRU41DE1X6T tag=K94ESFL09Z8B type=write size=2573955 2024-09-14T11:20:54.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.246+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=MTLAMLSJUJEY type=del 2024-09-14T11:20:54.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.248+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~B2DCHJ9HE8PW.0 size=617087 2024-09-14T11:20:54.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.248+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=B2DCHJ9HE8PW tag=R0U1AVP0L60U type=write size=1665663 2024-09-14T11:20:54.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.249+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=R95WCLEBNSSG type=del 2024-09-14T11:20:54.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.250+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=5FGP9KJ8U9PW type=del size=926106 2024-09-14T11:20:54.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.251+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=UM7IMZ4MWXGQ type=del 2024-09-14T11:20:54.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.252+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=3N4K5K4IZNM6 type=del size=293227 2024-09-14T11:20:54.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.253+0000 7fc354693780 1 < completed write operation key=FMG2DNGS0LZ3 tag=DTB788YSKO2D type=write size=94580 2024-09-14T11:20:54.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.254+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=42R7C6BIAEM9 type=del size=2444437 2024-09-14T11:20:54.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.255+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=TT3JL8ORDY4E type=del 2024-09-14T11:20:54.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.256+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=6WUQUP4MN1N9 type=write size=531285 2024-09-14T11:20:54.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.257+0000 7fc354693780 -1 < failed to complete operation key=EFX0VXGHRUDR tag=7GBV1KI0RBPQ type=del size=1588510: (22) Invalid argument 2024-09-14T11:20:54.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.259+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~SO6YJBBY13WZ.0 size=759301 2024-09-14T11:20:54.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.259+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=SO6YJBBY13WZ tag=4OVLJP6M9CU1 type=write size=1807877 2024-09-14T11:20:54.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.261+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=UQQ8RKRHK1YD type=del size=2701676 2024-09-14T11:20:54.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.263+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=EV85W1VB32U3 type=del size=2988614 2024-09-14T11:20:54.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.265+0000 7fc354693780 1 < suggested remove operation key=OOFM3K1KEB9V tag=8F2RIYCY2UFJ type=del 2024-09-14T11:20:54.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.266+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=7WD9UR7YXX6W type=write size=582171 2024-09-14T11:20:54.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.268+0000 7fc354693780 1 < suggested remove operation key=WYD70VR8OKAN tag=FFJ4TYDA2DU4 type=del 2024-09-14T11:20:54.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.269+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=HEMGT28URQCM type=del size=849830 2024-09-14T11:20:54.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.270+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=28CK7MW5D6LT type=del 2024-09-14T11:20:54.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.271+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=OZC6GDNV4MRY type=del size=3593082 2024-09-14T11:20:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.272+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.0 size=1048576 2024-09-14T11:20:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.273+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.1 size=1048576 2024-09-14T11:20:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.274+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~DZAIKXA77NGW.2 size=806744 2024-09-14T11:20:54.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.276+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=DZAIKXA77NGW tag=3509CYFJG1VO type=write size=3952472 2024-09-14T11:20:54.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.277+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=TJOARZ3CLVBN type=write size=861234 2024-09-14T11:20:54.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.278+0000 7fc354693780 -1 < failed to complete operation key=OOFM3K1KEB9V tag=WGGSJ5L1MUFE type=del size=3931540: (22) Invalid argument 2024-09-14T11:20:54.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.280+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=2W19M8S2214M type=del size=1279071 2024-09-14T11:20:54.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.281+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=CKX1ZZM9T7OQ type=del 2024-09-14T11:20:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.282+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=N6LP5KA5HY1P type=write size=769241 2024-09-14T11:20:54.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.283+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~3QTA83OK6T9Y.0 size=667938 2024-09-14T11:20:54.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.285+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=3QTA83OK6T9Y tag=JH929ARFXF28 type=write size=1716514 2024-09-14T11:20:54.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.287+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=KPCBJLA2D3ZH type=write size=686697 2024-09-14T11:20:54.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.289+0000 7fc354693780 1 < suggested remove operation key=4IDBIAE3VAY4 tag=VCR99FZKN6TP type=del 2024-09-14T11:20:54.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.291+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~I61IRGICYE0X.0 size=425544 2024-09-14T11:20:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.291+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=I61IRGICYE0X tag=2KIYNXMO9TK4 type=write size=1474120 2024-09-14T11:20:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.293+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~KQRU41DE1X6T.0 size=1048576 2024-09-14T11:20:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.293+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~KQRU41DE1X6T.1 size=476803 2024-09-14T11:20:54.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.295+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=KQRU41DE1X6T tag=K94ESFL09Z8B type=write size=2573955 2024-09-14T11:20:54.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.296+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=DJOOVEKKMTZ6 type=del size=365313 2024-09-14T11:20:54.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.297+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~B2DCHJ9HE8PW.0 size=617087 2024-09-14T11:20:54.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.299+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=B2DCHJ9HE8PW tag=R0U1AVP0L60U type=write size=1665663 2024-09-14T11:20:54.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.302+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.0 size=1048576 2024-09-14T11:20:54.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.303+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.1 size=1048576 2024-09-14T11:20:54.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.304+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.2 size=105754 2024-09-14T11:20:54.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.304+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=PX7SO417WCOW tag=8C6OBK8X1CYY type=write size=3251482 2024-09-14T11:20:54.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.305+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=5FGP9KJ8U9PW type=del 2024-09-14T11:20:54.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.307+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.0 size=1048576 2024-09-14T11:20:54.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.308+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.1 size=1048576 2024-09-14T11:20:54.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.310+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.2 size=133147 2024-09-14T11:20:54.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.310+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=M311WR9EQPRU tag=76OZXYP8XIM2 type=write size=3278875 2024-09-14T11:20:54.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.312+0000 7fc354693780 1 < suggested update operation key=ICNEXZMA3VQV tag=3N4K5K4IZNM6 type=del size=293227 2024-09-14T11:20:54.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.314+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.0 size=1048576 2024-09-14T11:20:54.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.315+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.1 size=1048576 2024-09-14T11:20:54.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.316+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.2 size=563004 2024-09-14T11:20:54.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.316+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=CNL4IJ750J1G tag=573ZPFOD2IK7 type=write size=3708732 2024-09-14T11:20:54.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.318+0000 7fc354693780 1 < suggested remove operation key=JGVLT0K0CEGQ tag=42R7C6BIAEM9 type=del 2024-09-14T11:20:54.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.320+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~GVNOBPK3A2RP.0 size=1048576 2024-09-14T11:20:54.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.321+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~GVNOBPK3A2RP.1 size=79132 2024-09-14T11:20:54.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.321+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=GVNOBPK3A2RP tag=987D1V8Z3G8P type=write size=2176284 2024-09-14T11:20:54.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.322+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=6WUQUP4MN1N9 type=write size=531285 2024-09-14T11:20:54.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.323+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=KSLC4CSU9L93 type=write size=596231 2024-09-14T11:20:54.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.325+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~SO6YJBBY13WZ.0 size=759301 2024-09-14T11:20:54.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.327+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=SO6YJBBY13WZ tag=4OVLJP6M9CU1 type=write size=1807877 2024-09-14T11:20:54.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.328+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=72CQBEKKSQJ3 type=del size=1865236 2024-09-14T11:20:54.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.329+0000 7fc354693780 -1 < failed to complete operation key=JGVLT0K0CEGQ tag=EV85W1VB32U3 type=del size=2988614: (22) Invalid argument 2024-09-14T11:20:54.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.330+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=STDM6Z6Z5KSL type=del size=1875048 2024-09-14T11:20:54.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.331+0000 7fc354693780 1 < completed write operation key=H1S2CBHNW6GI tag=7WD9UR7YXX6W type=write size=582171 2024-09-14T11:20:54.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.333+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~GP4XASESAYZB.0 size=1048576 2024-09-14T11:20:54.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.334+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~GP4XASESAYZB.1 size=986570 2024-09-14T11:20:54.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.334+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=GP4XASESAYZB tag=C79H7U642E8G type=write size=3083722 2024-09-14T11:20:54.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.335+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=HEMGT28URQCM type=del 2024-09-14T11:20:54.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.336+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=MHRWTGMGTFEY type=write size=671508 2024-09-14T11:20:54.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.337+0000 7fc354693780 -1 < failed to complete operation key=JGVLT0K0CEGQ tag=OZC6GDNV4MRY type=del size=3593082: (22) Invalid argument 2024-09-14T11:20:54.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.340+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~1VIUS28VTMKX.0 size=623746 2024-09-14T11:20:54.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.340+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=1VIUS28VTMKX tag=DPCQLAXD5Z0E type=write size=1672322 2024-09-14T11:20:54.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.341+0000 7fc354693780 1 < canceled operation key=WBT3M1NMEEAY tag=TJOARZ3CLVBN type=write size=861234 2024-09-14T11:20:54.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.342+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=9U2VR320OAUR type=write size=890962 2024-09-14T11:20:54.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.344+0000 7fc354693780 1 < suggested update operation key=ICNEXZMA3VQV tag=2W19M8S2214M type=del size=1279071 2024-09-14T11:20:54.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.347+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.0 size=1048576 2024-09-14T11:20:54.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.348+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.1 size=1048576 2024-09-14T11:20:54.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.349+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.2 size=702325 2024-09-14T11:20:54.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.349+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=OJ9V9C22SN0U tag=XXA33VK5CCTL type=write size=3848053 2024-09-14T11:20:54.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.351+0000 7fc354693780 1 < completed write operation key=BJ7AARJEIT8W tag=N6LP5KA5HY1P type=write size=769241 2024-09-14T11:20:54.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.353+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.0 size=1048576 2024-09-14T11:20:54.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.354+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.1 size=1048576 2024-09-14T11:20:54.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.354+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.2 size=673651 2024-09-14T11:20:54.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.354+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=7M0131KLG80R tag=FIM4CB6AZ5VW type=write size=3819379 2024-09-14T11:20:54.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.356+0000 7fc354693780 1 < completed write operation key=WYD70VR8OKAN tag=KPCBJLA2D3ZH type=write size=686697 2024-09-14T11:20:54.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.357+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=JIM4ODVH9BWZ type=del size=2285199 2024-09-14T11:20:54.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.358+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~I61IRGICYE0X.0 size=425544 2024-09-14T11:20:54.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.359+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=I61IRGICYE0X tag=2KIYNXMO9TK4 type=write size=1474120 2024-09-14T11:20:54.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.361+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=W4SH7Q7H0CLV type=del size=702024 2024-09-14T11:20:54.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.362+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=DJOOVEKKMTZ6 type=del 2024-09-14T11:20:54.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.364+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~UZ0JG2NC5EEZ.0 size=1024892 2024-09-14T11:20:54.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.364+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=UZ0JG2NC5EEZ tag=MGLNL8RJNTLG type=write size=2073468 2024-09-14T11:20:54.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.365+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.0 size=1048576 2024-09-14T11:20:54.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.366+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.1 size=1048576 2024-09-14T11:20:54.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.367+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PX7SO417WCOW.2 size=105754 2024-09-14T11:20:54.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.369+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=PX7SO417WCOW tag=8C6OBK8X1CYY type=write size=3251482 2024-09-14T11:20:54.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.371+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.0 size=1048576 2024-09-14T11:20:54.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.371+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.1 size=1048576 2024-09-14T11:20:54.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.372+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.2 size=686742 2024-09-14T11:20:54.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.372+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=REZ9US3Y0WR6 tag=EUAZ3HXXQQ3N type=write size=3832470 2024-09-14T11:20:54.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.372+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.0 size=1048576 2024-09-14T11:20:54.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.373+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.1 size=1048576 2024-09-14T11:20:54.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.374+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~M311WR9EQPRU.2 size=133147 2024-09-14T11:20:54.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.376+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=M311WR9EQPRU tag=76OZXYP8XIM2 type=write size=3278875 2024-09-14T11:20:54.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.377+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=OUJXC9O2C780 type=del size=508556 2024-09-14T11:20:54.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.378+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.0 size=1048576 2024-09-14T11:20:54.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.379+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.1 size=1048576 2024-09-14T11:20:54.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.380+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~CNL4IJ750J1G.2 size=563004 2024-09-14T11:20:54.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.382+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=CNL4IJ750J1G tag=573ZPFOD2IK7 type=write size=3708732 2024-09-14T11:20:54.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.383+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=WB39H7GEVEOG type=write size=832372 2024-09-14T11:20:54.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.385+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~GVNOBPK3A2RP.0 size=1048576 2024-09-14T11:20:54.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.386+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~GVNOBPK3A2RP.1 size=79132 2024-09-14T11:20:54.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.388+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=GVNOBPK3A2RP tag=987D1V8Z3G8P type=write size=2176284 2024-09-14T11:20:54.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.389+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=J5TBNS5WK2C5 type=del size=3169149 2024-09-14T11:20:54.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.391+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=KSLC4CSU9L93 type=write 2024-09-14T11:20:54.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.393+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=9Q5FWHU28UCW type=del size=1519234 2024-09-14T11:20:54.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.394+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=72CQBEKKSQJ3 type=del 2024-09-14T11:20:54.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.395+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=2XW3KX2M02PM type=del size=3696701 2024-09-14T11:20:54.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.397+0000 7fc354693780 1 < suggested update operation key=X4VH2WYJJ8GI tag=STDM6Z6Z5KSL type=del size=1875048 2024-09-14T11:20:54.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.399+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~SZVFFU1WUM0Y.0 size=1048576 2024-09-14T11:20:54.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.400+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~SZVFFU1WUM0Y.1 size=921403 2024-09-14T11:20:54.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.400+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=SZVFFU1WUM0Y tag=F00CDDJ5VAKE type=write size=3018555 2024-09-14T11:20:54.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.400+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~GP4XASESAYZB.0 size=1048576 2024-09-14T11:20:54.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.400+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~GP4XASESAYZB.1 size=986570 2024-09-14T11:20:54.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.402+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=GP4XASESAYZB tag=C79H7U642E8G type=write size=3083722 2024-09-14T11:20:54.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.404+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~1OS0CITFHQIF.0 size=1048576 2024-09-14T11:20:54.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.405+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~1OS0CITFHQIF.1 size=574201 2024-09-14T11:20:54.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.405+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=1OS0CITFHQIF tag=NY1RMLY94F2J type=write size=2671353 2024-09-14T11:20:54.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.406+0000 7fc354693780 -1 < failed to complete operation key=FMG2DNGS0LZ3 tag=MHRWTGMGTFEY type=write size=671508: (22) Invalid argument 2024-09-14T11:20:54.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.408+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~6DQVH1SOPNCX.0 size=1023513 2024-09-14T11:20:54.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.408+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=6DQVH1SOPNCX tag=GEU8YDNOEJ9X type=write size=2072089 2024-09-14T11:20:54.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.409+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~1VIUS28VTMKX.0 size=623746 2024-09-14T11:20:54.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.411+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=1VIUS28VTMKX tag=DPCQLAXD5Z0E type=write size=1672322 2024-09-14T11:20:54.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.413+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~99W2NE55G23W.0 size=1048576 2024-09-14T11:20:54.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.414+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~99W2NE55G23W.1 size=587942 2024-09-14T11:20:54.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.414+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=99W2NE55G23W tag=68ZJ0Z239U9Q type=write size=2685094 2024-09-14T11:20:54.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.416+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=9U2VR320OAUR type=write size=890962 2024-09-14T11:20:54.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.417+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=VG4K3IX50JB9 type=del size=3588716 2024-09-14T11:20:54.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.418+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.0 size=1048576 2024-09-14T11:20:54.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.419+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.1 size=1048576 2024-09-14T11:20:54.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.420+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~OJ9V9C22SN0U.2 size=702325 2024-09-14T11:20:54.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.422+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=OJ9V9C22SN0U tag=XXA33VK5CCTL type=write size=3848053 2024-09-14T11:20:54.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.423+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=TYP330066YH2 type=del size=578254 2024-09-14T11:20:54.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.424+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.0 size=1048576 2024-09-14T11:20:54.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.425+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.1 size=1048576 2024-09-14T11:20:54.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.426+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~7M0131KLG80R.2 size=673651 2024-09-14T11:20:54.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.428+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=7M0131KLG80R tag=FIM4CB6AZ5VW type=write size=3819379 2024-09-14T11:20:54.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.429+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=N3QLYLP2EWKR type=del size=460301 2024-09-14T11:20:54.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.430+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=JIM4ODVH9BWZ type=del 2024-09-14T11:20:54.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.432+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~TD7J91W2YMYE.0 size=1048576 2024-09-14T11:20:54.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.433+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~TD7J91W2YMYE.1 size=182031 2024-09-14T11:20:54.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.433+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=TD7J91W2YMYE tag=2C5VLCQ17OA2 type=write size=2279183 2024-09-14T11:20:54.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.434+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=W4SH7Q7H0CLV type=del size=702024 2024-09-14T11:20:54.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.436+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.0 size=1048576 2024-09-14T11:20:54.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.437+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.1 size=1048576 2024-09-14T11:20:54.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.437+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.2 size=459169 2024-09-14T11:20:54.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.438+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=Q600M0KOYNXZ tag=VN4XRZI2VG8J type=write size=3604897 2024-09-14T11:20:54.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.439+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~UZ0JG2NC5EEZ.0 size=1024892 2024-09-14T11:20:54.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.440+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=UZ0JG2NC5EEZ tag=MGLNL8RJNTLG type=write size=2073468 2024-09-14T11:20:54.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.441+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=ELJXSB7XR7LH type=del size=413089 2024-09-14T11:20:54.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.442+0000 7fc354693780 1 < canceled part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.0 size=1048576 2024-09-14T11:20:54.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.443+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.1 size=1048576 2024-09-14T11:20:54.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.443+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~REZ9US3Y0WR6.2 size=686742 2024-09-14T11:20:54.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.445+0000 7fc354693780 1 < canceled multipart upload key=TFTKNNCGN88D upload=REZ9US3Y0WR6 tag=EUAZ3HXXQQ3N type=write size=3832470 2024-09-14T11:20:54.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.446+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=CE4K28B7SN99 type=del size=96283 2024-09-14T11:20:54.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.448+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=OUJXC9O2C780 type=del size=508556 2024-09-14T11:20:54.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.450+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.0 size=1048576 2024-09-14T11:20:54.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.450+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.1 size=1048576 2024-09-14T11:20:54.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.451+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.2 size=531985 2024-09-14T11:20:54.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.451+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=8392VMTY8OP6 tag=VLJ15E33BO12 type=write size=3677713 2024-09-14T11:20:54.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.453+0000 7fc354693780 1 < suggested update operation key=ICNEXZMA3VQV tag=WB39H7GEVEOG type=write size=832372 2024-09-14T11:20:54.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.455+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=7U1GIQSEB3G7 type=del size=4107045 2024-09-14T11:20:54.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.457+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=J5TBNS5WK2C5 type=del 2024-09-14T11:20:54.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.458+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=65SES6ANOZ7W type=del size=2919655 2024-09-14T11:20:54.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.459+0000 7fc354693780 -1 < failed to complete operation key=ICNEXZMA3VQV tag=9Q5FWHU28UCW type=del size=1519234: (22) Invalid argument 2024-09-14T11:20:54.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.461+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~PYXPYTH6829R.0 size=1048576 2024-09-14T11:20:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.462+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~PYXPYTH6829R.1 size=904479 2024-09-14T11:20:54.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.462+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=PYXPYTH6829R tag=NVGEVOGQZ955 type=write size=3001631 2024-09-14T11:20:54.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.463+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=2XW3KX2M02PM type=del 2024-09-14T11:20:54.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.465+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~8JI17IKPKVXT.0 size=1048576 2024-09-14T11:20:54.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.466+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~8JI17IKPKVXT.1 size=721426 2024-09-14T11:20:54.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.466+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=8JI17IKPKVXT tag=AY4K335KXY68 type=write size=2818578 2024-09-14T11:20:54.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.467+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~SZVFFU1WUM0Y.0 size=1048576 2024-09-14T11:20:54.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.468+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~SZVFFU1WUM0Y.1 size=921403 2024-09-14T11:20:54.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.470+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=SZVFFU1WUM0Y tag=F00CDDJ5VAKE type=write size=3018555 2024-09-14T11:20:54.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.472+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.0 size=1048576 2024-09-14T11:20:54.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.473+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.1 size=1048576 2024-09-14T11:20:54.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.473+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.2 size=804301 2024-09-14T11:20:54.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.473+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=XWP573IDQIME tag=6CD8JTC5OF1E type=write size=3950029 2024-09-14T11:20:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.475+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~1OS0CITFHQIF.0 size=1048576 2024-09-14T11:20:54.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.475+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~1OS0CITFHQIF.1 size=574201 2024-09-14T11:20:54.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.477+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=1OS0CITFHQIF tag=NY1RMLY94F2J type=write size=2671353 2024-09-14T11:20:54.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.480+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~J089CK0SUKYU.0 size=1048576 2024-09-14T11:20:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.481+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~J089CK0SUKYU.1 size=825775 2024-09-14T11:20:54.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.481+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=J089CK0SUKYU tag=FT9L9EECV79O type=write size=2922927 2024-09-14T11:20:54.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.482+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~6DQVH1SOPNCX.0 size=1023513 2024-09-14T11:20:54.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.484+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=6DQVH1SOPNCX tag=GEU8YDNOEJ9X type=write size=2072089 2024-09-14T11:20:54.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.486+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.0 size=1048576 2024-09-14T11:20:54.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.487+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.1 size=1048576 2024-09-14T11:20:54.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.488+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.2 size=979119 2024-09-14T11:20:54.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.488+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=T9U55PWSWOQP tag=YV4733EK6CRC type=write size=4124847 2024-09-14T11:20:54.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.489+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~99W2NE55G23W.0 size=1048576 2024-09-14T11:20:54.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.489+0000 7fc354693780 1 < canceled part key=_multipart_T0Z8NK20DS5K.2~99W2NE55G23W.1 size=587942 2024-09-14T11:20:54.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.491+0000 7fc354693780 1 < canceled multipart upload key=T0Z8NK20DS5K upload=99W2NE55G23W tag=68ZJ0Z239U9Q type=write size=2685094 2024-09-14T11:20:54.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.492+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=E95J6RQPPHIJ type=del size=3119227 2024-09-14T11:20:54.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.493+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=VG4K3IX50JB9 type=del 2024-09-14T11:20:54.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.494+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=Z4BD1B1T9ZPO type=del size=1923303 2024-09-14T11:20:54.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.496+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=TYP330066YH2 type=del 2024-09-14T11:20:54.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.497+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=YXQUPIOPLHWD type=del size=838639 2024-09-14T11:20:54.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.498+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=N3QLYLP2EWKR type=del 2024-09-14T11:20:54.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.500+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~VETEBCB5Z1UN.0 size=1048576 2024-09-14T11:20:54.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.501+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~VETEBCB5Z1UN.1 size=653301 2024-09-14T11:20:54.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.501+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=VETEBCB5Z1UN tag=FUIGR256HXD3 type=write size=2750453 2024-09-14T11:20:54.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.502+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~TD7J91W2YMYE.0 size=1048576 2024-09-14T11:20:54.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.503+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~TD7J91W2YMYE.1 size=182031 2024-09-14T11:20:54.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.504+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=TD7J91W2YMYE tag=2C5VLCQ17OA2 type=write size=2279183 2024-09-14T11:20:54.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.506+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=1S6FI6H0PFNK type=write size=197735 2024-09-14T11:20:54.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.507+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.0 size=1048576 2024-09-14T11:20:54.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.508+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.1 size=1048576 2024-09-14T11:20:54.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.509+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~Q600M0KOYNXZ.2 size=459169 2024-09-14T11:20:54.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.511+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=Q600M0KOYNXZ tag=VN4XRZI2VG8J type=write size=3604897 2024-09-14T11:20:54.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.512+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=MIMPWKOT8QS2 type=write size=1036410 2024-09-14T11:20:54.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.513+0000 7fc354693780 -1 < failed to complete operation key=P061QWG9J16V tag=ELJXSB7XR7LH type=del size=413089: (22) Invalid argument 2024-09-14T11:20:54.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.514+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=7P2T46XI6HX4 type=del size=2674169 2024-09-14T11:20:54.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.515+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=CE4K28B7SN99 type=del 2024-09-14T11:20:54.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.516+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=Z2HL0ORN08NZ type=del size=457776 2024-09-14T11:20:54.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.518+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.0 size=1048576 2024-09-14T11:20:54.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.519+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.1 size=1048576 2024-09-14T11:20:54.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.520+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~8392VMTY8OP6.2 size=531985 2024-09-14T11:20:54.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.522+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=8392VMTY8OP6 tag=VLJ15E33BO12 type=write size=3677713 2024-09-14T11:20:54.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.523+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=UMNBXYGMA107 type=del size=2816620 2024-09-14T11:20:54.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.524+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=7U1GIQSEB3G7 type=del 2024-09-14T11:20:54.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.525+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=0VSNAEK6GHWZ type=del size=1555963 2024-09-14T11:20:54.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.526+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=65SES6ANOZ7W type=del 2024-09-14T11:20:54.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.527+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=WNH7VFF9U7ON type=del size=2252729 2024-09-14T11:20:54.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.528+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~PYXPYTH6829R.0 size=1048576 2024-09-14T11:20:54.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.529+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~PYXPYTH6829R.1 size=904479 2024-09-14T11:20:54.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.531+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=PYXPYTH6829R tag=NVGEVOGQZ955 type=write size=3001631 2024-09-14T11:20:54.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.532+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=O38PIME48F1V type=del size=2048938 2024-09-14T11:20:54.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.533+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~8JI17IKPKVXT.0 size=1048576 2024-09-14T11:20:54.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.534+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~8JI17IKPKVXT.1 size=721426 2024-09-14T11:20:54.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.536+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=8JI17IKPKVXT tag=AY4K335KXY68 type=write size=2818578 2024-09-14T11:20:54.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.538+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~SS01AJSHAHGG.0 size=1048576 2024-09-14T11:20:54.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.539+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~SS01AJSHAHGG.1 size=170124 2024-09-14T11:20:54.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.539+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=SS01AJSHAHGG tag=UUXMBG8OWU0I type=write size=2267276 2024-09-14T11:20:54.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.540+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.0 size=1048576 2024-09-14T11:20:54.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.541+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.1 size=1048576 2024-09-14T11:20:54.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.542+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~XWP573IDQIME.2 size=804301 2024-09-14T11:20:54.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.543+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=XWP573IDQIME tag=6CD8JTC5OF1E type=write size=3950029 2024-09-14T11:20:54.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.545+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=4K0NSLSVXN0L type=del size=3349115 2024-09-14T11:20:54.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.545+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~J089CK0SUKYU.0 size=1048576 2024-09-14T11:20:54.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.546+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~J089CK0SUKYU.1 size=825775 2024-09-14T11:20:54.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.547+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=J089CK0SUKYU tag=FT9L9EECV79O type=write size=2922927 2024-09-14T11:20:54.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.549+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.0 size=1048576 2024-09-14T11:20:54.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.550+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.1 size=1048576 2024-09-14T11:20:54.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.551+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.2 size=688515 2024-09-14T11:20:54.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.551+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=JSRAN4NO9T4T tag=YN8MG8FFFZE3 type=write size=3834243 2024-09-14T11:20:54.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.552+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.0 size=1048576 2024-09-14T11:20:54.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.553+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.1 size=1048576 2024-09-14T11:20:54.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.554+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~T9U55PWSWOQP.2 size=979119 2024-09-14T11:20:54.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.556+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=T9U55PWSWOQP tag=YV4733EK6CRC type=write size=4124847 2024-09-14T11:20:54.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.557+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=FGCPT0DW2WWK type=del size=1305906 2024-09-14T11:20:54.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.558+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=E95J6RQPPHIJ type=del 2024-09-14T11:20:54.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.559+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=AW3T6CM3JHO5 type=write size=903328 2024-09-14T11:20:54.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.560+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=Z4BD1B1T9ZPO type=del 2024-09-14T11:20:54.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.561+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=VGXGHHO1BA0L type=del size=3451251 2024-09-14T11:20:54.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.562+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=YXQUPIOPLHWD type=del 2024-09-14T11:20:54.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.564+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=U63CEL1BJDZI type=write size=1033423 2024-09-14T11:20:54.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.565+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~VETEBCB5Z1UN.0 size=1048576 2024-09-14T11:20:54.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.566+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~VETEBCB5Z1UN.1 size=653301 2024-09-14T11:20:54.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.567+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=VETEBCB5Z1UN tag=FUIGR256HXD3 type=write size=2750453 2024-09-14T11:20:54.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.569+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=212TPFXNDP9Z type=del size=3735857 2024-09-14T11:20:54.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.570+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=1S6FI6H0PFNK type=write size=197735 2024-09-14T11:20:54.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.572+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~AL71J6IRDONV.0 size=644226 2024-09-14T11:20:54.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.572+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=AL71J6IRDONV tag=BABJTBXDNMV3 type=write size=1692802 2024-09-14T11:20:54.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.573+0000 7fc354693780 1 < completed write operation key=TFTKNNCGN88D tag=MIMPWKOT8QS2 type=write size=1036410 2024-09-14T11:20:54.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.574+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=EPQOB9C045H8 type=write size=798451 2024-09-14T11:20:54.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.576+0000 7fc354693780 1 < suggested remove operation key=QWMHFF32M37W tag=7P2T46XI6HX4 type=del 2024-09-14T11:20:54.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.577+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=EJMPUQ7H1QWH type=del size=837531 2024-09-14T11:20:54.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.578+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=Z2HL0ORN08NZ type=del 2024-09-14T11:20:54.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.579+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=PVMPYWA5XMG8 type=del size=1119175 2024-09-14T11:20:54.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.581+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=UMNBXYGMA107 type=del 2024-09-14T11:20:54.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.583+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~MVWGAZV9OQ0F.0 size=1048576 2024-09-14T11:20:54.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.584+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~MVWGAZV9OQ0F.1 size=447078 2024-09-14T11:20:54.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.584+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=MVWGAZV9OQ0F tag=WT2NQ5M2MOJC type=write size=2544230 2024-09-14T11:20:54.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.585+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=0VSNAEK6GHWZ type=del size=1555963 2024-09-14T11:20:54.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.586+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=HQVS3BMLHCWD type=del size=2212298 2024-09-14T11:20:54.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.588+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=WNH7VFF9U7ON type=del 2024-09-14T11:20:54.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.590+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.0 size=1048576 2024-09-14T11:20:54.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.591+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.1 size=1048576 2024-09-14T11:20:54.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.592+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.2 size=520273 2024-09-14T11:20:54.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.592+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=EI279F0V89EZ tag=ZX02PHEEONUV type=write size=3666001 2024-09-14T11:20:54.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.593+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=O38PIME48F1V type=del 2024-09-14T11:20:54.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.595+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~PN80N3TW1G3E.0 size=1048576 2024-09-14T11:20:54.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.596+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~PN80N3TW1G3E.1 size=834912 2024-09-14T11:20:54.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.596+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=PN80N3TW1G3E tag=121FKPT2ZPKL type=write size=2932064 2024-09-14T11:20:54.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.597+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~SS01AJSHAHGG.0 size=1048576 2024-09-14T11:20:54.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.599+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~SS01AJSHAHGG.1 size=170124 2024-09-14T11:20:54.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.601+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=SS01AJSHAHGG tag=UUXMBG8OWU0I type=write size=2267276 2024-09-14T11:20:54.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.602+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=KMZEWVUTZ1XG type=write size=1000017 2024-09-14T11:20:54.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.603+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=4K0NSLSVXN0L type=del 2024-09-14T11:20:54.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.604+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=MXV18LSIOMJO type=write size=816291 2024-09-14T11:20:54.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.606+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.0 size=1048576 2024-09-14T11:20:54.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.607+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.1 size=1048576 2024-09-14T11:20:54.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.608+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~JSRAN4NO9T4T.2 size=688515 2024-09-14T11:20:54.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.610+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=JSRAN4NO9T4T tag=YN8MG8FFFZE3 type=write size=3834243 2024-09-14T11:20:54.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.611+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=JSZO7B5SRHR4 type=write size=948488 2024-09-14T11:20:54.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.613+0000 7fc354693780 1 < suggested remove operation key=AUL8F0SZVZX2 tag=FGCPT0DW2WWK type=del 2024-09-14T11:20:54.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.615+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=DT4L8P3H05PJ type=del size=1540976 2024-09-14T11:20:54.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.616+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=AW3T6CM3JHO5 type=write size=903328 2024-09-14T11:20:54.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.617+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=YBLMK89V5DS2 type=del size=2955155 2024-09-14T11:20:54.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.618+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=VGXGHHO1BA0L type=del 2024-09-14T11:20:54.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.619+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=I11Z6NL98283 type=del size=2544229 2024-09-14T11:20:54.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.621+0000 7fc354693780 1 < canceled operation key=BTET4HD5NY0D tag=U63CEL1BJDZI type=write size=1033423 2024-09-14T11:20:54.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.623+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~05KJ289W0ZJR.0 size=1048576 2024-09-14T11:20:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.625+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~05KJ289W0ZJR.1 size=610665 2024-09-14T11:20:54.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.625+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=05KJ289W0ZJR tag=EVUOX47459GM type=write size=2707817 2024-09-14T11:20:54.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.626+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=212TPFXNDP9Z type=del 2024-09-14T11:20:54.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.627+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=5XVU1HDANKJ2 type=del size=1026792 2024-09-14T11:20:54.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.628+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~AL71J6IRDONV.0 size=644226 2024-09-14T11:20:54.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.630+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=AL71J6IRDONV tag=BABJTBXDNMV3 type=write size=1692802 2024-09-14T11:20:54.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.632+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~JCA5V3WHCCMC.0 size=1029819 2024-09-14T11:20:54.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.632+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=JCA5V3WHCCMC tag=9TWHR3XT9X65 type=write size=2078395 2024-09-14T11:20:54.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.633+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=EPQOB9C045H8 type=write size=798451 2024-09-14T11:20:54.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.635+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=YX9F043KTJC3 type=del size=3459092 2024-09-14T11:20:54.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.636+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=EJMPUQ7H1QWH type=del 2024-09-14T11:20:54.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.637+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=7P2B8T4OOANB type=del size=3948542 2024-09-14T11:20:54.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.638+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=PVMPYWA5XMG8 type=del 2024-09-14T11:20:54.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.639+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=VZSZBUY3ES7W type=del size=2764804 2024-09-14T11:20:54.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.640+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~MVWGAZV9OQ0F.0 size=1048576 2024-09-14T11:20:54.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.641+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~MVWGAZV9OQ0F.1 size=447078 2024-09-14T11:20:54.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.643+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=MVWGAZV9OQ0F tag=WT2NQ5M2MOJC type=write size=2544230 2024-09-14T11:20:54.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.644+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=FL3D19RDLZLN type=del size=2325847 2024-09-14T11:20:54.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.645+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=HQVS3BMLHCWD type=del 2024-09-14T11:20:54.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.647+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.0 size=1048576 2024-09-14T11:20:54.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.648+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.1 size=1048576 2024-09-14T11:20:54.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.648+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.2 size=478323 2024-09-14T11:20:54.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.649+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=TW3V8XBWNRLE tag=H6SVL1SIH25B type=write size=3624051 2024-09-14T11:20:54.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.650+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.0 size=1048576 2024-09-14T11:20:54.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.651+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.1 size=1048576 2024-09-14T11:20:54.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.651+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~EI279F0V89EZ.2 size=520273 2024-09-14T11:20:54.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.653+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=EI279F0V89EZ tag=ZX02PHEEONUV type=write size=3666001 2024-09-14T11:20:54.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.655+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~3ZFF39NYG94N.0 size=1048576 2024-09-14T11:20:54.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.656+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~3ZFF39NYG94N.1 size=844542 2024-09-14T11:20:54.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.656+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=3ZFF39NYG94N tag=IHMZSYPG2QMG type=write size=2941694 2024-09-14T11:20:54.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.658+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~PN80N3TW1G3E.0 size=1048576 2024-09-14T11:20:54.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.659+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~PN80N3TW1G3E.1 size=834912 2024-09-14T11:20:54.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.660+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=PN80N3TW1G3E tag=121FKPT2ZPKL type=write size=2932064 2024-09-14T11:20:54.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.662+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=PR7WW6B0VXAZ type=write size=87219 2024-09-14T11:20:54.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.663+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=KMZEWVUTZ1XG type=write size=1000017 2024-09-14T11:20:54.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.664+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=DKAGGWDEVB12 type=del size=3444092 2024-09-14T11:20:54.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.665+0000 7fc354693780 1 < completed write operation key=TFTKNNCGN88D tag=MXV18LSIOMJO type=write size=816291 2024-09-14T11:20:54.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.667+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=OXW126AUVY3V type=write size=891440 2024-09-14T11:20:54.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.669+0000 7fc354693780 1 < suggested update operation key=H1S2CBHNW6GI tag=JSZO7B5SRHR4 type=write size=948488 2024-09-14T11:20:54.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.670+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=G7BKM24WQ3MS type=del size=2653800 2024-09-14T11:20:54.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.672+0000 7fc354693780 1 < suggested remove operation key=T0Z8NK20DS5K tag=DT4L8P3H05PJ type=del 2024-09-14T11:20:54.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.673+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=PP0NMZWWB72S type=del size=504442 2024-09-14T11:20:54.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.675+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=YBLMK89V5DS2 type=del 2024-09-14T11:20:54.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.676+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=GLMR4Z234FV6 type=del size=1111466 2024-09-14T11:20:54.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.677+0000 7fc354693780 1 < canceled operation key=BJ7AARJEIT8W tag=I11Z6NL98283 type=del size=2544229 2024-09-14T11:20:54.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.678+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=X43P6ELAXSLS type=del size=3593457 2024-09-14T11:20:54.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.679+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~05KJ289W0ZJR.0 size=1048576 2024-09-14T11:20:54.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.680+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~05KJ289W0ZJR.1 size=610665 2024-09-14T11:20:54.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.682+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=05KJ289W0ZJR tag=EVUOX47459GM type=write size=2707817 2024-09-14T11:20:54.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.684+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=S6RQ5AN30M3J type=del size=670565 2024-09-14T11:20:54.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.685+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=5XVU1HDANKJ2 type=del 2024-09-14T11:20:54.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.686+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=MYVO1197JVHI type=del size=1438672 2024-09-14T11:20:54.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.687+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~JCA5V3WHCCMC.0 size=1029819 2024-09-14T11:20:54.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.689+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=JCA5V3WHCCMC tag=9TWHR3XT9X65 type=write size=2078395 2024-09-14T11:20:54.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.691+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=1QUY0S95XJT3 type=del size=459330 2024-09-14T11:20:54.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.692+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=YX9F043KTJC3 type=del 2024-09-14T11:20:54.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.693+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=Z943XDH2LV26 type=del size=2819923 2024-09-14T11:20:54.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.694+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=7P2B8T4OOANB type=del 2024-09-14T11:20:54.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.695+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=MBT0H55T4DNP type=del size=166543 2024-09-14T11:20:54.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.697+0000 7fc354693780 1 < canceled operation key=N23XJJD7YYG0 tag=VZSZBUY3ES7W type=del size=2764804 2024-09-14T11:20:54.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.698+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=8KSGAZNGOP7P type=del size=999806 2024-09-14T11:20:54.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.699+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=FL3D19RDLZLN type=del 2024-09-14T11:20:54.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.701+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~V8U68V4ZN3AI.0 size=387298 2024-09-14T11:20:54.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.701+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=V8U68V4ZN3AI tag=PW6OCB5O0GFN type=write size=1435874 2024-09-14T11:20:54.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.703+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.0 size=1048576 2024-09-14T11:20:54.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.704+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.1 size=1048576 2024-09-14T11:20:54.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.704+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~TW3V8XBWNRLE.2 size=478323 2024-09-14T11:20:54.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.706+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=TW3V8XBWNRLE tag=H6SVL1SIH25B type=write size=3624051 2024-09-14T11:20:54.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.708+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.0 size=1048576 2024-09-14T11:20:54.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.709+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.1 size=1048576 2024-09-14T11:20:54.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.710+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.2 size=888952 2024-09-14T11:20:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.710+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=0FT2MP2ISX4X tag=VZMNTZ5QZPJF type=write size=4034680 2024-09-14T11:20:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.712+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~3ZFF39NYG94N.0 size=1048576 2024-09-14T11:20:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.712+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~3ZFF39NYG94N.1 size=844542 2024-09-14T11:20:54.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.714+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=3ZFF39NYG94N tag=IHMZSYPG2QMG type=write size=2941694 2024-09-14T11:20:54.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.717+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~25DAT1QMT55Q.0 size=1048576 2024-09-14T11:20:54.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.718+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~25DAT1QMT55Q.1 size=1021107 2024-09-14T11:20:54.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.718+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=25DAT1QMT55Q tag=JWIF3WPTLU1F type=write size=3118259 2024-09-14T11:20:54.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.719+0000 7fc354693780 1 < completed write operation key=WYD70VR8OKAN tag=PR7WW6B0VXAZ type=write size=87219 2024-09-14T11:20:54.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.721+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~ZDL63812PIPG.0 size=298582 2024-09-14T11:20:54.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.721+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=ZDL63812PIPG tag=B7G1RW82TRUY type=write size=1347158 2024-09-14T11:20:54.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.722+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=DKAGGWDEVB12 type=del 2024-09-14T11:20:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.724+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=R1LSMT2JRUGX type=del size=3174576 2024-09-14T11:20:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.725+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=OXW126AUVY3V type=write size=891440 2024-09-14T11:20:54.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.726+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=ZZZNXTYPJJO7 type=del size=1759848 2024-09-14T11:20:54.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.728+0000 7fc354693780 1 < suggested update operation key=6SIWH1BHPFGM tag=G7BKM24WQ3MS type=del size=2653800 2024-09-14T11:20:54.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.729+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=UT395B0Z0HDP type=del size=3999067 2024-09-14T11:20:54.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.731+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=PP0NMZWWB72S type=del 2024-09-14T11:20:54.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.732+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=GEIOXBPK7W1E type=del size=3783446 2024-09-14T11:20:54.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.733+0000 7fc354693780 1 < canceled operation key=H1S2CBHNW6GI tag=GLMR4Z234FV6 type=del size=1111466 2024-09-14T11:20:54.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.735+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=10723REYUHAQ type=del size=3521706 2024-09-14T11:20:54.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.737+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=X43P6ELAXSLS type=del 2024-09-14T11:20:54.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.739+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=E9EL78QCO8XT type=del size=2893182 2024-09-14T11:20:54.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.740+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=S6RQ5AN30M3J type=del 2024-09-14T11:20:54.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.741+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=VSJECU84KWXH type=del size=1044720 2024-09-14T11:20:54.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.744+0000 7fc354693780 1 < suggested update operation key=RHVF0Z2PRDA8 tag=MYVO1197JVHI type=del size=1438672 2024-09-14T11:20:54.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.745+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=E83TO44S3OOA type=del size=2154953 2024-09-14T11:20:54.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.745+0000 7fc354693780 -1 < no bi entry to suggest for operation key=ICNEXZMA3VQV tag=1QUY0S95XJT3 type=del size=459330: (2) No such file or directory 2024-09-14T11:20:54.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.747+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~DDA3A5XY7RVS.0 size=1048576 2024-09-14T11:20:54.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.748+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~DDA3A5XY7RVS.1 size=601487 2024-09-14T11:20:54.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.748+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=DDA3A5XY7RVS tag=S6R7Q9NDB1J6 type=write size=2698639 2024-09-14T11:20:54.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.749+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=Z943XDH2LV26 type=del 2024-09-14T11:20:54.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.750+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=70X5IG9Y15SG type=del size=461996 2024-09-14T11:20:54.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.751+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=MBT0H55T4DNP type=del 2024-09-14T11:20:54.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.753+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=HILV16CT3ZPJ type=del size=411569 2024-09-14T11:20:54.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.754+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=8KSGAZNGOP7P type=del 2024-09-14T11:20:54.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.755+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=DDULX56UG14R type=del size=99763 2024-09-14T11:20:54.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.756+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~V8U68V4ZN3AI.0 size=387298 2024-09-14T11:20:54.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.758+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=V8U68V4ZN3AI tag=PW6OCB5O0GFN type=write size=1435874 2024-09-14T11:20:54.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.759+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=NVWAXXNKSHUV type=write size=660174 2024-09-14T11:20:54.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.760+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.0 size=1048576 2024-09-14T11:20:54.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.761+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.1 size=1048576 2024-09-14T11:20:54.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.762+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0FT2MP2ISX4X.2 size=888952 2024-09-14T11:20:54.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.764+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=0FT2MP2ISX4X tag=VZMNTZ5QZPJF type=write size=4034680 2024-09-14T11:20:54.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.766+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~0ZS9JCRZDIV9.0 size=1048576 2024-09-14T11:20:54.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.767+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~0ZS9JCRZDIV9.1 size=611247 2024-09-14T11:20:54.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.767+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=0ZS9JCRZDIV9 tag=A7AYTTNFAH2D type=write size=2708399 2024-09-14T11:20:54.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.768+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~25DAT1QMT55Q.0 size=1048576 2024-09-14T11:20:54.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.768+0000 7fc354693780 1 < canceled part key=_multipart_NENG5XNJ7M5Z.2~25DAT1QMT55Q.1 size=1021107 2024-09-14T11:20:54.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.770+0000 7fc354693780 1 < canceled multipart upload key=NENG5XNJ7M5Z upload=25DAT1QMT55Q tag=JWIF3WPTLU1F type=write size=3118259 2024-09-14T11:20:54.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.772+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~IKF0POU6PABW.0 size=486252 2024-09-14T11:20:54.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.772+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=IKF0POU6PABW tag=DDMPGNJ03VUE type=write size=1534828 2024-09-14T11:20:54.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.773+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~ZDL63812PIPG.0 size=298582 2024-09-14T11:20:54.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.775+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=ZDL63812PIPG tag=B7G1RW82TRUY type=write size=1347158 2024-09-14T11:20:54.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.776+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=00F6DU1RBORI type=del size=2960415 2024-09-14T11:20:54.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.778+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=R1LSMT2JRUGX type=del 2024-09-14T11:20:54.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.780+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~7RW68E24205U.0 size=760429 2024-09-14T11:20:54.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.780+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=7RW68E24205U tag=T4APWT6FYG92 type=write size=1809005 2024-09-14T11:20:54.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.781+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=ZZZNXTYPJJO7 type=del 2024-09-14T11:20:54.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.782+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=48QPK83LO7IJ type=del size=2182528 2024-09-14T11:20:54.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.783+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=UT395B0Z0HDP type=del 2024-09-14T11:20:54.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.785+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~IBS3NKG60NZQ.0 size=1048576 2024-09-14T11:20:54.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.786+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~IBS3NKG60NZQ.1 size=640994 2024-09-14T11:20:54.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.786+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=IBS3NKG60NZQ tag=2MT0DX8FQ8HT type=write size=2738146 2024-09-14T11:20:54.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.787+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=GEIOXBPK7W1E type=del 2024-09-14T11:20:54.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.788+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=F0R1IJAXLU19 type=del size=522507 2024-09-14T11:20:54.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.789+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=10723REYUHAQ type=del 2024-09-14T11:20:54.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.791+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~04BLEWQKRP3H.0 size=124433 2024-09-14T11:20:54.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.791+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=04BLEWQKRP3H tag=ROWUH6UKS1H4 type=write size=1173009 2024-09-14T11:20:54.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.794+0000 7fc354693780 1 < suggested update operation key=4Z3KI5X3WQ0I tag=E9EL78QCO8XT type=del size=2893182 2024-09-14T11:20:54.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.795+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=NXGU1NRXRAW2 type=del size=3774488 2024-09-14T11:20:54.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.797+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=VSJECU84KWXH type=del 2024-09-14T11:20:54.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.798+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=FRGS5KTOSRTB type=write size=67164 2024-09-14T11:20:54.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.800+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=E83TO44S3OOA type=del 2024-09-14T11:20:54.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.802+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.0 size=1048576 2024-09-14T11:20:54.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.803+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.1 size=1048576 2024-09-14T11:20:54.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.804+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.2 size=471582 2024-09-14T11:20:54.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.804+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=B6L4QKGSVJLT tag=ZHEPWJRGWCQ1 type=write size=3617310 2024-09-14T11:20:54.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.805+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~DDA3A5XY7RVS.0 size=1048576 2024-09-14T11:20:54.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.806+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~DDA3A5XY7RVS.1 size=601487 2024-09-14T11:20:54.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.808+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=DDA3A5XY7RVS tag=S6R7Q9NDB1J6 type=write size=2698639 2024-09-14T11:20:54.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.810+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.0 size=1048576 2024-09-14T11:20:54.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.810+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.1 size=1048576 2024-09-14T11:20:54.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.811+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.2 size=830064 2024-09-14T11:20:54.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.811+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=ZKAQ9T2Y2B28 tag=7URIVPCV40L0 type=write size=3975792 2024-09-14T11:20:54.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.814+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=70X5IG9Y15SG type=del 2024-09-14T11:20:54.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.816+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~CP8UDZR14X38.0 size=1048576 2024-09-14T11:20:54.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.817+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~CP8UDZR14X38.1 size=520210 2024-09-14T11:20:54.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.817+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=CP8UDZR14X38 tag=Y9Z496OHIQ2H type=write size=2617362 2024-09-14T11:20:54.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.818+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=HILV16CT3ZPJ type=del 2024-09-14T11:20:54.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.820+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=362L2925CFBL type=del size=3390067 2024-09-14T11:20:54.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.821+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=DDULX56UG14R type=del 2024-09-14T11:20:54.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.822+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=Q2RXHCG8PAI4 type=del size=3915385 2024-09-14T11:20:54.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.823+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=NVWAXXNKSHUV type=write size=660174 2024-09-14T11:20:54.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.825+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=ZX1FUQZLP5XP type=del size=2579928 2024-09-14T11:20:54.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.826+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~0ZS9JCRZDIV9.0 size=1048576 2024-09-14T11:20:54.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.827+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~0ZS9JCRZDIV9.1 size=611247 2024-09-14T11:20:54.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.829+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=0ZS9JCRZDIV9 tag=A7AYTTNFAH2D type=write size=2708399 2024-09-14T11:20:54.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.831+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.0 size=1048576 2024-09-14T11:20:54.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.832+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.1 size=1048576 2024-09-14T11:20:54.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.833+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.2 size=567442 2024-09-14T11:20:54.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.833+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=Q7NMA5LI3UVG tag=IMCAB4PVKUAY type=write size=3713170 2024-09-14T11:20:54.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.834+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~IKF0POU6PABW.0 size=486252 2024-09-14T11:20:54.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.836+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=IKF0POU6PABW tag=DDMPGNJ03VUE type=write size=1534828 2024-09-14T11:20:54.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.838+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~CAJ0NKSDB2F6.0 size=189620 2024-09-14T11:20:54.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.838+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=CAJ0NKSDB2F6 tag=S8D0S103FMI8 type=write size=1238196 2024-09-14T11:20:54.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.840+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=00F6DU1RBORI type=del 2024-09-14T11:20:54.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.842+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.0 size=1048576 2024-09-14T11:20:54.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.843+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.1 size=1048576 2024-09-14T11:20:54.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.844+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.2 size=382458 2024-09-14T11:20:54.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.844+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=KQNT8IA6ZIDX tag=XD6MC8UULEWZ type=write size=3528186 2024-09-14T11:20:54.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.846+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~7RW68E24205U.0 size=760429 2024-09-14T11:20:54.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.848+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=7RW68E24205U tag=T4APWT6FYG92 type=write size=1809005 2024-09-14T11:20:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.849+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=QFD2XAV5WPKY type=del size=1506209 2024-09-14T11:20:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.850+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=48QPK83LO7IJ type=del 2024-09-14T11:20:54.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.851+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=FFSUKLG4VWZA type=del size=1081824 2024-09-14T11:20:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.853+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~IBS3NKG60NZQ.0 size=1048576 2024-09-14T11:20:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.854+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~IBS3NKG60NZQ.1 size=640994 2024-09-14T11:20:54.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.855+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=IBS3NKG60NZQ tag=2MT0DX8FQ8HT type=write size=2738146 2024-09-14T11:20:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.858+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~2TUL9CGGRAZ0.0 size=480213 2024-09-14T11:20:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.858+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=2TUL9CGGRAZ0 tag=CHXPLQ2HN71I type=write size=1528789 2024-09-14T11:20:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.859+0000 7fc354693780 1 < canceled operation key=IJZB38U355GG tag=F0R1IJAXLU19 type=del size=522507 2024-09-14T11:20:54.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.860+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=TJZGSDDKORZN type=write size=533226 2024-09-14T11:20:54.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.861+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~04BLEWQKRP3H.0 size=124433 2024-09-14T11:20:54.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.863+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=04BLEWQKRP3H tag=ROWUH6UKS1H4 type=write size=1173009 2024-09-14T11:20:54.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.864+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=2SORI4OCIYHE type=del size=1673182 2024-09-14T11:20:54.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.865+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=NXGU1NRXRAW2 type=del 2024-09-14T11:20:54.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.867+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~WK6HZW79HU8S.0 size=615763 2024-09-14T11:20:54.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.867+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=WK6HZW79HU8S tag=3UYCAEG6W7HV type=write size=1664339 2024-09-14T11:20:54.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.869+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=FRGS5KTOSRTB type=write size=67164 2024-09-14T11:20:54.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.871+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~1F7Y6U6JL7LW.0 size=400578 2024-09-14T11:20:54.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.872+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=1F7Y6U6JL7LW tag=EKYAFREIY3Q8 type=write size=1449154 2024-09-14T11:20:54.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.873+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.0 size=1048576 2024-09-14T11:20:54.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.874+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.1 size=1048576 2024-09-14T11:20:54.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.874+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~B6L4QKGSVJLT.2 size=471582 2024-09-14T11:20:54.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.876+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=B6L4QKGSVJLT tag=ZHEPWJRGWCQ1 type=write size=3617310 2024-09-14T11:20:54.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.878+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=0MQ0NMUP04NH type=del size=1801324 2024-09-14T11:20:54.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.879+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.0 size=1048576 2024-09-14T11:20:54.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.880+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.1 size=1048576 2024-09-14T11:20:54.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.880+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~ZKAQ9T2Y2B28.2 size=830064 2024-09-14T11:20:54.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.883+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=ZKAQ9T2Y2B28 tag=7URIVPCV40L0 type=write size=3975792 2024-09-14T11:20:54.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.885+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.0 size=1048576 2024-09-14T11:20:54.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.885+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.1 size=1048576 2024-09-14T11:20:54.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.886+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.2 size=187144 2024-09-14T11:20:54.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.886+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=VXAOSX8RASU1 tag=2HYKM4VGA55O type=write size=3332872 2024-09-14T11:20:54.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.887+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~CP8UDZR14X38.0 size=1048576 2024-09-14T11:20:54.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.888+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~CP8UDZR14X38.1 size=520210 2024-09-14T11:20:54.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.890+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=CP8UDZR14X38 tag=Y9Z496OHIQ2H type=write size=2617362 2024-09-14T11:20:54.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.891+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=9D5ZL8A1F3YD type=del size=1059193 2024-09-14T11:20:54.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.892+0000 7fc354693780 1 < canceled operation key=Z3ZFX1354IRF tag=362L2925CFBL type=del size=3390067 2024-09-14T11:20:54.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.894+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~3R46ZMKJG3BB.0 size=558229 2024-09-14T11:20:54.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.894+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=3R46ZMKJG3BB tag=TWZG22OMM47S type=write size=1606805 2024-09-14T11:20:54.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.895+0000 7fc354693780 1 < canceled operation key=RHVF0Z2PRDA8 tag=Q2RXHCG8PAI4 type=del size=3915385 2024-09-14T11:20:54.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.897+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~5F8H5SLX18B7.0 size=1038785 2024-09-14T11:20:54.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.897+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=5F8H5SLX18B7 tag=KMVCU3FQF0YS type=write size=2087361 2024-09-14T11:20:54.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.898+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=ZX1FUQZLP5XP type=del 2024-09-14T11:20:54.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.899+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=CNEWIC2Q5WJX type=del size=4004422 2024-09-14T11:20:54.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.900+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.0 size=1048576 2024-09-14T11:20:54.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.900+0000 7fc354693780 1 < canceled part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.1 size=1048576 2024-09-14T11:20:54.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.901+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~Q7NMA5LI3UVG.2 size=567442 2024-09-14T11:20:54.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.903+0000 7fc354693780 1 < canceled multipart upload key=T0Z8NK20DS5K upload=Q7NMA5LI3UVG tag=IMCAB4PVKUAY type=write size=3713170 2024-09-14T11:20:54.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.905+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~K60N48PX1SFO.0 size=1048576 2024-09-14T11:20:54.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.906+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~K60N48PX1SFO.1 size=40308 2024-09-14T11:20:54.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.906+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=K60N48PX1SFO tag=EMZDHSFCWGLC type=write size=2137460 2024-09-14T11:20:54.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.907+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~CAJ0NKSDB2F6.0 size=189620 2024-09-14T11:20:54.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.909+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=CAJ0NKSDB2F6 tag=S8D0S103FMI8 type=write size=1238196 2024-09-14T11:20:54.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.910+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=HPE76PBTIYU6 type=del size=2879205 2024-09-14T11:20:54.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.912+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.0 size=1048576 2024-09-14T11:20:54.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.913+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.1 size=1048576 2024-09-14T11:20:54.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.913+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~KQNT8IA6ZIDX.2 size=382458 2024-09-14T11:20:54.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.915+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=KQNT8IA6ZIDX tag=XD6MC8UULEWZ type=write size=3528186 2024-09-14T11:20:54.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.917+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=3US01HQ24TJA type=del size=1712569 2024-09-14T11:20:54.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.918+0000 7fc354693780 1 < canceled operation key=4IDBIAE3VAY4 tag=QFD2XAV5WPKY type=del size=1506209 2024-09-14T11:20:54.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.920+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~AR5JZVUJ01DO.0 size=1048576 2024-09-14T11:20:54.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.921+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~AR5JZVUJ01DO.1 size=934984 2024-09-14T11:20:54.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.921+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=AR5JZVUJ01DO tag=D09XWLJFIJBI type=write size=3032136 2024-09-14T11:20:54.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.922+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=FFSUKLG4VWZA type=del 2024-09-14T11:20:54.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.923+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=YPD7GPGIYDX3 type=del size=1337527 2024-09-14T11:20:54.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.925+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~2TUL9CGGRAZ0.0 size=480213 2024-09-14T11:20:54.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.927+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=2TUL9CGGRAZ0 tag=CHXPLQ2HN71I type=write size=1528789 2024-09-14T11:20:54.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.929+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.0 size=1048576 2024-09-14T11:20:54.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.930+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.1 size=1048576 2024-09-14T11:20:54.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.931+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.2 size=1002764 2024-09-14T11:20:54.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.931+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=TNJ7SBC79B32 tag=I8EKFEVJVQ80 type=write size=4148492 2024-09-14T11:20:54.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.932+0000 7fc354693780 1 < completed write operation key=ICNEXZMA3VQV tag=TJZGSDDKORZN type=write size=533226 2024-09-14T11:20:54.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.933+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=6L4Z4CZFBRG4 type=del size=1854947 2024-09-14T11:20:54.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.934+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=2SORI4OCIYHE type=del 2024-09-14T11:20:54.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.937+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~00U8ZJ64MKK2.0 size=1048576 2024-09-14T11:20:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.937+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~00U8ZJ64MKK2.1 size=24987 2024-09-14T11:20:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.937+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=00U8ZJ64MKK2 tag=257ADJB8I2K2 type=write size=2122139 2024-09-14T11:20:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.938+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~WK6HZW79HU8S.0 size=615763 2024-09-14T11:20:54.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.940+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=WK6HZW79HU8S tag=3UYCAEG6W7HV type=write size=1664339 2024-09-14T11:20:54.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.942+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~XMAW6974IJK7.0 size=235799 2024-09-14T11:20:54.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.942+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=XMAW6974IJK7 tag=SCOO5Z5YF44J type=write size=1284375 2024-09-14T11:20:54.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.943+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~1F7Y6U6JL7LW.0 size=400578 2024-09-14T11:20:54.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.945+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=1F7Y6U6JL7LW tag=EKYAFREIY3Q8 type=write size=1449154 2024-09-14T11:20:54.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.946+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=XN2UI6CQTBZK type=del size=739684 2024-09-14T11:20:54.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.948+0000 7fc354693780 1 < suggested update operation key=Z3ZFX1354IRF tag=0MQ0NMUP04NH type=del size=1801324 2024-09-14T11:20:54.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.950+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=8CV73DEUZW00 type=del size=3986714 2024-09-14T11:20:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.952+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.0 size=1048576 2024-09-14T11:20:54.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.952+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.1 size=1048576 2024-09-14T11:20:54.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.953+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~VXAOSX8RASU1.2 size=187144 2024-09-14T11:20:54.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.955+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=VXAOSX8RASU1 tag=2HYKM4VGA55O type=write size=3332872 2024-09-14T11:20:54.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.956+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=3BCR3VBU2P69 type=del size=1205872 2024-09-14T11:20:54.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.957+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=9D5ZL8A1F3YD type=del 2024-09-14T11:20:54.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.959+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~IDCL1RLQH63H.0 size=307059 2024-09-14T11:20:54.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.959+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=IDCL1RLQH63H tag=8PMICXOL6A54 type=write size=1355635 2024-09-14T11:20:54.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.961+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~3R46ZMKJG3BB.0 size=558229 2024-09-14T11:20:54.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.962+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=3R46ZMKJG3BB tag=TWZG22OMM47S type=write size=1606805 2024-09-14T11:20:54.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.964+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=WL2VEMVRKVQP type=del size=1190512 2024-09-14T11:20:54.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.965+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~5F8H5SLX18B7.0 size=1038785 2024-09-14T11:20:54.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.967+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=5F8H5SLX18B7 tag=KMVCU3FQF0YS type=write size=2087361 2024-09-14T11:20:54.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.968+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=UG0D3SOPDF39 type=del size=2088650 2024-09-14T11:20:54.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.969+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=CNEWIC2Q5WJX type=del size=4004422 2024-09-14T11:20:54.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.970+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=NRUUSBE58Q1N type=del size=3717531 2024-09-14T11:20:54.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.971+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~K60N48PX1SFO.0 size=1048576 2024-09-14T11:20:54.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.972+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~K60N48PX1SFO.1 size=40308 2024-09-14T11:20:54.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.974+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=K60N48PX1SFO tag=EMZDHSFCWGLC type=write size=2137460 2024-09-14T11:20:54.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.975+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=MSXEN92Q83NI type=del size=2482943 2024-09-14T11:20:54.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.976+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=HPE76PBTIYU6 type=del 2024-09-14T11:20:54.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.977+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=Q1TZQTC8X8LT type=del size=1024560 2024-09-14T11:20:54.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.978+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=3US01HQ24TJA type=del 2024-09-14T11:20:54.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.980+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~M89SC3APAW7Z.0 size=142172 2024-09-14T11:20:54.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.980+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=M89SC3APAW7Z tag=5CENMQYJV0Y5 type=write size=1190748 2024-09-14T11:20:54.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.981+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~AR5JZVUJ01DO.0 size=1048576 2024-09-14T11:20:54.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.982+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~AR5JZVUJ01DO.1 size=934984 2024-09-14T11:20:54.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.984+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=AR5JZVUJ01DO tag=D09XWLJFIJBI type=write size=3032136 2024-09-14T11:20:54.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.985+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=T4GP8KXGUN1Y type=del size=2222339 2024-09-14T11:20:54.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.986+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=YPD7GPGIYDX3 type=del 2024-09-14T11:20:54.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.987+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=5HSIVHCCAIZV type=del size=1108882 2024-09-14T11:20:54.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.989+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.0 size=1048576 2024-09-14T11:20:54.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.990+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.1 size=1048576 2024-09-14T11:20:54.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.990+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~TNJ7SBC79B32.2 size=1002764 2024-09-14T11:20:54.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.992+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=TNJ7SBC79B32 tag=I8EKFEVJVQ80 type=write size=4148492 2024-09-14T11:20:54.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.993+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=9IHKM50PDPZJ type=del size=974580 2024-09-14T11:20:54.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.995+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=6L4Z4CZFBRG4 type=del 2024-09-14T11:20:54.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.996+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=L089GBO1GK0D type=del size=3749241 2024-09-14T11:20:54.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.997+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~00U8ZJ64MKK2.0 size=1048576 2024-09-14T11:20:54.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.998+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~00U8ZJ64MKK2.1 size=24987 2024-09-14T11:20:54.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:54.999+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=00U8ZJ64MKK2 tag=257ADJB8I2K2 type=write size=2122139 2024-09-14T11:20:54.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.000+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=YN7E4A9JOSIO type=del size=450710 2024-09-14T11:20:55.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.001+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~XMAW6974IJK7.0 size=235799 2024-09-14T11:20:55.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.003+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=XMAW6974IJK7 tag=SCOO5Z5YF44J type=write size=1284375 2024-09-14T11:20:55.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.005+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~FXZKAWW9LGOJ.0 size=1048576 2024-09-14T11:20:55.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.006+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~FXZKAWW9LGOJ.1 size=136185 2024-09-14T11:20:55.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.006+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=FXZKAWW9LGOJ tag=PWYCUUMZO5WA type=write size=2233337 2024-09-14T11:20:55.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.007+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=XN2UI6CQTBZK type=del 2024-09-14T11:20:55.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.008+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=1OGJ40CLUVU8 type=del size=4126843 2024-09-14T11:20:55.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.010+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=8CV73DEUZW00 type=del 2024-09-14T11:20:55.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.011+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=50QG9GJRK1M6 type=del size=2478977 2024-09-14T11:20:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.013+0000 7fc354693780 1 < suggested update operation key=BJ7AARJEIT8W tag=3BCR3VBU2P69 type=del size=1205872 2024-09-14T11:20:55.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.014+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=MVIELXKXG2MB type=del size=3849159 2024-09-14T11:20:55.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.015+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~IDCL1RLQH63H.0 size=307059 2024-09-14T11:20:55.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.017+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=IDCL1RLQH63H tag=8PMICXOL6A54 type=write size=1355635 2024-09-14T11:20:55.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.018+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=3J2RS17S88QY type=del size=2694377 2024-09-14T11:20:55.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.019+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=WL2VEMVRKVQP type=del 2024-09-14T11:20:55.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.020+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=MGMPSJ1UJ6MQ type=write size=770864 2024-09-14T11:20:55.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.021+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=UG0D3SOPDF39 type=del 2024-09-14T11:20:55.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.023+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=ZBQGI6P47SND type=del size=364023 2024-09-14T11:20:55.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.024+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=NRUUSBE58Q1N type=del 2024-09-14T11:20:55.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.025+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=N791X1171DZM type=del size=3754181 2024-09-14T11:20:55.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.026+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=MSXEN92Q83NI type=del 2024-09-14T11:20:55.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.028+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.0 size=1048576 2024-09-14T11:20:55.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.029+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.1 size=1048576 2024-09-14T11:20:55.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.030+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.2 size=377841 2024-09-14T11:20:55.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.030+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=YLI3E0PXYH7D tag=ZDLL2774GMFG type=write size=3523569 2024-09-14T11:20:55.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.031+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=Q1TZQTC8X8LT type=del 2024-09-14T11:20:55.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.033+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.0 size=1048576 2024-09-14T11:20:55.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.034+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.1 size=1048576 2024-09-14T11:20:55.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.035+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.2 size=661244 2024-09-14T11:20:55.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.035+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=3UXLDB5B79IV tag=4P4CJ3UOEAZN type=write size=3806972 2024-09-14T11:20:55.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.036+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~M89SC3APAW7Z.0 size=142172 2024-09-14T11:20:55.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.038+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=M89SC3APAW7Z tag=5CENMQYJV0Y5 type=write size=1190748 2024-09-14T11:20:55.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.039+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=3VW1PGCZRS6M type=del size=4145166 2024-09-14T11:20:55.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.040+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=T4GP8KXGUN1Y type=del 2024-09-14T11:20:55.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.041+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=R3JD77MG7HS3 type=write size=1046154 2024-09-14T11:20:55.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.043+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=5HSIVHCCAIZV type=del 2024-09-14T11:20:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.044+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=AUP607I20YBU type=del size=2203494 2024-09-14T11:20:55.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.045+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=9IHKM50PDPZJ type=del 2024-09-14T11:20:55.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.047+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~P82EZOP1BM89.0 size=1048576 2024-09-14T11:20:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.048+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~P82EZOP1BM89.1 size=357995 2024-09-14T11:20:55.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.048+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=P82EZOP1BM89 tag=2CS8MEQVFDAH type=write size=2455147 2024-09-14T11:20:55.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.049+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=L089GBO1GK0D type=del 2024-09-14T11:20:55.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.051+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=XZY3BIODI43G type=write size=205654 2024-09-14T11:20:55.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.052+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=YN7E4A9JOSIO type=del 2024-09-14T11:20:55.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.053+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=18U6446Q2C81 type=write size=974043 2024-09-14T11:20:55.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.054+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~FXZKAWW9LGOJ.0 size=1048576 2024-09-14T11:20:55.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.055+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~FXZKAWW9LGOJ.1 size=136185 2024-09-14T11:20:55.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.057+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=FXZKAWW9LGOJ tag=PWYCUUMZO5WA type=write size=2233337 2024-09-14T11:20:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.059+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=ZNDRCN9EEDTV type=write size=243343 2024-09-14T11:20:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.061+0000 7fc354693780 1 < suggested update operation key=4Z3KI5X3WQ0I tag=1OGJ40CLUVU8 type=del size=4126843 2024-09-14T11:20:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.062+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=2CVJEIH9QLPC type=write size=330911 2024-09-14T11:20:55.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.063+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=50QG9GJRK1M6 type=del 2024-09-14T11:20:55.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.065+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~JAA1G7ZM9MBU.0 size=491730 2024-09-14T11:20:55.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.065+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=JAA1G7ZM9MBU tag=2OSRUWCF1D8J type=write size=1540306 2024-09-14T11:20:55.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.067+0000 7fc354693780 1 < suggested update operation key=GE83T07IQG0S tag=MVIELXKXG2MB type=del size=3849159 2024-09-14T11:20:55.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.069+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~D2N8PS54XOPT.0 size=1048576 2024-09-14T11:20:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.070+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~D2N8PS54XOPT.1 size=288555 2024-09-14T11:20:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.070+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=D2N8PS54XOPT tag=5H29LB0N0GQU type=write size=2385707 2024-09-14T11:20:55.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.071+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=3J2RS17S88QY type=del size=2694377 2024-09-14T11:20:55.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.072+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=Y4MYBWRZOI61 type=write size=194476 2024-09-14T11:20:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.073+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=MGMPSJ1UJ6MQ type=write size=770864 2024-09-14T11:20:55.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.075+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~OR9FRTR44FZ0.0 size=1048576 2024-09-14T11:20:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.076+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~OR9FRTR44FZ0.1 size=912878 2024-09-14T11:20:55.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.076+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=OR9FRTR44FZ0 tag=IXMHCGPA3J02 type=write size=3010030 2024-09-14T11:20:55.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.077+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=ZBQGI6P47SND type=del 2024-09-14T11:20:55.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.079+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=BCZ5C6HOLFAU type=del size=2462073 2024-09-14T11:20:55.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.080+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=N791X1171DZM type=del 2024-09-14T11:20:55.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.081+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=PO4IQ1EW2DU6 type=del size=576539 2024-09-14T11:20:55.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.082+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.0 size=1048576 2024-09-14T11:20:55.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.083+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.1 size=1048576 2024-09-14T11:20:55.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.084+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~YLI3E0PXYH7D.2 size=377841 2024-09-14T11:20:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.086+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=YLI3E0PXYH7D tag=ZDLL2774GMFG type=write size=3523569 2024-09-14T11:20:55.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.087+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=RK3LEZPPD1GX type=del size=4156542 2024-09-14T11:20:55.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.088+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.0 size=1048576 2024-09-14T11:20:55.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.089+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.1 size=1048576 2024-09-14T11:20:55.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.090+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~3UXLDB5B79IV.2 size=661244 2024-09-14T11:20:55.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.092+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=3UXLDB5B79IV tag=4P4CJ3UOEAZN type=write size=3806972 2024-09-14T11:20:55.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.093+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~FBV4456VHDXL.0 size=1048576 2024-09-14T11:20:55.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.094+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~FBV4456VHDXL.1 size=84071 2024-09-14T11:20:55.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.094+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=FBV4456VHDXL tag=9P5T9CQSTENW type=write size=2181223 2024-09-14T11:20:55.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.095+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=3VW1PGCZRS6M type=del 2024-09-14T11:20:55.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.097+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~P6H4GK42JNHS.0 size=965867 2024-09-14T11:20:55.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.097+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=P6H4GK42JNHS tag=WRT4DXK4B0B9 type=write size=2014443 2024-09-14T11:20:55.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.099+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=R3JD77MG7HS3 type=write size=1046154 2024-09-14T11:20:55.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.100+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=VI2MIJQ412N2 type=del size=171427 2024-09-14T11:20:55.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.101+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=AUP607I20YBU type=del 2024-09-14T11:20:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.103+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~48WWA5CBXDNU.0 size=892915 2024-09-14T11:20:55.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.103+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=48WWA5CBXDNU tag=JZW24P3SK0LZ type=write size=1941491 2024-09-14T11:20:55.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.104+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~P82EZOP1BM89.0 size=1048576 2024-09-14T11:20:55.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.105+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~P82EZOP1BM89.1 size=357995 2024-09-14T11:20:55.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.106+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=P82EZOP1BM89 tag=2CS8MEQVFDAH type=write size=2455147 2024-09-14T11:20:55.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.108+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=JVZRT91YM3NJ type=del size=373892 2024-09-14T11:20:55.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.110+0000 7fc354693780 1 < suggested remove operation key=54EUIL28P2H1 tag=XZY3BIODI43G type=write 2024-09-14T11:20:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.112+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~KHBH3S73TKRH.0 size=517643 2024-09-14T11:20:55.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.112+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=KHBH3S73TKRH tag=L849JLEN1849 type=write size=1566219 2024-09-14T11:20:55.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.113+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=18U6446Q2C81 type=write size=974043 2024-09-14T11:20:55.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.115+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.0 size=1048576 2024-09-14T11:20:55.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.116+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.1 size=1048576 2024-09-14T11:20:55.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.116+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.2 size=695651 2024-09-14T11:20:55.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.116+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=H2KG76TF5A67 tag=7KXOBYC57UED type=write size=3841379 2024-09-14T11:20:55.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.118+0000 7fc354693780 1 < completed write operation key=JF6PHF17N5WE tag=ZNDRCN9EEDTV type=write size=243343 2024-09-14T11:20:55.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.119+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=NB1FQPC998S2 type=del size=1878948 2024-09-14T11:20:55.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.120+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=2CVJEIH9QLPC type=write size=330911 2024-09-14T11:20:55.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.121+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=XSM8BDNVRW20 type=del size=550998 2024-09-14T11:20:55.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.122+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~JAA1G7ZM9MBU.0 size=491730 2024-09-14T11:20:55.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.124+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=JAA1G7ZM9MBU tag=2OSRUWCF1D8J type=write size=1540306 2024-09-14T11:20:55.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.125+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=RFT3Z8G4BRWT type=del size=2340505 2024-09-14T11:20:55.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.126+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~D2N8PS54XOPT.0 size=1048576 2024-09-14T11:20:55.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.126+0000 7fc354693780 1 < canceled part key=_multipart_IGZK9BWJFCV3.2~D2N8PS54XOPT.1 size=288555 2024-09-14T11:20:55.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.128+0000 7fc354693780 1 < canceled multipart upload key=IGZK9BWJFCV3 upload=D2N8PS54XOPT tag=5H29LB0N0GQU type=write size=2385707 2024-09-14T11:20:55.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.130+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~2FEFT6L2FLFU.0 size=1048576 2024-09-14T11:20:55.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.131+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~2FEFT6L2FLFU.1 size=178713 2024-09-14T11:20:55.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.131+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=2FEFT6L2FLFU tag=512F3LBVKXH1 type=write size=2275865 2024-09-14T11:20:55.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.132+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=Y4MYBWRZOI61 type=write size=194476 2024-09-14T11:20:55.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.134+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~51MW23HQ4OHR.0 size=1048576 2024-09-14T11:20:55.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.135+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~51MW23HQ4OHR.1 size=24958 2024-09-14T11:20:55.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.135+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=51MW23HQ4OHR tag=26JJNMB7T2EN type=write size=2122110 2024-09-14T11:20:55.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.136+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~OR9FRTR44FZ0.0 size=1048576 2024-09-14T11:20:55.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.137+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~OR9FRTR44FZ0.1 size=912878 2024-09-14T11:20:55.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.139+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=OR9FRTR44FZ0 tag=IXMHCGPA3J02 type=write size=3010030 2024-09-14T11:20:55.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.140+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=13GTW3MLQI50 type=write size=777092 2024-09-14T11:20:55.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.141+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=BCZ5C6HOLFAU type=del 2024-09-14T11:20:55.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.143+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=59QPZ2E1VSTK type=del size=1441263 2024-09-14T11:20:55.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.144+0000 7fc354693780 1 < canceled operation key=P061QWG9J16V tag=PO4IQ1EW2DU6 type=del size=576539 2024-09-14T11:20:55.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.145+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=HVEJ7HGXR2JP type=write size=776706 2024-09-14T11:20:55.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.147+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=RK3LEZPPD1GX type=del 2024-09-14T11:20:55.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.149+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=MGNWJUIF03E2 type=write size=1022132 2024-09-14T11:20:55.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.150+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~FBV4456VHDXL.0 size=1048576 2024-09-14T11:20:55.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.151+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~FBV4456VHDXL.1 size=84071 2024-09-14T11:20:55.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.153+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=FBV4456VHDXL tag=9P5T9CQSTENW type=write size=2181223 2024-09-14T11:20:55.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.155+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~HI2D53GNZQQS.0 size=66156 2024-09-14T11:20:55.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.155+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=HI2D53GNZQQS tag=L9ZYLYYDKRQT type=write size=1114732 2024-09-14T11:20:55.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.156+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~P6H4GK42JNHS.0 size=965867 2024-09-14T11:20:55.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.158+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=P6H4GK42JNHS tag=WRT4DXK4B0B9 type=write size=2014443 2024-09-14T11:20:55.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.159+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=CYZ1ODHSJ1SG type=del size=3129392 2024-09-14T11:20:55.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.162+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=VI2MIJQ412N2 type=del 2024-09-14T11:20:55.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.164+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.0 size=1048576 2024-09-14T11:20:55.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.165+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.1 size=1048576 2024-09-14T11:20:55.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.166+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.2 size=1006768 2024-09-14T11:20:55.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.166+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=HMSR1VMSOC8G tag=3AJ7YELLPCOH type=write size=4152496 2024-09-14T11:20:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.167+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~48WWA5CBXDNU.0 size=892915 2024-09-14T11:20:55.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.169+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=48WWA5CBXDNU tag=JZW24P3SK0LZ type=write size=1941491 2024-09-14T11:20:55.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.171+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.0 size=1048576 2024-09-14T11:20:55.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.172+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.1 size=1048576 2024-09-14T11:20:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.173+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.2 size=625692 2024-09-14T11:20:55.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.173+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=XTH78C6D166J tag=R1EV7WXB2YDB type=write size=3771420 2024-09-14T11:20:55.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.174+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=JVZRT91YM3NJ type=del 2024-09-14T11:20:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.175+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=WRKO9W5TZ5DT type=del size=446557 2024-09-14T11:20:55.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.176+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~KHBH3S73TKRH.0 size=517643 2024-09-14T11:20:55.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.178+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=KHBH3S73TKRH tag=L849JLEN1849 type=write size=1566219 2024-09-14T11:20:55.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.181+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~E3IMB8RTHZ27.0 size=701090 2024-09-14T11:20:55.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.181+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=E3IMB8RTHZ27 tag=8EGZ7QPS0CPV type=write size=1749666 2024-09-14T11:20:55.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.182+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.0 size=1048576 2024-09-14T11:20:55.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.182+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.1 size=1048576 2024-09-14T11:20:55.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.183+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~H2KG76TF5A67.2 size=695651 2024-09-14T11:20:55.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.185+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=H2KG76TF5A67 tag=7KXOBYC57UED type=write size=3841379 2024-09-14T11:20:55.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.187+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.0 size=1048576 2024-09-14T11:20:55.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.188+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.1 size=1048576 2024-09-14T11:20:55.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.188+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.2 size=1031279 2024-09-14T11:20:55.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.188+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=SVIU2JASAXPE tag=4MCYE89JXG12 type=write size=4177007 2024-09-14T11:20:55.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.189+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=NB1FQPC998S2 type=del 2024-09-14T11:20:55.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.191+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=9SHFR7CMZF6K type=del size=3137341 2024-09-14T11:20:55.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.192+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=XSM8BDNVRW20 type=del size=550998 2024-09-14T11:20:55.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.193+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=CT2V3DQKTKXW type=del size=2671800 2024-09-14T11:20:55.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.195+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=RFT3Z8G4BRWT type=del 2024-09-14T11:20:55.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.197+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=LG36LQ4TNEGL type=write size=901602 2024-09-14T11:20:55.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.198+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~2FEFT6L2FLFU.0 size=1048576 2024-09-14T11:20:55.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.199+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~2FEFT6L2FLFU.1 size=178713 2024-09-14T11:20:55.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.200+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=2FEFT6L2FLFU tag=512F3LBVKXH1 type=write size=2275865 2024-09-14T11:20:55.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.203+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~PI1X41SJHLXQ.0 size=1048576 2024-09-14T11:20:55.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.203+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~PI1X41SJHLXQ.1 size=554700 2024-09-14T11:20:55.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.203+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=PI1X41SJHLXQ tag=5F14R3YNC4JX type=write size=2651852 2024-09-14T11:20:55.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.204+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~51MW23HQ4OHR.0 size=1048576 2024-09-14T11:20:55.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.205+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~51MW23HQ4OHR.1 size=24958 2024-09-14T11:20:55.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.207+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=51MW23HQ4OHR tag=26JJNMB7T2EN type=write size=2122110 2024-09-14T11:20:55.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.209+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=U5SXHOSGPFSU type=del size=2483848 2024-09-14T11:20:55.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.210+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=13GTW3MLQI50 type=write size=777092 2024-09-14T11:20:55.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.211+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=YFBSATNXTOST type=del size=214307 2024-09-14T11:20:55.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.213+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=59QPZ2E1VSTK type=del size=1441263 2024-09-14T11:20:55.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.215+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~I5BB79GCFVTW.0 size=1048576 2024-09-14T11:20:55.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.216+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~I5BB79GCFVTW.1 size=466118 2024-09-14T11:20:55.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.216+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=I5BB79GCFVTW tag=6UIKHNB90T9Z type=write size=2563270 2024-09-14T11:20:55.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.218+0000 7fc354693780 1 < suggested remove operation key=WBT3M1NMEEAY tag=HVEJ7HGXR2JP type=write 2024-09-14T11:20:55.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.219+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=O1J6RRWF3LKK type=del size=628008 2024-09-14T11:20:55.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.220+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=MGNWJUIF03E2 type=write size=1022132 2024-09-14T11:20:55.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.223+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.0 size=1048576 2024-09-14T11:20:55.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.223+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.1 size=1048576 2024-09-14T11:20:55.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.224+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.2 size=391242 2024-09-14T11:20:55.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.224+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=5HK1KGQ31ZLY tag=603SRLWFPZL8 type=write size=3536970 2024-09-14T11:20:55.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.226+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~HI2D53GNZQQS.0 size=66156 2024-09-14T11:20:55.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.227+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=HI2D53GNZQQS tag=L9ZYLYYDKRQT type=write size=1114732 2024-09-14T11:20:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.229+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=HXZZMHNXF1H4 type=write size=198812 2024-09-14T11:20:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.231+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=CYZ1ODHSJ1SG type=del size=3129392 2024-09-14T11:20:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.232+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=QWZP8HB5X4U9 type=del size=131264 2024-09-14T11:20:55.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.233+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.0 size=1048576 2024-09-14T11:20:55.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.234+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.1 size=1048576 2024-09-14T11:20:55.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.235+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~HMSR1VMSOC8G.2 size=1006768 2024-09-14T11:20:55.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.237+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=HMSR1VMSOC8G tag=3AJ7YELLPCOH type=write size=4152496 2024-09-14T11:20:55.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.238+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=CQBVM5SKRI7L type=write size=1038791 2024-09-14T11:20:55.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.239+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.0 size=1048576 2024-09-14T11:20:55.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.239+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.1 size=1048576 2024-09-14T11:20:55.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.240+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~XTH78C6D166J.2 size=625692 2024-09-14T11:20:55.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.242+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=XTH78C6D166J tag=R1EV7WXB2YDB type=write size=3771420 2024-09-14T11:20:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.243+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=NKRDUBXH19FP type=del size=1041403 2024-09-14T11:20:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.244+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=WRKO9W5TZ5DT type=del 2024-09-14T11:20:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.247+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.0 size=1048576 2024-09-14T11:20:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.248+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.1 size=1048576 2024-09-14T11:20:55.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.249+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.2 size=288613 2024-09-14T11:20:55.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.249+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=F9429NNNT6YA tag=QJIVILK022G4 type=write size=3434341 2024-09-14T11:20:55.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.250+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~E3IMB8RTHZ27.0 size=701090 2024-09-14T11:20:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.252+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=E3IMB8RTHZ27 tag=8EGZ7QPS0CPV type=write size=1749666 2024-09-14T11:20:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.253+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=49Q8TPICS0IX type=del size=3176571 2024-09-14T11:20:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.255+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.0 size=1048576 2024-09-14T11:20:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.256+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.1 size=1048576 2024-09-14T11:20:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.257+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~SVIU2JASAXPE.2 size=1031279 2024-09-14T11:20:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.259+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=SVIU2JASAXPE tag=4MCYE89JXG12 type=write size=4177007 2024-09-14T11:20:55.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.260+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=NWMVBF0U59E5 type=del size=3699895 2024-09-14T11:20:55.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.262+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=9SHFR7CMZF6K type=del 2024-09-14T11:20:55.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.263+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=24OVVPU4NVOB type=del size=749810 2024-09-14T11:20:55.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.264+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=CT2V3DQKTKXW type=del 2024-09-14T11:20:55.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.266+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~H0ODZAM67JVQ.0 size=510328 2024-09-14T11:20:55.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.266+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=H0ODZAM67JVQ tag=0OQKRO6QTB9N type=write size=1558904 2024-09-14T11:20:55.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.268+0000 7fc354693780 1 < completed write operation key=T0Z8NK20DS5K tag=LG36LQ4TNEGL type=write size=901602 2024-09-14T11:20:55.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.270+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=MK5CLAPJTRA0 type=del size=3121676 2024-09-14T11:20:55.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.271+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~PI1X41SJHLXQ.0 size=1048576 2024-09-14T11:20:55.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.273+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~PI1X41SJHLXQ.1 size=554700 2024-09-14T11:20:55.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.274+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=PI1X41SJHLXQ tag=5F14R3YNC4JX type=write size=2651852 2024-09-14T11:20:55.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.277+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~4DTGF06HNXMC.0 size=1048576 2024-09-14T11:20:55.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.278+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~4DTGF06HNXMC.1 size=753509 2024-09-14T11:20:55.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.278+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=4DTGF06HNXMC tag=UKPITPSA38QB type=write size=2850661 2024-09-14T11:20:55.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.279+0000 7fc354693780 -1 < failed to complete operation key=N23XJJD7YYG0 tag=U5SXHOSGPFSU type=del size=2483848: (22) Invalid argument 2024-09-14T11:20:55.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.280+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=I6TMYI279PQS type=del size=3863468 2024-09-14T11:20:55.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.281+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=YFBSATNXTOST type=del size=214307 2024-09-14T11:20:55.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.283+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~98UWZEIW7FCU.0 size=1048576 2024-09-14T11:20:55.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.284+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~98UWZEIW7FCU.1 size=934337 2024-09-14T11:20:55.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.284+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=98UWZEIW7FCU tag=NMK7LL81RGTP type=write size=3031489 2024-09-14T11:20:55.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.285+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~I5BB79GCFVTW.0 size=1048576 2024-09-14T11:20:55.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.285+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~I5BB79GCFVTW.1 size=466118 2024-09-14T11:20:55.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.287+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=I5BB79GCFVTW tag=6UIKHNB90T9Z type=write size=2563270 2024-09-14T11:20:55.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.288+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=7EEBS2EJRFTF type=del size=727667 2024-09-14T11:20:55.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.290+0000 7fc354693780 1 < suggested update operation key=4Z3KI5X3WQ0I tag=O1J6RRWF3LKK type=del size=628008 2024-09-14T11:20:55.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.291+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=PC8PT2RH7KJW type=del size=3796590 2024-09-14T11:20:55.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.293+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.0 size=1048576 2024-09-14T11:20:55.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.294+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.1 size=1048576 2024-09-14T11:20:55.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.294+0000 7fc354693780 1 < canceled part key=_multipart_WYD70VR8OKAN.2~5HK1KGQ31ZLY.2 size=391242 2024-09-14T11:20:55.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.296+0000 7fc354693780 1 < canceled multipart upload key=WYD70VR8OKAN upload=5HK1KGQ31ZLY tag=603SRLWFPZL8 type=write size=3536970 2024-09-14T11:20:55.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.297+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=EZ35WHT5IB4C type=del size=3397751 2024-09-14T11:20:55.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.298+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=HXZZMHNXF1H4 type=write size=198812 2024-09-14T11:20:55.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.300+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~JCY1L8CJM3V0.0 size=802123 2024-09-14T11:20:55.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.300+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=JCY1L8CJM3V0 tag=W1C8H93BDWLA type=write size=1850699 2024-09-14T11:20:55.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.301+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=QWZP8HB5X4U9 type=del 2024-09-14T11:20:55.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.304+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~1J8YAE4JKXEV.0 size=1048576 2024-09-14T11:20:55.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.305+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~1J8YAE4JKXEV.1 size=913349 2024-09-14T11:20:55.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.305+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=1J8YAE4JKXEV tag=6DZ31MQJXGFM type=write size=3010501 2024-09-14T11:20:55.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.306+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=CQBVM5SKRI7L type=write size=1038791 2024-09-14T11:20:55.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.308+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~BC5NG3B3CUO7.0 size=737406 2024-09-14T11:20:55.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.308+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=BC5NG3B3CUO7 tag=LE6ZPS9J15OD type=write size=1785982 2024-09-14T11:20:55.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.309+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=NKRDUBXH19FP type=del 2024-09-14T11:20:55.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.310+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=83UWOBENSCIR type=write size=994882 2024-09-14T11:20:55.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.311+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.0 size=1048576 2024-09-14T11:20:55.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.312+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.1 size=1048576 2024-09-14T11:20:55.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.313+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~F9429NNNT6YA.2 size=288613 2024-09-14T11:20:55.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.315+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=F9429NNNT6YA tag=QJIVILK022G4 type=write size=3434341 2024-09-14T11:20:55.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.317+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~CJX704YBO3FG.0 size=218854 2024-09-14T11:20:55.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.317+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=CJX704YBO3FG tag=5SH4Q5YCPWKF type=write size=1267430 2024-09-14T11:20:55.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.318+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=49Q8TPICS0IX type=del 2024-09-14T11:20:55.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.319+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=88M567HMA3BM type=del size=3350515 2024-09-14T11:20:55.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.321+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=NWMVBF0U59E5 type=del 2024-09-14T11:20:55.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.323+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~BEHWY24WMXFW.0 size=916427 2024-09-14T11:20:55.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.323+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=BEHWY24WMXFW tag=ONTEP3BUTEX5 type=write size=1965003 2024-09-14T11:20:55.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.324+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=24OVVPU4NVOB type=del 2024-09-14T11:20:55.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.326+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~OWH2B1VFAKVE.0 size=639135 2024-09-14T11:20:55.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.326+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=OWH2B1VFAKVE tag=1B8T1YANDSNS type=write size=1687711 2024-09-14T11:20:55.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.327+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~H0ODZAM67JVQ.0 size=510328 2024-09-14T11:20:55.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.329+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=H0ODZAM67JVQ tag=0OQKRO6QTB9N type=write size=1558904 2024-09-14T11:20:55.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.331+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.0 size=1048576 2024-09-14T11:20:55.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.332+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.1 size=1048576 2024-09-14T11:20:55.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.333+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.2 size=797713 2024-09-14T11:20:55.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.333+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=M095ILVJAHSD tag=QHCWW8HW0SOV type=write size=3943441 2024-09-14T11:20:55.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.334+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=MK5CLAPJTRA0 type=del 2024-09-14T11:20:55.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.335+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=6UMRJKWDYTO6 type=write size=492154 2024-09-14T11:20:55.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.336+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~4DTGF06HNXMC.0 size=1048576 2024-09-14T11:20:55.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.337+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~4DTGF06HNXMC.1 size=753509 2024-09-14T11:20:55.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.339+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=4DTGF06HNXMC tag=UKPITPSA38QB type=write size=2850661 2024-09-14T11:20:55.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.341+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.0 size=1048576 2024-09-14T11:20:55.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.342+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.1 size=1048576 2024-09-14T11:20:55.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.343+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.2 size=854954 2024-09-14T11:20:55.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.343+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=R97B3H5O3DPO tag=J2MOK1XLCDKI type=write size=4000682 2024-09-14T11:20:55.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.344+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=I6TMYI279PQS type=del 2024-09-14T11:20:55.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.346+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.0 size=1048576 2024-09-14T11:20:55.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.347+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.1 size=1048576 2024-09-14T11:20:55.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.348+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.2 size=503859 2024-09-14T11:20:55.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.348+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=KU23XJ6G2BJY tag=VEKPAJR6V80Y type=write size=3649587 2024-09-14T11:20:55.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.349+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~98UWZEIW7FCU.0 size=1048576 2024-09-14T11:20:55.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.350+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~98UWZEIW7FCU.1 size=934337 2024-09-14T11:20:55.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.352+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=98UWZEIW7FCU tag=NMK7LL81RGTP type=write size=3031489 2024-09-14T11:20:55.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.353+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=DRMG0MAX991Q type=del size=2126797 2024-09-14T11:20:55.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.354+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=7EEBS2EJRFTF type=del 2024-09-14T11:20:55.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.355+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=T4BWJUPUDSJT type=del size=742257 2024-09-14T11:20:55.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.357+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=PC8PT2RH7KJW type=del 2024-09-14T11:20:55.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.359+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~Q6HZPP3KC5SO.0 size=623207 2024-09-14T11:20:55.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.359+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=Q6HZPP3KC5SO tag=SINGS97QK75G type=write size=1671783 2024-09-14T11:20:55.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.360+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=EZ35WHT5IB4C type=del 2024-09-14T11:20:55.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.361+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=LP30N8OIQN8A type=del size=1719327 2024-09-14T11:20:55.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.362+0000 7fc354693780 1 < canceled part key=_multipart_ICNEXZMA3VQV.2~JCY1L8CJM3V0.0 size=802123 2024-09-14T11:20:55.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.363+0000 7fc354693780 1 < canceled multipart upload key=ICNEXZMA3VQV upload=JCY1L8CJM3V0 tag=W1C8H93BDWLA type=write size=1850699 2024-09-14T11:20:55.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.366+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~XU0JLR2VHI8V.0 size=1048576 2024-09-14T11:20:55.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.367+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~XU0JLR2VHI8V.1 size=701671 2024-09-14T11:20:55.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.367+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=XU0JLR2VHI8V tag=WXEGXEG2HF21 type=write size=2798823 2024-09-14T11:20:55.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.368+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~1J8YAE4JKXEV.0 size=1048576 2024-09-14T11:20:55.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.369+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~1J8YAE4JKXEV.1 size=913349 2024-09-14T11:20:55.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.371+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=1J8YAE4JKXEV tag=6DZ31MQJXGFM type=write size=3010501 2024-09-14T11:20:55.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.373+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.0 size=1048576 2024-09-14T11:20:55.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.374+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.1 size=1048576 2024-09-14T11:20:55.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.375+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.2 size=352406 2024-09-14T11:20:55.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.375+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=WK2OV3WKUZC3 tag=E4NC33W3W3GD type=write size=3498134 2024-09-14T11:20:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.377+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~BC5NG3B3CUO7.0 size=737406 2024-09-14T11:20:55.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.379+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=BC5NG3B3CUO7 tag=LE6ZPS9J15OD type=write size=1785982 2024-09-14T11:20:55.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.380+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=IEY3RLE7NW2S type=write size=214195 2024-09-14T11:20:55.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.381+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=83UWOBENSCIR type=write size=994882 2024-09-14T11:20:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.382+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=F28COTFR7ELM type=del size=1370831 2024-09-14T11:20:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.383+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~CJX704YBO3FG.0 size=218854 2024-09-14T11:20:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.385+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=CJX704YBO3FG tag=5SH4Q5YCPWKF type=write size=1267430 2024-09-14T11:20:55.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.386+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=FRLBNPEP7Y53 type=del size=983422 2024-09-14T11:20:55.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.387+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=88M567HMA3BM type=del 2024-09-14T11:20:55.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.388+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=S4CR2DHKJELS type=del size=1925366 2024-09-14T11:20:55.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.389+0000 7fc354693780 1 < canceled part key=_multipart_X4VH2WYJJ8GI.2~BEHWY24WMXFW.0 size=916427 2024-09-14T11:20:55.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.391+0000 7fc354693780 1 < canceled multipart upload key=X4VH2WYJJ8GI upload=BEHWY24WMXFW tag=ONTEP3BUTEX5 type=write size=1965003 2024-09-14T11:20:55.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.392+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=F7H24KW6P6XG type=del size=2322524 2024-09-14T11:20:55.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.393+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~OWH2B1VFAKVE.0 size=639135 2024-09-14T11:20:55.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.395+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=OWH2B1VFAKVE tag=1B8T1YANDSNS type=write size=1687711 2024-09-14T11:20:55.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.396+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=WXMMC37ZTULE type=del size=1922042 2024-09-14T11:20:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.397+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.0 size=1048576 2024-09-14T11:20:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.398+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.1 size=1048576 2024-09-14T11:20:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.399+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~M095ILVJAHSD.2 size=797713 2024-09-14T11:20:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.401+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=M095ILVJAHSD tag=QHCWW8HW0SOV type=write size=3943441 2024-09-14T11:20:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.402+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=9HC1YDPKZJTW type=del size=1026467 2024-09-14T11:20:55.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.405+0000 7fc354693780 1 < suggested update operation key=OOFM3K1KEB9V tag=6UMRJKWDYTO6 type=write size=492154 2024-09-14T11:20:55.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.406+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=C1V2JBBB0HYZ type=del size=3639003 2024-09-14T11:20:55.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.407+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.0 size=1048576 2024-09-14T11:20:55.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.408+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.1 size=1048576 2024-09-14T11:20:55.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.409+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~R97B3H5O3DPO.2 size=854954 2024-09-14T11:20:55.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.411+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=R97B3H5O3DPO tag=J2MOK1XLCDKI type=write size=4000682 2024-09-14T11:20:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.413+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.0 size=1048576 2024-09-14T11:20:55.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.414+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.1 size=1048576 2024-09-14T11:20:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.415+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.2 size=40984 2024-09-14T11:20:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.415+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=QIFX39OUIVF0 tag=0ZU7PLNEEISI type=write size=3186712 2024-09-14T11:20:55.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.416+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.0 size=1048576 2024-09-14T11:20:55.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.417+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.1 size=1048576 2024-09-14T11:20:55.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.417+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~KU23XJ6G2BJY.2 size=503859 2024-09-14T11:20:55.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.419+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=KU23XJ6G2BJY tag=VEKPAJR6V80Y type=write size=3649587 2024-09-14T11:20:55.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.421+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=9PZYDXJY3QZZ type=write size=312248 2024-09-14T11:20:55.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.422+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=DRMG0MAX991Q type=del 2024-09-14T11:20:55.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.423+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=8TH1M5TYU6ZI type=del size=504834 2024-09-14T11:20:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.424+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=T4BWJUPUDSJT type=del 2024-09-14T11:20:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.426+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~W3LO4KCNHFHZ.0 size=1048576 2024-09-14T11:20:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.427+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~W3LO4KCNHFHZ.1 size=772966 2024-09-14T11:20:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.427+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=W3LO4KCNHFHZ tag=5C4BO1BU3LGW type=write size=2870118 2024-09-14T11:20:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.428+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~Q6HZPP3KC5SO.0 size=623207 2024-09-14T11:20:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.430+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=Q6HZPP3KC5SO tag=SINGS97QK75G type=write size=1671783 2024-09-14T11:20:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.433+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.0 size=1048576 2024-09-14T11:20:55.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.434+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.1 size=1048576 2024-09-14T11:20:55.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.435+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.2 size=370429 2024-09-14T11:20:55.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.435+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=RZ0V1O52OB96 tag=EU4Y3HF36G54 type=write size=3516157 2024-09-14T11:20:55.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.436+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=LP30N8OIQN8A type=del size=1719327 2024-09-14T11:20:55.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.437+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=O2TH3GI3BS2N type=del size=2709780 2024-09-14T11:20:55.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.438+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~XU0JLR2VHI8V.0 size=1048576 2024-09-14T11:20:55.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.439+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~XU0JLR2VHI8V.1 size=701671 2024-09-14T11:20:55.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.441+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=XU0JLR2VHI8V tag=WXEGXEG2HF21 type=write size=2798823 2024-09-14T11:20:55.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.442+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=9SY88I5D6NPJ type=del size=3027670 2024-09-14T11:20:55.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.444+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.0 size=1048576 2024-09-14T11:20:55.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.445+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.1 size=1048576 2024-09-14T11:20:55.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.446+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~WK2OV3WKUZC3.2 size=352406 2024-09-14T11:20:55.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.448+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=WK2OV3WKUZC3 tag=E4NC33W3W3GD type=write size=3498134 2024-09-14T11:20:55.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.450+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.0 size=1048576 2024-09-14T11:20:55.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.451+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.1 size=1048576 2024-09-14T11:20:55.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.451+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.2 size=679787 2024-09-14T11:20:55.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.451+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=0DKJVIQXLV4P tag=MXC5MMA18NIQ type=write size=3825515 2024-09-14T11:20:55.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.454+0000 7fc354693780 1 < suggested remove operation key=JF6PHF17N5WE tag=IEY3RLE7NW2S type=write 2024-09-14T11:20:55.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.455+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~B04BWQ31MHZG.0 size=1048576 2024-09-14T11:20:55.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.456+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~B04BWQ31MHZG.1 size=725556 2024-09-14T11:20:55.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.456+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=B04BWQ31MHZG tag=P60YOXEQVGXH type=write size=2822708 2024-09-14T11:20:55.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.458+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=F28COTFR7ELM type=del 2024-09-14T11:20:55.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.459+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=DZJRT35TMUEN type=write size=150036 2024-09-14T11:20:55.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.460+0000 7fc354693780 1 < canceled operation key=BKW08T86L2ZF tag=FRLBNPEP7Y53 type=del size=983422 2024-09-14T11:20:55.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.462+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.0 size=1048576 2024-09-14T11:20:55.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.463+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.1 size=1048576 2024-09-14T11:20:55.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.464+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.2 size=643860 2024-09-14T11:20:55.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.464+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=PBQ0VKNTFDCE tag=2I35X18EDAYK type=write size=3789588 2024-09-14T11:20:55.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.465+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=S4CR2DHKJELS type=del 2024-09-14T11:20:55.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.466+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=XAXFT37HQJMN type=del size=2015198 2024-09-14T11:20:55.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.467+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=F7H24KW6P6XG type=del 2024-09-14T11:20:55.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.469+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.0 size=1048576 2024-09-14T11:20:55.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.470+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.1 size=1048576 2024-09-14T11:20:55.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.471+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.2 size=101237 2024-09-14T11:20:55.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.471+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=T2Z5RMY9M9Q2 tag=YFW5N19HX0JN type=write size=3246965 2024-09-14T11:20:55.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.472+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=WXMMC37ZTULE type=del 2024-09-14T11:20:55.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.474+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~BPN37SCILYC9.0 size=1048576 2024-09-14T11:20:55.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.475+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~BPN37SCILYC9.1 size=507875 2024-09-14T11:20:55.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.475+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=BPN37SCILYC9 tag=A6ISEAMFUSBL type=write size=2605027 2024-09-14T11:20:55.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.478+0000 7fc354693780 1 < suggested remove operation key=EFX0VXGHRUDR tag=9HC1YDPKZJTW type=del 2024-09-14T11:20:55.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.479+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=1589AZWI5SXT type=del size=481317 2024-09-14T11:20:55.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.480+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=C1V2JBBB0HYZ type=del 2024-09-14T11:20:55.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.481+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=14UH362TS309 type=del size=4111172 2024-09-14T11:20:55.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.483+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.0 size=1048576 2024-09-14T11:20:55.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.484+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.1 size=1048576 2024-09-14T11:20:55.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.485+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~QIFX39OUIVF0.2 size=40984 2024-09-14T11:20:55.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.487+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=QIFX39OUIVF0 tag=0ZU7PLNEEISI type=write size=3186712 2024-09-14T11:20:55.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.488+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=1K6F7Z96KJ6Q type=del size=98689 2024-09-14T11:20:55.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.489+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=9PZYDXJY3QZZ type=write size=312248 2024-09-14T11:20:55.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.490+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=IRG2L3GKBKXC type=del size=1837105 2024-09-14T11:20:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.491+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=8TH1M5TYU6ZI type=del size=504834 2024-09-14T11:20:55.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.493+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.0 size=1048576 2024-09-14T11:20:55.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.494+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.1 size=1048576 2024-09-14T11:20:55.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.495+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.2 size=662663 2024-09-14T11:20:55.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.495+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=U2EFAQZ1ORJ7 tag=RFN8JKDY38F5 type=write size=3808391 2024-09-14T11:20:55.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.496+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~W3LO4KCNHFHZ.0 size=1048576 2024-09-14T11:20:55.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.496+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~W3LO4KCNHFHZ.1 size=772966 2024-09-14T11:20:55.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.498+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=W3LO4KCNHFHZ tag=5C4BO1BU3LGW type=write size=2870118 2024-09-14T11:20:55.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.499+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=IG1MAZQP0GL5 type=del size=256068 2024-09-14T11:20:55.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.500+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.0 size=1048576 2024-09-14T11:20:55.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.500+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.1 size=1048576 2024-09-14T11:20:55.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.501+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~RZ0V1O52OB96.2 size=370429 2024-09-14T11:20:55.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.503+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=RZ0V1O52OB96 tag=EU4Y3HF36G54 type=write size=3516157 2024-09-14T11:20:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.504+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=QXIZV06YWTCO type=write size=411871 2024-09-14T11:20:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.505+0000 7fc354693780 -1 < no bi entry to suggest for operation key=JF6PHF17N5WE tag=O2TH3GI3BS2N type=del size=2709780: (2) No such file or directory 2024-09-14T11:20:55.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.506+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=KQYYY91BX7PM type=del size=2129284 2024-09-14T11:20:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.507+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=9SY88I5D6NPJ type=del 2024-09-14T11:20:55.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.508+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=OK2NTKS8T599 type=del size=3910879 2024-09-14T11:20:55.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.509+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.0 size=1048576 2024-09-14T11:20:55.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.510+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.1 size=1048576 2024-09-14T11:20:55.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.511+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~0DKJVIQXLV4P.2 size=679787 2024-09-14T11:20:55.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.513+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=0DKJVIQXLV4P tag=MXC5MMA18NIQ type=write size=3825515 2024-09-14T11:20:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.514+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=L0X00AC8XHNU type=del size=2463136 2024-09-14T11:20:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.515+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~B04BWQ31MHZG.0 size=1048576 2024-09-14T11:20:55.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.516+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~B04BWQ31MHZG.1 size=725556 2024-09-14T11:20:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.518+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=B04BWQ31MHZG tag=P60YOXEQVGXH type=write size=2822708 2024-09-14T11:20:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.519+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=D8DDMUK7PZEW type=del size=415439 2024-09-14T11:20:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.520+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=DZJRT35TMUEN type=write size=150036 2024-09-14T11:20:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.522+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.0 size=1048576 2024-09-14T11:20:55.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.523+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.1 size=1048576 2024-09-14T11:20:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.524+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.2 size=800702 2024-09-14T11:20:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.524+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=ELSMK6VHQF9N tag=I1ZZJDPIHCMH type=write size=3946430 2024-09-14T11:20:55.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.525+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.0 size=1048576 2024-09-14T11:20:55.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.526+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.1 size=1048576 2024-09-14T11:20:55.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.527+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~PBQ0VKNTFDCE.2 size=643860 2024-09-14T11:20:55.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.529+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=PBQ0VKNTFDCE tag=2I35X18EDAYK type=write size=3789588 2024-09-14T11:20:55.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.530+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=GDSGFH8G89GF type=del size=2652423 2024-09-14T11:20:55.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.531+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=XAXFT37HQJMN type=del 2024-09-14T11:20:55.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.533+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~T4OJEG5WEBYI.0 size=215165 2024-09-14T11:20:55.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.533+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=T4OJEG5WEBYI tag=4X3YHK3X1SMQ type=write size=1263741 2024-09-14T11:20:55.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.533+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.0 size=1048576 2024-09-14T11:20:55.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.534+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.1 size=1048576 2024-09-14T11:20:55.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.535+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~T2Z5RMY9M9Q2.2 size=101237 2024-09-14T11:20:55.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.537+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=T2Z5RMY9M9Q2 tag=YFW5N19HX0JN type=write size=3246965 2024-09-14T11:20:55.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.539+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~5A0QVHG55356.0 size=1048576 2024-09-14T11:20:55.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.540+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~5A0QVHG55356.1 size=75173 2024-09-14T11:20:55.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.540+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=5A0QVHG55356 tag=R1BMEFEQRE7X type=write size=2172325 2024-09-14T11:20:55.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.541+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~BPN37SCILYC9.0 size=1048576 2024-09-14T11:20:55.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.542+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~BPN37SCILYC9.1 size=507875 2024-09-14T11:20:55.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.544+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=BPN37SCILYC9 tag=A6ISEAMFUSBL type=write size=2605027 2024-09-14T11:20:55.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.545+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=8COEMTV3OAFZ type=del size=3643734 2024-09-14T11:20:55.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.548+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=1589AZWI5SXT type=del 2024-09-14T11:20:55.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.550+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.0 size=1048576 2024-09-14T11:20:55.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.550+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.1 size=1048576 2024-09-14T11:20:55.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.551+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.2 size=898996 2024-09-14T11:20:55.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.551+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=DUUU30C7Y266 tag=YEEVKFMZP0Z0 type=write size=4044724 2024-09-14T11:20:55.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.553+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=14UH362TS309 type=del 2024-09-14T11:20:55.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.555+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.0 size=1048576 2024-09-14T11:20:55.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.555+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.1 size=1048576 2024-09-14T11:20:55.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.556+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.2 size=860591 2024-09-14T11:20:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.556+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=0HQJZ4B08OV2 tag=JUWROO0SF9LO type=write size=4006319 2024-09-14T11:20:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.557+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=1K6F7Z96KJ6Q type=del 2024-09-14T11:20:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.559+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=7IFB5FYKXMXB type=del size=3420556 2024-09-14T11:20:55.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.560+0000 7fc354693780 -1 < failed to complete operation key=TFTKNNCGN88D tag=IRG2L3GKBKXC type=del size=1837105: (22) Invalid argument 2024-09-14T11:20:55.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.561+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=74YUYZMSR75B type=del size=1459621 2024-09-14T11:20:55.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.562+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.0 size=1048576 2024-09-14T11:20:55.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.563+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.1 size=1048576 2024-09-14T11:20:55.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.564+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~U2EFAQZ1ORJ7.2 size=662663 2024-09-14T11:20:55.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.566+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=U2EFAQZ1ORJ7 tag=RFN8JKDY38F5 type=write size=3808391 2024-09-14T11:20:55.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.567+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=V7PQ7XCXXYBI type=del size=1744696 2024-09-14T11:20:55.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.569+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=IG1MAZQP0GL5 type=del 2024-09-14T11:20:55.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.571+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~1WFKK00V7W86.0 size=259973 2024-09-14T11:20:55.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.571+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=1WFKK00V7W86 tag=R2H35H6JPN0W type=write size=1308549 2024-09-14T11:20:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.574+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=QXIZV06YWTCO type=write 2024-09-14T11:20:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.576+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~FEODD0UVJ83C.0 size=25840 2024-09-14T11:20:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.576+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=FEODD0UVJ83C tag=TIIM8UXU8Q3U type=write size=1074416 2024-09-14T11:20:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.577+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=KQYYY91BX7PM type=del 2024-09-14T11:20:55.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.579+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.0 size=1048576 2024-09-14T11:20:55.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.580+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.1 size=1048576 2024-09-14T11:20:55.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.581+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.2 size=199995 2024-09-14T11:20:55.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.581+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=3X4Z1PMDEPD1 tag=0I5N9O12G3WB type=write size=3345723 2024-09-14T11:20:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.582+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=OK2NTKS8T599 type=del 2024-09-14T11:20:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.584+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=1JNB0LORNZF3 type=del size=1277442 2024-09-14T11:20:55.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.585+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=L0X00AC8XHNU type=del 2024-09-14T11:20:55.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.586+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=IEMCWPJCE95O type=write size=667223 2024-09-14T11:20:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.587+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=D8DDMUK7PZEW type=del 2024-09-14T11:20:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.589+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=0IKR6ETZZGNM type=write size=162476 2024-09-14T11:20:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.591+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.0 size=1048576 2024-09-14T11:20:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.592+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.1 size=1048576 2024-09-14T11:20:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.592+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~ELSMK6VHQF9N.2 size=800702 2024-09-14T11:20:55.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.595+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=ELSMK6VHQF9N tag=I1ZZJDPIHCMH type=write size=3946430 2024-09-14T11:20:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.596+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=TE1FIWW97YZN type=del size=2885119 2024-09-14T11:20:55.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.598+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=GDSGFH8G89GF type=del 2024-09-14T11:20:55.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.599+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=03CTH2GD3HVC type=del size=1251388 2024-09-14T11:20:55.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.600+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~T4OJEG5WEBYI.0 size=215165 2024-09-14T11:20:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.602+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=T4OJEG5WEBYI tag=4X3YHK3X1SMQ type=write size=1263741 2024-09-14T11:20:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.603+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=4UPWXFX15KTQ type=del size=393600 2024-09-14T11:20:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.604+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~5A0QVHG55356.0 size=1048576 2024-09-14T11:20:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.605+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~5A0QVHG55356.1 size=75173 2024-09-14T11:20:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.607+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=5A0QVHG55356 tag=R1BMEFEQRE7X type=write size=2172325 2024-09-14T11:20:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.608+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=MKG0HHX5ZU5U type=del size=282826 2024-09-14T11:20:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.609+0000 7fc354693780 1 < canceled operation key=GE83T07IQG0S tag=8COEMTV3OAFZ type=del size=3643734 2024-09-14T11:20:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.611+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=996UZJ0OZ54A type=del size=899853 2024-09-14T11:20:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.612+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.0 size=1048576 2024-09-14T11:20:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.613+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.1 size=1048576 2024-09-14T11:20:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.614+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~DUUU30C7Y266.2 size=898996 2024-09-14T11:20:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.616+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=DUUU30C7Y266 tag=YEEVKFMZP0Z0 type=write size=4044724 2024-09-14T11:20:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.617+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=099G4I1JR3OR type=del size=4045248 2024-09-14T11:20:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.618+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.0 size=1048576 2024-09-14T11:20:55.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.619+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.1 size=1048576 2024-09-14T11:20:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.620+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~0HQJZ4B08OV2.2 size=860591 2024-09-14T11:20:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.621+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=0HQJZ4B08OV2 tag=JUWROO0SF9LO type=write size=4006319 2024-09-14T11:20:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.623+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=SD461TZ65CZ4 type=write size=102643 2024-09-14T11:20:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.624+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=7IFB5FYKXMXB type=del 2024-09-14T11:20:55.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.626+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~VC8EOP35UHP4.0 size=180528 2024-09-14T11:20:55.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.626+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=VC8EOP35UHP4 tag=CQF0E34ZCMSK type=write size=1229104 2024-09-14T11:20:55.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.627+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=74YUYZMSR75B type=del 2024-09-14T11:20:55.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.629+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.0 size=1048576 2024-09-14T11:20:55.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.630+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.1 size=1048576 2024-09-14T11:20:55.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.631+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.2 size=501950 2024-09-14T11:20:55.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.631+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=HDNI3RX5YUUY tag=RH4FAKJXWN5B type=write size=3647678 2024-09-14T11:20:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.632+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=V7PQ7XCXXYBI type=del size=1744696 2024-09-14T11:20:55.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.633+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=5V51FIR10XDK type=del size=861397 2024-09-14T11:20:55.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.634+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~1WFKK00V7W86.0 size=259973 2024-09-14T11:20:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.636+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=1WFKK00V7W86 tag=R2H35H6JPN0W type=write size=1308549 2024-09-14T11:20:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.638+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~QYZAYBBV48OU.0 size=100303 2024-09-14T11:20:55.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.638+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=QYZAYBBV48OU tag=22X5WVSESPO0 type=write size=1148879 2024-09-14T11:20:55.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.639+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~FEODD0UVJ83C.0 size=25840 2024-09-14T11:20:55.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.641+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=FEODD0UVJ83C tag=TIIM8UXU8Q3U type=write size=1074416 2024-09-14T11:20:55.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.643+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~QNNKTSRQ3UKD.0 size=1048576 2024-09-14T11:20:55.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.644+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~QNNKTSRQ3UKD.1 size=156671 2024-09-14T11:20:55.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.644+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=QNNKTSRQ3UKD tag=POP110FK9TRC type=write size=2253823 2024-09-14T11:20:55.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.645+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.0 size=1048576 2024-09-14T11:20:55.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.646+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.1 size=1048576 2024-09-14T11:20:55.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.647+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~3X4Z1PMDEPD1.2 size=199995 2024-09-14T11:20:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.649+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=3X4Z1PMDEPD1 tag=0I5N9O12G3WB type=write size=3345723 2024-09-14T11:20:55.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.650+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=935PPPER0T4M type=del size=3383403 2024-09-14T11:20:55.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.652+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=1JNB0LORNZF3 type=del size=1277442 2024-09-14T11:20:55.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.654+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.0 size=1048576 2024-09-14T11:20:55.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.655+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.1 size=1048576 2024-09-14T11:20:55.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.656+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.2 size=571825 2024-09-14T11:20:55.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.656+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=PAEP0Z3ZPVY7 tag=IG1OY2V1Q5B8 type=write size=3717553 2024-09-14T11:20:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.657+0000 7fc354693780 1 < completed write operation key=N23XJJD7YYG0 tag=IEMCWPJCE95O type=write size=667223 2024-09-14T11:20:55.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.659+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=3NA0KMG1H4KJ type=del size=3960223 2024-09-14T11:20:55.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.660+0000 7fc354693780 1 < canceled operation key=WYD70VR8OKAN tag=0IKR6ETZZGNM type=write size=162476 2024-09-14T11:20:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.662+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ON41KKNH3SO0.0 size=572110 2024-09-14T11:20:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.662+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=ON41KKNH3SO0 tag=NMQX1JDHWBBY type=write size=1620686 2024-09-14T11:20:55.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.663+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=TE1FIWW97YZN type=del 2024-09-14T11:20:55.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.664+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=37F70QJSD2V4 type=write size=114957 2024-09-14T11:20:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.665+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=03CTH2GD3HVC type=del 2024-09-14T11:20:55.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.666+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=OGL6SSPVAHR2 type=del size=1012508 2024-09-14T11:20:55.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.669+0000 7fc354693780 1 < suggested remove operation key=BKW08T86L2ZF tag=4UPWXFX15KTQ type=del 2024-09-14T11:20:55.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.670+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=21BLACL2PAAG type=del size=1614315 2024-09-14T11:20:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.671+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=MKG0HHX5ZU5U type=del size=282826 2024-09-14T11:20:55.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.673+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~MIDNGL0RW5XB.0 size=737372 2024-09-14T11:20:55.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.673+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=MIDNGL0RW5XB tag=39A40PK9BAMO type=write size=1785948 2024-09-14T11:20:55.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.674+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=996UZJ0OZ54A type=del 2024-09-14T11:20:55.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.676+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=Q90FNFT2YZ70 type=del size=3897357 2024-09-14T11:20:55.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.677+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=099G4I1JR3OR type=del 2024-09-14T11:20:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.679+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~POQVT4S2TGYX.0 size=1017844 2024-09-14T11:20:55.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.679+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=POQVT4S2TGYX tag=TDZKAOEZGK2S type=write size=2066420 2024-09-14T11:20:55.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.681+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=SD461TZ65CZ4 type=write size=102643 2024-09-14T11:20:55.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.682+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=D0SWWZ127UUI type=write size=333512 2024-09-14T11:20:55.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.683+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~VC8EOP35UHP4.0 size=180528 2024-09-14T11:20:55.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.685+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=VC8EOP35UHP4 tag=CQF0E34ZCMSK type=write size=1229104 2024-09-14T11:20:55.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.687+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.0 size=1048576 2024-09-14T11:20:55.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.688+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.1 size=1048576 2024-09-14T11:20:55.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.689+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.2 size=839946 2024-09-14T11:20:55.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.689+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=VMU36WTNGJOE tag=2P9EG9BU8DWJ type=write size=3985674 2024-09-14T11:20:55.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.690+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.0 size=1048576 2024-09-14T11:20:55.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.691+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.1 size=1048576 2024-09-14T11:20:55.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.692+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~HDNI3RX5YUUY.2 size=501950 2024-09-14T11:20:55.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.694+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=HDNI3RX5YUUY tag=RH4FAKJXWN5B type=write size=3647678 2024-09-14T11:20:55.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.695+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=LH1F6873OZFV type=del size=3703525 2024-09-14T11:20:55.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.697+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=5V51FIR10XDK type=del 2024-09-14T11:20:55.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.698+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=JD9UGMG7FW3Q type=del size=1764357 2024-09-14T11:20:55.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.699+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~QYZAYBBV48OU.0 size=100303 2024-09-14T11:20:55.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.701+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=QYZAYBBV48OU tag=22X5WVSESPO0 type=write size=1148879 2024-09-14T11:20:55.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.703+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~DCT9UVNMRN3N.0 size=970841 2024-09-14T11:20:55.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.703+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=DCT9UVNMRN3N tag=8NI1XZUWQVIH type=write size=2019417 2024-09-14T11:20:55.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.704+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~QNNKTSRQ3UKD.0 size=1048576 2024-09-14T11:20:55.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.704+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~QNNKTSRQ3UKD.1 size=156671 2024-09-14T11:20:55.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.706+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=QNNKTSRQ3UKD tag=POP110FK9TRC type=write size=2253823 2024-09-14T11:20:55.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.707+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=H1WSN3GXFHJ4 type=del size=2579461 2024-09-14T11:20:55.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.708+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=935PPPER0T4M type=del 2024-09-14T11:20:55.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.709+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=RQQRI0BK0O4E type=del size=4077638 2024-09-14T11:20:55.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.710+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.0 size=1048576 2024-09-14T11:20:55.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.711+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.1 size=1048576 2024-09-14T11:20:55.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.712+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~PAEP0Z3ZPVY7.2 size=571825 2024-09-14T11:20:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.714+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=PAEP0Z3ZPVY7 tag=IG1OY2V1Q5B8 type=write size=3717553 2024-09-14T11:20:55.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.716+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=1JEE2UFDDTGO type=write size=604196 2024-09-14T11:20:55.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.717+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=3NA0KMG1H4KJ type=del 2024-09-14T11:20:55.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.719+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~0H2X0V1U8M0K.0 size=1048576 2024-09-14T11:20:55.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.720+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~0H2X0V1U8M0K.1 size=838106 2024-09-14T11:20:55.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.720+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=0H2X0V1U8M0K tag=AA4ZZU9JK1OM type=write size=2935258 2024-09-14T11:20:55.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.721+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~ON41KKNH3SO0.0 size=572110 2024-09-14T11:20:55.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.723+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=ON41KKNH3SO0 tag=NMQX1JDHWBBY type=write size=1620686 2024-09-14T11:20:55.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.724+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=G0YQHM21GRA6 type=del size=2519935 2024-09-14T11:20:55.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.725+0000 7fc354693780 1 < completed write operation key=QWMHFF32M37W tag=37F70QJSD2V4 type=write size=114957 2024-09-14T11:20:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.727+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~1RJRAJ17Q73K.0 size=580433 2024-09-14T11:20:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.727+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=1RJRAJ17Q73K tag=ES3J8Q274Z12 type=write size=1629009 2024-09-14T11:20:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.728+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=OGL6SSPVAHR2 type=del 2024-09-14T11:20:55.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.729+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=0LPQZJKCQQ7P type=del size=3854720 2024-09-14T11:20:55.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.730+0000 7fc354693780 1 < canceled operation key=977GI7HKD9JJ tag=21BLACL2PAAG type=del size=1614315 2024-09-14T11:20:55.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.732+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=1HYKUNEP2OMD type=del size=2045473 2024-09-14T11:20:55.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.733+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~MIDNGL0RW5XB.0 size=737372 2024-09-14T11:20:55.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.735+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=MIDNGL0RW5XB tag=39A40PK9BAMO type=write size=1785948 2024-09-14T11:20:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.736+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=Z3YEL181W5SK type=del size=3534425 2024-09-14T11:20:55.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.738+0000 7fc354693780 1 < suggested update operation key=Z3ZFX1354IRF tag=Q90FNFT2YZ70 type=del size=3897357 2024-09-14T11:20:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.740+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~JJKGZ54FGH2B.0 size=600816 2024-09-14T11:20:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.740+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=JJKGZ54FGH2B tag=7JP84G3T5P4K type=write size=1649392 2024-09-14T11:20:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.741+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~POQVT4S2TGYX.0 size=1017844 2024-09-14T11:20:55.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.743+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=POQVT4S2TGYX tag=TDZKAOEZGK2S type=write size=2066420 2024-09-14T11:20:55.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.744+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=2VHCE336I8TQ type=write size=782307 2024-09-14T11:20:55.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.745+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=D0SWWZ127UUI type=write size=333512 2024-09-14T11:20:55.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.748+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~8TGJB3XLAQAR.0 size=482096 2024-09-14T11:20:55.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.748+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=8TGJB3XLAQAR tag=YQI2VBV2AVFG type=write size=1530672 2024-09-14T11:20:55.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.749+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.0 size=1048576 2024-09-14T11:20:55.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.750+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.1 size=1048576 2024-09-14T11:20:55.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.751+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~VMU36WTNGJOE.2 size=839946 2024-09-14T11:20:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.753+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=VMU36WTNGJOE tag=2P9EG9BU8DWJ type=write size=3985674 2024-09-14T11:20:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.754+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=VB694D1FA2ZZ type=del size=1068066 2024-09-14T11:20:55.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.755+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=LH1F6873OZFV type=del 2024-09-14T11:20:55.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.756+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=DK6E3T01CN3I type=del size=216323 2024-09-14T11:20:55.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.758+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=JD9UGMG7FW3Q type=del size=1764357 2024-09-14T11:20:55.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.760+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=3D7HTIXFHOO5 type=del size=3441790 2024-09-14T11:20:55.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.761+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~DCT9UVNMRN3N.0 size=970841 2024-09-14T11:20:55.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.763+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=DCT9UVNMRN3N tag=8NI1XZUWQVIH type=write size=2019417 2024-09-14T11:20:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.764+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=4RA2FCMS485X type=write size=701739 2024-09-14T11:20:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.765+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=H1WSN3GXFHJ4 type=del 2024-09-14T11:20:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.766+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=4BSWCRQXSJG3 type=del size=1246255 2024-09-14T11:20:55.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.768+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=RQQRI0BK0O4E type=del size=4077638 2024-09-14T11:20:55.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.771+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.0 size=1048576 2024-09-14T11:20:55.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.772+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.1 size=1048576 2024-09-14T11:20:55.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.772+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.2 size=713601 2024-09-14T11:20:55.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.772+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=M2HOSYF1242Y tag=ZOAG9FS6WZ56 type=write size=3859329 2024-09-14T11:20:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.774+0000 7fc354693780 1 < completed write operation key=IGZK9BWJFCV3 tag=1JEE2UFDDTGO type=write size=604196 2024-09-14T11:20:55.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.776+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~X5AJ78KFAXR1.0 size=1048576 2024-09-14T11:20:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.777+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~X5AJ78KFAXR1.1 size=239210 2024-09-14T11:20:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.777+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=X5AJ78KFAXR1 tag=ZM7D7H94N6JA type=write size=2336362 2024-09-14T11:20:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.778+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~0H2X0V1U8M0K.0 size=1048576 2024-09-14T11:20:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.779+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~0H2X0V1U8M0K.1 size=838106 2024-09-14T11:20:55.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.781+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=0H2X0V1U8M0K tag=AA4ZZU9JK1OM type=write size=2935258 2024-09-14T11:20:55.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.782+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=3YV9EL818SAG type=write size=694174 2024-09-14T11:20:55.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.784+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=G0YQHM21GRA6 type=del size=2519935 2024-09-14T11:20:55.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.785+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=02K174546II4 type=del size=3100376 2024-09-14T11:20:55.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.787+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~1RJRAJ17Q73K.0 size=580433 2024-09-14T11:20:55.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.788+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=1RJRAJ17Q73K tag=ES3J8Q274Z12 type=write size=1629009 2024-09-14T11:20:55.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.790+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=81WVMA9P5DC4 type=del size=382063 2024-09-14T11:20:55.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.791+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=0LPQZJKCQQ7P type=del 2024-09-14T11:20:55.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.792+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=2WSEYJUTWAKE type=write size=497213 2024-09-14T11:20:55.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.793+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=1HYKUNEP2OMD type=del 2024-09-14T11:20:55.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.794+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=FNEMPX5PTU6P type=write size=283136 2024-09-14T11:20:55.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.795+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=Z3YEL181W5SK type=del 2024-09-14T11:20:55.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.796+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=UKGXY2OKHW28 type=del size=2668796 2024-09-14T11:20:55.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.798+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~JJKGZ54FGH2B.0 size=600816 2024-09-14T11:20:55.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.800+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=JJKGZ54FGH2B tag=7JP84G3T5P4K type=write size=1649392 2024-09-14T11:20:55.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.801+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=PRWK3N6D7593 type=del size=3751809 2024-09-14T11:20:55.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.802+0000 7fc354693780 1 < completed write operation key=6SIWH1BHPFGM tag=2VHCE336I8TQ type=write size=782307 2024-09-14T11:20:55.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.805+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~PYXWC5SY556B.0 size=746055 2024-09-14T11:20:55.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.805+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=PYXWC5SY556B tag=TVS2AR82GR11 type=write size=1794631 2024-09-14T11:20:55.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.806+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~8TGJB3XLAQAR.0 size=482096 2024-09-14T11:20:55.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.808+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=8TGJB3XLAQAR tag=YQI2VBV2AVFG type=write size=1530672 2024-09-14T11:20:55.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.809+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=WMB1Q4DAASCT type=del size=814938 2024-09-14T11:20:55.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.811+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=VB694D1FA2ZZ type=del size=1068066 2024-09-14T11:20:55.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.812+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=156J0XUY6OCG type=del size=872472 2024-09-14T11:20:55.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.814+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=DK6E3T01CN3I type=del 2024-09-14T11:20:55.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.816+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~DPTELSATF1M1.0 size=412183 2024-09-14T11:20:55.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.816+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=DPTELSATF1M1 tag=TFENBQ8R8D3T type=write size=1460759 2024-09-14T11:20:55.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.817+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=3D7HTIXFHOO5 type=del 2024-09-14T11:20:55.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.819+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=KXAXO4EAJMY9 type=del size=1596153 2024-09-14T11:20:55.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.820+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=4RA2FCMS485X type=write size=701739 2024-09-14T11:20:55.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.821+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=XZE0XX4D5GNA type=del size=859770 2024-09-14T11:20:55.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.822+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=4BSWCRQXSJG3 type=del 2024-09-14T11:20:55.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.823+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=TNRTA9SCXQND type=del size=1410127 2024-09-14T11:20:55.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.824+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.0 size=1048576 2024-09-14T11:20:55.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.825+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.1 size=1048576 2024-09-14T11:20:55.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.825+0000 7fc354693780 1 < canceled part key=_multipart_T0Z8NK20DS5K.2~M2HOSYF1242Y.2 size=713601 2024-09-14T11:20:55.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.827+0000 7fc354693780 1 < canceled multipart upload key=T0Z8NK20DS5K upload=M2HOSYF1242Y tag=ZOAG9FS6WZ56 type=write size=3859329 2024-09-14T11:20:55.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.828+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=NCS5RB47498L type=del size=2583411 2024-09-14T11:20:55.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.829+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~X5AJ78KFAXR1.0 size=1048576 2024-09-14T11:20:55.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.830+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~X5AJ78KFAXR1.1 size=239210 2024-09-14T11:20:55.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.832+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=X5AJ78KFAXR1 tag=ZM7D7H94N6JA type=write size=2336362 2024-09-14T11:20:55.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.834+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~09O3EEJB8BZK.0 size=1029668 2024-09-14T11:20:55.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.834+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=09O3EEJB8BZK tag=A5OYD0IWT8YI type=write size=2078244 2024-09-14T11:20:55.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.836+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=3YV9EL818SAG type=write size=694174 2024-09-14T11:20:55.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.837+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.0 size=1048576 2024-09-14T11:20:55.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.838+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.1 size=1048576 2024-09-14T11:20:55.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.839+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.2 size=442013 2024-09-14T11:20:55.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.839+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=JHWKNXRRJSIS tag=GWR6X7D2QGEV type=write size=3587741 2024-09-14T11:20:55.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.840+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=02K174546II4 type=del 2024-09-14T11:20:55.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.841+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=NI3XHD1KXMVE type=del size=2439136 2024-09-14T11:20:55.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.842+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=81WVMA9P5DC4 type=del 2024-09-14T11:20:55.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.844+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=QR2V6AL2TL3U type=write size=448751 2024-09-14T11:20:55.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.845+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=2WSEYJUTWAKE type=write size=497213 2024-09-14T11:20:55.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.847+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.0 size=1048576 2024-09-14T11:20:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.848+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.1 size=1048576 2024-09-14T11:20:55.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.849+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.2 size=157391 2024-09-14T11:20:55.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.849+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=BZFI2NDS92ZH tag=J1LQ8NMF55JN type=write size=3303119 2024-09-14T11:20:55.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.850+0000 7fc354693780 1 < canceled operation key=X4VH2WYJJ8GI tag=FNEMPX5PTU6P type=write size=283136 2024-09-14T11:20:55.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.851+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=9NK2DE6KOMLR type=del size=4190549 2024-09-14T11:20:55.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.854+0000 7fc354693780 1 < suggested update operation key=OOFM3K1KEB9V tag=UKGXY2OKHW28 type=del size=2668796 2024-09-14T11:20:55.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.856+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.0 size=1048576 2024-09-14T11:20:55.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.857+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.1 size=1048576 2024-09-14T11:20:55.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.858+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.2 size=570435 2024-09-14T11:20:55.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.858+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=6RTVO66Y9J7Z tag=O4ERQ3X1CVYO type=write size=3716163 2024-09-14T11:20:55.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.859+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=PRWK3N6D7593 type=del 2024-09-14T11:20:55.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.860+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=JFSJ021XRSH1 type=del size=991945 2024-09-14T11:20:55.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.860+0000 7fc354693780 1 < canceled part key=_multipart_JGVLT0K0CEGQ.2~PYXWC5SY556B.0 size=746055 2024-09-14T11:20:55.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.862+0000 7fc354693780 1 < canceled multipart upload key=JGVLT0K0CEGQ upload=PYXWC5SY556B tag=TVS2AR82GR11 type=write size=1794631 2024-09-14T11:20:55.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.863+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=3AUE5UL5VVW4 type=del size=3834349 2024-09-14T11:20:55.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.864+0000 7fc354693780 -1 < failed to complete operation key=NENG5XNJ7M5Z tag=WMB1Q4DAASCT type=del size=814938: (22) Invalid argument 2024-09-14T11:20:55.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.865+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=7HQBA9XP0WKH type=del size=2775443 2024-09-14T11:20:55.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.867+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=156J0XUY6OCG type=del 2024-09-14T11:20:55.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.869+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.0 size=1048576 2024-09-14T11:20:55.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.869+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.1 size=1048576 2024-09-14T11:20:55.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.870+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.2 size=56455 2024-09-14T11:20:55.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.870+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=FI17MZ3WMVZ0 tag=K832LJ72R06X type=write size=3202183 2024-09-14T11:20:55.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.871+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~DPTELSATF1M1.0 size=412183 2024-09-14T11:20:55.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.873+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=DPTELSATF1M1 tag=TFENBQ8R8D3T type=write size=1460759 2024-09-14T11:20:55.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.875+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=B8AWSGN05XYC type=del size=9834 2024-09-14T11:20:55.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.876+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=KXAXO4EAJMY9 type=del 2024-09-14T11:20:55.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.878+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=2UGASDWID9K8 type=del size=3365112 2024-09-14T11:20:55.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.879+0000 7fc354693780 1 < canceled operation key=FMG2DNGS0LZ3 tag=XZE0XX4D5GNA type=del size=859770 2024-09-14T11:20:55.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.881+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.0 size=1048576 2024-09-14T11:20:55.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.882+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.1 size=1048576 2024-09-14T11:20:55.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.883+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.2 size=918079 2024-09-14T11:20:55.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.883+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=5LUG9AS27RTD tag=OJ0YFTC88PCN type=write size=4063807 2024-09-14T11:20:55.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.885+0000 7fc354693780 1 < suggested remove operation key=OOFM3K1KEB9V tag=TNRTA9SCXQND type=del 2024-09-14T11:20:55.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.886+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=QM3IDCW9L2NK type=del size=2560412 2024-09-14T11:20:55.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.887+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=NCS5RB47498L type=del 2024-09-14T11:20:55.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.888+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=F1XJ9LXM4NGR type=del size=2437216 2024-09-14T11:20:55.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.889+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~09O3EEJB8BZK.0 size=1029668 2024-09-14T11:20:55.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.890+0000 7fc354693780 1 < canceled multipart upload key=BKW08T86L2ZF upload=09O3EEJB8BZK tag=A5OYD0IWT8YI type=write size=2078244 2024-09-14T11:20:55.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.891+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=VIRSAY4KGD9Q type=del size=3111522 2024-09-14T11:20:55.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.893+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.0 size=1048576 2024-09-14T11:20:55.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.893+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.1 size=1048576 2024-09-14T11:20:55.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.894+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~JHWKNXRRJSIS.2 size=442013 2024-09-14T11:20:55.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.895+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=JHWKNXRRJSIS tag=GWR6X7D2QGEV type=write size=3587741 2024-09-14T11:20:55.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.898+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~1G2170QX3UHM.0 size=1048576 2024-09-14T11:20:55.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.898+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~1G2170QX3UHM.1 size=1009010 2024-09-14T11:20:55.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.898+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=1G2170QX3UHM tag=9JMEKW4GCKBJ type=write size=3106162 2024-09-14T11:20:55.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.900+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=NI3XHD1KXMVE type=del 2024-09-14T11:20:55.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.902+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~6XLQ8IF4BIW2.0 size=388122 2024-09-14T11:20:55.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.902+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=6XLQ8IF4BIW2 tag=RBPG2RPMVH3Q type=write size=1436698 2024-09-14T11:20:55.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.903+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=QR2V6AL2TL3U type=write size=448751 2024-09-14T11:20:55.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.905+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~E544JDDA5FCS.0 size=402457 2024-09-14T11:20:55.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.905+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=E544JDDA5FCS tag=RKQG28CT0PBH type=write size=1451033 2024-09-14T11:20:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.905+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.0 size=1048576 2024-09-14T11:20:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.906+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.1 size=1048576 2024-09-14T11:20:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.907+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~BZFI2NDS92ZH.2 size=157391 2024-09-14T11:20:55.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.909+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=BZFI2NDS92ZH tag=J1LQ8NMF55JN type=write size=3303119 2024-09-14T11:20:55.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.912+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~9SISOERRFFDM.0 size=1048576 2024-09-14T11:20:55.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.913+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~9SISOERRFFDM.1 size=670823 2024-09-14T11:20:55.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.913+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=9SISOERRFFDM tag=VPK40ZXTFPSY type=write size=2767975 2024-09-14T11:20:55.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.914+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=9NK2DE6KOMLR type=del 2024-09-14T11:20:55.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.915+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=Q9W1G3MU9T90 type=del size=2723219 2024-09-14T11:20:55.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.916+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.0 size=1048576 2024-09-14T11:20:55.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.916+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.1 size=1048576 2024-09-14T11:20:55.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.916+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~6RTVO66Y9J7Z.2 size=570435 2024-09-14T11:20:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.918+0000 7fc354693780 1 < canceled multipart upload key=BKW08T86L2ZF upload=6RTVO66Y9J7Z tag=O4ERQ3X1CVYO type=write size=3716163 2024-09-14T11:20:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.920+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~4BNWE95A8VPH.0 size=532235 2024-09-14T11:20:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.920+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=4BNWE95A8VPH tag=16WR0IR7ZZ3U type=write size=1580811 2024-09-14T11:20:55.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.921+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=JFSJ021XRSH1 type=del size=991945 2024-09-14T11:20:55.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.922+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=1LEOQYOBBBCA type=write size=657698 2024-09-14T11:20:55.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.923+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=3AUE5UL5VVW4 type=del 2024-09-14T11:20:55.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.924+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=JY7JHCOFU117 type=del size=995205 2024-09-14T11:20:55.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.925+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=7HQBA9XP0WKH type=del size=2775443 2024-09-14T11:20:55.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.927+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~MOG6OTMMVA38.0 size=313151 2024-09-14T11:20:55.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.927+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=MOG6OTMMVA38 tag=PI4WHO0JPMNO type=write size=1361727 2024-09-14T11:20:55.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.928+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.0 size=1048576 2024-09-14T11:20:55.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.929+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.1 size=1048576 2024-09-14T11:20:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.930+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~FI17MZ3WMVZ0.2 size=56455 2024-09-14T11:20:55.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.932+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=FI17MZ3WMVZ0 tag=K832LJ72R06X type=write size=3202183 2024-09-14T11:20:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.934+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=ACOJN1NM5OJ9 type=del size=1692900 2024-09-14T11:20:55.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.935+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=B8AWSGN05XYC type=del 2024-09-14T11:20:55.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.937+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~8MS6IIVCV32U.0 size=490630 2024-09-14T11:20:55.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.937+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=8MS6IIVCV32U tag=ZQ09QZ50T11A type=write size=1539206 2024-09-14T11:20:55.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.938+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=2UGASDWID9K8 type=del 2024-09-14T11:20:55.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.939+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=AB1W4TOSIYU8 type=del size=651648 2024-09-14T11:20:55.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.940+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.0 size=1048576 2024-09-14T11:20:55.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.941+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.1 size=1048576 2024-09-14T11:20:55.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.942+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~5LUG9AS27RTD.2 size=918079 2024-09-14T11:20:55.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.944+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=5LUG9AS27RTD tag=OJ0YFTC88PCN type=write size=4063807 2024-09-14T11:20:55.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.946+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~MM3XXV0ELAWB.0 size=1048576 2024-09-14T11:20:55.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.947+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~MM3XXV0ELAWB.1 size=320269 2024-09-14T11:20:55.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.947+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=MM3XXV0ELAWB tag=J7SNYUSXL2CK type=write size=2417421 2024-09-14T11:20:55.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.948+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=QM3IDCW9L2NK type=del 2024-09-14T11:20:55.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.950+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.0 size=1048576 2024-09-14T11:20:55.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.951+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.1 size=1048576 2024-09-14T11:20:55.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.952+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.2 size=873455 2024-09-14T11:20:55.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.952+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=CHGDKSA3HWDO tag=QMCK2XE03R2O type=write size=4019183 2024-09-14T11:20:55.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.953+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=F1XJ9LXM4NGR type=del 2024-09-14T11:20:55.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.954+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=TPQV689TI5G3 type=del size=874252 2024-09-14T11:20:55.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.955+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=VIRSAY4KGD9Q type=del 2024-09-14T11:20:55.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.956+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=U2XF7CL6H3HF type=del size=2676342 2024-09-14T11:20:55.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.958+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~1G2170QX3UHM.0 size=1048576 2024-09-14T11:20:55.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.959+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~1G2170QX3UHM.1 size=1009010 2024-09-14T11:20:55.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.960+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=1G2170QX3UHM tag=9JMEKW4GCKBJ type=write size=3106162 2024-09-14T11:20:55.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.962+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=QYUSCJQ75E1A type=del size=2587067 2024-09-14T11:20:55.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.963+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~6XLQ8IF4BIW2.0 size=388122 2024-09-14T11:20:55.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.965+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=6XLQ8IF4BIW2 tag=RBPG2RPMVH3Q type=write size=1436698 2024-09-14T11:20:55.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.967+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~3GKN1CYCJ4ZW.0 size=1048576 2024-09-14T11:20:55.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.968+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~3GKN1CYCJ4ZW.1 size=286877 2024-09-14T11:20:55.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.968+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=3GKN1CYCJ4ZW tag=LCM2QWETDYT4 type=write size=2384029 2024-09-14T11:20:55.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.969+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~E544JDDA5FCS.0 size=402457 2024-09-14T11:20:55.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.971+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=E544JDDA5FCS tag=RKQG28CT0PBH type=write size=1451033 2024-09-14T11:20:55.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.972+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=E7OKSAV07QU5 type=del size=3328304 2024-09-14T11:20:55.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.973+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~9SISOERRFFDM.0 size=1048576 2024-09-14T11:20:55.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.974+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~9SISOERRFFDM.1 size=670823 2024-09-14T11:20:55.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.976+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=9SISOERRFFDM tag=VPK40ZXTFPSY type=write size=2767975 2024-09-14T11:20:55.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.978+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~NK78JW10SNLU.0 size=116192 2024-09-14T11:20:55.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.978+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=NK78JW10SNLU tag=FFABJ9NEP9L6 type=write size=1164768 2024-09-14T11:20:55.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.980+0000 7fc354693780 1 < suggested remove operation key=QWMHFF32M37W tag=Q9W1G3MU9T90 type=del 2024-09-14T11:20:55.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.982+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.0 size=1048576 2024-09-14T11:20:55.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.983+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.1 size=1048576 2024-09-14T11:20:55.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.984+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.2 size=568016 2024-09-14T11:20:55.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.984+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=CEAWW2XC1B38 tag=WES8F3D63FE7 type=write size=3713744 2024-09-14T11:20:55.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.985+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~4BNWE95A8VPH.0 size=532235 2024-09-14T11:20:55.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.987+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=4BNWE95A8VPH tag=16WR0IR7ZZ3U type=write size=1580811 2024-09-14T11:20:55.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.988+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=SXAN78G7TU7I type=del size=1783597 2024-09-14T11:20:55.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.989+0000 7fc354693780 1 < canceled operation key=PRBZQWTFXQ7R tag=1LEOQYOBBBCA type=write size=657698 2024-09-14T11:20:55.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.990+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=RV8I7I0JAZCV type=del size=3809687 2024-09-14T11:20:55.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.992+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=JY7JHCOFU117 type=del 2024-09-14T11:20:55.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.993+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=Q35B3XDOJY51 type=write size=246559 2024-09-14T11:20:55.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.993+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~MOG6OTMMVA38.0 size=313151 2024-09-14T11:20:55.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.995+0000 7fc354693780 1 < canceled multipart upload key=QWMHFF32M37W upload=MOG6OTMMVA38 tag=PI4WHO0JPMNO type=write size=1361727 2024-09-14T11:20:55.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.996+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=HBM2M9PK9R14 type=del size=214672 2024-09-14T11:20:55.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.997+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=ACOJN1NM5OJ9 type=del 2024-09-14T11:20:55.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:55.999+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~YGXUMEIK5TML.0 size=1048576 2024-09-14T11:20:55.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.000+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~YGXUMEIK5TML.1 size=36896 2024-09-14T11:20:55.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.000+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=YGXUMEIK5TML tag=VZ9MVWWTZ2O7 type=write size=2134048 2024-09-14T11:20:55.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.001+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~8MS6IIVCV32U.0 size=490630 2024-09-14T11:20:56.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.003+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=8MS6IIVCV32U tag=ZQ09QZ50T11A type=write size=1539206 2024-09-14T11:20:56.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.004+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=AAI44HBFP8U7 type=del size=537164 2024-09-14T11:20:56.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.006+0000 7fc354693780 1 < suggested remove operation key=IJZB38U355GG tag=AB1W4TOSIYU8 type=del 2024-09-14T11:20:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.007+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=WV2IE7VTOT76 type=write size=344123 2024-09-14T11:20:56.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.009+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~MM3XXV0ELAWB.0 size=1048576 2024-09-14T11:20:56.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.010+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~MM3XXV0ELAWB.1 size=320269 2024-09-14T11:20:56.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.011+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=MM3XXV0ELAWB tag=J7SNYUSXL2CK type=write size=2417421 2024-09-14T11:20:56.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.014+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~GLN2RQP9B6C3.0 size=1048576 2024-09-14T11:20:56.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.014+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~GLN2RQP9B6C3.1 size=250183 2024-09-14T11:20:56.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.014+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=GLN2RQP9B6C3 tag=RFOJSS6DLF5M type=write size=2347335 2024-09-14T11:20:56.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.017+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.0 size=1048576 2024-09-14T11:20:56.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.018+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.1 size=1048576 2024-09-14T11:20:56.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.019+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~CHGDKSA3HWDO.2 size=873455 2024-09-14T11:20:56.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.020+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=CHGDKSA3HWDO tag=QMCK2XE03R2O type=write size=4019183 2024-09-14T11:20:56.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.023+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~VA4DGNZYZZ9C.0 size=1048576 2024-09-14T11:20:56.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.024+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~VA4DGNZYZZ9C.1 size=97683 2024-09-14T11:20:56.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.024+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=VA4DGNZYZZ9C tag=P0GNR8QX2038 type=write size=2194835 2024-09-14T11:20:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.025+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=TPQV689TI5G3 type=del 2024-09-14T11:20:56.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.027+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.0 size=1048576 2024-09-14T11:20:56.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.028+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.1 size=1048576 2024-09-14T11:20:56.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.028+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.2 size=641192 2024-09-14T11:20:56.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.028+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=3PDD2CHY8YNA tag=EJSLG33JB03P type=write size=3786920 2024-09-14T11:20:56.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.030+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=U2XF7CL6H3HF type=del 2024-09-14T11:20:56.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.031+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=21B42MHHBAUU type=del size=2793980 2024-09-14T11:20:56.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.032+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=QYUSCJQ75E1A type=del 2024-09-14T11:20:56.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.034+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.0 size=1048576 2024-09-14T11:20:56.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.035+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.1 size=1048576 2024-09-14T11:20:56.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.036+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.2 size=460455 2024-09-14T11:20:56.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.036+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=B1OU9DMCM9NY tag=KOJ40A93DMVU type=write size=3606183 2024-09-14T11:20:56.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.037+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~3GKN1CYCJ4ZW.0 size=1048576 2024-09-14T11:20:56.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.037+0000 7fc354693780 1 < canceled part key=_multipart_NENG5XNJ7M5Z.2~3GKN1CYCJ4ZW.1 size=286877 2024-09-14T11:20:56.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.039+0000 7fc354693780 1 < canceled multipart upload key=NENG5XNJ7M5Z upload=3GKN1CYCJ4ZW tag=LCM2QWETDYT4 type=write size=2384029 2024-09-14T11:20:56.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.040+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=0QPQ5NI8Q2YI type=del size=1666139 2024-09-14T11:20:56.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.041+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=E7OKSAV07QU5 type=del 2024-09-14T11:20:56.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.043+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=3QOFWS14U6VG type=del size=1925294 2024-09-14T11:20:56.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.044+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~NK78JW10SNLU.0 size=116192 2024-09-14T11:20:56.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.046+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=NK78JW10SNLU tag=FFABJ9NEP9L6 type=write size=1164768 2024-09-14T11:20:56.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.048+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~PYAN9BPOTCFI.0 size=697727 2024-09-14T11:20:56.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.048+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=PYAN9BPOTCFI tag=W5AN9AZZ5ENI type=write size=1746303 2024-09-14T11:20:56.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.049+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.0 size=1048576 2024-09-14T11:20:56.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.050+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.1 size=1048576 2024-09-14T11:20:56.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.051+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~CEAWW2XC1B38.2 size=568016 2024-09-14T11:20:56.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.053+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=CEAWW2XC1B38 tag=WES8F3D63FE7 type=write size=3713744 2024-09-14T11:20:56.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.054+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=LMGR7D9WUCWI type=del size=643251 2024-09-14T11:20:56.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.055+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=SXAN78G7TU7I type=del 2024-09-14T11:20:56.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.057+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~H5NL95I9CQ9G.0 size=1048576 2024-09-14T11:20:56.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.058+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~H5NL95I9CQ9G.1 size=1026980 2024-09-14T11:20:56.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.058+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=H5NL95I9CQ9G tag=4QJAYF3SGYZK type=write size=3124132 2024-09-14T11:20:56.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.060+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=RV8I7I0JAZCV type=del 2024-09-14T11:20:56.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.061+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=H5DXNCME64V6 type=del size=303744 2024-09-14T11:20:56.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.063+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=Q35B3XDOJY51 type=write size=246559 2024-09-14T11:20:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.065+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.0 size=1048576 2024-09-14T11:20:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.065+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.1 size=1048576 2024-09-14T11:20:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.066+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.2 size=209487 2024-09-14T11:20:56.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.066+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=43DNJ2VXBLDR tag=2ELO2UZY5VA2 type=write size=3355215 2024-09-14T11:20:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.068+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=HBM2M9PK9R14 type=del 2024-09-14T11:20:56.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.069+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=9ZMEDXGEC33D type=del size=796376 2024-09-14T11:20:56.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.070+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~YGXUMEIK5TML.0 size=1048576 2024-09-14T11:20:56.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.070+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~YGXUMEIK5TML.1 size=36896 2024-09-14T11:20:56.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.072+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=YGXUMEIK5TML tag=VZ9MVWWTZ2O7 type=write size=2134048 2024-09-14T11:20:56.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.073+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=SQNN2NWL1VVL type=del size=3309271 2024-09-14T11:20:56.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.074+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=AAI44HBFP8U7 type=del 2024-09-14T11:20:56.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.076+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~U0E1Q931BY45.0 size=256038 2024-09-14T11:20:56.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.076+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=U0E1Q931BY45 tag=9P9NJOV6P7AZ type=write size=1304614 2024-09-14T11:20:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.077+0000 7fc354693780 -1 < failed to complete operation key=TFTKNNCGN88D tag=WV2IE7VTOT76 type=write size=344123: (22) Invalid argument 2024-09-14T11:20:56.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.078+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=A04S15A7T1WK type=del size=3345813 2024-09-14T11:20:56.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.079+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~GLN2RQP9B6C3.0 size=1048576 2024-09-14T11:20:56.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.080+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~GLN2RQP9B6C3.1 size=250183 2024-09-14T11:20:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.082+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=GLN2RQP9B6C3 tag=RFOJSS6DLF5M type=write size=2347335 2024-09-14T11:20:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.083+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=46UMERWJHBON type=del size=2576658 2024-09-14T11:20:56.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.084+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~VA4DGNZYZZ9C.0 size=1048576 2024-09-14T11:20:56.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.084+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~VA4DGNZYZZ9C.1 size=97683 2024-09-14T11:20:56.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.086+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=VA4DGNZYZZ9C tag=P0GNR8QX2038 type=write size=2194835 2024-09-14T11:20:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.088+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.0 size=1048576 2024-09-14T11:20:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.089+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.1 size=1048576 2024-09-14T11:20:56.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.090+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.2 size=510054 2024-09-14T11:20:56.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.090+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=H0A44IDBCM9I tag=N4AIID77E5TX type=write size=3655782 2024-09-14T11:20:56.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.091+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.0 size=1048576 2024-09-14T11:20:56.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.092+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.1 size=1048576 2024-09-14T11:20:56.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.093+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~3PDD2CHY8YNA.2 size=641192 2024-09-14T11:20:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.094+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=3PDD2CHY8YNA tag=EJSLG33JB03P type=write size=3786920 2024-09-14T11:20:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.096+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=EXMYJ0K3NMYR type=del size=1444750 2024-09-14T11:20:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.097+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=21B42MHHBAUU type=del 2024-09-14T11:20:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.098+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=XACM5P4XJ966 type=del size=1375683 2024-09-14T11:20:56.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.099+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.0 size=1048576 2024-09-14T11:20:56.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.100+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.1 size=1048576 2024-09-14T11:20:56.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.101+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~B1OU9DMCM9NY.2 size=460455 2024-09-14T11:20:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.103+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=B1OU9DMCM9NY tag=KOJ40A93DMVU type=write size=3606183 2024-09-14T11:20:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.104+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.0 size=1048576 2024-09-14T11:20:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.105+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.1 size=1048576 2024-09-14T11:20:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.106+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.2 size=283291 2024-09-14T11:20:56.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.106+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=W28NH56ELVQF tag=U3W099YB15EJ type=write size=3429019 2024-09-14T11:20:56.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.107+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=0QPQ5NI8Q2YI type=del 2024-09-14T11:20:56.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.108+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=HEKBQZ0OQ9G7 type=del size=252332 2024-09-14T11:20:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.111+0000 7fc354693780 1 < suggested update operation key=H1S2CBHNW6GI tag=3QOFWS14U6VG type=del size=1925294 2024-09-14T11:20:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.112+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=GWFS4JS8M17J type=del size=2519505 2024-09-14T11:20:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.113+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~PYAN9BPOTCFI.0 size=697727 2024-09-14T11:20:56.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.115+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=PYAN9BPOTCFI tag=W5AN9AZZ5ENI type=write size=1746303 2024-09-14T11:20:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.116+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=ILFKTTSMPQNM type=del size=1792645 2024-09-14T11:20:56.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.119+0000 7fc354693780 1 < suggested remove operation key=MQ5V2G5U43J1 tag=LMGR7D9WUCWI type=del 2024-09-14T11:20:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.120+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=A8QGXLIDLBYG type=del size=106333 2024-09-14T11:20:56.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.122+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~H5NL95I9CQ9G.0 size=1048576 2024-09-14T11:20:56.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.123+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~H5NL95I9CQ9G.1 size=1026980 2024-09-14T11:20:56.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.125+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=H5NL95I9CQ9G tag=4QJAYF3SGYZK type=write size=3124132 2024-09-14T11:20:56.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.126+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=QK2DPJSP69HR type=del size=2299617 2024-09-14T11:20:56.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.127+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=H5DXNCME64V6 type=del 2024-09-14T11:20:56.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.128+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=P7EUK60TPX59 type=del size=1672666 2024-09-14T11:20:56.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.130+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.0 size=1048576 2024-09-14T11:20:56.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.130+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.1 size=1048576 2024-09-14T11:20:56.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.131+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~43DNJ2VXBLDR.2 size=209487 2024-09-14T11:20:56.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.133+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=43DNJ2VXBLDR tag=2ELO2UZY5VA2 type=write size=3355215 2024-09-14T11:20:56.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.135+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~NE1WGJ1BQLPM.0 size=563260 2024-09-14T11:20:56.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.135+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=NE1WGJ1BQLPM tag=0BSLJ0A17IZT type=write size=1611836 2024-09-14T11:20:56.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.138+0000 7fc354693780 1 < suggested update operation key=4IDBIAE3VAY4 tag=9ZMEDXGEC33D type=del size=796376 2024-09-14T11:20:56.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.140+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~71JVU4A3XQ6K.0 size=917343 2024-09-14T11:20:56.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.140+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=71JVU4A3XQ6K tag=S0089AYBSHLX type=write size=1965919 2024-09-14T11:20:56.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.142+0000 7fc354693780 1 < suggested remove operation key=BKW08T86L2ZF tag=SQNN2NWL1VVL type=del 2024-09-14T11:20:56.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.143+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=I7C6VT11RHIZ type=del size=4143946 2024-09-14T11:20:56.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.145+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~U0E1Q931BY45.0 size=256038 2024-09-14T11:20:56.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.146+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=U0E1Q931BY45 tag=9P9NJOV6P7AZ type=write size=1304614 2024-09-14T11:20:56.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.148+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=C2YPC2LWS4I9 type=del size=2576851 2024-09-14T11:20:56.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.149+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=A04S15A7T1WK type=del 2024-09-14T11:20:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.151+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~EYJRBZU110UL.0 size=109367 2024-09-14T11:20:56.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.151+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=EYJRBZU110UL tag=2NGM4YTFXX7N type=write size=1157943 2024-09-14T11:20:56.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.152+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=46UMERWJHBON type=del 2024-09-14T11:20:56.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.154+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~18O5HIL6106G.0 size=1048576 2024-09-14T11:20:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.155+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~18O5HIL6106G.1 size=965435 2024-09-14T11:20:56.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.155+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=18O5HIL6106G tag=G4DNIZ5AT9EJ type=write size=3062587 2024-09-14T11:20:56.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.156+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.0 size=1048576 2024-09-14T11:20:56.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.157+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.1 size=1048576 2024-09-14T11:20:56.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.158+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~H0A44IDBCM9I.2 size=510054 2024-09-14T11:20:56.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.160+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=H0A44IDBCM9I tag=N4AIID77E5TX type=write size=3655782 2024-09-14T11:20:56.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.161+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=Y98OJ3C638QX type=write size=39729 2024-09-14T11:20:56.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.162+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=EXMYJ0K3NMYR type=del 2024-09-14T11:20:56.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.164+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=Y4IQQHT19JEC type=write size=969686 2024-09-14T11:20:56.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.165+0000 7fc354693780 1 < canceled operation key=ICNEXZMA3VQV tag=XACM5P4XJ966 type=del size=1375683 2024-09-14T11:20:56.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.166+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=TUKFXNKE34PT type=del size=2850876 2024-09-14T11:20:56.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.167+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.0 size=1048576 2024-09-14T11:20:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.168+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.1 size=1048576 2024-09-14T11:20:56.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.168+0000 7fc354693780 1 < canceled part key=_multipart_TFTKNNCGN88D.2~W28NH56ELVQF.2 size=283291 2024-09-14T11:20:56.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.169+0000 7fc354693780 1 < canceled multipart upload key=TFTKNNCGN88D upload=W28NH56ELVQF tag=U3W099YB15EJ type=write size=3429019 2024-09-14T11:20:56.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.171+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=FTJOR318YE2D type=del size=1780149 2024-09-14T11:20:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.172+0000 7fc354693780 -1 < failed to complete operation key=H1S2CBHNW6GI tag=HEKBQZ0OQ9G7 type=del size=252332: (22) Invalid argument 2024-09-14T11:20:56.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.174+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~IB7D1WJWLJBJ.0 size=1048576 2024-09-14T11:20:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.175+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~IB7D1WJWLJBJ.1 size=205887 2024-09-14T11:20:56.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.175+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=IB7D1WJWLJBJ tag=6Q7NRZL988HY type=write size=2303039 2024-09-14T11:20:56.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.176+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=GWFS4JS8M17J type=del 2024-09-14T11:20:56.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.178+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~U727LHHXD5CX.0 size=1048576 2024-09-14T11:20:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.179+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~U727LHHXD5CX.1 size=352310 2024-09-14T11:20:56.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.179+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=U727LHHXD5CX tag=44LAYV8ETVMW type=write size=2449462 2024-09-14T11:20:56.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.180+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=ILFKTTSMPQNM type=del size=1792645 2024-09-14T11:20:56.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.181+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=40BZ2ATBH0UL type=del size=4020041 2024-09-14T11:20:56.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.182+0000 7fc354693780 -1 < no bi entry to suggest for operation key=BKW08T86L2ZF tag=A8QGXLIDLBYG type=del size=106333: (2) No such file or directory 2024-09-14T11:20:56.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.184+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~OEM108CWMTQY.0 size=49968 2024-09-14T11:20:56.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.184+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=OEM108CWMTQY tag=8JU6YO3O1PW0 type=write size=1098544 2024-09-14T11:20:56.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.185+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=QK2DPJSP69HR type=del 2024-09-14T11:20:56.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.186+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=95MMS4P2JUX3 type=write size=933764 2024-09-14T11:20:56.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.187+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=P7EUK60TPX59 type=del 2024-09-14T11:20:56.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.188+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=O495WZW7MUX5 type=del size=348860 2024-09-14T11:20:56.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.189+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~NE1WGJ1BQLPM.0 size=563260 2024-09-14T11:20:56.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.191+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=NE1WGJ1BQLPM tag=0BSLJ0A17IZT type=write size=1611836 2024-09-14T11:20:56.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.192+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=IQ87W0QK12ED type=del size=3539809 2024-09-14T11:20:56.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.194+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~71JVU4A3XQ6K.0 size=917343 2024-09-14T11:20:56.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.195+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=71JVU4A3XQ6K tag=S0089AYBSHLX type=write size=1965919 2024-09-14T11:20:56.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.197+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~H3VMU6GDIG69.0 size=772846 2024-09-14T11:20:56.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.197+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=H3VMU6GDIG69 tag=KV4CND00PW3U type=write size=1821422 2024-09-14T11:20:56.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.198+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=I7C6VT11RHIZ type=del 2024-09-14T11:20:56.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.200+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=VNVZRET06G7J type=del size=3840740 2024-09-14T11:20:56.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.202+0000 7fc354693780 1 < suggested update operation key=WYD70VR8OKAN tag=C2YPC2LWS4I9 type=del size=2576851 2024-09-14T11:20:56.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.204+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~K78C1NSM0V96.0 size=1048576 2024-09-14T11:20:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.205+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~K78C1NSM0V96.1 size=768518 2024-09-14T11:20:56.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.205+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=K78C1NSM0V96 tag=UD4DRAQNFIXU type=write size=2865670 2024-09-14T11:20:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.206+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~EYJRBZU110UL.0 size=109367 2024-09-14T11:20:56.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.208+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=EYJRBZU110UL tag=2NGM4YTFXX7N type=write size=1157943 2024-09-14T11:20:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.209+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=GZ2DK59OK2U6 type=del size=1552475 2024-09-14T11:20:56.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.210+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~18O5HIL6106G.0 size=1048576 2024-09-14T11:20:56.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.211+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~18O5HIL6106G.1 size=965435 2024-09-14T11:20:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.213+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=18O5HIL6106G tag=G4DNIZ5AT9EJ type=write size=3062587 2024-09-14T11:20:56.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.214+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=P32J7QRKL3BG type=write size=299678 2024-09-14T11:20:56.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.216+0000 7fc354693780 1 < completed write operation key=PRBZQWTFXQ7R tag=Y98OJ3C638QX type=write size=39729 2024-09-14T11:20:56.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.217+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=NBR979CRYRIM type=del size=3343955 2024-09-14T11:20:56.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.218+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=Y4IQQHT19JEC type=write size=969686 2024-09-14T11:20:56.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.220+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~2R31MS69GW0S.0 size=182190 2024-09-14T11:20:56.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.220+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=2R31MS69GW0S tag=NSIB4X6F61SH type=write size=1230766 2024-09-14T11:20:56.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.223+0000 7fc354693780 1 < suggested update operation key=OOFM3K1KEB9V tag=TUKFXNKE34PT type=del size=2850876 2024-09-14T11:20:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.225+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.0 size=1048576 2024-09-14T11:20:56.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.226+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.1 size=1048576 2024-09-14T11:20:56.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.227+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.2 size=751754 2024-09-14T11:20:56.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.227+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=TYGCU2QA62WS tag=ETYJANW6J6P5 type=write size=3897482 2024-09-14T11:20:56.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.229+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=FTJOR318YE2D type=del size=1780149 2024-09-14T11:20:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.231+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~L97A2EQSJ67G.0 size=163272 2024-09-14T11:20:56.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.231+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=L97A2EQSJ67G tag=RRT2XM2XW1XB type=write size=1211848 2024-09-14T11:20:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.232+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~IB7D1WJWLJBJ.0 size=1048576 2024-09-14T11:20:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.232+0000 7fc354693780 1 < canceled part key=_multipart_GE83T07IQG0S.2~IB7D1WJWLJBJ.1 size=205887 2024-09-14T11:20:56.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.234+0000 7fc354693780 1 < canceled multipart upload key=GE83T07IQG0S upload=IB7D1WJWLJBJ tag=6Q7NRZL988HY type=write size=2303039 2024-09-14T11:20:56.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.235+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=25U9H6OLJLA6 type=del size=4055876 2024-09-14T11:20:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.236+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~U727LHHXD5CX.0 size=1048576 2024-09-14T11:20:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.237+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~U727LHHXD5CX.1 size=352310 2024-09-14T11:20:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.239+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=U727LHHXD5CX tag=44LAYV8ETVMW type=write size=2449462 2024-09-14T11:20:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.241+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~DUKL19WRYXG7.0 size=440148 2024-09-14T11:20:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.241+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=DUKL19WRYXG7 tag=JJM05VQ090E0 type=write size=1488724 2024-09-14T11:20:56.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.242+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=40BZ2ATBH0UL type=del 2024-09-14T11:20:56.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.243+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=O28JM12618XC type=write size=372589 2024-09-14T11:20:56.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.243+0000 7fc354693780 1 < canceled part key=_multipart_X4VH2WYJJ8GI.2~OEM108CWMTQY.0 size=49968 2024-09-14T11:20:56.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.245+0000 7fc354693780 1 < canceled multipart upload key=X4VH2WYJJ8GI upload=OEM108CWMTQY tag=8JU6YO3O1PW0 type=write size=1098544 2024-09-14T11:20:56.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.247+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~DILEOXK26XH5.0 size=1048576 2024-09-14T11:20:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.248+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~DILEOXK26XH5.1 size=314962 2024-09-14T11:20:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.248+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=DILEOXK26XH5 tag=B3Z97E4J38H9 type=write size=2412114 2024-09-14T11:20:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.249+0000 7fc354693780 1 < completed write operation key=GE83T07IQG0S tag=95MMS4P2JUX3 type=write size=933764 2024-09-14T11:20:56.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.251+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.0 size=1048576 2024-09-14T11:20:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.252+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.1 size=1048576 2024-09-14T11:20:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.253+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.2 size=20648 2024-09-14T11:20:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.253+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=AUU35O6IBIHP tag=9XEADAN74511 type=write size=3166376 2024-09-14T11:20:56.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.255+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=O495WZW7MUX5 type=del 2024-09-14T11:20:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.257+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~8K1U0FNR8C1S.0 size=1048576 2024-09-14T11:20:56.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.258+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~8K1U0FNR8C1S.1 size=543590 2024-09-14T11:20:56.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.258+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=8K1U0FNR8C1S tag=CEQTZ08QOUUF type=write size=2640742 2024-09-14T11:20:56.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.259+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=IQ87W0QK12ED type=del size=3539809 2024-09-14T11:20:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.261+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~MBG4A3OGK2BY.0 size=1048576 2024-09-14T11:20:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.262+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~MBG4A3OGK2BY.1 size=937965 2024-09-14T11:20:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.262+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=MBG4A3OGK2BY tag=6LW7RJC8POC3 type=write size=3035117 2024-09-14T11:20:56.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.263+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~H3VMU6GDIG69.0 size=772846 2024-09-14T11:20:56.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.265+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=H3VMU6GDIG69 tag=KV4CND00PW3U type=write size=1821422 2024-09-14T11:20:56.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.267+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.0 size=1048576 2024-09-14T11:20:56.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.268+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.1 size=1048576 2024-09-14T11:20:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.269+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.2 size=855274 2024-09-14T11:20:56.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.269+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=3LEQG2MIIG35 tag=HQLQ8CFID380 type=write size=4001002 2024-09-14T11:20:56.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.271+0000 7fc354693780 1 < suggested update operation key=FMG2DNGS0LZ3 tag=VNVZRET06G7J type=del size=3840740 2024-09-14T11:20:56.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.273+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~AAYQ1B0OLULN.0 size=527713 2024-09-14T11:20:56.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.273+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=AAYQ1B0OLULN tag=124991T2O3R8 type=write size=1576289 2024-09-14T11:20:56.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.273+0000 7fc354693780 1 < canceled part key=_multipart_MQ5V2G5U43J1.2~K78C1NSM0V96.0 size=1048576 2024-09-14T11:20:56.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.274+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~K78C1NSM0V96.1 size=768518 2024-09-14T11:20:56.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.276+0000 7fc354693780 1 < canceled multipart upload key=MQ5V2G5U43J1 upload=K78C1NSM0V96 tag=UD4DRAQNFIXU type=write size=2865670 2024-09-14T11:20:56.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.277+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=U96WD6J4ARMX type=del size=3685959 2024-09-14T11:20:56.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.280+0000 7fc354693780 1 < suggested update operation key=QWMHFF32M37W tag=GZ2DK59OK2U6 type=del size=1552475 2024-09-14T11:20:56.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.281+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=29KB0MQVQ0VT type=del size=1298904 2024-09-14T11:20:56.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.282+0000 7fc354693780 1 < completed write operation key=54EUIL28P2H1 tag=P32J7QRKL3BG type=write size=299678 2024-09-14T11:20:56.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.283+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=5I3SKR9VLHTX type=del size=3182478 2024-09-14T11:20:56.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.284+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=NBR979CRYRIM type=del 2024-09-14T11:20:56.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.286+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.0 size=1048576 2024-09-14T11:20:56.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.287+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.1 size=1048576 2024-09-14T11:20:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.288+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.2 size=59570 2024-09-14T11:20:56.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.288+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=UTQD4C2ERH0J tag=WB3906DAQ612 type=write size=3205298 2024-09-14T11:20:56.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.289+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~2R31MS69GW0S.0 size=182190 2024-09-14T11:20:56.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.291+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=2R31MS69GW0S tag=NSIB4X6F61SH type=write size=1230766 2024-09-14T11:20:56.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.293+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~01R6ZIH7C20J.0 size=361611 2024-09-14T11:20:56.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.293+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=01R6ZIH7C20J tag=RKO4BVEKG72Y type=write size=1410187 2024-09-14T11:20:56.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.294+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.0 size=1048576 2024-09-14T11:20:56.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.294+0000 7fc354693780 1 < canceled part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.1 size=1048576 2024-09-14T11:20:56.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.296+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~TYGCU2QA62WS.2 size=751754 2024-09-14T11:20:56.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.297+0000 7fc354693780 1 < canceled multipart upload key=X4VH2WYJJ8GI upload=TYGCU2QA62WS tag=ETYJANW6J6P5 type=write size=3897482 2024-09-14T11:20:56.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.300+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.0 size=1048576 2024-09-14T11:20:56.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.300+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.1 size=1048576 2024-09-14T11:20:56.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.301+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.2 size=16427 2024-09-14T11:20:56.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.301+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=6LVR3RBB6JVT tag=0YHA0VV036XL type=write size=3162155 2024-09-14T11:20:56.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.303+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~L97A2EQSJ67G.0 size=163272 2024-09-14T11:20:56.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.304+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=L97A2EQSJ67G tag=RRT2XM2XW1XB type=write size=1211848 2024-09-14T11:20:56.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.306+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=QXH8XBSIBFME type=del size=1104979 2024-09-14T11:20:56.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.308+0000 7fc354693780 1 < suggested update operation key=FMG2DNGS0LZ3 tag=25U9H6OLJLA6 type=del size=4055876 2024-09-14T11:20:56.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.309+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=IU6DZTQ0XORP type=write size=285392 2024-09-14T11:20:56.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.310+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~DUKL19WRYXG7.0 size=440148 2024-09-14T11:20:56.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.312+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=DUKL19WRYXG7 tag=JJM05VQ090E0 type=write size=1488724 2024-09-14T11:20:56.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.314+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.0 size=1048576 2024-09-14T11:20:56.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.315+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.1 size=1048576 2024-09-14T11:20:56.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.316+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.2 size=599342 2024-09-14T11:20:56.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.316+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=O2K5B0U3LD3M tag=GRILDA8JC6S3 type=write size=3745070 2024-09-14T11:20:56.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.317+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=O28JM12618XC type=write size=372589 2024-09-14T11:20:56.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.319+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.0 size=1048576 2024-09-14T11:20:56.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.320+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.1 size=1048576 2024-09-14T11:20:56.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.321+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.2 size=34374 2024-09-14T11:20:56.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.321+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=C7AGZDEYWOB5 tag=LLSZMGZOOR8Y type=write size=3180102 2024-09-14T11:20:56.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.321+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~DILEOXK26XH5.0 size=1048576 2024-09-14T11:20:56.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.322+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~DILEOXK26XH5.1 size=314962 2024-09-14T11:20:56.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.324+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=DILEOXK26XH5 tag=B3Z97E4J38H9 type=write size=2412114 2024-09-14T11:20:56.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.325+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=FOW7JI0W0YNH type=del size=108807 2024-09-14T11:20:56.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.326+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.0 size=1048576 2024-09-14T11:20:56.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.326+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.1 size=1048576 2024-09-14T11:20:56.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.327+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~AUU35O6IBIHP.2 size=20648 2024-09-14T11:20:56.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.329+0000 7fc354693780 1 < canceled multipart upload key=4Z3KI5X3WQ0I upload=AUU35O6IBIHP tag=9XEADAN74511 type=write size=3166376 2024-09-14T11:20:56.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.330+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=1T1B892SFDMO type=del size=3323011 2024-09-14T11:20:56.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.332+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~8K1U0FNR8C1S.0 size=1048576 2024-09-14T11:20:56.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.333+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~8K1U0FNR8C1S.1 size=543590 2024-09-14T11:20:56.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.335+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=8K1U0FNR8C1S tag=CEQTZ08QOUUF type=write size=2640742 2024-09-14T11:20:56.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.336+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=Q8WPAIK5SL7H type=del size=1716950 2024-09-14T11:20:56.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.337+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~MBG4A3OGK2BY.0 size=1048576 2024-09-14T11:20:56.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.337+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~MBG4A3OGK2BY.1 size=937965 2024-09-14T11:20:56.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.339+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=MBG4A3OGK2BY tag=6LW7RJC8POC3 type=write size=3035117 2024-09-14T11:20:56.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.341+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=KMGBNSLJQLCQ type=del size=295826 2024-09-14T11:20:56.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.341+0000 7fc354693780 1 < canceled part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.0 size=1048576 2024-09-14T11:20:56.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.342+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.1 size=1048576 2024-09-14T11:20:56.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.342+0000 7fc354693780 1 < canceled part key=_multipart_NENG5XNJ7M5Z.2~3LEQG2MIIG35.2 size=855274 2024-09-14T11:20:56.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.344+0000 7fc354693780 1 < canceled multipart upload key=NENG5XNJ7M5Z upload=3LEQG2MIIG35 tag=HQLQ8CFID380 type=write size=4001002 2024-09-14T11:20:56.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.346+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.0 size=1048576 2024-09-14T11:20:56.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.347+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.1 size=1048576 2024-09-14T11:20:56.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.348+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.2 size=126933 2024-09-14T11:20:56.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.348+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=GO0TYV6GSUCJ tag=C8JZQUFDBNNO type=write size=3272661 2024-09-14T11:20:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.349+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~AAYQ1B0OLULN.0 size=527713 2024-09-14T11:20:56.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.351+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=AAYQ1B0OLULN tag=124991T2O3R8 type=write size=1576289 2024-09-14T11:20:56.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.353+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~W8H4XHJJDM3M.0 size=1048576 2024-09-14T11:20:56.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.354+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~W8H4XHJJDM3M.1 size=137064 2024-09-14T11:20:56.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.354+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=W8H4XHJJDM3M tag=1V24AB809NHB type=write size=2234216 2024-09-14T11:20:56.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.356+0000 7fc354693780 1 < suggested remove operation key=4IDBIAE3VAY4 tag=U96WD6J4ARMX type=del 2024-09-14T11:20:56.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.357+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=8289L4091E4H type=del size=1280618 2024-09-14T11:20:56.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.358+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=29KB0MQVQ0VT type=del 2024-09-14T11:20:56.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.359+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=IQIGDGKHN59P type=write size=248395 2024-09-14T11:20:56.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.360+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=5I3SKR9VLHTX type=del 2024-09-14T11:20:56.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.362+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~US0V75VEIRXS.0 size=1048576 2024-09-14T11:20:56.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.363+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~US0V75VEIRXS.1 size=730355 2024-09-14T11:20:56.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.363+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=US0V75VEIRXS tag=YYA5692NTVLC type=write size=2827507 2024-09-14T11:20:56.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.365+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.0 size=1048576 2024-09-14T11:20:56.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.365+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.1 size=1048576 2024-09-14T11:20:56.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.366+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~UTQD4C2ERH0J.2 size=59570 2024-09-14T11:20:56.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.368+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=UTQD4C2ERH0J tag=WB3906DAQ612 type=write size=3205298 2024-09-14T11:20:56.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.370+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=Q4CYSCEG8BRY type=del size=721946 2024-09-14T11:20:56.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.371+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~01R6ZIH7C20J.0 size=361611 2024-09-14T11:20:56.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.373+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=01R6ZIH7C20J tag=RKO4BVEKG72Y type=write size=1410187 2024-09-14T11:20:56.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.374+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=6PENW2V3Z7VD type=del size=448869 2024-09-14T11:20:56.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.375+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.0 size=1048576 2024-09-14T11:20:56.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.376+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.1 size=1048576 2024-09-14T11:20:56.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.377+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~6LVR3RBB6JVT.2 size=16427 2024-09-14T11:20:56.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.379+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=6LVR3RBB6JVT tag=0YHA0VV036XL type=write size=3162155 2024-09-14T11:20:56.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.381+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.0 size=1048576 2024-09-14T11:20:56.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.382+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.1 size=1048576 2024-09-14T11:20:56.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.383+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.2 size=923148 2024-09-14T11:20:56.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.383+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=Y2WK8HT2LJE5 tag=5DHX74525015 type=write size=4068876 2024-09-14T11:20:56.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.384+0000 7fc354693780 -1 < failed to complete operation key=4IDBIAE3VAY4 tag=QXH8XBSIBFME type=del size=1104979: (22) Invalid argument 2024-09-14T11:20:56.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.386+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=NYV00ZRSC05N type=del size=572726 2024-09-14T11:20:56.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.387+0000 7fc354693780 1 < completed write operation key=4Z3KI5X3WQ0I tag=IU6DZTQ0XORP type=write size=285392 2024-09-14T11:20:56.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.388+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=H9PMKPKL9TEB type=del size=3324483 2024-09-14T11:20:56.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.389+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.0 size=1048576 2024-09-14T11:20:56.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.390+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.1 size=1048576 2024-09-14T11:20:56.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.391+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~O2K5B0U3LD3M.2 size=599342 2024-09-14T11:20:56.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.393+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=O2K5B0U3LD3M tag=GRILDA8JC6S3 type=write size=3745070 2024-09-14T11:20:56.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.394+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=GMEEUEL6Y3WZ type=del size=3794885 2024-09-14T11:20:56.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.395+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.0 size=1048576 2024-09-14T11:20:56.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.396+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.1 size=1048576 2024-09-14T11:20:56.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.397+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~C7AGZDEYWOB5.2 size=34374 2024-09-14T11:20:56.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.398+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=C7AGZDEYWOB5 tag=LLSZMGZOOR8Y type=write size=3180102 2024-09-14T11:20:56.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.400+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=TOY7MDTRDUKZ type=write size=747992 2024-09-14T11:20:56.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.401+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=FOW7JI0W0YNH type=del 2024-09-14T11:20:56.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.402+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=VL0J3PBA5AEN type=del size=1552319 2024-09-14T11:20:56.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.404+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=1T1B892SFDMO type=del size=3323011 2024-09-14T11:20:56.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.405+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=3KJ74UNQJI5T type=del size=491065 2024-09-14T11:20:56.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.406+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=Q8WPAIK5SL7H type=del 2024-09-14T11:20:56.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.408+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=8LXKRX0SZ1VG type=write size=38671 2024-09-14T11:20:56.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.409+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=KMGBNSLJQLCQ type=del 2024-09-14T11:20:56.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.410+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=RBTIJDPLGSLE type=del size=4139876 2024-09-14T11:20:56.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.412+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.0 size=1048576 2024-09-14T11:20:56.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.413+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.1 size=1048576 2024-09-14T11:20:56.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.413+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~GO0TYV6GSUCJ.2 size=126933 2024-09-14T11:20:56.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.415+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=GO0TYV6GSUCJ tag=C8JZQUFDBNNO type=write size=3272661 2024-09-14T11:20:56.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.416+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=ZPE19NM2DP60 type=del size=969047 2024-09-14T11:20:56.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.417+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~W8H4XHJJDM3M.0 size=1048576 2024-09-14T11:20:56.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.418+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~W8H4XHJJDM3M.1 size=137064 2024-09-14T11:20:56.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.420+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=W8H4XHJJDM3M tag=1V24AB809NHB type=write size=2234216 2024-09-14T11:20:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.421+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=4JKFR7FCQVS2 type=del size=2773793 2024-09-14T11:20:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.424+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=8289L4091E4H type=del size=1280618 2024-09-14T11:20:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.426+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~NPCPKAPHIHVJ.0 size=60810 2024-09-14T11:20:56.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.426+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=NPCPKAPHIHVJ tag=3GZ3DWVV0H8Z type=write size=1109386 2024-09-14T11:20:56.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.427+0000 7fc354693780 1 < completed write operation key=FMG2DNGS0LZ3 tag=IQIGDGKHN59P type=write size=248395 2024-09-14T11:20:56.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.428+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=G9RA6CU3PD1O type=del size=2804758 2024-09-14T11:20:56.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.429+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~US0V75VEIRXS.0 size=1048576 2024-09-14T11:20:56.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.430+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~US0V75VEIRXS.1 size=730355 2024-09-14T11:20:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.432+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=US0V75VEIRXS tag=YYA5692NTVLC type=write size=2827507 2024-09-14T11:20:56.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.433+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=TY7VNZNJ4642 type=del size=752022 2024-09-14T11:20:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.435+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=Q4CYSCEG8BRY type=del 2024-09-14T11:20:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.437+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~1BVQ25LNIRKL.0 size=940910 2024-09-14T11:20:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.437+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=1BVQ25LNIRKL tag=CJN92TOGT6AP type=write size=1989486 2024-09-14T11:20:56.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.438+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=6PENW2V3Z7VD type=del 2024-09-14T11:20:56.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.440+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=LJ3FWGUG5IEH type=del size=2958658 2024-09-14T11:20:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.441+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.0 size=1048576 2024-09-14T11:20:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.442+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.1 size=1048576 2024-09-14T11:20:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.443+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~Y2WK8HT2LJE5.2 size=923148 2024-09-14T11:20:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.445+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=Y2WK8HT2LJE5 tag=5DHX74525015 type=write size=4068876 2024-09-14T11:20:56.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.446+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=6TS77A8S5K8L type=del size=1077831 2024-09-14T11:20:56.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.448+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=NYV00ZRSC05N type=del 2024-09-14T11:20:56.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.449+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=M0IFZDUJ4UAA type=del size=4041445 2024-09-14T11:20:56.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.450+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=H9PMKPKL9TEB type=del 2024-09-14T11:20:56.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.451+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=GRLUSXQT9NJP type=del size=3485333 2024-09-14T11:20:56.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.452+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=GMEEUEL6Y3WZ type=del 2024-09-14T11:20:56.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.453+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=0D47M2GMPHX7 type=del size=4118874 2024-09-14T11:20:56.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.455+0000 7fc354693780 -1 < failed to complete operation key=BKW08T86L2ZF tag=TOY7MDTRDUKZ type=write size=747992: (22) Invalid argument 2024-09-14T11:20:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.456+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=A5MP200GWVGD type=del size=1846978 2024-09-14T11:20:56.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.457+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=VL0J3PBA5AEN type=del 2024-09-14T11:20:56.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.458+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=J200EKBD5O3C type=write size=355573 2024-09-14T11:20:56.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.459+0000 7fc354693780 1 < canceled operation key=P061QWG9J16V tag=3KJ74UNQJI5T type=del size=491065 2024-09-14T11:20:56.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.460+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=553A7DTLN6VD type=write size=1039092 2024-09-14T11:20:56.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.461+0000 7fc354693780 1 < completed write operation key=4IDBIAE3VAY4 tag=8LXKRX0SZ1VG type=write size=38671 2024-09-14T11:20:56.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.462+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=7C0ZSATUY233 type=del size=2796371 2024-09-14T11:20:56.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.463+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=RBTIJDPLGSLE type=del 2024-09-14T11:20:56.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.465+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~9K3JH3FULRSD.0 size=509145 2024-09-14T11:20:56.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.465+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=9K3JH3FULRSD tag=L8YIUCIM81OW type=write size=1557721 2024-09-14T11:20:56.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.467+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=ZPE19NM2DP60 type=del 2024-09-14T11:20:56.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.468+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=ZCDL08JGVQYV type=del size=2152976 2024-09-14T11:20:56.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.469+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=4JKFR7FCQVS2 type=del 2024-09-14T11:20:56.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.470+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=DGMJ2B8PCNI8 type=del size=1583448 2024-09-14T11:20:56.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.471+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~NPCPKAPHIHVJ.0 size=60810 2024-09-14T11:20:56.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.473+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=NPCPKAPHIHVJ tag=3GZ3DWVV0H8Z type=write size=1109386 2024-09-14T11:20:56.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.474+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=PPBD09ZCW4T6 type=write size=843570 2024-09-14T11:20:56.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.475+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=G9RA6CU3PD1O type=del 2024-09-14T11:20:56.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.476+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=C9IJS7T7REXP type=del size=2403938 2024-09-14T11:20:56.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.477+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=TY7VNZNJ4642 type=del size=752022 2024-09-14T11:20:56.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.479+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~A7BF9NDO4A78.0 size=21554 2024-09-14T11:20:56.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.479+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=A7BF9NDO4A78 tag=NALHT53URG4O type=write size=1070130 2024-09-14T11:20:56.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.480+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~1BVQ25LNIRKL.0 size=940910 2024-09-14T11:20:56.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.482+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=1BVQ25LNIRKL tag=CJN92TOGT6AP type=write size=1989486 2024-09-14T11:20:56.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.483+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=6LWZOE56JJFK type=write size=855177 2024-09-14T11:20:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.484+0000 7fc354693780 1 < canceled operation key=X4VH2WYJJ8GI tag=LJ3FWGUG5IEH type=del size=2958658 2024-09-14T11:20:56.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.486+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=2A99QO6WJM10 type=del size=1338881 2024-09-14T11:20:56.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.487+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=6TS77A8S5K8L type=del 2024-09-14T11:20:56.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.488+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=PXM75LQFJX4V type=del size=725449 2024-09-14T11:20:56.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.490+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=M0IFZDUJ4UAA type=del 2024-09-14T11:20:56.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.492+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.0 size=1048576 2024-09-14T11:20:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.493+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.1 size=1048576 2024-09-14T11:20:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.494+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.2 size=207041 2024-09-14T11:20:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.494+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=K0L1AKJNZ43F tag=4J9LFBNYEVXZ type=write size=3352769 2024-09-14T11:20:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.495+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=GRLUSXQT9NJP type=del 2024-09-14T11:20:56.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.496+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=79Z5M14V85V1 type=del size=1665359 2024-09-14T11:20:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.498+0000 7fc354693780 1 < suggested remove operation key=WBT3M1NMEEAY tag=0D47M2GMPHX7 type=del 2024-09-14T11:20:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.501+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~UA03M21OBIMV.0 size=582675 2024-09-14T11:20:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.501+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=UA03M21OBIMV tag=JPTACC2SXY7W type=write size=1631251 2024-09-14T11:20:56.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.502+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=A5MP200GWVGD type=del 2024-09-14T11:20:56.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.503+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=WO10XD3QWUYN type=write size=498499 2024-09-14T11:20:56.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.504+0000 7fc354693780 1 < completed write operation key=T0Z8NK20DS5K tag=J200EKBD5O3C type=write size=355573 2024-09-14T11:20:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.506+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=UA5ZWBQBH8IZ type=write size=635806 2024-09-14T11:20:56.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.507+0000 7fc354693780 1 < completed write operation key=4IDBIAE3VAY4 tag=553A7DTLN6VD type=write size=1039092 2024-09-14T11:20:56.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.509+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.0 size=1048576 2024-09-14T11:20:56.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.510+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.1 size=1048576 2024-09-14T11:20:56.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.510+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.2 size=1030582 2024-09-14T11:20:56.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.510+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=3CYU9EU50MAO tag=V7VFZ730WLLI type=write size=4176310 2024-09-14T11:20:56.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.513+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=7C0ZSATUY233 type=del 2024-09-14T11:20:56.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.515+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~TZBMES7P5J3O.0 size=84545 2024-09-14T11:20:56.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.515+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=TZBMES7P5J3O tag=DOJ4VLVHF43C type=write size=1133121 2024-09-14T11:20:56.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.516+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~9K3JH3FULRSD.0 size=509145 2024-09-14T11:20:56.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.518+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=9K3JH3FULRSD tag=L8YIUCIM81OW type=write size=1557721 2024-09-14T11:20:56.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.519+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=J8XBMM1GVB9R type=del size=3843416 2024-09-14T11:20:56.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.520+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=ZCDL08JGVQYV type=del 2024-09-14T11:20:56.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.521+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=TREO00FG6ZR1 type=del size=859365 2024-09-14T11:20:56.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.523+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=DGMJ2B8PCNI8 type=del 2024-09-14T11:20:56.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.524+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=IM75PUU6P0XA type=del size=1762391 2024-09-14T11:20:56.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.526+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=PPBD09ZCW4T6 type=write 2024-09-14T11:20:56.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.527+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=7MQF6J1NXB3G type=del size=918915 2024-09-14T11:20:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.528+0000 7fc354693780 -1 < failed to complete operation key=IGZK9BWJFCV3 tag=C9IJS7T7REXP type=del size=2403938: (22) Invalid argument 2024-09-14T11:20:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.529+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=9J39PTIHHR3J type=del size=3424842 2024-09-14T11:20:56.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.530+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~A7BF9NDO4A78.0 size=21554 2024-09-14T11:20:56.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.532+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=A7BF9NDO4A78 tag=NALHT53URG4O type=write size=1070130 2024-09-14T11:20:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.534+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=R842WL7ARULO type=del size=2533923 2024-09-14T11:20:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.535+0000 7fc354693780 1 < completed write operation key=PRBZQWTFXQ7R tag=6LWZOE56JJFK type=write size=855177 2024-09-14T11:20:56.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.536+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=UNZ9E41Z9T55 type=del size=232639 2024-09-14T11:20:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.537+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=2A99QO6WJM10 type=del 2024-09-14T11:20:56.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.538+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=9HORFBD2G1FZ type=del size=3286463 2024-09-14T11:20:56.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.539+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=PXM75LQFJX4V type=del 2024-09-14T11:20:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.541+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=D4Y7W03V8I2G type=del size=66119 2024-09-14T11:20:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.542+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.0 size=1048576 2024-09-14T11:20:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.543+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.1 size=1048576 2024-09-14T11:20:56.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.544+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~K0L1AKJNZ43F.2 size=207041 2024-09-14T11:20:56.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.545+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=K0L1AKJNZ43F tag=4J9LFBNYEVXZ type=write size=3352769 2024-09-14T11:20:56.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.547+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~VXV1HJODFE1Z.0 size=1048576 2024-09-14T11:20:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.550+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~VXV1HJODFE1Z.1 size=198607 2024-09-14T11:20:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.550+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=VXV1HJODFE1Z tag=73Q5ZGUE3LHX type=write size=2295759 2024-09-14T11:20:56.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.551+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=79Z5M14V85V1 type=del 2024-09-14T11:20:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.553+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~URQLWQQC3T1E.0 size=1048576 2024-09-14T11:20:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.554+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~URQLWQQC3T1E.1 size=347162 2024-09-14T11:20:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.554+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=URQLWQQC3T1E tag=XV5HTSFF29LP type=write size=2444314 2024-09-14T11:20:56.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.555+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~UA03M21OBIMV.0 size=582675 2024-09-14T11:20:56.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.556+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=UA03M21OBIMV tag=JPTACC2SXY7W type=write size=1631251 2024-09-14T11:20:56.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.558+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=Y2GK605W8039 type=del size=1465480 2024-09-14T11:20:56.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.559+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=WO10XD3QWUYN type=write size=498499 2024-09-14T11:20:56.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.560+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=09EWLBCB8441 type=del size=3458981 2024-09-14T11:20:56.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.561+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=UA5ZWBQBH8IZ type=write size=635806 2024-09-14T11:20:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.563+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~4A1QM73E6QN7.0 size=355187 2024-09-14T11:20:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.563+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=4A1QM73E6QN7 tag=09V9BJ2HRC2R type=write size=1403763 2024-09-14T11:20:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.563+0000 7fc354693780 1 < canceled part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.0 size=1048576 2024-09-14T11:20:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.563+0000 7fc354693780 1 < canceled part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.1 size=1048576 2024-09-14T11:20:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.564+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~3CYU9EU50MAO.2 size=1030582 2024-09-14T11:20:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.566+0000 7fc354693780 1 < canceled multipart upload key=JF6PHF17N5WE upload=3CYU9EU50MAO tag=V7VFZ730WLLI type=write size=4176310 2024-09-14T11:20:56.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.568+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~HUBCJ9OBOOMF.0 size=1048576 2024-09-14T11:20:56.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.569+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~HUBCJ9OBOOMF.1 size=452126 2024-09-14T11:20:56.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.569+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=HUBCJ9OBOOMF tag=0DV4C7OQS60B type=write size=2549278 2024-09-14T11:20:56.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.570+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~TZBMES7P5J3O.0 size=84545 2024-09-14T11:20:56.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.572+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=TZBMES7P5J3O tag=DOJ4VLVHF43C type=write size=1133121 2024-09-14T11:20:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.574+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~FRPOIGPP5PFC.0 size=1006304 2024-09-14T11:20:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.574+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=FRPOIGPP5PFC tag=0CHK0UIDYVXQ type=write size=2054880 2024-09-14T11:20:56.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.575+0000 7fc354693780 1 < canceled operation key=WBT3M1NMEEAY tag=J8XBMM1GVB9R type=del size=3843416 2024-09-14T11:20:56.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.577+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~3Z9MIAE6Z6YY.0 size=1048576 2024-09-14T11:20:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.578+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~3Z9MIAE6Z6YY.1 size=631255 2024-09-14T11:20:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.578+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=3Z9MIAE6Z6YY tag=XL9H7VI1ORZP type=write size=2728407 2024-09-14T11:20:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.579+0000 7fc354693780 -1 < failed to complete operation key=IGZK9BWJFCV3 tag=TREO00FG6ZR1 type=del size=859365: (22) Invalid argument 2024-09-14T11:20:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.580+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=TNDXOET7LEHE type=write size=209577 2024-09-14T11:20:56.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.583+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=IM75PUU6P0XA type=del size=1762391 2024-09-14T11:20:56.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.584+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=UQ1BE94Y5OSX type=del size=539744 2024-09-14T11:20:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.585+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=7MQF6J1NXB3G type=del 2024-09-14T11:20:56.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.586+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=L7DOABA8E5NQ type=del size=2540374 2024-09-14T11:20:56.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.587+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=9J39PTIHHR3J type=del 2024-09-14T11:20:56.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.588+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=B3XXPT4WZKDK type=del size=3057675 2024-09-14T11:20:56.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.589+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=R842WL7ARULO type=del 2024-09-14T11:20:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.592+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~DFP3QMQHK70M.0 size=373236 2024-09-14T11:20:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.592+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=DFP3QMQHK70M tag=OVDA4WWA1R6W type=write size=1421812 2024-09-14T11:20:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.594+0000 7fc354693780 1 < suggested remove operation key=GE83T07IQG0S tag=UNZ9E41Z9T55 type=del 2024-09-14T11:20:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.596+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.0 size=1048576 2024-09-14T11:20:56.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.597+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.1 size=1048576 2024-09-14T11:20:56.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.598+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.2 size=846657 2024-09-14T11:20:56.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.598+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=P95B7JJF6UIN tag=HY9GKAT2IJ62 type=write size=3992385 2024-09-14T11:20:56.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.599+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=9HORFBD2G1FZ type=del 2024-09-14T11:20:56.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.600+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=836NC16J6EJF type=write size=731605 2024-09-14T11:20:56.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.601+0000 7fc354693780 -1 < failed to complete operation key=GE83T07IQG0S tag=D4Y7W03V8I2G type=del size=66119: (22) Invalid argument 2024-09-14T11:20:56.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.602+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=A73ZXAFMCPVN type=del size=1610711 2024-09-14T11:20:56.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.604+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~VXV1HJODFE1Z.0 size=1048576 2024-09-14T11:20:56.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.605+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~VXV1HJODFE1Z.1 size=198607 2024-09-14T11:20:56.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.607+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=VXV1HJODFE1Z tag=73Q5ZGUE3LHX type=write size=2295759 2024-09-14T11:20:56.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.608+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=9YGHTN83813P type=write size=864206 2024-09-14T11:20:56.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.609+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~URQLWQQC3T1E.0 size=1048576 2024-09-14T11:20:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.610+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~URQLWQQC3T1E.1 size=347162 2024-09-14T11:20:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.611+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=URQLWQQC3T1E tag=XV5HTSFF29LP type=write size=2444314 2024-09-14T11:20:56.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.613+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~K888CP96EB6A.0 size=536699 2024-09-14T11:20:56.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.613+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=K888CP96EB6A tag=2S8X3M03LL86 type=write size=1585275 2024-09-14T11:20:56.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.615+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=Y2GK605W8039 type=del 2024-09-14T11:20:56.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.616+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=P4N59PF52ZKE type=del size=1839650 2024-09-14T11:20:56.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.618+0000 7fc354693780 1 < suggested remove operation key=54EUIL28P2H1 tag=09EWLBCB8441 type=del 2024-09-14T11:20:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.619+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=8Y8YAN11FC1B type=del size=3933818 2024-09-14T11:20:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.620+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~4A1QM73E6QN7.0 size=355187 2024-09-14T11:20:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.622+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=4A1QM73E6QN7 tag=09V9BJ2HRC2R type=write size=1403763 2024-09-14T11:20:56.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.623+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=9P7I6XBNFRWL type=del size=3492311 2024-09-14T11:20:56.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.624+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~HUBCJ9OBOOMF.0 size=1048576 2024-09-14T11:20:56.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.625+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~HUBCJ9OBOOMF.1 size=452126 2024-09-14T11:20:56.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.627+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=HUBCJ9OBOOMF tag=0DV4C7OQS60B type=write size=2549278 2024-09-14T11:20:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.628+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=4940GQMGLISC type=write size=162500 2024-09-14T11:20:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.629+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~FRPOIGPP5PFC.0 size=1006304 2024-09-14T11:20:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.631+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=FRPOIGPP5PFC tag=0CHK0UIDYVXQ type=write size=2054880 2024-09-14T11:20:56.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.632+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=Z5TEE2NX0T26 type=del size=3845970 2024-09-14T11:20:56.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.632+0000 7fc354693780 1 < canceled part key=_multipart_PRBZQWTFXQ7R.2~3Z9MIAE6Z6YY.0 size=1048576 2024-09-14T11:20:56.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.633+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~3Z9MIAE6Z6YY.1 size=631255 2024-09-14T11:20:56.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.635+0000 7fc354693780 1 < canceled multipart upload key=PRBZQWTFXQ7R upload=3Z9MIAE6Z6YY tag=XL9H7VI1ORZP type=write size=2728407 2024-09-14T11:20:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.637+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~OUT9897TJWYL.0 size=631495 2024-09-14T11:20:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.637+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=OUT9897TJWYL tag=JB9DFN82P2WW type=write size=1680071 2024-09-14T11:20:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.638+0000 7fc354693780 1 < canceled operation key=BKW08T86L2ZF tag=TNDXOET7LEHE type=write size=209577 2024-09-14T11:20:56.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.640+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=7Y1OQBDJC3NC type=write size=843348 2024-09-14T11:20:56.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.641+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=UQ1BE94Y5OSX type=del 2024-09-14T11:20:56.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.642+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=LGKE0EBIZV6M type=write size=697919 2024-09-14T11:20:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.645+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=L7DOABA8E5NQ type=del size=2540374 2024-09-14T11:20:56.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.647+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~B6KC153YQR6V.0 size=1048576 2024-09-14T11:20:56.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.648+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~B6KC153YQR6V.1 size=960725 2024-09-14T11:20:56.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.648+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=B6KC153YQR6V tag=TRXNA38M59TV type=write size=3057877 2024-09-14T11:20:56.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.650+0000 7fc354693780 1 < suggested remove operation key=X4VH2WYJJ8GI tag=B3XXPT4WZKDK type=del 2024-09-14T11:20:56.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.652+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~C73W5PX0Y3J6.0 size=1048576 2024-09-14T11:20:56.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.653+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~C73W5PX0Y3J6.1 size=222138 2024-09-14T11:20:56.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.653+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=C73W5PX0Y3J6 tag=3YCEVAI77C2P type=write size=2319290 2024-09-14T11:20:56.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.655+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~DFP3QMQHK70M.0 size=373236 2024-09-14T11:20:56.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.658+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=DFP3QMQHK70M tag=OVDA4WWA1R6W type=write size=1421812 2024-09-14T11:20:56.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.659+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=M56TN8SC3Y6E type=write size=414696 2024-09-14T11:20:56.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.660+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.0 size=1048576 2024-09-14T11:20:56.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.661+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.1 size=1048576 2024-09-14T11:20:56.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.662+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~P95B7JJF6UIN.2 size=846657 2024-09-14T11:20:56.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.664+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=P95B7JJF6UIN tag=HY9GKAT2IJ62 type=write size=3992385 2024-09-14T11:20:56.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.665+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=12MAT913SZ81 type=write size=228173 2024-09-14T11:20:56.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.667+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=836NC16J6EJF type=write size=731605 2024-09-14T11:20:56.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.668+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=TXOFISV0CU2J type=write size=822486 2024-09-14T11:20:56.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.669+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=A73ZXAFMCPVN type=del 2024-09-14T11:20:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.670+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=F7O5OL8A2GNM type=del size=119094 2024-09-14T11:20:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.673+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=9YGHTN83813P type=write 2024-09-14T11:20:56.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.674+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=BFZVAS39UL6F type=write size=865083 2024-09-14T11:20:56.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.675+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~K888CP96EB6A.0 size=536699 2024-09-14T11:20:56.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.677+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=K888CP96EB6A tag=2S8X3M03LL86 type=write size=1585275 2024-09-14T11:20:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.679+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.0 size=1048576 2024-09-14T11:20:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.680+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.1 size=1048576 2024-09-14T11:20:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.681+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.2 size=616489 2024-09-14T11:20:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.681+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=0Y8FN8JGWFMG tag=MC23RQBC12GQ type=write size=3762217 2024-09-14T11:20:56.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.683+0000 7fc354693780 1 < suggested update operation key=T0Z8NK20DS5K tag=P4N59PF52ZKE type=del size=1839650 2024-09-14T11:20:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.686+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~RVNH0053MD0X.0 size=1048576 2024-09-14T11:20:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.687+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~RVNH0053MD0X.1 size=1043425 2024-09-14T11:20:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.687+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=RVNH0053MD0X tag=G90PLIFF50TM type=write size=3140577 2024-09-14T11:20:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.688+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=8Y8YAN11FC1B type=del size=3933818 2024-09-14T11:20:56.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.690+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.0 size=1048576 2024-09-14T11:20:56.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.691+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.1 size=1048576 2024-09-14T11:20:56.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.692+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.2 size=985233 2024-09-14T11:20:56.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.692+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=XXSIYBWTON20 tag=C8X0TK4UX08Z type=write size=4130961 2024-09-14T11:20:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.693+0000 7fc354693780 -1 < failed to complete operation key=BJ7AARJEIT8W tag=9P7I6XBNFRWL type=del size=3492311: (22) Invalid argument 2024-09-14T11:20:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.695+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=58NYFZ9E1IPX type=del size=3194875 2024-09-14T11:20:56.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.697+0000 7fc354693780 1 < suggested update operation key=AUL8F0SZVZX2 tag=4940GQMGLISC type=write size=162500 2024-09-14T11:20:56.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.698+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=EURYB8HYVKUV type=del size=1620177 2024-09-14T11:20:56.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.699+0000 7fc354693780 -1 < failed to complete operation key=T0Z8NK20DS5K tag=Z5TEE2NX0T26 type=del size=3845970: (22) Invalid argument 2024-09-14T11:20:56.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.700+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=947YLT1HFIOE type=del size=851724 2024-09-14T11:20:56.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.702+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~OUT9897TJWYL.0 size=631495 2024-09-14T11:20:56.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.703+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=OUT9897TJWYL tag=JB9DFN82P2WW type=write size=1680071 2024-09-14T11:20:56.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.705+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=DP60P88C56YO type=del size=2473522 2024-09-14T11:20:56.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.707+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=7Y1OQBDJC3NC type=write 2024-09-14T11:20:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.708+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=BY9WH7UBCC6R type=del size=2515426 2024-09-14T11:20:56.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.709+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=LGKE0EBIZV6M type=write size=697919 2024-09-14T11:20:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.710+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=KSAN2MSF1EON type=write size=766346 2024-09-14T11:20:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.711+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~B6KC153YQR6V.0 size=1048576 2024-09-14T11:20:56.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.712+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~B6KC153YQR6V.1 size=960725 2024-09-14T11:20:56.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.714+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=B6KC153YQR6V tag=TRXNA38M59TV type=write size=3057877 2024-09-14T11:20:56.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.715+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=LKOX3ATAWDAG type=del size=485280 2024-09-14T11:20:56.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.717+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~C73W5PX0Y3J6.0 size=1048576 2024-09-14T11:20:56.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.717+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~C73W5PX0Y3J6.1 size=222138 2024-09-14T11:20:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.719+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=C73W5PX0Y3J6 tag=3YCEVAI77C2P type=write size=2319290 2024-09-14T11:20:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.721+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=NGBWMQVWS2M4 type=del size=3356522 2024-09-14T11:20:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.722+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=M56TN8SC3Y6E type=write size=414696 2024-09-14T11:20:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.724+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~X21PT1GV57NT.0 size=1018624 2024-09-14T11:20:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.724+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=X21PT1GV57NT tag=RF13KFVEQG7T type=write size=2067200 2024-09-14T11:20:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.726+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=12MAT913SZ81 type=write 2024-09-14T11:20:56.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.728+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~XKLZE59MKN6G.0 size=302094 2024-09-14T11:20:56.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.728+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=XKLZE59MKN6G tag=LUX39MR9Z6OV type=write size=1350670 2024-09-14T11:20:56.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.729+0000 7fc354693780 1 < completed write operation key=54EUIL28P2H1 tag=TXOFISV0CU2J type=write size=822486 2024-09-14T11:20:56.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.730+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=96OMOOPQXTSO type=write size=1027940 2024-09-14T11:20:56.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.732+0000 7fc354693780 1 < canceled operation key=BTET4HD5NY0D tag=F7O5OL8A2GNM type=del size=119094 2024-09-14T11:20:56.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.733+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=ILU6SXY7OARC type=del size=3634728 2024-09-14T11:20:56.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.735+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=BFZVAS39UL6F type=write 2024-09-14T11:20:56.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.737+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~SXB5PTLL7VV3.0 size=318567 2024-09-14T11:20:56.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.737+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=SXB5PTLL7VV3 tag=5RMP8X2ICEBI type=write size=1367143 2024-09-14T11:20:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.738+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.0 size=1048576 2024-09-14T11:20:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.738+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.1 size=1048576 2024-09-14T11:20:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.739+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~0Y8FN8JGWFMG.2 size=616489 2024-09-14T11:20:56.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.741+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=0Y8FN8JGWFMG tag=MC23RQBC12GQ type=write size=3762217 2024-09-14T11:20:56.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.744+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.0 size=1048576 2024-09-14T11:20:56.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.745+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.1 size=1048576 2024-09-14T11:20:56.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.746+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.2 size=963360 2024-09-14T11:20:56.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.746+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=R9DY8RUCQFT5 tag=VBXUB395604J type=write size=4109088 2024-09-14T11:20:56.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.747+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~RVNH0053MD0X.0 size=1048576 2024-09-14T11:20:56.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.748+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~RVNH0053MD0X.1 size=1043425 2024-09-14T11:20:56.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.750+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=RVNH0053MD0X tag=G90PLIFF50TM type=write size=3140577 2024-09-14T11:20:56.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.751+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=ZATRSHXVG994 type=del size=3329384 2024-09-14T11:20:56.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.752+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.0 size=1048576 2024-09-14T11:20:56.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.753+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.1 size=1048576 2024-09-14T11:20:56.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.754+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XXSIYBWTON20.2 size=985233 2024-09-14T11:20:56.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.756+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=XXSIYBWTON20 tag=C8X0TK4UX08Z type=write size=4130961 2024-09-14T11:20:56.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.757+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=Z9KKFR6OFFLT type=del size=4099503 2024-09-14T11:20:56.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.758+0000 7fc354693780 -1 < failed to complete operation key=N23XJJD7YYG0 tag=58NYFZ9E1IPX type=del size=3194875: (22) Invalid argument 2024-09-14T11:20:56.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.761+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.0 size=1048576 2024-09-14T11:20:56.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.762+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.1 size=1048576 2024-09-14T11:20:56.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.763+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.2 size=219055 2024-09-14T11:20:56.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.763+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=QLCQYLGFHVQO tag=0NOBS4B6HIXB type=write size=3364783 2024-09-14T11:20:56.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.764+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=EURYB8HYVKUV type=del 2024-09-14T11:20:56.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.767+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.0 size=1048576 2024-09-14T11:20:56.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.768+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.1 size=1048576 2024-09-14T11:20:56.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.769+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.2 size=1031005 2024-09-14T11:20:56.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.769+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=8OMS0BY2BPOA tag=PHR3A9MULBFC type=write size=4176733 2024-09-14T11:20:56.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.770+0000 7fc354693780 -1 < failed to complete operation key=977GI7HKD9JJ tag=947YLT1HFIOE type=del size=851724: (22) Invalid argument 2024-09-14T11:20:56.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.772+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=AGTQLB304FJ1 type=del size=3537045 2024-09-14T11:20:56.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.773+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=DP60P88C56YO type=del 2024-09-14T11:20:56.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.775+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~6K0N9Q7ENXLR.0 size=1048576 2024-09-14T11:20:56.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.776+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~6K0N9Q7ENXLR.1 size=750856 2024-09-14T11:20:56.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.776+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=6K0N9Q7ENXLR tag=GL3CLAG23V07 type=write size=2848008 2024-09-14T11:20:56.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.777+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=BY9WH7UBCC6R type=del 2024-09-14T11:20:56.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.779+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=HLRQ81S7MWY5 type=del size=3487941 2024-09-14T11:20:56.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.781+0000 7fc354693780 1 < suggested remove operation key=54EUIL28P2H1 tag=KSAN2MSF1EON type=write 2024-09-14T11:20:56.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.782+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=YL9O4P2MDCK4 type=del size=1278249 2024-09-14T11:20:56.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.783+0000 7fc354693780 1 < canceled operation key=FMG2DNGS0LZ3 tag=LKOX3ATAWDAG type=del size=485280 2024-09-14T11:20:56.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.785+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.0 size=1048576 2024-09-14T11:20:56.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.786+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.1 size=1048576 2024-09-14T11:20:56.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.787+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.2 size=392736 2024-09-14T11:20:56.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.787+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=YVHTG4DQ9FPH tag=48QQJHLK1G9F type=write size=3538464 2024-09-14T11:20:56.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.789+0000 7fc354693780 1 < suggested remove operation key=WYD70VR8OKAN tag=NGBWMQVWS2M4 type=del 2024-09-14T11:20:56.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.790+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=3LZPF3WS801O type=del size=3701347 2024-09-14T11:20:56.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.791+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~X21PT1GV57NT.0 size=1018624 2024-09-14T11:20:56.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.793+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=X21PT1GV57NT tag=RF13KFVEQG7T type=write size=2067200 2024-09-14T11:20:56.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.794+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=V8U81OUIKIGB type=del size=1443200 2024-09-14T11:20:56.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.795+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~XKLZE59MKN6G.0 size=302094 2024-09-14T11:20:56.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.797+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=XKLZE59MKN6G tag=LUX39MR9Z6OV type=write size=1350670 2024-09-14T11:20:56.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.798+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=T0D1JZKNP2QR type=del size=2729770 2024-09-14T11:20:56.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.800+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=96OMOOPQXTSO type=write size=1027940 2024-09-14T11:20:56.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.802+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~IOGH0PSLJ51N.0 size=1048576 2024-09-14T11:20:56.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.802+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~IOGH0PSLJ51N.1 size=1010061 2024-09-14T11:20:56.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.802+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=IOGH0PSLJ51N tag=1XA70DLIIHPJ type=write size=3107213 2024-09-14T11:20:56.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.804+0000 7fc354693780 -1 < failed to complete operation key=54EUIL28P2H1 tag=ILU6SXY7OARC type=del size=3634728: (22) Invalid argument 2024-09-14T11:20:56.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.806+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~KKGOVB1PFMUC.0 size=1048576 2024-09-14T11:20:56.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.806+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~KKGOVB1PFMUC.1 size=352734 2024-09-14T11:20:56.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.806+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=KKGOVB1PFMUC tag=X2YONXNM87DX type=write size=2449886 2024-09-14T11:20:56.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.808+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~SXB5PTLL7VV3.0 size=318567 2024-09-14T11:20:56.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.809+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=SXB5PTLL7VV3 tag=5RMP8X2ICEBI type=write size=1367143 2024-09-14T11:20:56.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.810+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=WFVXZF299BKH type=del size=2165407 2024-09-14T11:20:56.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.811+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.0 size=1048576 2024-09-14T11:20:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.812+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.1 size=1048576 2024-09-14T11:20:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.812+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~R9DY8RUCQFT5.2 size=963360 2024-09-14T11:20:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.814+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=R9DY8RUCQFT5 tag=VBXUB395604J type=write size=4109088 2024-09-14T11:20:56.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.816+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~IVE6T9WZ0HQC.0 size=478698 2024-09-14T11:20:56.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.816+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=IVE6T9WZ0HQC tag=JC1JU7MP1WPW type=write size=1527274 2024-09-14T11:20:56.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.818+0000 7fc354693780 -1 < failed to complete operation key=WYD70VR8OKAN tag=ZATRSHXVG994 type=del size=3329384: (22) Invalid argument 2024-09-14T11:20:56.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.819+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=QDAGC48SLJJL type=del size=1926938 2024-09-14T11:20:56.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.820+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=Z9KKFR6OFFLT type=del 2024-09-14T11:20:56.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.821+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=F3PNDWG9QF5K type=del size=570132 2024-09-14T11:20:56.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.822+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.0 size=1048576 2024-09-14T11:20:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.823+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.1 size=1048576 2024-09-14T11:20:56.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.823+0000 7fc354693780 1 < canceled part key=_multipart_4IDBIAE3VAY4.2~QLCQYLGFHVQO.2 size=219055 2024-09-14T11:20:56.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.825+0000 7fc354693780 1 < canceled multipart upload key=4IDBIAE3VAY4 upload=QLCQYLGFHVQO tag=0NOBS4B6HIXB type=write size=3364783 2024-09-14T11:20:56.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.827+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.0 size=1048576 2024-09-14T11:20:56.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.828+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.1 size=1048576 2024-09-14T11:20:56.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.829+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.2 size=344338 2024-09-14T11:20:56.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.829+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=GX7QDC243XR4 tag=4OZUYKBFUQUX type=write size=3490066 2024-09-14T11:20:56.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.830+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.0 size=1048576 2024-09-14T11:20:56.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.831+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.1 size=1048576 2024-09-14T11:20:56.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.832+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8OMS0BY2BPOA.2 size=1031005 2024-09-14T11:20:56.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.834+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=8OMS0BY2BPOA tag=PHR3A9MULBFC type=write size=4176733 2024-09-14T11:20:56.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.836+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.0 size=1048576 2024-09-14T11:20:56.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.837+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.1 size=1048576 2024-09-14T11:20:56.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.838+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.2 size=615034 2024-09-14T11:20:56.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.838+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=J9K0KKYK53JC tag=REDGT8BBIXOT type=write size=3760762 2024-09-14T11:20:56.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.839+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=AGTQLB304FJ1 type=del 2024-09-14T11:20:56.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.841+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~KOSDZMX7ATZR.0 size=1001428 2024-09-14T11:20:56.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.841+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=KOSDZMX7ATZR tag=F53QFYG40X28 type=write size=2050004 2024-09-14T11:20:56.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.842+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~6K0N9Q7ENXLR.0 size=1048576 2024-09-14T11:20:56.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.843+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~6K0N9Q7ENXLR.1 size=750856 2024-09-14T11:20:56.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.845+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=6K0N9Q7ENXLR tag=GL3CLAG23V07 type=write size=2848008 2024-09-14T11:20:56.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.846+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=4JTSB7WWZC30 type=write size=701020 2024-09-14T11:20:56.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.847+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=HLRQ81S7MWY5 type=del 2024-09-14T11:20:56.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.848+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=WBV0T7FYYK8N type=del size=309377 2024-09-14T11:20:56.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.850+0000 7fc354693780 1 < suggested remove operation key=GE83T07IQG0S tag=YL9O4P2MDCK4 type=del 2024-09-14T11:20:56.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.852+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=SBA2FPUODAMP type=del size=1323097 2024-09-14T11:20:56.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.853+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.0 size=1048576 2024-09-14T11:20:56.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.854+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.1 size=1048576 2024-09-14T11:20:56.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.855+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~YVHTG4DQ9FPH.2 size=392736 2024-09-14T11:20:56.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.857+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=YVHTG4DQ9FPH tag=48QQJHLK1G9F type=write size=3538464 2024-09-14T11:20:56.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.859+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~2AQ1S8HZGGJA.0 size=905845 2024-09-14T11:20:56.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.859+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=2AQ1S8HZGGJA tag=NAS9B6VPYLXY type=write size=1954421 2024-09-14T11:20:56.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.861+0000 7fc354693780 1 < suggested remove operation key=PRBZQWTFXQ7R tag=3LZPF3WS801O type=del 2024-09-14T11:20:56.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.863+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.0 size=1048576 2024-09-14T11:20:56.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.864+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.1 size=1048576 2024-09-14T11:20:56.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.865+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.2 size=871073 2024-09-14T11:20:56.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.865+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=88F4VHOQZRVM tag=Q5LQJVI9TFBP type=write size=4016801 2024-09-14T11:20:56.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.867+0000 7fc354693780 1 < suggested remove operation key=WBT3M1NMEEAY tag=V8U81OUIKIGB type=del 2024-09-14T11:20:56.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.869+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~GC8Q3O9ZSUF3.0 size=582710 2024-09-14T11:20:56.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.869+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=GC8Q3O9ZSUF3 tag=RHNW7DJ56TGK type=write size=1631286 2024-09-14T11:20:56.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.870+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=T0D1JZKNP2QR type=del 2024-09-14T11:20:56.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.872+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=VAR7533K2MR4 type=del size=2561464 2024-09-14T11:20:56.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.873+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~IOGH0PSLJ51N.0 size=1048576 2024-09-14T11:20:56.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.874+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~IOGH0PSLJ51N.1 size=1010061 2024-09-14T11:20:56.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.876+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=IOGH0PSLJ51N tag=1XA70DLIIHPJ type=write size=3107213 2024-09-14T11:20:56.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.878+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~YAYFRIRY3CUH.0 size=1048576 2024-09-14T11:20:56.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.879+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~YAYFRIRY3CUH.1 size=635418 2024-09-14T11:20:56.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.879+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=YAYFRIRY3CUH tag=GAOQX5NL1YB6 type=write size=2732570 2024-09-14T11:20:56.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.880+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~KKGOVB1PFMUC.0 size=1048576 2024-09-14T11:20:56.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.881+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~KKGOVB1PFMUC.1 size=352734 2024-09-14T11:20:56.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.883+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=KKGOVB1PFMUC tag=X2YONXNM87DX type=write size=2449886 2024-09-14T11:20:56.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.884+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=XZY9PCA0Z6ZM type=del size=255306 2024-09-14T11:20:56.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.885+0000 7fc354693780 1 < canceled operation key=RHVF0Z2PRDA8 tag=WFVXZF299BKH type=del size=2165407 2024-09-14T11:20:56.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.886+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=LZFN8UH2P8LS type=write size=397949 2024-09-14T11:20:56.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.887+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~IVE6T9WZ0HQC.0 size=478698 2024-09-14T11:20:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.889+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=IVE6T9WZ0HQC tag=JC1JU7MP1WPW type=write size=1527274 2024-09-14T11:20:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.890+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=3K5HSN13F1YR type=del size=3137923 2024-09-14T11:20:56.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.892+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=QDAGC48SLJJL type=del 2024-09-14T11:20:56.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.893+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=594BLLXWN45S type=del size=1818126 2024-09-14T11:20:56.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.895+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=F3PNDWG9QF5K type=del size=570132 2024-09-14T11:20:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.896+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=99DOV42I7Z6E type=del size=920937 2024-09-14T11:20:56.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.896+0000 7fc354693780 1 < canceled part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.0 size=1048576 2024-09-14T11:20:56.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.897+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.1 size=1048576 2024-09-14T11:20:56.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.898+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~GX7QDC243XR4.2 size=344338 2024-09-14T11:20:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.900+0000 7fc354693780 1 < canceled multipart upload key=54EUIL28P2H1 upload=GX7QDC243XR4 tag=4OZUYKBFUQUX type=write size=3490066 2024-09-14T11:20:56.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.902+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~0G91UWEYKPTW.0 size=729414 2024-09-14T11:20:56.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.902+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=0G91UWEYKPTW tag=1NO5TBQ44KXA type=write size=1777990 2024-09-14T11:20:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.903+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.0 size=1048576 2024-09-14T11:20:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.904+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.1 size=1048576 2024-09-14T11:20:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.904+0000 7fc354693780 1 < canceled part key=_multipart_54EUIL28P2H1.2~J9K0KKYK53JC.2 size=615034 2024-09-14T11:20:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.906+0000 7fc354693780 1 < canceled multipart upload key=54EUIL28P2H1 upload=J9K0KKYK53JC tag=REDGT8BBIXOT type=write size=3760762 2024-09-14T11:20:56.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.908+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~P33MED0W410I.0 size=511779 2024-09-14T11:20:56.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.908+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=P33MED0W410I tag=N0OZV4X2ELYI type=write size=1560355 2024-09-14T11:20:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.909+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~KOSDZMX7ATZR.0 size=1001428 2024-09-14T11:20:56.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.911+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=KOSDZMX7ATZR tag=F53QFYG40X28 type=write size=2050004 2024-09-14T11:20:56.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.912+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=FT3EBWK8011B type=del size=173944 2024-09-14T11:20:56.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.913+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=4JTSB7WWZC30 type=write size=701020 2024-09-14T11:20:56.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.915+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=VJM8SKJ38LJO type=del size=4037814 2024-09-14T11:20:56.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.916+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=WBV0T7FYYK8N type=del 2024-09-14T11:20:56.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.918+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.0 size=1048576 2024-09-14T11:20:56.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.919+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.1 size=1048576 2024-09-14T11:20:56.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.920+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.2 size=104218 2024-09-14T11:20:56.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.920+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=1Q3PWI89LKAU tag=Y8KVIGRF17JD type=write size=3249946 2024-09-14T11:20:56.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.921+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=SBA2FPUODAMP type=del 2024-09-14T11:20:56.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.922+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=7NZMYL46NUVH type=del size=1257704 2024-09-14T11:20:56.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.923+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~2AQ1S8HZGGJA.0 size=905845 2024-09-14T11:20:56.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.925+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=2AQ1S8HZGGJA tag=NAS9B6VPYLXY type=write size=1954421 2024-09-14T11:20:56.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.927+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=ZDD2243DLD6S type=del size=1088395 2024-09-14T11:20:56.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.928+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.0 size=1048576 2024-09-14T11:20:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.929+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.1 size=1048576 2024-09-14T11:20:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.929+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~88F4VHOQZRVM.2 size=871073 2024-09-14T11:20:56.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.931+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=88F4VHOQZRVM tag=Q5LQJVI9TFBP type=write size=4016801 2024-09-14T11:20:56.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.932+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=NBEK9HTD4KKH type=del size=2408345 2024-09-14T11:20:56.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.934+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~GC8Q3O9ZSUF3.0 size=582710 2024-09-14T11:20:56.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.935+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=GC8Q3O9ZSUF3 tag=RHNW7DJ56TGK type=write size=1631286 2024-09-14T11:20:56.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.936+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=41K2YO0XM3LB type=write size=433554 2024-09-14T11:20:56.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.937+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=VAR7533K2MR4 type=del 2024-09-14T11:20:56.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.939+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=J5NY626Y2XL4 type=del size=1387083 2024-09-14T11:20:56.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.940+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~YAYFRIRY3CUH.0 size=1048576 2024-09-14T11:20:56.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.941+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~YAYFRIRY3CUH.1 size=635418 2024-09-14T11:20:56.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.942+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=YAYFRIRY3CUH tag=GAOQX5NL1YB6 type=write size=2732570 2024-09-14T11:20:56.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.944+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.0 size=1048576 2024-09-14T11:20:56.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.945+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.1 size=1048576 2024-09-14T11:20:56.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.946+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.2 size=970377 2024-09-14T11:20:56.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.946+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=18DCLEC8LAR6 tag=EILUWVAXCEWM type=write size=4116105 2024-09-14T11:20:56.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.947+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=XZY9PCA0Z6ZM type=del 2024-09-14T11:20:56.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.948+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=OVR6MJGWHP2T type=del size=1863391 2024-09-14T11:20:56.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.950+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=LZFN8UH2P8LS type=write 2024-09-14T11:20:56.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.952+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=RHN6EDKC2CB7 type=write size=148085 2024-09-14T11:20:56.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.954+0000 7fc354693780 1 < suggested remove operation key=IJZB38U355GG tag=3K5HSN13F1YR type=del 2024-09-14T11:20:56.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.956+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~XCV1HBXQT58N.0 size=1048576 2024-09-14T11:20:56.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.957+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~XCV1HBXQT58N.1 size=424220 2024-09-14T11:20:56.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.957+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=XCV1HBXQT58N tag=BTZTICPHH86O type=write size=2521372 2024-09-14T11:20:56.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.958+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=594BLLXWN45S type=del 2024-09-14T11:20:56.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.959+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=Q8LQWA3MXT5L type=del size=2268412 2024-09-14T11:20:56.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.960+0000 7fc354693780 1 < canceled operation key=Z3ZFX1354IRF tag=99DOV42I7Z6E type=del size=920937 2024-09-14T11:20:56.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.962+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~40E36JIX2L6N.0 size=804390 2024-09-14T11:20:56.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.962+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=40E36JIX2L6N tag=BWU01TTZY282 type=write size=1852966 2024-09-14T11:20:56.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.963+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~0G91UWEYKPTW.0 size=729414 2024-09-14T11:20:56.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.965+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=0G91UWEYKPTW tag=1NO5TBQ44KXA type=write size=1777990 2024-09-14T11:20:56.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.966+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=22ML43SABHJY type=del size=1986197 2024-09-14T11:20:56.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.967+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~P33MED0W410I.0 size=511779 2024-09-14T11:20:56.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.969+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=P33MED0W410I tag=N0OZV4X2ELYI type=write size=1560355 2024-09-14T11:20:56.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.971+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~VDS7IX0UNDAM.0 size=659150 2024-09-14T11:20:56.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.971+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=VDS7IX0UNDAM tag=8CI04R667URM type=write size=1707726 2024-09-14T11:20:56.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.972+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=FT3EBWK8011B type=del 2024-09-14T11:20:56.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.973+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=BRWI9JKPARN0 type=del size=3150073 2024-09-14T11:20:56.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.974+0000 7fc354693780 1 < canceled operation key=JF6PHF17N5WE tag=VJM8SKJ38LJO type=del size=4037814 2024-09-14T11:20:56.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.977+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=L3XCR1MXBS5Q type=write size=363663 2024-09-14T11:20:56.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.978+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.0 size=1048576 2024-09-14T11:20:56.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.979+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.1 size=1048576 2024-09-14T11:20:56.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.979+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~1Q3PWI89LKAU.2 size=104218 2024-09-14T11:20:56.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.981+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=1Q3PWI89LKAU tag=Y8KVIGRF17JD type=write size=3249946 2024-09-14T11:20:56.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.982+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=X8K1MQ8SH9XI type=del size=121645 2024-09-14T11:20:56.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.983+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=7NZMYL46NUVH type=del 2024-09-14T11:20:56.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.985+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.0 size=1048576 2024-09-14T11:20:56.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.986+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.1 size=1048576 2024-09-14T11:20:56.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.987+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.2 size=1047881 2024-09-14T11:20:56.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.987+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=WLXE8MCRCNAA tag=OCORFIACELHX type=write size=4193609 2024-09-14T11:20:56.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.988+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=ZDD2243DLD6S type=del 2024-09-14T11:20:56.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.990+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~E58XXJPA7TH8.0 size=1048576 2024-09-14T11:20:56.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.990+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~E58XXJPA7TH8.1 size=551449 2024-09-14T11:20:56.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.990+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=E58XXJPA7TH8 tag=845PEIL9L3JK type=write size=2648601 2024-09-14T11:20:56.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.991+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=NBEK9HTD4KKH type=del 2024-09-14T11:20:56.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.992+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=OWDJX88S62RQ type=del size=2522348 2024-09-14T11:20:56.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.994+0000 7fc354693780 1 < completed write operation key=QWMHFF32M37W tag=41K2YO0XM3LB type=write size=433554 2024-09-14T11:20:56.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.995+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~H4YT10ME0G2D.0 size=938131 2024-09-14T11:20:56.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.995+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=H4YT10ME0G2D tag=WQJBX3QMXT7U type=write size=1986707 2024-09-14T11:20:56.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.996+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=J5NY626Y2XL4 type=del 2024-09-14T11:20:56.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.998+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~MD4P2E66X8Y7.0 size=1048576 2024-09-14T11:20:56.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.999+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~MD4P2E66X8Y7.1 size=48186 2024-09-14T11:20:56.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:56.999+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=MD4P2E66X8Y7 tag=S4G1FY1IX71X type=write size=2145338 2024-09-14T11:20:56.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.000+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.0 size=1048576 2024-09-14T11:20:56.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.001+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.1 size=1048576 2024-09-14T11:20:57.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.002+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~18DCLEC8LAR6.2 size=970377 2024-09-14T11:20:57.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.004+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=18DCLEC8LAR6 tag=EILUWVAXCEWM type=write size=4116105 2024-09-14T11:20:57.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.005+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=1MYCF0IB5F7T type=del size=3589252 2024-09-14T11:20:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.006+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=OVR6MJGWHP2T type=del 2024-09-14T11:20:57.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.008+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~BMX65NM4TE04.0 size=1048576 2024-09-14T11:20:57.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.009+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~BMX65NM4TE04.1 size=127095 2024-09-14T11:20:57.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.009+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=BMX65NM4TE04 tag=XJYPLOBQHH71 type=write size=2224247 2024-09-14T11:20:57.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.010+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=RHN6EDKC2CB7 type=write size=148085 2024-09-14T11:20:57.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.013+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~3AYBS14TJP6O.0 size=177486 2024-09-14T11:20:57.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.013+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=3AYBS14TJP6O tag=O90POWT74AT9 type=write size=1226062 2024-09-14T11:20:57.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.014+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~XCV1HBXQT58N.0 size=1048576 2024-09-14T11:20:57.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.015+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~XCV1HBXQT58N.1 size=424220 2024-09-14T11:20:57.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.016+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=XCV1HBXQT58N tag=BTZTICPHH86O type=write size=2521372 2024-09-14T11:20:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.018+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~CIM088KPUJNV.0 size=1048576 2024-09-14T11:20:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.019+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~CIM088KPUJNV.1 size=173904 2024-09-14T11:20:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.019+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=CIM088KPUJNV tag=HOZFCFO6LPYL type=write size=2271056 2024-09-14T11:20:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.020+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=Q8LQWA3MXT5L type=del 2024-09-14T11:20:57.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.022+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.0 size=1048576 2024-09-14T11:20:57.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.023+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.1 size=1048576 2024-09-14T11:20:57.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.024+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.2 size=683893 2024-09-14T11:20:57.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.024+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=I2Q3R6SSKBX0 tag=7L1CYG1CJIOH type=write size=3829621 2024-09-14T11:20:57.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.025+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~40E36JIX2L6N.0 size=804390 2024-09-14T11:20:57.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.027+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=40E36JIX2L6N tag=BWU01TTZY282 type=write size=1852966 2024-09-14T11:20:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.029+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.0 size=1048576 2024-09-14T11:20:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.030+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.1 size=1048576 2024-09-14T11:20:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.031+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.2 size=310354 2024-09-14T11:20:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.031+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=QQCCGQGE3M1I tag=XPC9AAHEHH6L type=write size=3456082 2024-09-14T11:20:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.032+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=22ML43SABHJY type=del 2024-09-14T11:20:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.034+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~NKNTUBZBR9KE.0 size=493747 2024-09-14T11:20:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.034+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=NKNTUBZBR9KE tag=PSUW4EU0XC1D type=write size=1542323 2024-09-14T11:20:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.035+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~VDS7IX0UNDAM.0 size=659150 2024-09-14T11:20:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.037+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=VDS7IX0UNDAM tag=8CI04R667URM type=write size=1707726 2024-09-14T11:20:57.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.039+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=44FU92IN1PPW type=write size=14392 2024-09-14T11:20:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.040+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=BRWI9JKPARN0 type=del 2024-09-14T11:20:57.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.042+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.0 size=1048576 2024-09-14T11:20:57.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.043+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.1 size=1048576 2024-09-14T11:20:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.044+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.2 size=970190 2024-09-14T11:20:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.044+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=HBGWIQWEAO80 tag=PMCS4XDX18HC type=write size=4115918 2024-09-14T11:20:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.045+0000 7fc354693780 1 < completed write operation key=BJ7AARJEIT8W tag=L3XCR1MXBS5Q type=write size=363663 2024-09-14T11:20:57.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.046+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=KHOQBHYOZVBA type=del size=3798309 2024-09-14T11:20:57.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.047+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=X8K1MQ8SH9XI type=del 2024-09-14T11:20:57.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.049+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=UYTPGQC1D1E7 type=del size=2061963 2024-09-14T11:20:57.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.050+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.0 size=1048576 2024-09-14T11:20:57.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.051+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.1 size=1048576 2024-09-14T11:20:57.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.052+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~WLXE8MCRCNAA.2 size=1047881 2024-09-14T11:20:57.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.053+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=WLXE8MCRCNAA tag=OCORFIACELHX type=write size=4193609 2024-09-14T11:20:57.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.054+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=1F06S1RSJZPP type=del size=1127021 2024-09-14T11:20:57.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.056+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~E58XXJPA7TH8.0 size=1048576 2024-09-14T11:20:57.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.056+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~E58XXJPA7TH8.1 size=551449 2024-09-14T11:20:57.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.058+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=E58XXJPA7TH8 tag=845PEIL9L3JK type=write size=2648601 2024-09-14T11:20:57.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.060+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.0 size=1048576 2024-09-14T11:20:57.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.061+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.1 size=1048576 2024-09-14T11:20:57.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.062+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.2 size=805430 2024-09-14T11:20:57.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.062+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=27VFU6I99DHJ tag=R4ACG2O0A4TY type=write size=3951158 2024-09-14T11:20:57.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.063+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=OWDJX88S62RQ type=del 2024-09-14T11:20:57.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.064+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=T1QJYG1DCW4W type=del size=2320094 2024-09-14T11:20:57.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.065+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~H4YT10ME0G2D.0 size=938131 2024-09-14T11:20:57.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.067+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=H4YT10ME0G2D tag=WQJBX3QMXT7U type=write size=1986707 2024-09-14T11:20:57.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.068+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=UF3VKJXD23TI type=del size=1209031 2024-09-14T11:20:57.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.070+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~MD4P2E66X8Y7.0 size=1048576 2024-09-14T11:20:57.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.071+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~MD4P2E66X8Y7.1 size=48186 2024-09-14T11:20:57.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.073+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=MD4P2E66X8Y7 tag=S4G1FY1IX71X type=write size=2145338 2024-09-14T11:20:57.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.075+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~7OIOGPSPP45Q.0 size=1048576 2024-09-14T11:20:57.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.076+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~7OIOGPSPP45Q.1 size=519565 2024-09-14T11:20:57.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.076+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=7OIOGPSPP45Q tag=V2ARXRB203FC type=write size=2616717 2024-09-14T11:20:57.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.079+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=1MYCF0IB5F7T type=del 2024-09-14T11:20:57.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.081+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.0 size=1048576 2024-09-14T11:20:57.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.082+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.1 size=1048576 2024-09-14T11:20:57.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.083+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.2 size=876170 2024-09-14T11:20:57.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.083+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=PNTHPMTQ2M6Y tag=YHIVPNTZD6RE type=write size=4021898 2024-09-14T11:20:57.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.084+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~BMX65NM4TE04.0 size=1048576 2024-09-14T11:20:57.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.085+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~BMX65NM4TE04.1 size=127095 2024-09-14T11:20:57.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.086+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=BMX65NM4TE04 tag=XJYPLOBQHH71 type=write size=2224247 2024-09-14T11:20:57.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.089+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~FXNEXQ29QGVJ.0 size=1048576 2024-09-14T11:20:57.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.089+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~FXNEXQ29QGVJ.1 size=480495 2024-09-14T11:20:57.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.089+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=FXNEXQ29QGVJ tag=5WQF2Z07J5M1 type=write size=2577647 2024-09-14T11:20:57.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.091+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~3AYBS14TJP6O.0 size=177486 2024-09-14T11:20:57.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.092+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=3AYBS14TJP6O tag=O90POWT74AT9 type=write size=1226062 2024-09-14T11:20:57.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.095+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.0 size=1048576 2024-09-14T11:20:57.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.095+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.1 size=1048576 2024-09-14T11:20:57.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.096+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.2 size=323610 2024-09-14T11:20:57.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.096+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=M8OO88YBXCKL tag=R8YXDAXBH9OH type=write size=3469338 2024-09-14T11:20:57.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.098+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~CIM088KPUJNV.0 size=1048576 2024-09-14T11:20:57.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.099+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~CIM088KPUJNV.1 size=173904 2024-09-14T11:20:57.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.101+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=CIM088KPUJNV tag=HOZFCFO6LPYL type=write size=2271056 2024-09-14T11:20:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.103+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~K5UV0R7R2I4P.0 size=182891 2024-09-14T11:20:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.103+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=K5UV0R7R2I4P tag=YV9IHZC8WGEN type=write size=1231467 2024-09-14T11:20:57.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.104+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.0 size=1048576 2024-09-14T11:20:57.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.105+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.1 size=1048576 2024-09-14T11:20:57.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.106+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I2Q3R6SSKBX0.2 size=683893 2024-09-14T11:20:57.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.108+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=I2Q3R6SSKBX0 tag=7L1CYG1CJIOH type=write size=3829621 2024-09-14T11:20:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.110+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~ER1578DIUW2V.0 size=1048576 2024-09-14T11:20:57.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.111+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~ER1578DIUW2V.1 size=749270 2024-09-14T11:20:57.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.111+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=ER1578DIUW2V tag=VRLYTXJ35TP4 type=write size=2846422 2024-09-14T11:20:57.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.112+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.0 size=1048576 2024-09-14T11:20:57.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.113+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.1 size=1048576 2024-09-14T11:20:57.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.113+0000 7fc354693780 1 < canceled part key=_multipart_IGZK9BWJFCV3.2~QQCCGQGE3M1I.2 size=310354 2024-09-14T11:20:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.115+0000 7fc354693780 1 < canceled multipart upload key=IGZK9BWJFCV3 upload=QQCCGQGE3M1I tag=XPC9AAHEHH6L type=write size=3456082 2024-09-14T11:20:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.117+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.0 size=1048576 2024-09-14T11:20:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.118+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.1 size=1048576 2024-09-14T11:20:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.119+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.2 size=951629 2024-09-14T11:20:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.119+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=CCZJH29KELSZ tag=E43GJ634JNGK type=write size=4097357 2024-09-14T11:20:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.120+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~NKNTUBZBR9KE.0 size=493747 2024-09-14T11:20:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.122+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=NKNTUBZBR9KE tag=PSUW4EU0XC1D type=write size=1542323 2024-09-14T11:20:57.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.124+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~X4E6M9KW1W6J.0 size=77720 2024-09-14T11:20:57.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.124+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=X4E6M9KW1W6J tag=HSM83T6GNIM0 type=write size=1126296 2024-09-14T11:20:57.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.125+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=44FU92IN1PPW type=write size=14392 2024-09-14T11:20:57.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.126+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=CPX2V71T98XO type=del size=3473936 2024-09-14T11:20:57.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.127+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.0 size=1048576 2024-09-14T11:20:57.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.128+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.1 size=1048576 2024-09-14T11:20:57.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.129+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~HBGWIQWEAO80.2 size=970190 2024-09-14T11:20:57.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.132+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=HBGWIQWEAO80 tag=PMCS4XDX18HC type=write size=4115918 2024-09-14T11:20:57.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.133+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=OXP81KH27NMH type=del size=3593681 2024-09-14T11:20:57.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.135+0000 7fc354693780 1 < suggested update operation key=6SIWH1BHPFGM tag=KHOQBHYOZVBA type=del size=3798309 2024-09-14T11:20:57.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.136+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=YYF8HGAH2MMF type=del size=2413895 2024-09-14T11:20:57.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.137+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=UYTPGQC1D1E7 type=del 2024-09-14T11:20:57.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.139+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=PWH8HXTN3D9B type=del size=1671385 2024-09-14T11:20:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.140+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=1F06S1RSJZPP type=del 2024-09-14T11:20:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.141+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=Q7GLXQP8CN4G type=del size=1117885 2024-09-14T11:20:57.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.142+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.0 size=1048576 2024-09-14T11:20:57.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.143+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.1 size=1048576 2024-09-14T11:20:57.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.144+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~27VFU6I99DHJ.2 size=805430 2024-09-14T11:20:57.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.146+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=27VFU6I99DHJ tag=R4ACG2O0A4TY type=write size=3951158 2024-09-14T11:20:57.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.148+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.0 size=1048576 2024-09-14T11:20:57.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.149+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.1 size=1048576 2024-09-14T11:20:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.150+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.2 size=251507 2024-09-14T11:20:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.150+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=0FI67GX9JE7A tag=TJ9QTJOB50M3 type=write size=3397235 2024-09-14T11:20:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.151+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=T1QJYG1DCW4W type=del 2024-09-14T11:20:57.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.153+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.0 size=1048576 2024-09-14T11:20:57.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.154+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.1 size=1048576 2024-09-14T11:20:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.155+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.2 size=219448 2024-09-14T11:20:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.155+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=4E855Z6VPX28 tag=YKKJQ1RNVERK type=write size=3365176 2024-09-14T11:20:57.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.157+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=UF3VKJXD23TI type=del 2024-09-14T11:20:57.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.158+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=KMFBWH6G5ACZ type=del size=3666251 2024-09-14T11:20:57.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.159+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~7OIOGPSPP45Q.0 size=1048576 2024-09-14T11:20:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.160+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~7OIOGPSPP45Q.1 size=519565 2024-09-14T11:20:57.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.162+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=7OIOGPSPP45Q tag=V2ARXRB203FC type=write size=2616717 2024-09-14T11:20:57.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.163+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=A2V8JYSKWXUS type=del size=3983265 2024-09-14T11:20:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.164+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.0 size=1048576 2024-09-14T11:20:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.165+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.1 size=1048576 2024-09-14T11:20:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.166+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~PNTHPMTQ2M6Y.2 size=876170 2024-09-14T11:20:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.168+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=PNTHPMTQ2M6Y tag=YHIVPNTZD6RE type=write size=4021898 2024-09-14T11:20:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.169+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=WPMOD1KPZCMC type=del size=2508371 2024-09-14T11:20:57.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.170+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~FXNEXQ29QGVJ.0 size=1048576 2024-09-14T11:20:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.171+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~FXNEXQ29QGVJ.1 size=480495 2024-09-14T11:20:57.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.173+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=FXNEXQ29QGVJ tag=5WQF2Z07J5M1 type=write size=2577647 2024-09-14T11:20:57.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.174+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=K3DU4WUAPYC9 type=del size=2847417 2024-09-14T11:20:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.175+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.0 size=1048576 2024-09-14T11:20:57.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.176+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.1 size=1048576 2024-09-14T11:20:57.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.176+0000 7fc354693780 1 < canceled part key=_multipart_IJZB38U355GG.2~M8OO88YBXCKL.2 size=323610 2024-09-14T11:20:57.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.178+0000 7fc354693780 1 < canceled multipart upload key=IJZB38U355GG upload=M8OO88YBXCKL tag=R8YXDAXBH9OH type=write size=3469338 2024-09-14T11:20:57.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.180+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.0 size=1048576 2024-09-14T11:20:57.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.182+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.1 size=1048576 2024-09-14T11:20:57.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.183+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.2 size=519556 2024-09-14T11:20:57.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.183+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=LN5L0SD6F52D tag=OJEZMDXOM0GT type=write size=3665284 2024-09-14T11:20:57.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.184+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~K5UV0R7R2I4P.0 size=182891 2024-09-14T11:20:57.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.185+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=K5UV0R7R2I4P tag=YV9IHZC8WGEN type=write size=1231467 2024-09-14T11:20:57.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.186+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=M60SMDOAV0IK type=del size=2132819 2024-09-14T11:20:57.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.188+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~ER1578DIUW2V.0 size=1048576 2024-09-14T11:20:57.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.189+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~ER1578DIUW2V.1 size=749270 2024-09-14T11:20:57.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.190+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=ER1578DIUW2V tag=VRLYTXJ35TP4 type=write size=2846422 2024-09-14T11:20:57.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.192+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=17CP34OR163T type=write size=391031 2024-09-14T11:20:57.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.193+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.0 size=1048576 2024-09-14T11:20:57.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.194+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.1 size=1048576 2024-09-14T11:20:57.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.194+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~CCZJH29KELSZ.2 size=951629 2024-09-14T11:20:57.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.196+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=CCZJH29KELSZ tag=E43GJ634JNGK type=write size=4097357 2024-09-14T11:20:57.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.198+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~LRNOMMOS37AW.0 size=1048576 2024-09-14T11:20:57.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.199+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~LRNOMMOS37AW.1 size=6886 2024-09-14T11:20:57.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.199+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=LRNOMMOS37AW tag=DNZP3FJE4Z8P type=write size=2104038 2024-09-14T11:20:57.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.200+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~X4E6M9KW1W6J.0 size=77720 2024-09-14T11:20:57.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.202+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=X4E6M9KW1W6J tag=HSM83T6GNIM0 type=write size=1126296 2024-09-14T11:20:57.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.203+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=SYBQTSSCO1CZ type=del size=2593555 2024-09-14T11:20:57.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.204+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=CPX2V71T98XO type=del 2024-09-14T11:20:57.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.207+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~YX5MQRLQOBH6.0 size=1048576 2024-09-14T11:20:57.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.207+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~YX5MQRLQOBH6.1 size=352967 2024-09-14T11:20:57.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.207+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=YX5MQRLQOBH6 tag=V9IBFSH05ZP7 type=write size=2450119 2024-09-14T11:20:57.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.209+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=OXP81KH27NMH type=del 2024-09-14T11:20:57.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.211+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~FX40IB2XYXU8.0 size=1048576 2024-09-14T11:20:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.212+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~FX40IB2XYXU8.1 size=500529 2024-09-14T11:20:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.212+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=FX40IB2XYXU8 tag=2NOKRC07RX1Q type=write size=2597681 2024-09-14T11:20:57.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.213+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=YYF8HGAH2MMF type=del 2024-09-14T11:20:57.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.215+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~ERY2D9R96NAB.0 size=98966 2024-09-14T11:20:57.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.215+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=ERY2D9R96NAB tag=O16WGDZ4Q3I2 type=write size=1147542 2024-09-14T11:20:57.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.216+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=PWH8HXTN3D9B type=del 2024-09-14T11:20:57.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.217+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=2D4P2KPV3EF9 type=del size=253661 2024-09-14T11:20:57.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.219+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=Q7GLXQP8CN4G type=del 2024-09-14T11:20:57.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.221+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.0 size=1048576 2024-09-14T11:20:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.221+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.1 size=1048576 2024-09-14T11:20:57.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.222+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.2 size=503848 2024-09-14T11:20:57.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.222+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=3LLXVI5TXSUB tag=HXE7FJPGTBLN type=write size=3649576 2024-09-14T11:20:57.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.223+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.0 size=1048576 2024-09-14T11:20:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.224+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.1 size=1048576 2024-09-14T11:20:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.225+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~0FI67GX9JE7A.2 size=251507 2024-09-14T11:20:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.227+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=0FI67GX9JE7A tag=TJ9QTJOB50M3 type=write size=3397235 2024-09-14T11:20:57.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.228+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=ISJJ9JEU2CYM type=del size=2469951 2024-09-14T11:20:57.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.229+0000 7fc354693780 1 < canceled part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.0 size=1048576 2024-09-14T11:20:57.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.229+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.1 size=1048576 2024-09-14T11:20:57.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.230+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~4E855Z6VPX28.2 size=219448 2024-09-14T11:20:57.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.232+0000 7fc354693780 1 < canceled multipart upload key=H1S2CBHNW6GI upload=4E855Z6VPX28 tag=YKKJQ1RNVERK type=write size=3365176 2024-09-14T11:20:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.233+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=PDU0GTUPI4W3 type=write size=60060 2024-09-14T11:20:57.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.236+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=KMFBWH6G5ACZ type=del size=3666251 2024-09-14T11:20:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.237+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=0BGA5P6QRQ6C type=write size=448364 2024-09-14T11:20:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.239+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=A2V8JYSKWXUS type=del size=3983265 2024-09-14T11:20:57.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.241+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.0 size=1048576 2024-09-14T11:20:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.242+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.1 size=1048576 2024-09-14T11:20:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.242+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.2 size=780900 2024-09-14T11:20:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.242+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=QV815HC817YK tag=B0A0KS2WC6B5 type=write size=3926628 2024-09-14T11:20:57.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.244+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=WPMOD1KPZCMC type=del 2024-09-14T11:20:57.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.245+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=YC5BIYWVVO8O type=del size=497861 2024-09-14T11:20:57.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.246+0000 7fc354693780 1 < canceled operation key=BJ7AARJEIT8W tag=K3DU4WUAPYC9 type=del size=2847417 2024-09-14T11:20:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.247+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=KFFCUB7518NX type=write size=755370 2024-09-14T11:20:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.248+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.0 size=1048576 2024-09-14T11:20:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.249+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.1 size=1048576 2024-09-14T11:20:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.250+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~LN5L0SD6F52D.2 size=519556 2024-09-14T11:20:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.252+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=LN5L0SD6F52D tag=OJEZMDXOM0GT type=write size=3665284 2024-09-14T11:20:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.253+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=I772KJTJNG5G type=del size=3542606 2024-09-14T11:20:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.254+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=M60SMDOAV0IK type=del 2024-09-14T11:20:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.256+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=2JGTFAUX09UU type=write size=816777 2024-09-14T11:20:57.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.257+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=17CP34OR163T type=write size=391031 2024-09-14T11:20:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.258+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=P90OKB57ZHCC type=del size=313130 2024-09-14T11:20:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.259+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~LRNOMMOS37AW.0 size=1048576 2024-09-14T11:20:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.260+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~LRNOMMOS37AW.1 size=6886 2024-09-14T11:20:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.262+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=LRNOMMOS37AW tag=DNZP3FJE4Z8P type=write size=2104038 2024-09-14T11:20:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.264+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~7EWVRLZ8BY30.0 size=340124 2024-09-14T11:20:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.264+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=7EWVRLZ8BY30 tag=R6QHWJ31KCYQ type=write size=1388700 2024-09-14T11:20:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.265+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=SYBQTSSCO1CZ type=del 2024-09-14T11:20:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.267+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~5EMPHN23AP04.0 size=484139 2024-09-14T11:20:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.267+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=5EMPHN23AP04 tag=76KG5QP7E45N type=write size=1532715 2024-09-14T11:20:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.268+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~YX5MQRLQOBH6.0 size=1048576 2024-09-14T11:20:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.269+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~YX5MQRLQOBH6.1 size=352967 2024-09-14T11:20:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.271+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=YX5MQRLQOBH6 tag=V9IBFSH05ZP7 type=write size=2450119 2024-09-14T11:20:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.273+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ZK82WIPINBT6.0 size=1048576 2024-09-14T11:20:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.274+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ZK82WIPINBT6.1 size=308194 2024-09-14T11:20:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.274+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=ZK82WIPINBT6 tag=XG902XXYB8K9 type=write size=2405346 2024-09-14T11:20:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.275+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~FX40IB2XYXU8.0 size=1048576 2024-09-14T11:20:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.276+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~FX40IB2XYXU8.1 size=500529 2024-09-14T11:20:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.278+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=FX40IB2XYXU8 tag=2NOKRC07RX1Q type=write size=2597681 2024-09-14T11:20:57.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.280+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~VIOZTSXJ7VKE.0 size=1048576 2024-09-14T11:20:57.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.281+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~VIOZTSXJ7VKE.1 size=40406 2024-09-14T11:20:57.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.281+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=VIOZTSXJ7VKE tag=MITUCZJH0SHA type=write size=2137558 2024-09-14T11:20:57.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.282+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~ERY2D9R96NAB.0 size=98966 2024-09-14T11:20:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.285+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=ERY2D9R96NAB tag=O16WGDZ4Q3I2 type=write size=1147542 2024-09-14T11:20:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.286+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=ROZ6Y342QJOV type=del size=1752453 2024-09-14T11:20:57.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.288+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=2D4P2KPV3EF9 type=del 2024-09-14T11:20:57.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.289+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~I45UJ2LHKLOK.0 size=932481 2024-09-14T11:20:57.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.289+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=I45UJ2LHKLOK tag=5XFBCWEQL419 type=write size=1981057 2024-09-14T11:20:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.291+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.0 size=1048576 2024-09-14T11:20:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.292+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.1 size=1048576 2024-09-14T11:20:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.292+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~3LLXVI5TXSUB.2 size=503848 2024-09-14T11:20:57.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.294+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=3LLXVI5TXSUB tag=HXE7FJPGTBLN type=write size=3649576 2024-09-14T11:20:57.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.295+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=QSIZ9P3JWMSO type=del size=2649294 2024-09-14T11:20:57.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.297+0000 7fc354693780 1 < suggested remove operation key=54EUIL28P2H1 tag=ISJJ9JEU2CYM type=del 2024-09-14T11:20:57.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.299+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=PRTNPXWR8KM1 type=del size=2635481 2024-09-14T11:20:57.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.300+0000 7fc354693780 1 < canceled operation key=WBT3M1NMEEAY tag=PDU0GTUPI4W3 type=write size=60060 2024-09-14T11:20:57.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.301+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=EWSKH3N2AAXN type=write size=229005 2024-09-14T11:20:57.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.302+0000 7fc354693780 1 < completed write operation key=FMG2DNGS0LZ3 tag=0BGA5P6QRQ6C type=write size=448364 2024-09-14T11:20:57.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.303+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=1VDUA4M9HTKN type=del size=3277222 2024-09-14T11:20:57.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.304+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.0 size=1048576 2024-09-14T11:20:57.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.305+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.1 size=1048576 2024-09-14T11:20:57.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.306+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~QV815HC817YK.2 size=780900 2024-09-14T11:20:57.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.308+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=QV815HC817YK tag=B0A0KS2WC6B5 type=write size=3926628 2024-09-14T11:20:57.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.309+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=TMC47VNV2AAL type=write size=635938 2024-09-14T11:20:57.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.311+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=YC5BIYWVVO8O type=del 2024-09-14T11:20:57.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.313+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~6YL5I13QS60W.0 size=1048576 2024-09-14T11:20:57.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.314+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~6YL5I13QS60W.1 size=894209 2024-09-14T11:20:57.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.314+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=6YL5I13QS60W tag=7HIWTQEQSK9P type=write size=2991361 2024-09-14T11:20:57.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.316+0000 7fc354693780 1 < suggested remove operation key=OOFM3K1KEB9V tag=KFFCUB7518NX type=write 2024-09-14T11:20:57.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.317+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=46LO3T335C82 type=del size=270935 2024-09-14T11:20:57.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.318+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=I772KJTJNG5G type=del 2024-09-14T11:20:57.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.319+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=MUOSAPK2AZ2L type=del size=2164103 2024-09-14T11:20:57.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.320+0000 7fc354693780 1 < completed write operation key=JF6PHF17N5WE tag=2JGTFAUX09UU type=write size=816777 2024-09-14T11:20:57.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.322+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~XTZZ4BJ1D8KX.0 size=1048576 2024-09-14T11:20:57.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.323+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~XTZZ4BJ1D8KX.1 size=576543 2024-09-14T11:20:57.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.323+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=XTZZ4BJ1D8KX tag=KPIB2O0W2VMO type=write size=2673695 2024-09-14T11:20:57.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.324+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=P90OKB57ZHCC type=del 2024-09-14T11:20:57.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.326+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~TI32Z8R07T70.0 size=1048576 2024-09-14T11:20:57.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.327+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~TI32Z8R07T70.1 size=625025 2024-09-14T11:20:57.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.327+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=TI32Z8R07T70 tag=VTHZN54SZ8AF type=write size=2722177 2024-09-14T11:20:57.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.328+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~7EWVRLZ8BY30.0 size=340124 2024-09-14T11:20:57.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.330+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=7EWVRLZ8BY30 tag=R6QHWJ31KCYQ type=write size=1388700 2024-09-14T11:20:57.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.331+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=X7SVWIHIJF90 type=del size=2755776 2024-09-14T11:20:57.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.332+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~5EMPHN23AP04.0 size=484139 2024-09-14T11:20:57.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.334+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=5EMPHN23AP04 tag=76KG5QP7E45N type=write size=1532715 2024-09-14T11:20:57.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.336+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.0 size=1048576 2024-09-14T11:20:57.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.337+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.1 size=1048576 2024-09-14T11:20:57.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.338+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.2 size=1012070 2024-09-14T11:20:57.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.338+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=LCG359IQF818 tag=KIF9Z2HBZD9J type=write size=4157798 2024-09-14T11:20:57.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.339+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~ZK82WIPINBT6.0 size=1048576 2024-09-14T11:20:57.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.340+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~ZK82WIPINBT6.1 size=308194 2024-09-14T11:20:57.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.342+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=ZK82WIPINBT6 tag=XG902XXYB8K9 type=write size=2405346 2024-09-14T11:20:57.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.343+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=N3NICOJO4RMA type=del size=2403795 2024-09-14T11:20:57.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.345+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~VIOZTSXJ7VKE.0 size=1048576 2024-09-14T11:20:57.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.346+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~VIOZTSXJ7VKE.1 size=40406 2024-09-14T11:20:57.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.348+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=VIOZTSXJ7VKE tag=MITUCZJH0SHA type=write size=2137558 2024-09-14T11:20:57.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.349+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=LXRHDL72SC9Y type=del size=2813970 2024-09-14T11:20:57.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.350+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=ROZ6Y342QJOV type=del 2024-09-14T11:20:57.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.352+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=RPC8JX9JXKDH type=del size=383076 2024-09-14T11:20:57.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.352+0000 7fc354693780 1 < canceled part key=_multipart_Z3ZFX1354IRF.2~I45UJ2LHKLOK.0 size=932481 2024-09-14T11:20:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.354+0000 7fc354693780 1 < canceled multipart upload key=Z3ZFX1354IRF upload=I45UJ2LHKLOK tag=5XFBCWEQL419 type=write size=1981057 2024-09-14T11:20:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.355+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=CUKM07JMNEL4 type=del size=1766721 2024-09-14T11:20:57.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.357+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=QSIZ9P3JWMSO type=del 2024-09-14T11:20:57.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.358+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=WKT4C3F1XDFP type=del size=80238 2024-09-14T11:20:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.359+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=PRTNPXWR8KM1 type=del 2024-09-14T11:20:57.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.361+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~1MON70UGJTCA.0 size=339807 2024-09-14T11:20:57.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.361+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=1MON70UGJTCA tag=TCZVS5HECF1J type=write size=1388383 2024-09-14T11:20:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.363+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=EWSKH3N2AAXN type=write size=229005 2024-09-14T11:20:57.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.364+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=8JZ6JJXP6OI2 type=del size=1472546 2024-09-14T11:20:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.366+0000 7fc354693780 1 < suggested update operation key=WYD70VR8OKAN tag=1VDUA4M9HTKN type=del size=3277222 2024-09-14T11:20:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.367+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=W9Z1CV554PM7 type=del size=147157 2024-09-14T11:20:57.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.369+0000 7fc354693780 1 < completed write operation key=IGZK9BWJFCV3 tag=TMC47VNV2AAL type=write size=635938 2024-09-14T11:20:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.370+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=AZR4L8PYKOR7 type=write size=156643 2024-09-14T11:20:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.371+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~6YL5I13QS60W.0 size=1048576 2024-09-14T11:20:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.372+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~6YL5I13QS60W.1 size=894209 2024-09-14T11:20:57.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.374+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=6YL5I13QS60W tag=7HIWTQEQSK9P type=write size=2991361 2024-09-14T11:20:57.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.375+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=6MTNGEB03O1V type=del size=2178807 2024-09-14T11:20:57.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.377+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=46LO3T335C82 type=del 2024-09-14T11:20:57.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.378+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=MTJ37PU660VH type=del size=272967 2024-09-14T11:20:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.379+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=MUOSAPK2AZ2L type=del 2024-09-14T11:20:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.380+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=VSZBT1WFINK4 type=del size=1740341 2024-09-14T11:20:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.380+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~XTZZ4BJ1D8KX.0 size=1048576 2024-09-14T11:20:57.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.381+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~XTZZ4BJ1D8KX.1 size=576543 2024-09-14T11:20:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.383+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=XTZZ4BJ1D8KX tag=KPIB2O0W2VMO type=write size=2673695 2024-09-14T11:20:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.385+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.0 size=1048576 2024-09-14T11:20:57.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.386+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.1 size=1048576 2024-09-14T11:20:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.387+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.2 size=938971 2024-09-14T11:20:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.387+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=ICPM8FH91HVK tag=CPVZ65X1N7QY type=write size=4084699 2024-09-14T11:20:57.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.388+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~TI32Z8R07T70.0 size=1048576 2024-09-14T11:20:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.389+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~TI32Z8R07T70.1 size=625025 2024-09-14T11:20:57.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.391+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=TI32Z8R07T70 tag=VTHZN54SZ8AF type=write size=2722177 2024-09-14T11:20:57.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.394+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=W43FWHVLXYD7 type=del size=255182 2024-09-14T11:20:57.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.395+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=X7SVWIHIJF90 type=del 2024-09-14T11:20:57.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.396+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=UOWU2GIV6T4T type=del size=3789065 2024-09-14T11:20:57.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.398+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.0 size=1048576 2024-09-14T11:20:57.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.399+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.1 size=1048576 2024-09-14T11:20:57.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.400+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~LCG359IQF818.2 size=1012070 2024-09-14T11:20:57.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.401+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=LCG359IQF818 tag=KIF9Z2HBZD9J type=write size=4157798 2024-09-14T11:20:57.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.404+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~CDM2S3RCP7GP.0 size=1048576 2024-09-14T11:20:57.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.404+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~CDM2S3RCP7GP.1 size=494041 2024-09-14T11:20:57.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.404+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=CDM2S3RCP7GP tag=LS58UEN8VS9S type=write size=2591193 2024-09-14T11:20:57.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.406+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=N3NICOJO4RMA type=del 2024-09-14T11:20:57.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.408+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.0 size=1048576 2024-09-14T11:20:57.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.409+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.1 size=1048576 2024-09-14T11:20:57.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.410+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.2 size=520454 2024-09-14T11:20:57.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.410+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=D5P6X7SZCK8J tag=65CLNODMI46W type=write size=3666182 2024-09-14T11:20:57.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.411+0000 7fc354693780 1 < canceled operation key=BKW08T86L2ZF tag=LXRHDL72SC9Y type=del size=2813970 2024-09-14T11:20:57.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.412+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=SYZJEYZD70DN type=del size=159039 2024-09-14T11:20:57.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.413+0000 7fc354693780 -1 < failed to complete operation key=WYD70VR8OKAN tag=RPC8JX9JXKDH type=del size=383076: (22) Invalid argument 2024-09-14T11:20:57.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.415+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~107XRTY7OYNO.0 size=904931 2024-09-14T11:20:57.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.415+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=107XRTY7OYNO tag=NQB2YQN6E4XY type=write size=1953507 2024-09-14T11:20:57.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.416+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=CUKM07JMNEL4 type=del 2024-09-14T11:20:57.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.418+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~VEKB8WU3IUOK.0 size=1048576 2024-09-14T11:20:57.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.419+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~VEKB8WU3IUOK.1 size=326128 2024-09-14T11:20:57.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.419+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=VEKB8WU3IUOK tag=BWX30ARGS63N type=write size=2423280 2024-09-14T11:20:57.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.420+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=WKT4C3F1XDFP type=del 2024-09-14T11:20:57.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.422+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~381VDF2WD75B.0 size=1048576 2024-09-14T11:20:57.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.423+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~381VDF2WD75B.1 size=498696 2024-09-14T11:20:57.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.423+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=381VDF2WD75B tag=RDWV942XPW7W type=write size=2595848 2024-09-14T11:20:57.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.424+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~1MON70UGJTCA.0 size=339807 2024-09-14T11:20:57.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.426+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=1MON70UGJTCA tag=TCZVS5HECF1J type=write size=1388383 2024-09-14T11:20:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.427+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=843E6JTI425Z type=del size=138223 2024-09-14T11:20:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.428+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=8JZ6JJXP6OI2 type=del 2024-09-14T11:20:57.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.429+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=W6X8LP3EE7FJ type=del size=1436857 2024-09-14T11:20:57.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.431+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=W9Z1CV554PM7 type=del 2024-09-14T11:20:57.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.432+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=F2JFXIPT3NWJ type=del size=3628337 2024-09-14T11:20:57.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.433+0000 7fc354693780 1 < completed write operation key=JF6PHF17N5WE tag=AZR4L8PYKOR7 type=write size=156643 2024-09-14T11:20:57.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.434+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=8JA3YN0VSQIB type=del size=1808317 2024-09-14T11:20:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.435+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=6MTNGEB03O1V type=del 2024-09-14T11:20:57.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.436+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=013TERBUIS7H type=del size=1633336 2024-09-14T11:20:57.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.438+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=MTJ37PU660VH type=del size=272967 2024-09-14T11:20:57.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.439+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=4NF7FR19HIR4 type=write size=154080 2024-09-14T11:20:57.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.442+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=VSZBT1WFINK4 type=del 2024-09-14T11:20:57.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.444+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~JT9DONZIR1KT.0 size=1048576 2024-09-14T11:20:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.445+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~JT9DONZIR1KT.1 size=749662 2024-09-14T11:20:57.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.445+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=JT9DONZIR1KT tag=29FCVLMG96FZ type=write size=2846814 2024-09-14T11:20:57.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.446+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.0 size=1048576 2024-09-14T11:20:57.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.446+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.1 size=1048576 2024-09-14T11:20:57.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.447+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~ICPM8FH91HVK.2 size=938971 2024-09-14T11:20:57.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.449+0000 7fc354693780 1 < canceled multipart upload key=BKW08T86L2ZF upload=ICPM8FH91HVK tag=CPVZ65X1N7QY type=write size=4084699 2024-09-14T11:20:57.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.451+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~4F3A7DE1Q4KC.0 size=1048576 2024-09-14T11:20:57.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.452+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~4F3A7DE1Q4KC.1 size=419724 2024-09-14T11:20:57.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.452+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=4F3A7DE1Q4KC tag=401HLK3C01OL type=write size=2516876 2024-09-14T11:20:57.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.453+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=W43FWHVLXYD7 type=del 2024-09-14T11:20:57.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.454+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=IH207P0BTLW0 type=del size=3747070 2024-09-14T11:20:57.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.455+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=UOWU2GIV6T4T type=del 2024-09-14T11:20:57.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.457+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=16VGZAMCXQ52 type=del size=2672458 2024-09-14T11:20:57.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.458+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~CDM2S3RCP7GP.0 size=1048576 2024-09-14T11:20:57.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.459+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~CDM2S3RCP7GP.1 size=494041 2024-09-14T11:20:57.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.461+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=CDM2S3RCP7GP tag=LS58UEN8VS9S type=write size=2591193 2024-09-14T11:20:57.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.463+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~J1CY1F5DIMR2.0 size=1048576 2024-09-14T11:20:57.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.464+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~J1CY1F5DIMR2.1 size=922643 2024-09-14T11:20:57.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.464+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=J1CY1F5DIMR2 tag=70IEGN9CNE25 type=write size=3019795 2024-09-14T11:20:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.465+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.0 size=1048576 2024-09-14T11:20:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.466+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.1 size=1048576 2024-09-14T11:20:57.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.466+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~D5P6X7SZCK8J.2 size=520454 2024-09-14T11:20:57.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.468+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=D5P6X7SZCK8J tag=65CLNODMI46W type=write size=3666182 2024-09-14T11:20:57.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.469+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=DDDRED8JPWDY type=del size=1218030 2024-09-14T11:20:57.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.472+0000 7fc354693780 1 < suggested remove operation key=6SIWH1BHPFGM tag=SYZJEYZD70DN type=del 2024-09-14T11:20:57.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.473+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~V5YFQJWE23GW.0 size=553418 2024-09-14T11:20:57.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.473+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=V5YFQJWE23GW tag=O4Z1P1EFGND1 type=write size=1601994 2024-09-14T11:20:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.475+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~107XRTY7OYNO.0 size=904931 2024-09-14T11:20:57.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.476+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=107XRTY7OYNO tag=NQB2YQN6E4XY type=write size=1953507 2024-09-14T11:20:57.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.478+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XXT1RA4V92QV.0 size=1048576 2024-09-14T11:20:57.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.479+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XXT1RA4V92QV.1 size=962816 2024-09-14T11:20:57.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.479+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=XXT1RA4V92QV tag=99NJZPB5FZW9 type=write size=3059968 2024-09-14T11:20:57.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.480+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~VEKB8WU3IUOK.0 size=1048576 2024-09-14T11:20:57.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.481+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~VEKB8WU3IUOK.1 size=326128 2024-09-14T11:20:57.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.483+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=VEKB8WU3IUOK tag=BWX30ARGS63N type=write size=2423280 2024-09-14T11:20:57.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.484+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=ANEHXQKF4LMS type=del size=1866515 2024-09-14T11:20:57.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.485+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~381VDF2WD75B.0 size=1048576 2024-09-14T11:20:57.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.486+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~381VDF2WD75B.1 size=498696 2024-09-14T11:20:57.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.488+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=381VDF2WD75B tag=RDWV942XPW7W type=write size=2595848 2024-09-14T11:20:57.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.489+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=5NHPC4SQ9QBY type=del size=3711811 2024-09-14T11:20:57.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.490+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=843E6JTI425Z type=del 2024-09-14T11:20:57.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.491+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=DW7TQ6IKPRE2 type=del size=2866011 2024-09-14T11:20:57.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.492+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=W6X8LP3EE7FJ type=del 2024-09-14T11:20:57.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.493+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=R182A113L9PP type=del size=932661 2024-09-14T11:20:57.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.494+0000 7fc354693780 -1 < failed to complete operation key=ICNEXZMA3VQV tag=F2JFXIPT3NWJ type=del size=3628337: (22) Invalid argument 2024-09-14T11:20:57.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.496+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=4WCE9GVUG5RQ type=write size=522635 2024-09-14T11:20:57.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.499+0000 7fc354693780 1 < suggested update operation key=AUL8F0SZVZX2 tag=8JA3YN0VSQIB type=del size=1808317 2024-09-14T11:20:57.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.501+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.0 size=1048576 2024-09-14T11:20:57.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.502+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.1 size=1048576 2024-09-14T11:20:57.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.503+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.2 size=667824 2024-09-14T11:20:57.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.503+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=LNZ17Q5TC7DU tag=Z3Q9K3G9P92R type=write size=3813552 2024-09-14T11:20:57.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.505+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=013TERBUIS7H type=del 2024-09-14T11:20:57.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.507+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~8R4OQZ9ZRVNG.0 size=1048576 2024-09-14T11:20:57.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.508+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~8R4OQZ9ZRVNG.1 size=910207 2024-09-14T11:20:57.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.508+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=8R4OQZ9ZRVNG tag=Z2ZAGKLG5BKF type=write size=3007359 2024-09-14T11:20:57.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.510+0000 7fc354693780 1 < suggested remove operation key=H1S2CBHNW6GI tag=4NF7FR19HIR4 type=write 2024-09-14T11:20:57.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.511+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=7NK9ACIAO4DF type=del size=1763185 2024-09-14T11:20:57.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.513+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~JT9DONZIR1KT.0 size=1048576 2024-09-14T11:20:57.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.514+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~JT9DONZIR1KT.1 size=749662 2024-09-14T11:20:57.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.516+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=JT9DONZIR1KT tag=29FCVLMG96FZ type=write size=2846814 2024-09-14T11:20:57.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.517+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=WBPS5Y4W8S2A type=del size=86122 2024-09-14T11:20:57.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.518+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~4F3A7DE1Q4KC.0 size=1048576 2024-09-14T11:20:57.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.518+0000 7fc354693780 1 < canceled part key=_multipart_BTET4HD5NY0D.2~4F3A7DE1Q4KC.1 size=419724 2024-09-14T11:20:57.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.520+0000 7fc354693780 1 < canceled multipart upload key=BTET4HD5NY0D upload=4F3A7DE1Q4KC tag=401HLK3C01OL type=write size=2516876 2024-09-14T11:20:57.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.521+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=4VXZFXSY299H type=write size=455177 2024-09-14T11:20:57.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.522+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=IH207P0BTLW0 type=del 2024-09-14T11:20:57.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.524+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=XE7G4FJQ6II9 type=write size=406804 2024-09-14T11:20:57.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.525+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=16VGZAMCXQ52 type=del 2024-09-14T11:20:57.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.526+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=8XF4D0420YE7 type=write size=1038687 2024-09-14T11:20:57.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.527+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~J1CY1F5DIMR2.0 size=1048576 2024-09-14T11:20:57.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.528+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~J1CY1F5DIMR2.1 size=922643 2024-09-14T11:20:57.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.530+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=J1CY1F5DIMR2 tag=70IEGN9CNE25 type=write size=3019795 2024-09-14T11:20:57.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.531+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=O23O1UJ1R4KF type=del size=3790461 2024-09-14T11:20:57.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.532+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=DDDRED8JPWDY type=del size=1218030 2024-09-14T11:20:57.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.534+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~9MRB7VX0NPM6.0 size=1048576 2024-09-14T11:20:57.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.535+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~9MRB7VX0NPM6.1 size=62621 2024-09-14T11:20:57.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.535+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=9MRB7VX0NPM6 tag=E3F6F8FMV6UW type=write size=2159773 2024-09-14T11:20:57.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.536+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~V5YFQJWE23GW.0 size=553418 2024-09-14T11:20:57.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.538+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=V5YFQJWE23GW tag=O4Z1P1EFGND1 type=write size=1601994 2024-09-14T11:20:57.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.539+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=NYVP00ZHJIAH type=write size=314654 2024-09-14T11:20:57.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.540+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XXT1RA4V92QV.0 size=1048576 2024-09-14T11:20:57.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.541+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XXT1RA4V92QV.1 size=962816 2024-09-14T11:20:57.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.543+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=XXT1RA4V92QV tag=99NJZPB5FZW9 type=write size=3059968 2024-09-14T11:20:57.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.544+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=CKKSST8812TR type=del size=2829645 2024-09-14T11:20:57.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.545+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=ANEHXQKF4LMS type=del 2024-09-14T11:20:57.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.547+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~I7V9CJE8DPO4.0 size=439713 2024-09-14T11:20:57.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.547+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=I7V9CJE8DPO4 tag=D3DPNB5JG1MM type=write size=1488289 2024-09-14T11:20:57.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.548+0000 7fc354693780 1 < canceled operation key=WYD70VR8OKAN tag=5NHPC4SQ9QBY type=del size=3711811 2024-09-14T11:20:57.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.549+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=I11A2EDIEF80 type=del size=500858 2024-09-14T11:20:57.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.550+0000 7fc354693780 1 < canceled operation key=T0Z8NK20DS5K tag=DW7TQ6IKPRE2 type=del size=2866011 2024-09-14T11:20:57.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.551+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=QP344C6HPA3H type=del size=2016776 2024-09-14T11:20:57.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.552+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=R182A113L9PP type=del 2024-09-14T11:20:57.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.554+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.0 size=1048576 2024-09-14T11:20:57.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.555+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.1 size=1048576 2024-09-14T11:20:57.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.556+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.2 size=133735 2024-09-14T11:20:57.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.556+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=Q1VVQAD2B7IN tag=ZX06Z502JCRZ type=write size=3279463 2024-09-14T11:20:57.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.557+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=4WCE9GVUG5RQ type=write size=522635 2024-09-14T11:20:57.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.559+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~L9O9W4RHLBVA.0 size=837056 2024-09-14T11:20:57.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.559+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=L9O9W4RHLBVA tag=4BG6KTFBCK74 type=write size=1885632 2024-09-14T11:20:57.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.560+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.0 size=1048576 2024-09-14T11:20:57.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.560+0000 7fc354693780 1 < canceled part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.1 size=1048576 2024-09-14T11:20:57.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.561+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~LNZ17Q5TC7DU.2 size=667824 2024-09-14T11:20:57.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.563+0000 7fc354693780 1 < canceled multipart upload key=TFTKNNCGN88D upload=LNZ17Q5TC7DU tag=Z3Q9K3G9P92R type=write size=3813552 2024-09-14T11:20:57.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.564+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=TPFD9WXVAPI2 type=del size=3260647 2024-09-14T11:20:57.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.565+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~8R4OQZ9ZRVNG.0 size=1048576 2024-09-14T11:20:57.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.566+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~8R4OQZ9ZRVNG.1 size=910207 2024-09-14T11:20:57.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.568+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=8R4OQZ9ZRVNG tag=Z2ZAGKLG5BKF type=write size=3007359 2024-09-14T11:20:57.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.569+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=F2ZT8HODUKIV type=del size=2623475 2024-09-14T11:20:57.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.570+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=7NK9ACIAO4DF type=del 2024-09-14T11:20:57.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.571+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=6RBJV24ZIJ7W type=del size=3598836 2024-09-14T11:20:57.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.572+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=WBPS5Y4W8S2A type=del 2024-09-14T11:20:57.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.574+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~W9T1NU86GCN4.0 size=976751 2024-09-14T11:20:57.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.574+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=W9T1NU86GCN4 tag=W1HYWL0KFF89 type=write size=2025327 2024-09-14T11:20:57.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.575+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=4VXZFXSY299H type=write size=455177 2024-09-14T11:20:57.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.577+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~GIHS65LF89JL.0 size=1048576 2024-09-14T11:20:57.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.578+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~GIHS65LF89JL.1 size=457256 2024-09-14T11:20:57.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.578+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=GIHS65LF89JL tag=8DDQA81TX1DJ type=write size=2554408 2024-09-14T11:20:57.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.579+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=XE7G4FJQ6II9 type=write size=406804 2024-09-14T11:20:57.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.580+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=VEB9E68D3TQ9 type=del size=3179536 2024-09-14T11:20:57.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.581+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=8XF4D0420YE7 type=write size=1038687 2024-09-14T11:20:57.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.583+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=312HCRXOJUNZ type=del size=1913110 2024-09-14T11:20:57.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.584+0000 7fc354693780 1 < canceled operation key=N23XJJD7YYG0 tag=O23O1UJ1R4KF type=del size=3790461 2024-09-14T11:20:57.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.585+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=HDQSE81369LE type=del size=3392667 2024-09-14T11:20:57.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.586+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~9MRB7VX0NPM6.0 size=1048576 2024-09-14T11:20:57.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.587+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~9MRB7VX0NPM6.1 size=62621 2024-09-14T11:20:57.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.589+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=9MRB7VX0NPM6 tag=E3F6F8FMV6UW type=write size=2159773 2024-09-14T11:20:57.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.591+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.0 size=1048576 2024-09-14T11:20:57.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.591+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.1 size=1048576 2024-09-14T11:20:57.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.592+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.2 size=809751 2024-09-14T11:20:57.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.592+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=USA0VQ7QNK98 tag=R3LA2DBFKEKJ type=write size=3955479 2024-09-14T11:20:57.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.593+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=NYVP00ZHJIAH type=write size=314654 2024-09-14T11:20:57.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.596+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.0 size=1048576 2024-09-14T11:20:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.597+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.1 size=1048576 2024-09-14T11:20:57.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.597+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.2 size=1047291 2024-09-14T11:20:57.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.597+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=MNR1ML1WZZAX tag=3BE0EC1JQJZE type=write size=4193019 2024-09-14T11:20:57.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.599+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=CKKSST8812TR type=del size=2829645 2024-09-14T11:20:57.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.600+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=EGA33QSAAAJM type=del size=3471352 2024-09-14T11:20:57.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.601+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~I7V9CJE8DPO4.0 size=439713 2024-09-14T11:20:57.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.604+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=I7V9CJE8DPO4 tag=D3DPNB5JG1MM type=write size=1488289 2024-09-14T11:20:57.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.606+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~R1C75JBWDBL2.0 size=1048576 2024-09-14T11:20:57.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.607+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~R1C75JBWDBL2.1 size=592948 2024-09-14T11:20:57.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.607+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=R1C75JBWDBL2 tag=MRRP09LBJ6Q8 type=write size=2690100 2024-09-14T11:20:57.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.608+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=I11A2EDIEF80 type=del 2024-09-14T11:20:57.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.609+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=AWVC4R3QL3CP type=write size=304594 2024-09-14T11:20:57.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.611+0000 7fc354693780 1 < suggested update operation key=BTET4HD5NY0D tag=QP344C6HPA3H type=del size=2016776 2024-09-14T11:20:57.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.613+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~DYOOPFDTKA3Y.0 size=1048576 2024-09-14T11:20:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.614+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~DYOOPFDTKA3Y.1 size=466802 2024-09-14T11:20:57.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.614+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=DYOOPFDTKA3Y tag=1GX17T807ON5 type=write size=2563954 2024-09-14T11:20:57.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.615+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.0 size=1048576 2024-09-14T11:20:57.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.616+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.1 size=1048576 2024-09-14T11:20:57.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.617+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~Q1VVQAD2B7IN.2 size=133735 2024-09-14T11:20:57.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.619+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=Q1VVQAD2B7IN tag=ZX06Z502JCRZ type=write size=3279463 2024-09-14T11:20:57.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.620+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=9ZQNMA1JSC8C type=del size=2894293 2024-09-14T11:20:57.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.621+0000 7fc354693780 1 < canceled part key=_multipart_N23XJJD7YYG0.2~L9O9W4RHLBVA.0 size=837056 2024-09-14T11:20:57.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.622+0000 7fc354693780 1 < canceled multipart upload key=N23XJJD7YYG0 upload=L9O9W4RHLBVA tag=4BG6KTFBCK74 type=write size=1885632 2024-09-14T11:20:57.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.623+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=GGEOWQ1VISXY type=write size=804046 2024-09-14T11:20:57.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.625+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=TPFD9WXVAPI2 type=del 2024-09-14T11:20:57.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.626+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=LY8GOV39TPU2 type=del size=991180 2024-09-14T11:20:57.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.627+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=F2ZT8HODUKIV type=del 2024-09-14T11:20:57.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.628+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=VHRARBB9G0DB type=del size=208790 2024-09-14T11:20:57.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.629+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=6RBJV24ZIJ7W type=del size=3598836 2024-09-14T11:20:57.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.631+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~IU0TOQEFNSGD.0 size=1048576 2024-09-14T11:20:57.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.632+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~IU0TOQEFNSGD.1 size=873906 2024-09-14T11:20:57.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.632+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=IU0TOQEFNSGD tag=RU9BFSQDFO56 type=write size=2971058 2024-09-14T11:20:57.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.633+0000 7fc354693780 1 < canceled part key=_multipart_GE83T07IQG0S.2~W9T1NU86GCN4.0 size=976751 2024-09-14T11:20:57.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.634+0000 7fc354693780 1 < canceled multipart upload key=GE83T07IQG0S upload=W9T1NU86GCN4 tag=W1HYWL0KFF89 type=write size=2025327 2024-09-14T11:20:57.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.636+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=MNR7VLSH76RT type=del size=1485712 2024-09-14T11:20:57.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.637+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~GIHS65LF89JL.0 size=1048576 2024-09-14T11:20:57.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.638+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~GIHS65LF89JL.1 size=457256 2024-09-14T11:20:57.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.640+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=GIHS65LF89JL tag=8DDQA81TX1DJ type=write size=2554408 2024-09-14T11:20:57.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.642+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.0 size=1048576 2024-09-14T11:20:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.643+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.1 size=1048576 2024-09-14T11:20:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.643+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.2 size=724516 2024-09-14T11:20:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.643+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=4FDTDU06B1MJ tag=J3UOP5W72HOW type=write size=3870244 2024-09-14T11:20:57.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.646+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=VEB9E68D3TQ9 type=del size=3179536 2024-09-14T11:20:57.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.647+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=3NDWOGEIWVTZ type=write size=812591 2024-09-14T11:20:57.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.648+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=312HCRXOJUNZ type=del 2024-09-14T11:20:57.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.649+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=BAM6FVIAWW77 type=del size=432811 2024-09-14T11:20:57.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.651+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=HDQSE81369LE type=del 2024-09-14T11:20:57.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.652+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=610IALTLNIAP type=del size=107709 2024-09-14T11:20:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.653+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.0 size=1048576 2024-09-14T11:20:57.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.654+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.1 size=1048576 2024-09-14T11:20:57.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.655+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~USA0VQ7QNK98.2 size=809751 2024-09-14T11:20:57.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.657+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=USA0VQ7QNK98 tag=R3LA2DBFKEKJ type=write size=3955479 2024-09-14T11:20:57.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.659+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~5L2E69K7MD59.0 size=9883 2024-09-14T11:20:57.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.659+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=5L2E69K7MD59 tag=H3PYIRG1VXAU type=write size=1058459 2024-09-14T11:20:57.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.659+0000 7fc354693780 1 < canceled part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.0 size=1048576 2024-09-14T11:20:57.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.660+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.1 size=1048576 2024-09-14T11:20:57.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.661+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~MNR1ML1WZZAX.2 size=1047291 2024-09-14T11:20:57.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.663+0000 7fc354693780 1 < canceled multipart upload key=WBT3M1NMEEAY upload=MNR1ML1WZZAX tag=3BE0EC1JQJZE type=write size=4193019 2024-09-14T11:20:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.665+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.0 size=1048576 2024-09-14T11:20:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.666+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.1 size=1048576 2024-09-14T11:20:57.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.667+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.2 size=90354 2024-09-14T11:20:57.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.667+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=08DIKWHUV7M5 tag=KAVH0QYM2ZC2 type=write size=3236082 2024-09-14T11:20:57.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.668+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=EGA33QSAAAJM type=del 2024-09-14T11:20:57.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.670+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~O4MBTBUUZZUB.0 size=1048576 2024-09-14T11:20:57.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.671+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~O4MBTBUUZZUB.1 size=565579 2024-09-14T11:20:57.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.671+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=O4MBTBUUZZUB tag=0HAVB2SVCD8W type=write size=2662731 2024-09-14T11:20:57.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.672+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~R1C75JBWDBL2.0 size=1048576 2024-09-14T11:20:57.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.673+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~R1C75JBWDBL2.1 size=592948 2024-09-14T11:20:57.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.675+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=R1C75JBWDBL2 tag=MRRP09LBJ6Q8 type=write size=2690100 2024-09-14T11:20:57.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.677+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~6OCASG077AN2.0 size=1048576 2024-09-14T11:20:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.678+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~6OCASG077AN2.1 size=50194 2024-09-14T11:20:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.678+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=6OCASG077AN2 tag=2S5PKAQXU3J9 type=write size=2147346 2024-09-14T11:20:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.679+0000 7fc354693780 1 < completed write operation key=4IDBIAE3VAY4 tag=AWVC4R3QL3CP type=write size=304594 2024-09-14T11:20:57.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.680+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=KJEJOGHQK3IX type=write size=760950 2024-09-14T11:20:57.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.682+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~DYOOPFDTKA3Y.0 size=1048576 2024-09-14T11:20:57.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.683+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~DYOOPFDTKA3Y.1 size=466802 2024-09-14T11:20:57.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.684+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=DYOOPFDTKA3Y tag=1GX17T807ON5 type=write size=2563954 2024-09-14T11:20:57.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.686+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.0 size=1048576 2024-09-14T11:20:57.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.687+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.1 size=1048576 2024-09-14T11:20:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.688+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.2 size=702725 2024-09-14T11:20:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.688+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=EUNQEJS14LFA tag=H0XGGTPI8Q99 type=write size=3848453 2024-09-14T11:20:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.689+0000 7fc354693780 1 < canceled operation key=H1S2CBHNW6GI tag=9ZQNMA1JSC8C type=del size=2894293 2024-09-14T11:20:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.691+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=O9P0F5P2AE5K type=del size=3653450 2024-09-14T11:20:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.693+0000 7fc354693780 1 < suggested update operation key=GE83T07IQG0S tag=GGEOWQ1VISXY type=write size=804046 2024-09-14T11:20:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.694+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=0027TK2YJO6X type=write size=1047002 2024-09-14T11:20:57.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.696+0000 7fc354693780 1 < suggested remove operation key=OOFM3K1KEB9V tag=LY8GOV39TPU2 type=del 2024-09-14T11:20:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.698+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~K4WFXPWEX5XH.0 size=825259 2024-09-14T11:20:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.698+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=K4WFXPWEX5XH tag=UBIY6CKVJ7IH type=write size=1873835 2024-09-14T11:20:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.699+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=VHRARBB9G0DB type=del 2024-09-14T11:20:57.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.700+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=ETDF6XJ5RUH4 type=del size=3345119 2024-09-14T11:20:57.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.701+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~IU0TOQEFNSGD.0 size=1048576 2024-09-14T11:20:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.702+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~IU0TOQEFNSGD.1 size=873906 2024-09-14T11:20:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.703+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=IU0TOQEFNSGD tag=RU9BFSQDFO56 type=write size=2971058 2024-09-14T11:20:57.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.705+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=T3T576RG3MVK type=write size=780416 2024-09-14T11:20:57.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.706+0000 7fc354693780 1 < canceled operation key=WBT3M1NMEEAY tag=MNR7VLSH76RT type=del size=1485712 2024-09-14T11:20:57.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.708+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.0 size=1048576 2024-09-14T11:20:57.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.710+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.1 size=1048576 2024-09-14T11:20:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.711+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.2 size=888282 2024-09-14T11:20:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.711+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=X4ESE66C289R tag=J4X4XVVKO903 type=write size=4034010 2024-09-14T11:20:57.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.712+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.0 size=1048576 2024-09-14T11:20:57.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.712+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.1 size=1048576 2024-09-14T11:20:57.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.713+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4FDTDU06B1MJ.2 size=724516 2024-09-14T11:20:57.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.715+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=4FDTDU06B1MJ tag=J3UOP5W72HOW type=write size=3870244 2024-09-14T11:20:57.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.716+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=M6LCBU2O3RUI type=del size=2035199 2024-09-14T11:20:57.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.718+0000 7fc354693780 1 < completed write operation key=IGZK9BWJFCV3 tag=3NDWOGEIWVTZ type=write size=812591 2024-09-14T11:20:57.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.719+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=PK0TA3VADOPY type=write size=390024 2024-09-14T11:20:57.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.720+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=BAM6FVIAWW77 type=del 2024-09-14T11:20:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.722+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~LTI5EY5EVYKX.0 size=213404 2024-09-14T11:20:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.722+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=LTI5EY5EVYKX tag=G4LVZ8IZ3HTS type=write size=1261980 2024-09-14T11:20:57.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.723+0000 7fc354693780 1 < canceled operation key=IGZK9BWJFCV3 tag=610IALTLNIAP type=del size=107709 2024-09-14T11:20:57.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.726+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.0 size=1048576 2024-09-14T11:20:57.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.726+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.1 size=1048576 2024-09-14T11:20:57.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.727+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.2 size=993666 2024-09-14T11:20:57.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.727+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=8VP1VKYHA36A tag=BS42QI8JFQX8 type=write size=4139394 2024-09-14T11:20:57.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.729+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~5L2E69K7MD59.0 size=9883 2024-09-14T11:20:57.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.730+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=5L2E69K7MD59 tag=H3PYIRG1VXAU type=write size=1058459 2024-09-14T11:20:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.733+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~DUQP45XQ72RC.0 size=437267 2024-09-14T11:20:57.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.733+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=DUQP45XQ72RC tag=P331WSWO615B type=write size=1485843 2024-09-14T11:20:57.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.734+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.0 size=1048576 2024-09-14T11:20:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.735+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.1 size=1048576 2024-09-14T11:20:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.736+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~08DIKWHUV7M5.2 size=90354 2024-09-14T11:20:57.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.737+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=08DIKWHUV7M5 tag=KAVH0QYM2ZC2 type=write size=3236082 2024-09-14T11:20:57.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.739+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=U00POXJ22WX8 type=del size=3855724 2024-09-14T11:20:57.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.739+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~O4MBTBUUZZUB.0 size=1048576 2024-09-14T11:20:57.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.739+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~O4MBTBUUZZUB.1 size=565579 2024-09-14T11:20:57.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.741+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=O4MBTBUUZZUB tag=0HAVB2SVCD8W type=write size=2662731 2024-09-14T11:20:57.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.743+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~N8MOZR877TE0.0 size=1048576 2024-09-14T11:20:57.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.744+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~N8MOZR877TE0.1 size=414083 2024-09-14T11:20:57.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.744+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=N8MOZR877TE0 tag=BOKA5ZRKB8LH type=write size=2511235 2024-09-14T11:20:57.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.745+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~6OCASG077AN2.0 size=1048576 2024-09-14T11:20:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.746+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~6OCASG077AN2.1 size=50194 2024-09-14T11:20:57.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.748+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=6OCASG077AN2 tag=2S5PKAQXU3J9 type=write size=2147346 2024-09-14T11:20:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.749+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=DJVK5A1JLY2F type=del size=2928880 2024-09-14T11:20:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.751+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=KJEJOGHQK3IX type=write size=760950 2024-09-14T11:20:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.752+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=NOOR3BKOCMDS type=del size=2685748 2024-09-14T11:20:57.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.752+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.0 size=1048576 2024-09-14T11:20:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.753+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.1 size=1048576 2024-09-14T11:20:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.754+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~EUNQEJS14LFA.2 size=702725 2024-09-14T11:20:57.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.756+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=EUNQEJS14LFA tag=H0XGGTPI8Q99 type=write size=3848453 2024-09-14T11:20:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.757+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=T2SET65IF0VR type=del size=395990 2024-09-14T11:20:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.759+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=O9P0F5P2AE5K type=del 2024-09-14T11:20:57.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.761+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~Y1HSLWXT6WWJ.0 size=1048576 2024-09-14T11:20:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.762+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~Y1HSLWXT6WWJ.1 size=376750 2024-09-14T11:20:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.762+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=Y1HSLWXT6WWJ tag=OG57KUUREGES type=write size=2473902 2024-09-14T11:20:57.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.763+0000 7fc354693780 1 < completed write operation key=T0Z8NK20DS5K tag=0027TK2YJO6X type=write size=1047002 2024-09-14T11:20:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.765+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.0 size=1048576 2024-09-14T11:20:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.766+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.1 size=1048576 2024-09-14T11:20:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.767+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.2 size=277004 2024-09-14T11:20:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.767+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=CX54XM2OB6R3 tag=ZAYOXVU1J60Z type=write size=3422732 2024-09-14T11:20:57.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.768+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~K4WFXPWEX5XH.0 size=825259 2024-09-14T11:20:57.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.770+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=K4WFXPWEX5XH tag=UBIY6CKVJ7IH type=write size=1873835 2024-09-14T11:20:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.771+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=G10Y5CZET7ML type=del size=3666484 2024-09-14T11:20:57.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.774+0000 7fc354693780 1 < suggested remove operation key=IJZB38U355GG tag=ETDF6XJ5RUH4 type=del 2024-09-14T11:20:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.776+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.0 size=1048576 2024-09-14T11:20:57.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.777+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.1 size=1048576 2024-09-14T11:20:57.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.778+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.2 size=371079 2024-09-14T11:20:57.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.778+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=K23DUVE0VMCW tag=Y3IHQQPURKTQ type=write size=3516807 2024-09-14T11:20:57.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.779+0000 7fc354693780 1 < completed write operation key=JGVLT0K0CEGQ tag=T3T576RG3MVK type=write size=780416 2024-09-14T11:20:57.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.781+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~MFXOWY1G19NU.0 size=1048576 2024-09-14T11:20:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.782+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~MFXOWY1G19NU.1 size=50082 2024-09-14T11:20:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.782+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=MFXOWY1G19NU tag=U22S2RTUXM4V type=write size=2147234 2024-09-14T11:20:57.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.783+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.0 size=1048576 2024-09-14T11:20:57.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.784+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.1 size=1048576 2024-09-14T11:20:57.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.785+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~X4ESE66C289R.2 size=888282 2024-09-14T11:20:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.787+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=X4ESE66C289R tag=J4X4XVVKO903 type=write size=4034010 2024-09-14T11:20:57.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.788+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=F30O6A7JBH81 type=del size=2131068 2024-09-14T11:20:57.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.789+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=M6LCBU2O3RUI type=del 2024-09-14T11:20:57.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.790+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=Z36TTZ7BJL6W type=write size=406302 2024-09-14T11:20:57.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.791+0000 7fc354693780 1 < completed write operation key=JGVLT0K0CEGQ tag=PK0TA3VADOPY type=write size=390024 2024-09-14T11:20:57.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.793+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8S6S5NS4I0T0.0 size=1048576 2024-09-14T11:20:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.794+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8S6S5NS4I0T0.1 size=618161 2024-09-14T11:20:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.794+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=8S6S5NS4I0T0 tag=9KP4KL8HUBDL type=write size=2715313 2024-09-14T11:20:57.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.795+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~LTI5EY5EVYKX.0 size=213404 2024-09-14T11:20:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.797+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=LTI5EY5EVYKX tag=G4LVZ8IZ3HTS type=write size=1261980 2024-09-14T11:20:57.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.798+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=W8JY9M4FTPXG type=write size=104108 2024-09-14T11:20:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.799+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.0 size=1048576 2024-09-14T11:20:57.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.800+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.1 size=1048576 2024-09-14T11:20:57.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.801+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~8VP1VKYHA36A.2 size=993666 2024-09-14T11:20:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.803+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=8VP1VKYHA36A tag=BS42QI8JFQX8 type=write size=4139394 2024-09-14T11:20:57.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.804+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=E02ZMOLK13NC type=del size=3396051 2024-09-14T11:20:57.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.805+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~DUQP45XQ72RC.0 size=437267 2024-09-14T11:20:57.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.807+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=DUQP45XQ72RC tag=P331WSWO615B type=write size=1485843 2024-09-14T11:20:57.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.809+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~8TTZBSZBK8FH.0 size=1048576 2024-09-14T11:20:57.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.810+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~8TTZBSZBK8FH.1 size=355370 2024-09-14T11:20:57.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.810+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=8TTZBSZBK8FH tag=9VTZHO1TQXQ4 type=write size=2452522 2024-09-14T11:20:57.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.812+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=U00POXJ22WX8 type=del 2024-09-14T11:20:57.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.813+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=YWZ7WTSTZWQX type=write size=1021067 2024-09-14T11:20:57.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.814+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~N8MOZR877TE0.0 size=1048576 2024-09-14T11:20:57.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.817+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~N8MOZR877TE0.1 size=414083 2024-09-14T11:20:57.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.819+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=N8MOZR877TE0 tag=BOKA5ZRKB8LH type=write size=2511235 2024-09-14T11:20:57.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.821+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~E7FYQEX227N0.0 size=1048576 2024-09-14T11:20:57.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.822+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~E7FYQEX227N0.1 size=28407 2024-09-14T11:20:57.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.822+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=E7FYQEX227N0 tag=RKAJIMLU2U1O type=write size=2125559 2024-09-14T11:20:57.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.823+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=DJVK5A1JLY2F type=del 2024-09-14T11:20:57.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.825+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~SN21GRT30D2B.0 size=147914 2024-09-14T11:20:57.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.825+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=SN21GRT30D2B tag=BMOEHA5JE3YP type=write size=1196490 2024-09-14T11:20:57.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.826+0000 7fc354693780 1 < canceled operation key=BJ7AARJEIT8W tag=NOOR3BKOCMDS type=del size=2685748 2024-09-14T11:20:57.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.827+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=M2L744QT72GF type=del size=109168 2024-09-14T11:20:57.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.829+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=T2SET65IF0VR type=del 2024-09-14T11:20:57.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.831+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~JZKVORJ5VG6N.0 size=1048576 2024-09-14T11:20:57.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.832+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~JZKVORJ5VG6N.1 size=555575 2024-09-14T11:20:57.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.832+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=JZKVORJ5VG6N tag=4WLP3WOJU0VQ type=write size=2652727 2024-09-14T11:20:57.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.833+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~Y1HSLWXT6WWJ.0 size=1048576 2024-09-14T11:20:57.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.834+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~Y1HSLWXT6WWJ.1 size=376750 2024-09-14T11:20:57.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.836+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=Y1HSLWXT6WWJ tag=OG57KUUREGES type=write size=2473902 2024-09-14T11:20:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.837+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=X95ACDF4SJSI type=del size=908133 2024-09-14T11:20:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.838+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.0 size=1048576 2024-09-14T11:20:57.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.839+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.1 size=1048576 2024-09-14T11:20:57.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.840+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~CX54XM2OB6R3.2 size=277004 2024-09-14T11:20:57.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.841+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=CX54XM2OB6R3 tag=ZAYOXVU1J60Z type=write size=3422732 2024-09-14T11:20:57.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.843+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.0 size=1048576 2024-09-14T11:20:57.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.844+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.1 size=1048576 2024-09-14T11:20:57.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.845+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.2 size=802119 2024-09-14T11:20:57.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.845+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=W1R85ZON81CG tag=1SE3YWKXAHU6 type=write size=3947847 2024-09-14T11:20:57.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.846+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=G10Y5CZET7ML type=del 2024-09-14T11:20:57.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.847+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=BYI1GG0V78CE type=del size=2919593 2024-09-14T11:20:57.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.848+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.0 size=1048576 2024-09-14T11:20:57.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.848+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.1 size=1048576 2024-09-14T11:20:57.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.849+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~K23DUVE0VMCW.2 size=371079 2024-09-14T11:20:57.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.851+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=K23DUVE0VMCW tag=Y3IHQQPURKTQ type=write size=3516807 2024-09-14T11:20:57.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.853+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.0 size=1048576 2024-09-14T11:20:57.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.854+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.1 size=1048576 2024-09-14T11:20:57.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.855+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.2 size=345064 2024-09-14T11:20:57.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.855+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=S12OSZHLAE46 tag=Z8S3ZMZY9HZK type=write size=3490792 2024-09-14T11:20:57.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.856+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~MFXOWY1G19NU.0 size=1048576 2024-09-14T11:20:57.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.857+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~MFXOWY1G19NU.1 size=50082 2024-09-14T11:20:57.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.859+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=MFXOWY1G19NU tag=U22S2RTUXM4V type=write size=2147234 2024-09-14T11:20:57.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.861+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~SYP19B7YMVI2.0 size=128620 2024-09-14T11:20:57.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.861+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=SYP19B7YMVI2 tag=N7XSTXDMKD2R type=write size=1177196 2024-09-14T11:20:57.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.862+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=F30O6A7JBH81 type=del 2024-09-14T11:20:57.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.864+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~X6VHQYJ49OIF.0 size=1048576 2024-09-14T11:20:57.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.865+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~X6VHQYJ49OIF.1 size=798657 2024-09-14T11:20:57.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.865+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=X6VHQYJ49OIF tag=U2MO7T3LB08A type=write size=2895809 2024-09-14T11:20:57.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.867+0000 7fc354693780 1 < suggested update operation key=4IDBIAE3VAY4 tag=Z36TTZ7BJL6W type=write size=406302 2024-09-14T11:20:57.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.868+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=RAN2RPIYZ7MV type=del size=904237 2024-09-14T11:20:57.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.870+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8S6S5NS4I0T0.0 size=1048576 2024-09-14T11:20:57.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.871+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8S6S5NS4I0T0.1 size=618161 2024-09-14T11:20:57.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.873+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=8S6S5NS4I0T0 tag=9KP4KL8HUBDL type=write size=2715313 2024-09-14T11:20:57.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.875+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~QQLORYSPXKAH.0 size=48899 2024-09-14T11:20:57.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.875+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=QQLORYSPXKAH tag=QOUCWMXVZG7V type=write size=1097475 2024-09-14T11:20:57.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.877+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=W8JY9M4FTPXG type=write size=104108 2024-09-14T11:20:57.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.878+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=IBQKP9EEI0FV type=del size=891546 2024-09-14T11:20:57.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.879+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=E02ZMOLK13NC type=del 2024-09-14T11:20:57.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.881+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=OSTKWMVKJBJX type=del size=2033327 2024-09-14T11:20:57.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.882+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~8TTZBSZBK8FH.0 size=1048576 2024-09-14T11:20:57.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.883+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~8TTZBSZBK8FH.1 size=355370 2024-09-14T11:20:57.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.885+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=8TTZBSZBK8FH tag=9VTZHO1TQXQ4 type=write size=2452522 2024-09-14T11:20:57.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.887+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.0 size=1048576 2024-09-14T11:20:57.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.888+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.1 size=1048576 2024-09-14T11:20:57.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.889+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.2 size=522144 2024-09-14T11:20:57.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.889+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=W2YF3P0RMSB4 tag=709WDSXF4KKA type=write size=3667872 2024-09-14T11:20:57.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.890+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=YWZ7WTSTZWQX type=write size=1021067 2024-09-14T11:20:57.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.892+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=TXW0E4OWEQRC type=del size=1104264 2024-09-14T11:20:57.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.893+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~E7FYQEX227N0.0 size=1048576 2024-09-14T11:20:57.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.894+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~E7FYQEX227N0.1 size=28407 2024-09-14T11:20:57.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.896+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=E7FYQEX227N0 tag=RKAJIMLU2U1O type=write size=2125559 2024-09-14T11:20:57.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.897+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=15H45DZOX02W type=del size=3405503 2024-09-14T11:20:57.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.898+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~SN21GRT30D2B.0 size=147914 2024-09-14T11:20:57.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.900+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=SN21GRT30D2B tag=BMOEHA5JE3YP type=write size=1196490 2024-09-14T11:20:57.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.901+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=ZE4XY1HJ98LD type=del size=3436587 2024-09-14T11:20:57.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.903+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=M2L744QT72GF type=del 2024-09-14T11:20:57.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.905+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~YQDE9SC7ARQ4.0 size=948467 2024-09-14T11:20:57.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.905+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=YQDE9SC7ARQ4 tag=F7RKM8BY4J67 type=write size=1997043 2024-09-14T11:20:57.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.906+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~JZKVORJ5VG6N.0 size=1048576 2024-09-14T11:20:57.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.907+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~JZKVORJ5VG6N.1 size=555575 2024-09-14T11:20:57.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.909+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=JZKVORJ5VG6N tag=4WLP3WOJU0VQ type=write size=2652727 2024-09-14T11:20:57.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.911+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~MH64LHYE8D1A.0 size=275760 2024-09-14T11:20:57.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.911+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=MH64LHYE8D1A tag=G41QPM5WTEW0 type=write size=1324336 2024-09-14T11:20:57.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.912+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=X95ACDF4SJSI type=del 2024-09-14T11:20:57.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.913+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=2I7EQGEH80Q8 type=write size=659529 2024-09-14T11:20:57.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.914+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.0 size=1048576 2024-09-14T11:20:57.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.915+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.1 size=1048576 2024-09-14T11:20:57.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.916+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~W1R85ZON81CG.2 size=802119 2024-09-14T11:20:57.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.918+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=W1R85ZON81CG tag=1SE3YWKXAHU6 type=write size=3947847 2024-09-14T11:20:57.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.919+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=GFD7IC9B4FCK type=del size=2535681 2024-09-14T11:20:57.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.920+0000 7fc354693780 -1 < failed to complete operation key=4IDBIAE3VAY4 tag=BYI1GG0V78CE type=del size=2919593: (22) Invalid argument 2024-09-14T11:20:57.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.923+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.0 size=1048576 2024-09-14T11:20:57.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.924+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.1 size=1048576 2024-09-14T11:20:57.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.925+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.2 size=726103 2024-09-14T11:20:57.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.925+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=E8PRFS8RKU22 tag=XMD4OU7Q4MK2 type=write size=3871831 2024-09-14T11:20:57.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.926+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.0 size=1048576 2024-09-14T11:20:57.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.927+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.1 size=1048576 2024-09-14T11:20:57.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.928+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~S12OSZHLAE46.2 size=345064 2024-09-14T11:20:57.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.930+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=S12OSZHLAE46 tag=Z8S3ZMZY9HZK type=write size=3490792 2024-09-14T11:20:57.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.931+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=VAZ2YHHUH2M1 type=del size=3230782 2024-09-14T11:20:57.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.932+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~SYP19B7YMVI2.0 size=128620 2024-09-14T11:20:57.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.934+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=SYP19B7YMVI2 tag=N7XSTXDMKD2R type=write size=1177196 2024-09-14T11:20:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.936+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~BVPTZ1T1V7XK.0 size=1048576 2024-09-14T11:20:57.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.937+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~BVPTZ1T1V7XK.1 size=532682 2024-09-14T11:20:57.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.937+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=BVPTZ1T1V7XK tag=ZKICYNHF7P0U type=write size=2629834 2024-09-14T11:20:57.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.938+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~X6VHQYJ49OIF.0 size=1048576 2024-09-14T11:20:57.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.939+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~X6VHQYJ49OIF.1 size=798657 2024-09-14T11:20:57.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.941+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=X6VHQYJ49OIF tag=U2MO7T3LB08A type=write size=2895809 2024-09-14T11:20:57.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.942+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=O9AX53LM2C77 type=del size=3421690 2024-09-14T11:20:57.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.944+0000 7fc354693780 1 < suggested remove operation key=WBT3M1NMEEAY tag=RAN2RPIYZ7MV type=del 2024-09-14T11:20:57.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.945+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=PNRS9Z4ZE77C type=del size=2750090 2024-09-14T11:20:57.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.946+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~QQLORYSPXKAH.0 size=48899 2024-09-14T11:20:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.948+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=QQLORYSPXKAH tag=QOUCWMXVZG7V type=write size=1097475 2024-09-14T11:20:57.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.949+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=T0RB8TYMNAV5 type=del size=2087986 2024-09-14T11:20:57.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.951+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=IBQKP9EEI0FV type=del 2024-09-14T11:20:57.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.952+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=NA02NQLCEL9Q type=del size=3760558 2024-09-14T11:20:57.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.953+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=OSTKWMVKJBJX type=del 2024-09-14T11:20:57.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.954+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=YONMTXLT9CYX type=del size=661451 2024-09-14T11:20:57.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.955+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.0 size=1048576 2024-09-14T11:20:57.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.956+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.1 size=1048576 2024-09-14T11:20:57.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.957+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~W2YF3P0RMSB4.2 size=522144 2024-09-14T11:20:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.959+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=W2YF3P0RMSB4 tag=709WDSXF4KKA type=write size=3667872 2024-09-14T11:20:57.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.960+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=XWLOHAD6CCQ7 type=del size=755248 2024-09-14T11:20:57.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.961+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=TXW0E4OWEQRC type=del 2024-09-14T11:20:57.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.962+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=0UUNLCLQL3PV type=write size=559690 2024-09-14T11:20:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.964+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=15H45DZOX02W type=del 2024-09-14T11:20:57.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.965+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=PJSRY7CH6EPY type=del size=2300910 2024-09-14T11:20:57.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.966+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=ZE4XY1HJ98LD type=del 2024-09-14T11:20:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.968+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~ZY12WNX77U2A.0 size=336684 2024-09-14T11:20:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.968+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=ZY12WNX77U2A tag=ZHA18FL16981 type=write size=1385260 2024-09-14T11:20:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.968+0000 7fc354693780 1 < canceled part key=_multipart_54EUIL28P2H1.2~YQDE9SC7ARQ4.0 size=948467 2024-09-14T11:20:57.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.970+0000 7fc354693780 1 < canceled multipart upload key=54EUIL28P2H1 upload=YQDE9SC7ARQ4 tag=F7RKM8BY4J67 type=write size=1997043 2024-09-14T11:20:57.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.971+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=EAPC4XNX0WAE type=write size=334737 2024-09-14T11:20:57.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.972+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~MH64LHYE8D1A.0 size=275760 2024-09-14T11:20:57.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.974+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=MH64LHYE8D1A tag=G41QPM5WTEW0 type=write size=1324336 2024-09-14T11:20:57.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.976+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~BP8N5BN6IIVL.0 size=1048576 2024-09-14T11:20:57.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.977+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~BP8N5BN6IIVL.1 size=742704 2024-09-14T11:20:57.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.977+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=BP8N5BN6IIVL tag=VKY0FJD9SVYJ type=write size=2839856 2024-09-14T11:20:57.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.978+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=2I7EQGEH80Q8 type=write size=659529 2024-09-14T11:20:57.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.979+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=NPK4LCZW462O type=del size=274204 2024-09-14T11:20:57.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.980+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=GFD7IC9B4FCK type=del 2024-09-14T11:20:57.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.982+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=CPPCEC95WCO8 type=del size=836809 2024-09-14T11:20:57.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.983+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.0 size=1048576 2024-09-14T11:20:57.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.984+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.1 size=1048576 2024-09-14T11:20:57.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.985+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~E8PRFS8RKU22.2 size=726103 2024-09-14T11:20:57.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.986+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=E8PRFS8RKU22 tag=XMD4OU7Q4MK2 type=write size=3871831 2024-09-14T11:20:57.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.988+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=DIFC8CHVKR74 type=del size=1808701 2024-09-14T11:20:57.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.989+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=VAZ2YHHUH2M1 type=del 2024-09-14T11:20:57.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.991+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~N03DR8V545V1.0 size=826446 2024-09-14T11:20:57.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.991+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=N03DR8V545V1 tag=2D334FVI0BIO type=write size=1875022 2024-09-14T11:20:57.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.992+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~BVPTZ1T1V7XK.0 size=1048576 2024-09-14T11:20:57.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.993+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~BVPTZ1T1V7XK.1 size=532682 2024-09-14T11:20:57.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.995+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=BVPTZ1T1V7XK tag=ZKICYNHF7P0U type=write size=2629834 2024-09-14T11:20:57.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.996+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=4AF1PELBMVYV type=del size=2386449 2024-09-14T11:20:57.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.997+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=O9AX53LM2C77 type=del size=3421690 2024-09-14T11:20:57.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:57.999+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.0 size=1048576 2024-09-14T11:20:57.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.000+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.1 size=1048576 2024-09-14T11:20:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.001+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.2 size=413401 2024-09-14T11:20:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.001+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=6511I4B78XNX tag=BXPK3Q6TG11F type=write size=3559129 2024-09-14T11:20:58.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.002+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=PNRS9Z4ZE77C type=del 2024-09-14T11:20:58.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.003+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=LFRJY974TAA2 type=del size=2163544 2024-09-14T11:20:58.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.004+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=T0RB8TYMNAV5 type=del 2024-09-14T11:20:58.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.006+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=LL06P3DMRTNA type=del size=2843457 2024-09-14T11:20:58.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.007+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=NA02NQLCEL9Q type=del 2024-09-14T11:20:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.008+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=66SFX6PZ42JN type=write size=161715 2024-09-14T11:20:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.009+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=YONMTXLT9CYX type=del 2024-09-14T11:20:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.010+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=YNKTIZ8DWXAT type=del size=1429315 2024-09-14T11:20:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.012+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=XWLOHAD6CCQ7 type=del 2024-09-14T11:20:58.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.013+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=ELPHIF2NJE7J type=del size=2084042 2024-09-14T11:20:58.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.014+0000 7fc354693780 1 < completed write operation key=WYD70VR8OKAN tag=0UUNLCLQL3PV type=write size=559690 2024-09-14T11:20:58.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.015+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=1DAUVQ6KRF2J type=del size=3086954 2024-09-14T11:20:58.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.016+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=PJSRY7CH6EPY type=del 2024-09-14T11:20:58.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.018+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=5ONRLL7M4LV5 type=write size=800972 2024-09-14T11:20:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.019+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~ZY12WNX77U2A.0 size=336684 2024-09-14T11:20:58.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.021+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=ZY12WNX77U2A tag=ZHA18FL16981 type=write size=1385260 2024-09-14T11:20:58.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.022+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=OHV5UZ9FV6MJ type=del size=212941 2024-09-14T11:20:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.023+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=EAPC4XNX0WAE type=write size=334737 2024-09-14T11:20:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.024+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=E74XHZ5G6V6Q type=del size=2432253 2024-09-14T11:20:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.025+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~BP8N5BN6IIVL.0 size=1048576 2024-09-14T11:20:58.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.026+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~BP8N5BN6IIVL.1 size=742704 2024-09-14T11:20:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.029+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=BP8N5BN6IIVL tag=VKY0FJD9SVYJ type=write size=2839856 2024-09-14T11:20:58.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.030+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=UFY5C82IFYA8 type=del size=422668 2024-09-14T11:20:58.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.032+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=NPK4LCZW462O type=del 2024-09-14T11:20:58.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.034+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.0 size=1048576 2024-09-14T11:20:58.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.034+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.1 size=1048576 2024-09-14T11:20:58.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.035+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.2 size=993914 2024-09-14T11:20:58.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.035+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=KQSZPPY35HGJ tag=QNVC687X12OL type=write size=4139642 2024-09-14T11:20:58.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.036+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=CPPCEC95WCO8 type=del 2024-09-14T11:20:58.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.037+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=3CN5XP6OTCFK type=del size=3166647 2024-09-14T11:20:58.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.039+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=DIFC8CHVKR74 type=del 2024-09-14T11:20:58.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.041+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=PA4DHWNW5E0J type=del size=3577658 2024-09-14T11:20:58.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.041+0000 7fc354693780 1 < canceled part key=_multipart_JF6PHF17N5WE.2~N03DR8V545V1.0 size=826446 2024-09-14T11:20:58.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.043+0000 7fc354693780 1 < canceled multipart upload key=JF6PHF17N5WE upload=N03DR8V545V1 tag=2D334FVI0BIO type=write size=1875022 2024-09-14T11:20:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.045+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.0 size=1048576 2024-09-14T11:20:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.045+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.1 size=1048576 2024-09-14T11:20:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.046+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.2 size=121868 2024-09-14T11:20:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.046+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=WYC5H629LKF9 tag=3KR5YAI36AYP type=write size=3267596 2024-09-14T11:20:58.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.047+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=4AF1PELBMVYV type=del size=2386449 2024-09-14T11:20:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.049+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.0 size=1048576 2024-09-14T11:20:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.050+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.1 size=1048576 2024-09-14T11:20:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.051+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.2 size=254721 2024-09-14T11:20:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.051+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=IL327I8W9NVS tag=ZM7LMPIOBCI5 type=write size=3400449 2024-09-14T11:20:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.052+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.0 size=1048576 2024-09-14T11:20:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.053+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.1 size=1048576 2024-09-14T11:20:58.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.054+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~6511I4B78XNX.2 size=413401 2024-09-14T11:20:58.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.056+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=6511I4B78XNX tag=BXPK3Q6TG11F type=write size=3559129 2024-09-14T11:20:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.058+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~45CEAULE0YWL.0 size=1048576 2024-09-14T11:20:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.059+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~45CEAULE0YWL.1 size=945435 2024-09-14T11:20:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.059+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=45CEAULE0YWL tag=PWVJ68SEUSF7 type=write size=3042587 2024-09-14T11:20:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.059+0000 7fc354693780 -1 < no bi entry to suggest for operation key=NENG5XNJ7M5Z tag=LFRJY974TAA2 type=del size=2163544: (2) No such file or directory 2024-09-14T11:20:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.061+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~E393APSU5HYP.0 size=1048576 2024-09-14T11:20:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.062+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~E393APSU5HYP.1 size=916418 2024-09-14T11:20:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.062+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=E393APSU5HYP tag=FI97EZW17E0H type=write size=3013570 2024-09-14T11:20:58.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.063+0000 7fc354693780 1 < canceled operation key=4IDBIAE3VAY4 tag=LL06P3DMRTNA type=del size=2843457 2024-09-14T11:20:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.064+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=U48TWXRGA89C type=del size=1384462 2024-09-14T11:20:58.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.066+0000 7fc354693780 1 < completed write operation key=4Z3KI5X3WQ0I tag=66SFX6PZ42JN type=write size=161715 2024-09-14T11:20:58.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.068+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.0 size=1048576 2024-09-14T11:20:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.069+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.1 size=1048576 2024-09-14T11:20:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.070+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.2 size=356772 2024-09-14T11:20:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.070+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=XG03QKDJK8E1 tag=P2RU0LXAIQ66 type=write size=3502500 2024-09-14T11:20:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.071+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=YNKTIZ8DWXAT type=del 2024-09-14T11:20:58.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.072+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=A51O2IS35KEF type=write size=689308 2024-09-14T11:20:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.073+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=ELPHIF2NJE7J type=del 2024-09-14T11:20:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.075+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~GZE9GUD71PF6.0 size=1048576 2024-09-14T11:20:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.077+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~GZE9GUD71PF6.1 size=640519 2024-09-14T11:20:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.077+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=GZE9GUD71PF6 tag=BD7NFHF5X4R3 type=write size=2737671 2024-09-14T11:20:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.078+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=1DAUVQ6KRF2J type=del 2024-09-14T11:20:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.079+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=4WB36TV415TI type=del size=979375 2024-09-14T11:20:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.080+0000 7fc354693780 1 < completed write operation key=TFTKNNCGN88D tag=5ONRLL7M4LV5 type=write size=800972 2024-09-14T11:20:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.081+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=IUH1SKEP7P9H type=del size=1584150 2024-09-14T11:20:58.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.083+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=OHV5UZ9FV6MJ type=del 2024-09-14T11:20:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.084+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=V9XGB3E40IVW type=write size=963533 2024-09-14T11:20:58.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.085+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=E74XHZ5G6V6Q type=del 2024-09-14T11:20:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.087+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.0 size=1048576 2024-09-14T11:20:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.088+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.1 size=1048576 2024-09-14T11:20:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.088+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.2 size=941347 2024-09-14T11:20:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.088+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=FCKQSSWGF7EU tag=OBYVWEP9CWCZ type=write size=4087075 2024-09-14T11:20:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.090+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=UFY5C82IFYA8 type=del 2024-09-14T11:20:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.091+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=Y7KN8770QWOM type=del size=2343234 2024-09-14T11:20:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.092+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.0 size=1048576 2024-09-14T11:20:58.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.093+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.1 size=1048576 2024-09-14T11:20:58.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.094+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~KQSZPPY35HGJ.2 size=993914 2024-09-14T11:20:58.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.096+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=KQSZPPY35HGJ tag=QNVC687X12OL type=write size=4139642 2024-09-14T11:20:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.097+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=P6FDNQZQ7VK8 type=del size=1104962 2024-09-14T11:20:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.098+0000 7fc354693780 1 < canceled operation key=IJZB38U355GG tag=3CN5XP6OTCFK type=del size=3166647 2024-09-14T11:20:58.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.100+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.0 size=1048576 2024-09-14T11:20:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.101+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.1 size=1048576 2024-09-14T11:20:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.102+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.2 size=709116 2024-09-14T11:20:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.102+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=PQ6SDC6KQIVD tag=BS2YMG3HPRH9 type=write size=3854844 2024-09-14T11:20:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.103+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=PA4DHWNW5E0J type=del 2024-09-14T11:20:58.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.105+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~5EJ8EY9R5LJG.0 size=164453 2024-09-14T11:20:58.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.105+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=5EJ8EY9R5LJG tag=1F0D2K1312RK type=write size=1213029 2024-09-14T11:20:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.106+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.0 size=1048576 2024-09-14T11:20:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.107+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.1 size=1048576 2024-09-14T11:20:58.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.108+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~WYC5H629LKF9.2 size=121868 2024-09-14T11:20:58.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.110+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=WYC5H629LKF9 tag=3KR5YAI36AYP type=write size=3267596 2024-09-14T11:20:58.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.111+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=BTTTV2SWQT56 type=del size=530961 2024-09-14T11:20:58.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.112+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.0 size=1048576 2024-09-14T11:20:58.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.113+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.1 size=1048576 2024-09-14T11:20:58.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.113+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~IL327I8W9NVS.2 size=254721 2024-09-14T11:20:58.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.115+0000 7fc354693780 1 < canceled multipart upload key=4Z3KI5X3WQ0I upload=IL327I8W9NVS tag=ZM7LMPIOBCI5 type=write size=3400449 2024-09-14T11:20:58.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.117+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~L2WG9M588FDC.0 size=969953 2024-09-14T11:20:58.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.117+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=L2WG9M588FDC tag=P92RCA769Y5W type=write size=2018529 2024-09-14T11:20:58.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.118+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~45CEAULE0YWL.0 size=1048576 2024-09-14T11:20:58.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.119+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~45CEAULE0YWL.1 size=945435 2024-09-14T11:20:58.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.121+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=45CEAULE0YWL tag=PWVJ68SEUSF7 type=write size=3042587 2024-09-14T11:20:58.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.122+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=LEK003CC59BF type=del size=1934981 2024-09-14T11:20:58.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.123+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~E393APSU5HYP.0 size=1048576 2024-09-14T11:20:58.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.124+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~E393APSU5HYP.1 size=916418 2024-09-14T11:20:58.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.126+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=E393APSU5HYP tag=FI97EZW17E0H type=write size=3013570 2024-09-14T11:20:58.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.128+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.0 size=1048576 2024-09-14T11:20:58.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.128+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.1 size=1048576 2024-09-14T11:20:58.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.129+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.2 size=72242 2024-09-14T11:20:58.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.129+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=3NMLLSC386WP tag=3Y8PTGNLK1Y5 type=write size=3217970 2024-09-14T11:20:58.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.131+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=U48TWXRGA89C type=del 2024-09-14T11:20:58.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.133+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~UP7I9POEH2M8.0 size=915294 2024-09-14T11:20:58.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.133+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=UP7I9POEH2M8 tag=B2VMZE8LYQ3R type=write size=1963870 2024-09-14T11:20:58.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.134+0000 7fc354693780 1 < canceled part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.0 size=1048576 2024-09-14T11:20:58.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.134+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.1 size=1048576 2024-09-14T11:20:58.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.135+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~XG03QKDJK8E1.2 size=356772 2024-09-14T11:20:58.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.137+0000 7fc354693780 1 < canceled multipart upload key=4IDBIAE3VAY4 upload=XG03QKDJK8E1 tag=P2RU0LXAIQ66 type=write size=3502500 2024-09-14T11:20:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.139+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~NXYTT9WOQP2X.0 size=616352 2024-09-14T11:20:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.139+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=NXYTT9WOQP2X tag=2P38XTHKNDII type=write size=1664928 2024-09-14T11:20:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.140+0000 7fc354693780 1 < completed write operation key=4Z3KI5X3WQ0I tag=A51O2IS35KEF type=write size=689308 2024-09-14T11:20:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.141+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=B9XV321KX45Y type=del size=3273072 2024-09-14T11:20:58.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.142+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~GZE9GUD71PF6.0 size=1048576 2024-09-14T11:20:58.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.143+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~GZE9GUD71PF6.1 size=640519 2024-09-14T11:20:58.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.145+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=GZE9GUD71PF6 tag=BD7NFHF5X4R3 type=write size=2737671 2024-09-14T11:20:58.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.146+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=JZBZUI58QMLS type=del size=3749972 2024-09-14T11:20:58.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.148+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=4WB36TV415TI type=del size=979375 2024-09-14T11:20:58.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.149+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=0P5ZTLYFYFBL type=del size=1954310 2024-09-14T11:20:58.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.151+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=IUH1SKEP7P9H type=del 2024-09-14T11:20:58.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.152+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.0 size=1048576 2024-09-14T11:20:58.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.153+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.1 size=1048576 2024-09-14T11:20:58.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.154+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.2 size=858908 2024-09-14T11:20:58.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.154+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=773G360SV67O tag=5OYHBZROLMX4 type=write size=4004636 2024-09-14T11:20:58.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.155+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=V9XGB3E40IVW type=write size=963533 2024-09-14T11:20:58.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.156+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=IQ6POH8MYAA0 type=write size=65569 2024-09-14T11:20:58.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.157+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.0 size=1048576 2024-09-14T11:20:58.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.157+0000 7fc354693780 1 < canceled part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.1 size=1048576 2024-09-14T11:20:58.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.159+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~FCKQSSWGF7EU.2 size=941347 2024-09-14T11:20:58.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.161+0000 7fc354693780 1 < canceled multipart upload key=54EUIL28P2H1 upload=FCKQSSWGF7EU tag=OBYVWEP9CWCZ type=write size=4087075 2024-09-14T11:20:58.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.163+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.0 size=1048576 2024-09-14T11:20:58.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.164+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.1 size=1048576 2024-09-14T11:20:58.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.165+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.2 size=810058 2024-09-14T11:20:58.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.165+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=O4JWIBOI0GUT tag=C4N897G4PNJA type=write size=3955786 2024-09-14T11:20:58.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.167+0000 7fc354693780 1 < suggested remove operation key=IJZB38U355GG tag=Y7KN8770QWOM type=del 2024-09-14T11:20:58.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.168+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=6DA7S6PQFUFS type=del size=3639261 2024-09-14T11:20:58.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.169+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=P6FDNQZQ7VK8 type=del 2024-09-14T11:20:58.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.170+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=2AW12V9OLNEW type=del size=1749397 2024-09-14T11:20:58.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.171+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.0 size=1048576 2024-09-14T11:20:58.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.172+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.1 size=1048576 2024-09-14T11:20:58.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.173+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~PQ6SDC6KQIVD.2 size=709116 2024-09-14T11:20:58.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.175+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=PQ6SDC6KQIVD tag=BS2YMG3HPRH9 type=write size=3854844 2024-09-14T11:20:58.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.176+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=L7VSNG64RF85 type=del size=916556 2024-09-14T11:20:58.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.177+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~5EJ8EY9R5LJG.0 size=164453 2024-09-14T11:20:58.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.179+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=5EJ8EY9R5LJG tag=1F0D2K1312RK type=write size=1213029 2024-09-14T11:20:58.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.181+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.0 size=1048576 2024-09-14T11:20:58.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.182+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.1 size=1048576 2024-09-14T11:20:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.183+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.2 size=763687 2024-09-14T11:20:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.183+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=2COJIFTSEP41 tag=9FXLA43PG8YO type=write size=3909415 2024-09-14T11:20:58.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.184+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=BTTTV2SWQT56 type=del 2024-09-14T11:20:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.185+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=8BWWYESTA6D0 type=del size=835155 2024-09-14T11:20:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.185+0000 7fc354693780 1 < canceled part key=_multipart_GE83T07IQG0S.2~L2WG9M588FDC.0 size=969953 2024-09-14T11:20:58.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.187+0000 7fc354693780 1 < canceled multipart upload key=GE83T07IQG0S upload=L2WG9M588FDC tag=P92RCA769Y5W type=write size=2018529 2024-09-14T11:20:58.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.188+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=DM05J16ZY0WY type=del size=2295005 2024-09-14T11:20:58.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.190+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=LEK003CC59BF type=del 2024-09-14T11:20:58.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.192+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~L12CAKIPOKDK.0 size=183778 2024-09-14T11:20:58.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.192+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=L12CAKIPOKDK tag=UZ5IPMAZBC26 type=write size=1232354 2024-09-14T11:20:58.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.193+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.0 size=1048576 2024-09-14T11:20:58.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.194+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.1 size=1048576 2024-09-14T11:20:58.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.194+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~3NMLLSC386WP.2 size=72242 2024-09-14T11:20:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.196+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=3NMLLSC386WP tag=3Y8PTGNLK1Y5 type=write size=3217970 2024-09-14T11:20:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.198+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~70ZOE2U2A8EF.0 size=491375 2024-09-14T11:20:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.198+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=70ZOE2U2A8EF tag=0NYZ8LMUQLS2 type=write size=1539951 2024-09-14T11:20:58.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.199+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~UP7I9POEH2M8.0 size=915294 2024-09-14T11:20:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.201+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=UP7I9POEH2M8 tag=B2VMZE8LYQ3R type=write size=1963870 2024-09-14T11:20:58.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.202+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=CI5A979303JM type=del size=939982 2024-09-14T11:20:58.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.203+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~NXYTT9WOQP2X.0 size=616352 2024-09-14T11:20:58.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.205+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=NXYTT9WOQP2X tag=2P38XTHKNDII type=write size=1664928 2024-09-14T11:20:58.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.207+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~M8D0N52GVLQ0.0 size=1048576 2024-09-14T11:20:58.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.208+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~M8D0N52GVLQ0.1 size=103243 2024-09-14T11:20:58.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.208+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=M8D0N52GVLQ0 tag=MRAHQ51QZ3HU type=write size=2200395 2024-09-14T11:20:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.209+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=B9XV321KX45Y type=del 2024-09-14T11:20:58.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.210+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=QA143TKIDY3B type=write size=137906 2024-09-14T11:20:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.211+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=JZBZUI58QMLS type=del 2024-09-14T11:20:58.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.212+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=MHQWMO49SSMI type=del size=2996436 2024-09-14T11:20:58.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.213+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=0P5ZTLYFYFBL type=del 2024-09-14T11:20:58.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.214+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=Q8K6XP6AN4UF type=del size=1586134 2024-09-14T11:20:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.216+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.0 size=1048576 2024-09-14T11:20:58.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.217+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.1 size=1048576 2024-09-14T11:20:58.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.218+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~773G360SV67O.2 size=858908 2024-09-14T11:20:58.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.220+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=773G360SV67O tag=5OYHBZROLMX4 type=write size=4004636 2024-09-14T11:20:58.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.221+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=V486R6WFH7TY type=del size=2108960 2024-09-14T11:20:58.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.222+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=IQ6POH8MYAA0 type=write size=65569 2024-09-14T11:20:58.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.223+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=KHS2T87O3AOV type=del size=630287 2024-09-14T11:20:58.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.224+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.0 size=1048576 2024-09-14T11:20:58.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.225+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.1 size=1048576 2024-09-14T11:20:58.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.226+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~O4JWIBOI0GUT.2 size=810058 2024-09-14T11:20:58.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.228+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=O4JWIBOI0GUT tag=C4N897G4PNJA type=write size=3955786 2024-09-14T11:20:58.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.229+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=8XH5WPWBJPW7 type=del size=622960 2024-09-14T11:20:58.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.230+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=6DA7S6PQFUFS type=del 2024-09-14T11:20:58.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.231+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=RN9PQUN3YZY5 type=del size=2683700 2024-09-14T11:20:58.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.233+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=2AW12V9OLNEW type=del 2024-09-14T11:20:58.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.234+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=AQQYTA3X254S type=del size=2674279 2024-09-14T11:20:58.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.237+0000 7fc354693780 1 < suggested update operation key=6SIWH1BHPFGM tag=L7VSNG64RF85 type=del size=916556 2024-09-14T11:20:58.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.239+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~0TB9OJ3WN91I.0 size=50589 2024-09-14T11:20:58.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.239+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=0TB9OJ3WN91I tag=YE4FTQ23EEE1 type=write size=1099165 2024-09-14T11:20:58.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.241+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.0 size=1048576 2024-09-14T11:20:58.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.242+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.1 size=1048576 2024-09-14T11:20:58.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.243+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~2COJIFTSEP41.2 size=763687 2024-09-14T11:20:58.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.244+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=2COJIFTSEP41 tag=9FXLA43PG8YO type=write size=3909415 2024-09-14T11:20:58.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.247+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~PPMX5B9S8WPS.0 size=112300 2024-09-14T11:20:58.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.247+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=PPMX5B9S8WPS tag=ZYX3BCMIBX2D type=write size=1160876 2024-09-14T11:20:58.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.248+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=8BWWYESTA6D0 type=del 2024-09-14T11:20:58.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.249+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=WBN6WRYSH160 type=del size=4128207 2024-09-14T11:20:58.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.250+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=DM05J16ZY0WY type=del 2024-09-14T11:20:58.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.253+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~6TBHQYRPXS7F.0 size=1048576 2024-09-14T11:20:58.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.253+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~6TBHQYRPXS7F.1 size=187423 2024-09-14T11:20:58.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.253+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=6TBHQYRPXS7F tag=NMI9NQZA43QG type=write size=2284575 2024-09-14T11:20:58.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.255+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~L12CAKIPOKDK.0 size=183778 2024-09-14T11:20:58.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.257+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=L12CAKIPOKDK tag=UZ5IPMAZBC26 type=write size=1232354 2024-09-14T11:20:58.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.258+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=Y7IL5RVXLUQQ type=del size=1936413 2024-09-14T11:20:58.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.259+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~70ZOE2U2A8EF.0 size=491375 2024-09-14T11:20:58.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.261+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=70ZOE2U2A8EF tag=0NYZ8LMUQLS2 type=write size=1539951 2024-09-14T11:20:58.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.262+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=GMFSE1PE73RQ type=del size=2236379 2024-09-14T11:20:58.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.263+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=CI5A979303JM type=del 2024-09-14T11:20:58.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.264+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=DNMOW0E4FJWG type=del size=834496 2024-09-14T11:20:58.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.266+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~M8D0N52GVLQ0.0 size=1048576 2024-09-14T11:20:58.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.267+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~M8D0N52GVLQ0.1 size=103243 2024-09-14T11:20:58.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.269+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=M8D0N52GVLQ0 tag=MRAHQ51QZ3HU type=write size=2200395 2024-09-14T11:20:58.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.270+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=W63QPF9BVG6U type=del size=680161 2024-09-14T11:20:58.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.272+0000 7fc354693780 1 < suggested update operation key=JGVLT0K0CEGQ tag=QA143TKIDY3B type=write size=137906 2024-09-14T11:20:58.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.273+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=J70V5E95L84G type=del size=3291537 2024-09-14T11:20:58.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.275+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=MHQWMO49SSMI type=del 2024-09-14T11:20:58.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.276+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=B6MVN7Q7IIMX type=del size=4119915 2024-09-14T11:20:58.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.277+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=Q8K6XP6AN4UF type=del 2024-09-14T11:20:58.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.278+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=L3FKMM5L1QWY type=write size=69032 2024-09-14T11:20:58.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.279+0000 7fc354693780 1 < canceled operation key=H1S2CBHNW6GI tag=V486R6WFH7TY type=del size=2108960 2024-09-14T11:20:58.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.281+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=BO1VKS6UMCHO type=del size=3024380 2024-09-14T11:20:58.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.282+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=KHS2T87O3AOV type=del 2024-09-14T11:20:58.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.283+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=GQNAZX9SG783 type=write size=672878 2024-09-14T11:20:58.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.284+0000 7fc354693780 1 < canceled operation key=X4VH2WYJJ8GI tag=8XH5WPWBJPW7 type=del size=622960 2024-09-14T11:20:58.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.286+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~KU074XMGZB9C.0 size=1048576 2024-09-14T11:20:58.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.287+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~KU074XMGZB9C.1 size=87137 2024-09-14T11:20:58.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.287+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=KU074XMGZB9C tag=P5617FF3KI0F type=write size=2184289 2024-09-14T11:20:58.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.288+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=RN9PQUN3YZY5 type=del 2024-09-14T11:20:58.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.289+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=ZBK9MRLQXV7C type=write size=448882 2024-09-14T11:20:58.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.291+0000 7fc354693780 1 < suggested remove operation key=EFX0VXGHRUDR tag=AQQYTA3X254S type=del 2024-09-14T11:20:58.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.293+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=GT9UP962IBB4 type=del size=316532 2024-09-14T11:20:58.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.294+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~0TB9OJ3WN91I.0 size=50589 2024-09-14T11:20:58.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.296+0000 7fc354693780 1 < completed multipart upload key=AUL8F0SZVZX2 upload=0TB9OJ3WN91I tag=YE4FTQ23EEE1 type=write size=1099165 2024-09-14T11:20:58.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.298+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.0 size=1048576 2024-09-14T11:20:58.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.299+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.1 size=1048576 2024-09-14T11:20:58.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.300+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.2 size=1036335 2024-09-14T11:20:58.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.300+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=NJSPYFRYFVNB tag=K1OX9AK1MNU9 type=write size=4182063 2024-09-14T11:20:58.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.301+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~PPMX5B9S8WPS.0 size=112300 2024-09-14T11:20:58.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.303+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=PPMX5B9S8WPS tag=ZYX3BCMIBX2D type=write size=1160876 2024-09-14T11:20:58.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.304+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=SRJGJ3VUJJER type=del size=3138656 2024-09-14T11:20:58.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.305+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=WBN6WRYSH160 type=del 2024-09-14T11:20:58.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.308+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~5JNCEHVK5YRJ.0 size=1048576 2024-09-14T11:20:58.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.309+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~5JNCEHVK5YRJ.1 size=168649 2024-09-14T11:20:58.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.309+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=5JNCEHVK5YRJ tag=RO56R3F5VX8G type=write size=2265801 2024-09-14T11:20:58.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.310+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~6TBHQYRPXS7F.0 size=1048576 2024-09-14T11:20:58.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.311+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~6TBHQYRPXS7F.1 size=187423 2024-09-14T11:20:58.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.313+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=6TBHQYRPXS7F tag=NMI9NQZA43QG type=write size=2284575 2024-09-14T11:20:58.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.314+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=EQLTG8UBLHLD type=del size=821183 2024-09-14T11:20:58.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.316+0000 7fc354693780 1 < suggested update operation key=4Z3KI5X3WQ0I tag=Y7IL5RVXLUQQ type=del size=1936413 2024-09-14T11:20:58.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.318+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=RGNPHNWMGJ93 type=del size=2990293 2024-09-14T11:20:58.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.319+0000 7fc354693780 1 < canceled operation key=Z3ZFX1354IRF tag=GMFSE1PE73RQ type=del size=2236379 2024-09-14T11:20:58.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.321+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.0 size=1048576 2024-09-14T11:20:58.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.322+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.1 size=1048576 2024-09-14T11:20:58.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.322+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.2 size=600231 2024-09-14T11:20:58.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.322+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=URH64R9W2CNQ tag=HM2D0TSVQ9IF type=write size=3745959 2024-09-14T11:20:58.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.325+0000 7fc354693780 1 < suggested update operation key=QWMHFF32M37W tag=DNMOW0E4FJWG type=del size=834496 2024-09-14T11:20:58.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.326+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=SN3SFJ86H5AT type=write size=320543 2024-09-14T11:20:58.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.327+0000 7fc354693780 -1 < failed to complete operation key=QWMHFF32M37W tag=W63QPF9BVG6U type=del size=680161: (22) Invalid argument 2024-09-14T11:20:58.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.329+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=TXXROH7EJ29O type=del size=1919088 2024-09-14T11:20:58.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.330+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=J70V5E95L84G type=del 2024-09-14T11:20:58.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.331+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=STGHPUEAQSZ6 type=write size=620270 2024-09-14T11:20:58.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.332+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=B6MVN7Q7IIMX type=del 2024-09-14T11:20:58.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.335+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~0GG5SWJN4S37.0 size=1012538 2024-09-14T11:20:58.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.335+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=0GG5SWJN4S37 tag=6OV5DOUWUXWF type=write size=2061114 2024-09-14T11:20:58.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.336+0000 7fc354693780 1 < completed write operation key=6SIWH1BHPFGM tag=L3FKMM5L1QWY type=write size=69032 2024-09-14T11:20:58.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.337+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=ZYHIU471E66B type=del size=1987261 2024-09-14T11:20:58.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.338+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=BO1VKS6UMCHO type=del 2024-09-14T11:20:58.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.340+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=U429DCOQV60W type=del size=3762009 2024-09-14T11:20:58.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.341+0000 7fc354693780 -1 < failed to complete operation key=QWMHFF32M37W tag=GQNAZX9SG783 type=write size=672878: (22) Invalid argument 2024-09-14T11:20:58.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.342+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=XENH5O05G2RI type=del size=3532048 2024-09-14T11:20:58.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.343+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~KU074XMGZB9C.0 size=1048576 2024-09-14T11:20:58.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.344+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~KU074XMGZB9C.1 size=87137 2024-09-14T11:20:58.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.346+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=KU074XMGZB9C tag=P5617FF3KI0F type=write size=2184289 2024-09-14T11:20:58.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.350+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~PN2NSWNOVSJ2.0 size=556524 2024-09-14T11:20:58.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.350+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=PN2NSWNOVSJ2 tag=9IBKPAKP7PW9 type=write size=1605100 2024-09-14T11:20:58.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.352+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=ZBK9MRLQXV7C type=write 2024-09-14T11:20:58.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.354+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~8XIVXRC7GB9D.0 size=117232 2024-09-14T11:20:58.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.354+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=8XIVXRC7GB9D tag=QCUB2YTS9TXU type=write size=1165808 2024-09-14T11:20:58.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.355+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=GT9UP962IBB4 type=del 2024-09-14T11:20:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.357+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~DLYFJ7L8DVRM.0 size=1048576 2024-09-14T11:20:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.358+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~DLYFJ7L8DVRM.1 size=176369 2024-09-14T11:20:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.358+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=DLYFJ7L8DVRM tag=86924UP0P2RL type=write size=2273521 2024-09-14T11:20:58.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.359+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.0 size=1048576 2024-09-14T11:20:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.360+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.1 size=1048576 2024-09-14T11:20:58.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.361+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~NJSPYFRYFVNB.2 size=1036335 2024-09-14T11:20:58.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.363+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=NJSPYFRYFVNB tag=K1OX9AK1MNU9 type=write size=4182063 2024-09-14T11:20:58.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.364+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=G3H4C3Z2FSMA type=write size=751112 2024-09-14T11:20:58.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.365+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=SRJGJ3VUJJER type=del 2024-09-14T11:20:58.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.367+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~3NUT36EAB291.0 size=1048576 2024-09-14T11:20:58.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.368+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~3NUT36EAB291.1 size=733090 2024-09-14T11:20:58.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.368+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=3NUT36EAB291 tag=08X89916AG31 type=write size=2830242 2024-09-14T11:20:58.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.369+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~5JNCEHVK5YRJ.0 size=1048576 2024-09-14T11:20:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.370+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~5JNCEHVK5YRJ.1 size=168649 2024-09-14T11:20:58.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.372+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=5JNCEHVK5YRJ tag=RO56R3F5VX8G type=write size=2265801 2024-09-14T11:20:58.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.373+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=RHH0AHZD6HOB type=write size=464636 2024-09-14T11:20:58.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.376+0000 7fc354693780 1 < suggested remove operation key=QWMHFF32M37W tag=EQLTG8UBLHLD type=del 2024-09-14T11:20:58.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.377+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=2VID4Z6CEKX5 type=write size=117639 2024-09-14T11:20:58.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.378+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=RGNPHNWMGJ93 type=del 2024-09-14T11:20:58.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.379+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=E09WH2PP5JAF type=del size=1256624 2024-09-14T11:20:58.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.380+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.0 size=1048576 2024-09-14T11:20:58.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.381+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.1 size=1048576 2024-09-14T11:20:58.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.382+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~URH64R9W2CNQ.2 size=600231 2024-09-14T11:20:58.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.384+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=URH64R9W2CNQ tag=HM2D0TSVQ9IF type=write size=3745959 2024-09-14T11:20:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.386+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.0 size=1048576 2024-09-14T11:20:58.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.387+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.1 size=1048576 2024-09-14T11:20:58.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.388+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.2 size=491724 2024-09-14T11:20:58.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.388+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=DYUCZYQNJREK tag=B7G1EOOUG3W9 type=write size=3637452 2024-09-14T11:20:58.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.390+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=SN3SFJ86H5AT type=write size=320543 2024-09-14T11:20:58.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.391+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=7N5E85GLWLM4 type=write size=603286 2024-09-14T11:20:58.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.392+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=TXXROH7EJ29O type=del 2024-09-14T11:20:58.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.393+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=K27GFUNBPI3R type=write size=650059 2024-09-14T11:20:58.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.394+0000 7fc354693780 1 < completed write operation key=ICNEXZMA3VQV tag=STGHPUEAQSZ6 type=write size=620270 2024-09-14T11:20:58.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.396+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=HMAVY32ICLJW type=del size=1907874 2024-09-14T11:20:58.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.397+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~0GG5SWJN4S37.0 size=1012538 2024-09-14T11:20:58.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.398+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=0GG5SWJN4S37 tag=6OV5DOUWUXWF type=write size=2061114 2024-09-14T11:20:58.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.399+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=MW24LJIG2IIN type=del size=3805280 2024-09-14T11:20:58.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.401+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=ZYHIU471E66B type=del 2024-09-14T11:20:58.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.403+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~HYUM9JVGVXC2.0 size=553746 2024-09-14T11:20:58.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.403+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=HYUM9JVGVXC2 tag=825JSM9DNERF type=write size=1602322 2024-09-14T11:20:58.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.405+0000 7fc354693780 1 < suggested update operation key=JF6PHF17N5WE tag=U429DCOQV60W type=del size=3762009 2024-09-14T11:20:58.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.408+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~SD2JPWB220BW.0 size=404562 2024-09-14T11:20:58.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.408+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=SD2JPWB220BW tag=ULV2HE3ZYNVN type=write size=1453138 2024-09-14T11:20:58.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.409+0000 7fc354693780 -1 < failed to complete operation key=IGZK9BWJFCV3 tag=XENH5O05G2RI type=del size=3532048: (22) Invalid argument 2024-09-14T11:20:58.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.410+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=2R0CCJHHF450 type=del size=3625098 2024-09-14T11:20:58.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.411+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~PN2NSWNOVSJ2.0 size=556524 2024-09-14T11:20:58.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.413+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=PN2NSWNOVSJ2 tag=9IBKPAKP7PW9 type=write size=1605100 2024-09-14T11:20:58.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.414+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=MYGABJHJ71K8 type=del size=1503888 2024-09-14T11:20:58.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.415+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~8XIVXRC7GB9D.0 size=117232 2024-09-14T11:20:58.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.417+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=8XIVXRC7GB9D tag=QCUB2YTS9TXU type=write size=1165808 2024-09-14T11:20:58.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.419+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~DNUYHB6ABTVL.0 size=1048576 2024-09-14T11:20:58.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.420+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~DNUYHB6ABTVL.1 size=545101 2024-09-14T11:20:58.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.420+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=DNUYHB6ABTVL tag=YX1JQ1C33SB6 type=write size=2642253 2024-09-14T11:20:58.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.421+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~DLYFJ7L8DVRM.0 size=1048576 2024-09-14T11:20:58.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.422+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~DLYFJ7L8DVRM.1 size=176369 2024-09-14T11:20:58.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.424+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=DLYFJ7L8DVRM tag=86924UP0P2RL type=write size=2273521 2024-09-14T11:20:58.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.425+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=W5ESBOP1P07Q type=del size=3979262 2024-09-14T11:20:58.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.427+0000 7fc354693780 1 < suggested update operation key=977GI7HKD9JJ tag=G3H4C3Z2FSMA type=write size=751112 2024-09-14T11:20:58.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.430+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.0 size=1048576 2024-09-14T11:20:58.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.431+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.1 size=1048576 2024-09-14T11:20:58.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.432+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.2 size=74633 2024-09-14T11:20:58.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.432+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=7G0UI0VRG4ZO tag=NC2TB4AFFROE type=write size=3220361 2024-09-14T11:20:58.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.433+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~3NUT36EAB291.0 size=1048576 2024-09-14T11:20:58.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.434+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~3NUT36EAB291.1 size=733090 2024-09-14T11:20:58.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.436+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=3NUT36EAB291 tag=08X89916AG31 type=write size=2830242 2024-09-14T11:20:58.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.438+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~1ESGS3ZVJ1DD.0 size=1048576 2024-09-14T11:20:58.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.439+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~1ESGS3ZVJ1DD.1 size=878915 2024-09-14T11:20:58.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.439+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=1ESGS3ZVJ1DD tag=3VFCDACE3AR5 type=write size=2976067 2024-09-14T11:20:58.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.442+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=RHH0AHZD6HOB type=write size=464636 2024-09-14T11:20:58.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.443+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=389P33EOWZH7 type=del size=522326 2024-09-14T11:20:58.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.444+0000 7fc354693780 -1 < failed to complete operation key=BKW08T86L2ZF tag=2VID4Z6CEKX5 type=write size=117639: (22) Invalid argument 2024-09-14T11:20:58.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.446+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.0 size=1048576 2024-09-14T11:20:58.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.447+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.1 size=1048576 2024-09-14T11:20:58.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.448+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.2 size=610556 2024-09-14T11:20:58.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.448+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=YVVN2GS1BBTZ tag=6DFZN14CTU6X type=write size=3756284 2024-09-14T11:20:58.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.449+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=E09WH2PP5JAF type=del 2024-09-14T11:20:58.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.451+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.0 size=1048576 2024-09-14T11:20:58.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.452+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.1 size=1048576 2024-09-14T11:20:58.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.453+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.2 size=993866 2024-09-14T11:20:58.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.453+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=0TF7Z34Q8S8T tag=1PZQ0YU9K8FY type=write size=4139594 2024-09-14T11:20:58.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.454+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.0 size=1048576 2024-09-14T11:20:58.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.456+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.1 size=1048576 2024-09-14T11:20:58.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.457+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~DYUCZYQNJREK.2 size=491724 2024-09-14T11:20:58.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.459+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=DYUCZYQNJREK tag=B7G1EOOUG3W9 type=write size=3637452 2024-09-14T11:20:58.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.461+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~N7OFJ38FTF2O.0 size=1048576 2024-09-14T11:20:58.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.462+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~N7OFJ38FTF2O.1 size=410106 2024-09-14T11:20:58.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.462+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=N7OFJ38FTF2O tag=9RVIPPEIEUE1 type=write size=2507258 2024-09-14T11:20:58.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.464+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=7N5E85GLWLM4 type=write 2024-09-14T11:20:58.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.465+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=2QJIJ9SRNBBV type=write size=398945 2024-09-14T11:20:58.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.466+0000 7fc354693780 1 < completed write operation key=54EUIL28P2H1 tag=K27GFUNBPI3R type=write size=650059 2024-09-14T11:20:58.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.467+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=CV8FOAJXFUXG type=del size=3894320 2024-09-14T11:20:58.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.468+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=HMAVY32ICLJW type=del 2024-09-14T11:20:58.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.471+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.0 size=1048576 2024-09-14T11:20:58.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.472+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.1 size=1048576 2024-09-14T11:20:58.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.472+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.2 size=202939 2024-09-14T11:20:58.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.472+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=9ZDW9CMBOS4T tag=56QQQMG24C7N type=write size=3348667 2024-09-14T11:20:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.475+0000 7fc354693780 1 < suggested remove operation key=MQ5V2G5U43J1 tag=MW24LJIG2IIN type=del 2024-09-14T11:20:58.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.477+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.0 size=1048576 2024-09-14T11:20:58.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.478+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.1 size=1048576 2024-09-14T11:20:58.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.479+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.2 size=576153 2024-09-14T11:20:58.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.479+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=SDVANSH0IGPP tag=3GIFF3AWOIE7 type=write size=3721881 2024-09-14T11:20:58.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.480+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~HYUM9JVGVXC2.0 size=553746 2024-09-14T11:20:58.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.482+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=HYUM9JVGVXC2 tag=825JSM9DNERF type=write size=1602322 2024-09-14T11:20:58.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.483+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=TZ7C7MGT3N2I type=del size=2164939 2024-09-14T11:20:58.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.484+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~SD2JPWB220BW.0 size=404562 2024-09-14T11:20:58.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.486+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=SD2JPWB220BW tag=ULV2HE3ZYNVN type=write size=1453138 2024-09-14T11:20:58.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.488+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~VP1QVOP1MKMQ.0 size=663850 2024-09-14T11:20:58.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.488+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=VP1QVOP1MKMQ tag=S60486NXHEX9 type=write size=1712426 2024-09-14T11:20:58.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.489+0000 7fc354693780 -1 < failed to complete operation key=TFTKNNCGN88D tag=2R0CCJHHF450 type=del size=3625098: (22) Invalid argument 2024-09-14T11:20:58.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.490+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=DDYAWCKXGJVX type=del size=3687227 2024-09-14T11:20:58.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.492+0000 7fc354693780 1 < suggested remove operation key=WYD70VR8OKAN tag=MYGABJHJ71K8 type=del 2024-09-14T11:20:58.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.493+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=MSC7KCQMYP8F type=del size=1204335 2024-09-14T11:20:58.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.495+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~DNUYHB6ABTVL.0 size=1048576 2024-09-14T11:20:58.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.496+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~DNUYHB6ABTVL.1 size=545101 2024-09-14T11:20:58.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.498+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=DNUYHB6ABTVL tag=YX1JQ1C33SB6 type=write size=2642253 2024-09-14T11:20:58.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.499+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=0WQN7GJ9HEWL type=write size=63483 2024-09-14T11:20:58.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.500+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=W5ESBOP1P07Q type=del 2024-09-14T11:20:58.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.502+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.0 size=1048576 2024-09-14T11:20:58.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.503+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.1 size=1048576 2024-09-14T11:20:58.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.504+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.2 size=584022 2024-09-14T11:20:58.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.504+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=4RLC8K0R5L6M tag=T7YB7W78QK36 type=write size=3729750 2024-09-14T11:20:58.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.505+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.0 size=1048576 2024-09-14T11:20:58.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.506+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.1 size=1048576 2024-09-14T11:20:58.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.507+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~7G0UI0VRG4ZO.2 size=74633 2024-09-14T11:20:58.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.509+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=7G0UI0VRG4ZO tag=NC2TB4AFFROE type=write size=3220361 2024-09-14T11:20:58.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.510+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=QUEE2DVP7GCY type=write size=1036644 2024-09-14T11:20:58.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.511+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~1ESGS3ZVJ1DD.0 size=1048576 2024-09-14T11:20:58.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.512+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~1ESGS3ZVJ1DD.1 size=878915 2024-09-14T11:20:58.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.514+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=1ESGS3ZVJ1DD tag=3VFCDACE3AR5 type=write size=2976067 2024-09-14T11:20:58.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.516+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~26VY3INUPR7N.0 size=1025390 2024-09-14T11:20:58.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.516+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=26VY3INUPR7N tag=XQOCRPIUWHXP type=write size=2073966 2024-09-14T11:20:58.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.517+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=389P33EOWZH7 type=del 2024-09-14T11:20:58.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.518+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=8CTMXA6HRICV type=del size=704877 2024-09-14T11:20:58.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.519+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.0 size=1048576 2024-09-14T11:20:58.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.520+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.1 size=1048576 2024-09-14T11:20:58.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.520+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~YVVN2GS1BBTZ.2 size=610556 2024-09-14T11:20:58.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.522+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=YVVN2GS1BBTZ tag=6DFZN14CTU6X type=write size=3756284 2024-09-14T11:20:58.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.523+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=T5NG3PLITL6C type=del size=2913156 2024-09-14T11:20:58.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.524+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.0 size=1048576 2024-09-14T11:20:58.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.525+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.1 size=1048576 2024-09-14T11:20:58.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.526+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~0TF7Z34Q8S8T.2 size=993866 2024-09-14T11:20:58.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.528+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=0TF7Z34Q8S8T tag=1PZQ0YU9K8FY type=write size=4139594 2024-09-14T11:20:58.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.529+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=CTWGF20041FK type=del size=711827 2024-09-14T11:20:58.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.530+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~N7OFJ38FTF2O.0 size=1048576 2024-09-14T11:20:58.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.531+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~N7OFJ38FTF2O.1 size=410106 2024-09-14T11:20:58.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.533+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=N7OFJ38FTF2O tag=9RVIPPEIEUE1 type=write size=2507258 2024-09-14T11:20:58.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.535+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=QHU8Q416L43O type=del size=1031336 2024-09-14T11:20:58.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.536+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=2QJIJ9SRNBBV type=write size=398945 2024-09-14T11:20:58.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.537+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=UKJ3FMU692CD type=del size=2798792 2024-09-14T11:20:58.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.539+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=CV8FOAJXFUXG type=del size=3894320 2024-09-14T11:20:58.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.541+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~Z4O0YVJNW5PN.0 size=939543 2024-09-14T11:20:58.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.541+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=Z4O0YVJNW5PN tag=S9WR4J9KWMKY type=write size=1988119 2024-09-14T11:20:58.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.541+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.0 size=1048576 2024-09-14T11:20:58.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.541+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.1 size=1048576 2024-09-14T11:20:58.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.541+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~9ZDW9CMBOS4T.2 size=202939 2024-09-14T11:20:58.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.543+0000 7fc354693780 1 < canceled multipart upload key=4Z3KI5X3WQ0I upload=9ZDW9CMBOS4T tag=56QQQMG24C7N type=write size=3348667 2024-09-14T11:20:58.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.545+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=PS2MVI1QG12U type=del size=2760655 2024-09-14T11:20:58.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.546+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.0 size=1048576 2024-09-14T11:20:58.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.546+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.1 size=1048576 2024-09-14T11:20:58.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.547+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~SDVANSH0IGPP.2 size=576153 2024-09-14T11:20:58.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.549+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=SDVANSH0IGPP tag=3GIFF3AWOIE7 type=write size=3721881 2024-09-14T11:20:58.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.551+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.0 size=1048576 2024-09-14T11:20:58.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.552+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.1 size=1048576 2024-09-14T11:20:58.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.552+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.2 size=210801 2024-09-14T11:20:58.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.553+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=P8HZIMB57LFN tag=LFZUH6HBM01G type=write size=3356529 2024-09-14T11:20:58.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.554+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=TZ7C7MGT3N2I type=del 2024-09-14T11:20:58.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.555+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=FZ5C2W38CQJQ type=del size=2465833 2024-09-14T11:20:58.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.556+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~VP1QVOP1MKMQ.0 size=663850 2024-09-14T11:20:58.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.558+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=VP1QVOP1MKMQ tag=S60486NXHEX9 type=write size=1712426 2024-09-14T11:20:58.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.559+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=25GUPWYIIXT9 type=del size=2008202 2024-09-14T11:20:58.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.562+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=DDYAWCKXGJVX type=del 2024-09-14T11:20:58.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.564+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~RDCYP9GZ6BAR.0 size=412146 2024-09-14T11:20:58.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.564+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=RDCYP9GZ6BAR tag=DOQH8WLD942S type=write size=1460722 2024-09-14T11:20:58.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.565+0000 7fc354693780 -1 < failed to complete operation key=N23XJJD7YYG0 tag=MSC7KCQMYP8F type=del size=1204335: (22) Invalid argument 2024-09-14T11:20:58.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.567+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~3J2S7JB3JKS8.0 size=1048576 2024-09-14T11:20:58.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.568+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~3J2S7JB3JKS8.1 size=40928 2024-09-14T11:20:58.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.568+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=3J2S7JB3JKS8 tag=8PXCCL1GZEJN type=write size=2138080 2024-09-14T11:20:58.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.569+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=0WQN7GJ9HEWL type=write size=63483 2024-09-14T11:20:58.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.570+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=N68I1Y39Z1N3 type=del size=1395606 2024-09-14T11:20:58.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.571+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.0 size=1048576 2024-09-14T11:20:58.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.572+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.1 size=1048576 2024-09-14T11:20:58.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.573+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4RLC8K0R5L6M.2 size=584022 2024-09-14T11:20:58.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.575+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=4RLC8K0R5L6M tag=T7YB7W78QK36 type=write size=3729750 2024-09-14T11:20:58.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.576+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=C63H0XL8OT8Y type=del size=183334 2024-09-14T11:20:58.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.578+0000 7fc354693780 1 < suggested update operation key=4IDBIAE3VAY4 tag=QUEE2DVP7GCY type=write size=1036644 2024-09-14T11:20:58.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.579+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=4PQ1J4QSZ07L type=del size=3829160 2024-09-14T11:20:58.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.581+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~26VY3INUPR7N.0 size=1025390 2024-09-14T11:20:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.582+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=26VY3INUPR7N tag=XQOCRPIUWHXP type=write size=2073966 2024-09-14T11:20:58.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.584+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=6X9I7JT2VBOD type=del size=3923195 2024-09-14T11:20:58.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.585+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=8CTMXA6HRICV type=del 2024-09-14T11:20:58.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.586+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=GNWHXIBSU8Q2 type=write size=810956 2024-09-14T11:20:58.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.588+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=T5NG3PLITL6C type=del 2024-09-14T11:20:58.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.589+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=1T76EWV14D7S type=del size=1617778 2024-09-14T11:20:58.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.590+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=CTWGF20041FK type=del 2024-09-14T11:20:58.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.591+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=BURO1B15GPH6 type=del size=438401 2024-09-14T11:20:58.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.594+0000 7fc354693780 1 < suggested remove operation key=AUL8F0SZVZX2 tag=QHU8Q416L43O type=del 2024-09-14T11:20:58.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.596+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.0 size=1048576 2024-09-14T11:20:58.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.596+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.1 size=1048576 2024-09-14T11:20:58.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.597+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.2 size=422025 2024-09-14T11:20:58.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.597+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=OW9WHCBWYA5F tag=1GN1HVE0TLNO type=write size=3567753 2024-09-14T11:20:58.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.599+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=UKJ3FMU692CD type=del 2024-09-14T11:20:58.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.600+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=T2ALIP8ZRVZT type=write size=183085 2024-09-14T11:20:58.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.601+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~Z4O0YVJNW5PN.0 size=939543 2024-09-14T11:20:58.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.603+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=Z4O0YVJNW5PN tag=S9WR4J9KWMKY type=write size=1988119 2024-09-14T11:20:58.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.605+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~OH8MAGUX4MPO.0 size=1048576 2024-09-14T11:20:58.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.606+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~OH8MAGUX4MPO.1 size=137237 2024-09-14T11:20:58.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.606+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=OH8MAGUX4MPO tag=56L9F2MFU2VC type=write size=2234389 2024-09-14T11:20:58.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.607+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=PS2MVI1QG12U type=del 2024-09-14T11:20:58.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.608+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=5TRRRD05SDOZ type=del size=2938731 2024-09-14T11:20:58.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.609+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.0 size=1048576 2024-09-14T11:20:58.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.609+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.1 size=1048576 2024-09-14T11:20:58.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.610+0000 7fc354693780 1 < completed part key=_multipart_AUL8F0SZVZX2.2~P8HZIMB57LFN.2 size=210801 2024-09-14T11:20:58.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.612+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=P8HZIMB57LFN tag=LFZUH6HBM01G type=write size=3356529 2024-09-14T11:20:58.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.614+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=LIU4MMTEBA6R type=write size=548438 2024-09-14T11:20:58.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.615+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=FZ5C2W38CQJQ type=del 2024-09-14T11:20:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.617+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~8DXWN4I5EY2A.0 size=864756 2024-09-14T11:20:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.617+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=8DXWN4I5EY2A tag=E333YH20E3P1 type=write size=1913332 2024-09-14T11:20:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.618+0000 7fc354693780 -1 < failed to complete operation key=AUL8F0SZVZX2 tag=25GUPWYIIXT9 type=del size=2008202: (22) Invalid argument 2024-09-14T11:20:58.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.620+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=8BT4HA06Q2SR type=del size=294973 2024-09-14T11:20:58.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.621+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~RDCYP9GZ6BAR.0 size=412146 2024-09-14T11:20:58.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.623+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=RDCYP9GZ6BAR tag=DOQH8WLD942S type=write size=1460722 2024-09-14T11:20:58.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.624+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=LJVPGDXD6LX5 type=del size=114940 2024-09-14T11:20:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.626+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~3J2S7JB3JKS8.0 size=1048576 2024-09-14T11:20:58.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.627+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~3J2S7JB3JKS8.1 size=40928 2024-09-14T11:20:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.629+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=3J2S7JB3JKS8 tag=8PXCCL1GZEJN type=write size=2138080 2024-09-14T11:20:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.630+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=XLOB4V6ZDUJP type=write size=1029804 2024-09-14T11:20:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.631+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=N68I1Y39Z1N3 type=del 2024-09-14T11:20:58.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.633+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=X2BBLLEO7YD9 type=del size=2696730 2024-09-14T11:20:58.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.634+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=C63H0XL8OT8Y type=del 2024-09-14T11:20:58.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.636+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8S1ZZ410DQ3B.0 size=1048576 2024-09-14T11:20:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.637+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~8S1ZZ410DQ3B.1 size=860415 2024-09-14T11:20:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.637+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=8S1ZZ410DQ3B tag=QL8GSNGZ59VQ type=write size=2957567 2024-09-14T11:20:58.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.639+0000 7fc354693780 1 < suggested update operation key=X4VH2WYJJ8GI tag=4PQ1J4QSZ07L type=del size=3829160 2024-09-14T11:20:58.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.640+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=U90RUQ6ZP7V1 type=del size=1665609 2024-09-14T11:20:58.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.642+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=6X9I7JT2VBOD type=del 2024-09-14T11:20:58.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.643+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=ZZ1CC1BTYZBD type=del size=1114685 2024-09-14T11:20:58.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.644+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=GNWHXIBSU8Q2 type=write size=810956 2024-09-14T11:20:58.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.646+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=8EE0HR11V7GT type=write size=308972 2024-09-14T11:20:58.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.647+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=1T76EWV14D7S type=del 2024-09-14T11:20:58.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.649+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.0 size=1048576 2024-09-14T11:20:58.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.650+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.1 size=1048576 2024-09-14T11:20:58.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.651+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.2 size=590819 2024-09-14T11:20:58.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.651+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=30IA8WEF7T52 tag=SFU0IBTR0681 type=write size=3736547 2024-09-14T11:20:58.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.652+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=BURO1B15GPH6 type=del 2024-09-14T11:20:58.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.654+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.0 size=1048576 2024-09-14T11:20:58.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.655+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.1 size=1048576 2024-09-14T11:20:58.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.656+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.2 size=186578 2024-09-14T11:20:58.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.656+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=QRYA7DKIMW0V tag=VGL5AC05X6PX type=write size=3332306 2024-09-14T11:20:58.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.657+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.0 size=1048576 2024-09-14T11:20:58.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.658+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.1 size=1048576 2024-09-14T11:20:58.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.659+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~OW9WHCBWYA5F.2 size=422025 2024-09-14T11:20:58.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.661+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=OW9WHCBWYA5F tag=1GN1HVE0TLNO type=write size=3567753 2024-09-14T11:20:58.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.662+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=ZD8ZZEEL4YMT type=del size=2208222 2024-09-14T11:20:58.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.664+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=T2ALIP8ZRVZT type=write 2024-09-14T11:20:58.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.666+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XKHWHKJ0H4J9.0 size=1048576 2024-09-14T11:20:58.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.667+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~XKHWHKJ0H4J9.1 size=150747 2024-09-14T11:20:58.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.667+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=XKHWHKJ0H4J9 tag=3LLTF4DPRS2W type=write size=2247899 2024-09-14T11:20:58.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.668+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~OH8MAGUX4MPO.0 size=1048576 2024-09-14T11:20:58.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.670+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~OH8MAGUX4MPO.1 size=137237 2024-09-14T11:20:58.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.672+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=OH8MAGUX4MPO tag=56L9F2MFU2VC type=write size=2234389 2024-09-14T11:20:58.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.673+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=GXYUBBX25S8P type=del size=863021 2024-09-14T11:20:58.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.674+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=5TRRRD05SDOZ type=del 2024-09-14T11:20:58.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.676+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=L43BKUZL3FX5 type=del size=3486628 2024-09-14T11:20:58.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.677+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=LIU4MMTEBA6R type=write size=548438 2024-09-14T11:20:58.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.679+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=UKYO7ZR3SV98 type=del size=849042 2024-09-14T11:20:58.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.680+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~8DXWN4I5EY2A.0 size=864756 2024-09-14T11:20:58.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.682+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=8DXWN4I5EY2A tag=E333YH20E3P1 type=write size=1913332 2024-09-14T11:20:58.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.683+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=E24NKM0RWW9A type=del size=2511083 2024-09-14T11:20:58.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.684+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=8BT4HA06Q2SR type=del 2024-09-14T11:20:58.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.686+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.0 size=1048576 2024-09-14T11:20:58.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.687+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.1 size=1048576 2024-09-14T11:20:58.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.688+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.2 size=218736 2024-09-14T11:20:58.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.688+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=QO54VZWQSYBR tag=ZUIOS4QMSB66 type=write size=3364464 2024-09-14T11:20:58.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.689+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=LJVPGDXD6LX5 type=del 2024-09-14T11:20:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.691+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.0 size=1048576 2024-09-14T11:20:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.691+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.1 size=1048576 2024-09-14T11:20:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.692+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.2 size=611501 2024-09-14T11:20:58.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.692+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=A69KIU3H2X1A tag=5DSZADR2I354 type=write size=3757229 2024-09-14T11:20:58.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.695+0000 7fc354693780 1 < suggested update operation key=6SIWH1BHPFGM tag=XLOB4V6ZDUJP type=write size=1029804 2024-09-14T11:20:58.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.696+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=GE41JLCON32Z type=del size=2076086 2024-09-14T11:20:58.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.697+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=X2BBLLEO7YD9 type=del 2024-09-14T11:20:58.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.698+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=CY6J5H502OAY type=del size=218194 2024-09-14T11:20:58.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.699+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8S1ZZ410DQ3B.0 size=1048576 2024-09-14T11:20:58.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.700+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~8S1ZZ410DQ3B.1 size=860415 2024-09-14T11:20:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.702+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=8S1ZZ410DQ3B tag=QL8GSNGZ59VQ type=write size=2957567 2024-09-14T11:20:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.704+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~AW3OP81G265L.0 size=1048576 2024-09-14T11:20:58.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.705+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~AW3OP81G265L.1 size=334993 2024-09-14T11:20:58.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.705+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=AW3OP81G265L tag=BQCRUDVG1LBK type=write size=2432145 2024-09-14T11:20:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.706+0000 7fc354693780 -1 < failed to complete operation key=977GI7HKD9JJ tag=U90RUQ6ZP7V1 type=del size=1665609: (22) Invalid argument 2024-09-14T11:20:58.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.707+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=4OHWZ3N8KAK5 type=del size=2400938 2024-09-14T11:20:58.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.708+0000 7fc354693780 1 < canceled operation key=BTET4HD5NY0D tag=ZZ1CC1BTYZBD type=del size=1114685 2024-09-14T11:20:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.709+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=LGGIIYX338HE type=del size=3895730 2024-09-14T11:20:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.710+0000 7fc354693780 1 < canceled operation key=X4VH2WYJJ8GI tag=8EE0HR11V7GT type=write size=308972 2024-09-14T11:20:58.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.712+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~HOOPECWVXY4K.0 size=1048576 2024-09-14T11:20:58.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.713+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~HOOPECWVXY4K.1 size=995409 2024-09-14T11:20:58.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.713+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=HOOPECWVXY4K tag=3HEJ3H1TEH1E type=write size=3092561 2024-09-14T11:20:58.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.714+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.0 size=1048576 2024-09-14T11:20:58.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.715+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.1 size=1048576 2024-09-14T11:20:58.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.716+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~30IA8WEF7T52.2 size=590819 2024-09-14T11:20:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.718+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=30IA8WEF7T52 tag=SFU0IBTR0681 type=write size=3736547 2024-09-14T11:20:58.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.719+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=09YFXTF0I6EI type=del size=313523 2024-09-14T11:20:58.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.720+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.0 size=1048576 2024-09-14T11:20:58.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.721+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.1 size=1048576 2024-09-14T11:20:58.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.722+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~QRYA7DKIMW0V.2 size=186578 2024-09-14T11:20:58.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.724+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=QRYA7DKIMW0V tag=VGL5AC05X6PX type=write size=3332306 2024-09-14T11:20:58.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.725+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=7GIY3TXDVWKC type=del size=751352 2024-09-14T11:20:58.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.726+0000 7fc354693780 -1 < failed to complete operation key=IGZK9BWJFCV3 tag=ZD8ZZEEL4YMT type=del size=2208222: (22) Invalid argument 2024-09-14T11:20:58.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.728+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=D49SOZLYCZC8 type=del size=3026031 2024-09-14T11:20:58.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.729+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XKHWHKJ0H4J9.0 size=1048576 2024-09-14T11:20:58.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.730+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~XKHWHKJ0H4J9.1 size=150747 2024-09-14T11:20:58.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.731+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=XKHWHKJ0H4J9 tag=3LLTF4DPRS2W type=write size=2247899 2024-09-14T11:20:58.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.733+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=JF7SIO1EATRT type=del size=2007862 2024-09-14T11:20:58.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.734+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=GXYUBBX25S8P type=del 2024-09-14T11:20:58.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.736+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~J8S65L56YVT8.0 size=1048576 2024-09-14T11:20:58.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.737+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~J8S65L56YVT8.1 size=53183 2024-09-14T11:20:58.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.737+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=J8S65L56YVT8 tag=A6QV3E2LM7DL type=write size=2150335 2024-09-14T11:20:58.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.738+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=L43BKUZL3FX5 type=del 2024-09-14T11:20:58.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.739+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=BIYUHGM41TF6 type=del size=69844 2024-09-14T11:20:58.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.740+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=UKYO7ZR3SV98 type=del 2024-09-14T11:20:58.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.741+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=NDR5C50WKU7X type=del size=1099252 2024-09-14T11:20:58.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.744+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=E24NKM0RWW9A type=del 2024-09-14T11:20:58.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.746+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.0 size=1048576 2024-09-14T11:20:58.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.747+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.1 size=1048576 2024-09-14T11:20:58.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.747+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.2 size=192339 2024-09-14T11:20:58.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.747+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=RT2T63FIJCX6 tag=5O73A09LK8WS type=write size=3338067 2024-09-14T11:20:58.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.749+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.0 size=1048576 2024-09-14T11:20:58.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.750+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.1 size=1048576 2024-09-14T11:20:58.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.750+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~QO54VZWQSYBR.2 size=218736 2024-09-14T11:20:58.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.752+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=QO54VZWQSYBR tag=ZUIOS4QMSB66 type=write size=3364464 2024-09-14T11:20:58.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.754+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=M7M2URP51DTC type=del size=1819014 2024-09-14T11:20:58.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.755+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.0 size=1048576 2024-09-14T11:20:58.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.756+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.1 size=1048576 2024-09-14T11:20:58.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.757+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~A69KIU3H2X1A.2 size=611501 2024-09-14T11:20:58.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.759+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=A69KIU3H2X1A tag=5DSZADR2I354 type=write size=3757229 2024-09-14T11:20:58.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.760+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=IZY5O4R6E65Q type=del size=2885165 2024-09-14T11:20:58.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.761+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=GE41JLCON32Z type=del 2024-09-14T11:20:58.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.763+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.0 size=1048576 2024-09-14T11:20:58.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.764+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.1 size=1048576 2024-09-14T11:20:58.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.765+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.2 size=259009 2024-09-14T11:20:58.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.765+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=VWEYAOQ5T7XN tag=1KY9SCKEKISV type=write size=3404737 2024-09-14T11:20:58.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.766+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=CY6J5H502OAY type=del 2024-09-14T11:20:58.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.768+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~X05POM91X98H.0 size=1048576 2024-09-14T11:20:58.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.769+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~X05POM91X98H.1 size=520307 2024-09-14T11:20:58.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.769+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=X05POM91X98H tag=HSF1RTHV4F75 type=write size=2617459 2024-09-14T11:20:58.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.770+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~AW3OP81G265L.0 size=1048576 2024-09-14T11:20:58.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.771+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~AW3OP81G265L.1 size=334993 2024-09-14T11:20:58.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.773+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=AW3OP81G265L tag=BQCRUDVG1LBK type=write size=2432145 2024-09-14T11:20:58.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.777+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~MK92O30ZQYTC.0 size=783624 2024-09-14T11:20:58.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.777+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=MK92O30ZQYTC tag=WUXNP0G298YP type=write size=1832200 2024-09-14T11:20:58.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.778+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=4OHWZ3N8KAK5 type=del 2024-09-14T11:20:58.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.779+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=TWVJ1I2U425O type=del size=3240918 2024-09-14T11:20:58.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.780+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=LGGIIYX338HE type=del 2024-09-14T11:20:58.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.781+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=M1N8L01N15KC type=del size=1385198 2024-09-14T11:20:58.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.782+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~HOOPECWVXY4K.0 size=1048576 2024-09-14T11:20:58.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.783+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~HOOPECWVXY4K.1 size=995409 2024-09-14T11:20:58.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.786+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=HOOPECWVXY4K tag=3HEJ3H1TEH1E type=write size=3092561 2024-09-14T11:20:58.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.788+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~MBKMBB5L80M9.0 size=521760 2024-09-14T11:20:58.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.788+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=MBKMBB5L80M9 tag=J7G1FE13R2P9 type=write size=1570336 2024-09-14T11:20:58.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.790+0000 7fc354693780 1 < suggested remove operation key=WBT3M1NMEEAY tag=09YFXTF0I6EI type=del 2024-09-14T11:20:58.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.792+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=5J0V1YPSAD2F type=del size=1617142 2024-09-14T11:20:58.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.793+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=7GIY3TXDVWKC type=del 2024-09-14T11:20:58.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.795+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~ZWKPBVMNEDGL.0 size=274281 2024-09-14T11:20:58.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.795+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=ZWKPBVMNEDGL tag=IMZA2S887V3D type=write size=1322857 2024-09-14T11:20:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.797+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=D49SOZLYCZC8 type=del 2024-09-14T11:20:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.799+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~5TJFLN3N4YV3.0 size=1048576 2024-09-14T11:20:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.800+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~5TJFLN3N4YV3.1 size=732585 2024-09-14T11:20:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.800+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=5TJFLN3N4YV3 tag=I5PG2221OU6P type=write size=2829737 2024-09-14T11:20:58.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.801+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=JF7SIO1EATRT type=del 2024-09-14T11:20:58.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.802+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=QSDHGG12KOI8 type=del size=3669896 2024-09-14T11:20:58.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.803+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~J8S65L56YVT8.0 size=1048576 2024-09-14T11:20:58.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.804+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~J8S65L56YVT8.1 size=53183 2024-09-14T11:20:58.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.806+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=J8S65L56YVT8 tag=A6QV3E2LM7DL type=write size=2150335 2024-09-14T11:20:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.807+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=RXBK2VNR0XXW type=del size=735699 2024-09-14T11:20:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.810+0000 7fc354693780 1 < suggested remove operation key=6SIWH1BHPFGM tag=BIYUHGM41TF6 type=del 2024-09-14T11:20:58.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.811+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=1BJPO083EZK9 type=del size=1394703 2024-09-14T11:20:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.812+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=NDR5C50WKU7X type=del 2024-09-14T11:20:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.814+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~JC2GEVUF05OE.0 size=962419 2024-09-14T11:20:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.814+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=JC2GEVUF05OE tag=CG359GVU04TB type=write size=2010995 2024-09-14T11:20:58.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.815+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.0 size=1048576 2024-09-14T11:20:58.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.816+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.1 size=1048576 2024-09-14T11:20:58.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.817+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~RT2T63FIJCX6.2 size=192339 2024-09-14T11:20:58.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.819+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=RT2T63FIJCX6 tag=5O73A09LK8WS type=write size=3338067 2024-09-14T11:20:58.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.820+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=R6LTMXTDS7KG type=del size=2182725 2024-09-14T11:20:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.821+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=M7M2URP51DTC type=del 2024-09-14T11:20:58.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.823+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.0 size=1048576 2024-09-14T11:20:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.824+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.1 size=1048576 2024-09-14T11:20:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.825+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.2 size=1047870 2024-09-14T11:20:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.825+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=D2CINYJTP487 tag=H8A5TLFZI8Z6 type=write size=4193598 2024-09-14T11:20:58.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.826+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=IZY5O4R6E65Q type=del 2024-09-14T11:20:58.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.828+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~BZ22RL12S5OV.0 size=1048576 2024-09-14T11:20:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.829+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~BZ22RL12S5OV.1 size=466960 2024-09-14T11:20:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.829+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=BZ22RL12S5OV tag=W23DFSZJ3RNU type=write size=2564112 2024-09-14T11:20:58.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.830+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.0 size=1048576 2024-09-14T11:20:58.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.831+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.1 size=1048576 2024-09-14T11:20:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.832+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~VWEYAOQ5T7XN.2 size=259009 2024-09-14T11:20:58.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.834+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=VWEYAOQ5T7XN tag=1KY9SCKEKISV type=write size=3404737 2024-09-14T11:20:58.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.835+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=JMHPD6BNI466 type=del size=283803 2024-09-14T11:20:58.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.835+0000 7fc354693780 1 < canceled part key=_multipart_H1S2CBHNW6GI.2~X05POM91X98H.0 size=1048576 2024-09-14T11:20:58.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.836+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~X05POM91X98H.1 size=520307 2024-09-14T11:20:58.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.838+0000 7fc354693780 1 < canceled multipart upload key=H1S2CBHNW6GI upload=X05POM91X98H tag=HSF1RTHV4F75 type=write size=2617459 2024-09-14T11:20:58.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.839+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=4SEXZCN1WSVV type=del size=2589509 2024-09-14T11:20:58.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.841+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~MK92O30ZQYTC.0 size=783624 2024-09-14T11:20:58.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.842+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=MK92O30ZQYTC tag=WUXNP0G298YP type=write size=1832200 2024-09-14T11:20:58.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.843+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=RLTOMB3TR7N8 type=del size=2993745 2024-09-14T11:20:58.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.845+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=TWVJ1I2U425O type=del 2024-09-14T11:20:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.846+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=YP5JBDYFBEYL type=write size=196691 2024-09-14T11:20:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.847+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=M1N8L01N15KC type=del 2024-09-14T11:20:58.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.849+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~37LVV4I408GP.0 size=733926 2024-09-14T11:20:58.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.849+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=37LVV4I408GP tag=Y929O4NY1TED type=write size=1782502 2024-09-14T11:20:58.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.850+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~MBKMBB5L80M9.0 size=521760 2024-09-14T11:20:58.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.852+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=MBKMBB5L80M9 tag=J7G1FE13R2P9 type=write size=1570336 2024-09-14T11:20:58.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.853+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=9CLQOOQ7TNR8 type=write size=980358 2024-09-14T11:20:58.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.854+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=5J0V1YPSAD2F type=del 2024-09-14T11:20:58.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.855+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=SWNTTIR3OGYC type=del size=3732278 2024-09-14T11:20:58.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.857+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~ZWKPBVMNEDGL.0 size=274281 2024-09-14T11:20:58.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.859+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=ZWKPBVMNEDGL tag=IMZA2S887V3D type=write size=1322857 2024-09-14T11:20:58.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.860+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=VFVOS8IGO1EX type=write size=707962 2024-09-14T11:20:58.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.861+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~5TJFLN3N4YV3.0 size=1048576 2024-09-14T11:20:58.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.862+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~5TJFLN3N4YV3.1 size=732585 2024-09-14T11:20:58.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.864+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=5TJFLN3N4YV3 tag=I5PG2221OU6P type=write size=2829737 2024-09-14T11:20:58.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.865+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=E2K1N3Q0FXD3 type=del size=1581389 2024-09-14T11:20:58.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.866+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=QSDHGG12KOI8 type=del 2024-09-14T11:20:58.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.868+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~B32SF0L3NH9P.0 size=1048576 2024-09-14T11:20:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.869+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~B32SF0L3NH9P.1 size=140213 2024-09-14T11:20:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.869+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=B32SF0L3NH9P tag=VGA1K5VZLFN4 type=write size=2237365 2024-09-14T11:20:58.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.870+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=RXBK2VNR0XXW type=del 2024-09-14T11:20:58.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.872+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~4OUX8ECLRO2N.0 size=657402 2024-09-14T11:20:58.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.872+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=4OUX8ECLRO2N tag=EWO5JQT73R2W type=write size=1705978 2024-09-14T11:20:58.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.873+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=1BJPO083EZK9 type=del 2024-09-14T11:20:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.875+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~E2GA5NF6JTBC.0 size=759884 2024-09-14T11:20:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.875+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=E2GA5NF6JTBC tag=FDJOVJ51L6F7 type=write size=1808460 2024-09-14T11:20:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.877+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~JC2GEVUF05OE.0 size=962419 2024-09-14T11:20:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.878+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=JC2GEVUF05OE tag=CG359GVU04TB type=write size=2010995 2024-09-14T11:20:58.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.880+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=70NRUB2L29KS type=write size=463077 2024-09-14T11:20:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.881+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=R6LTMXTDS7KG type=del 2024-09-14T11:20:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.882+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=04DNUVCIIOQX type=del size=3388449 2024-09-14T11:20:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.884+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.0 size=1048576 2024-09-14T11:20:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.885+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.1 size=1048576 2024-09-14T11:20:58.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.885+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~D2CINYJTP487.2 size=1047870 2024-09-14T11:20:58.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.887+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=D2CINYJTP487 tag=H8A5TLFZI8Z6 type=write size=4193598 2024-09-14T11:20:58.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.889+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~72U7QPSQE95L.0 size=1032779 2024-09-14T11:20:58.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.889+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=72U7QPSQE95L tag=Z546QRAI2731 type=write size=2081355 2024-09-14T11:20:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.890+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~BZ22RL12S5OV.0 size=1048576 2024-09-14T11:20:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.891+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~BZ22RL12S5OV.1 size=466960 2024-09-14T11:20:58.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.893+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=BZ22RL12S5OV tag=W23DFSZJ3RNU type=write size=2564112 2024-09-14T11:20:58.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.894+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=KYZL2AEVLR4U type=del size=585104 2024-09-14T11:20:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.895+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=JMHPD6BNI466 type=del 2024-09-14T11:20:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.897+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~N7AAAAGYWCTT.0 size=1048576 2024-09-14T11:20:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.898+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~N7AAAAGYWCTT.1 size=387547 2024-09-14T11:20:58.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.898+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=N7AAAAGYWCTT tag=QI0K36CUTSGK type=write size=2484699 2024-09-14T11:20:58.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.899+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=4SEXZCN1WSVV type=del 2024-09-14T11:20:58.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.902+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~J6KBJBT75SX9.0 size=1034892 2024-09-14T11:20:58.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.902+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=J6KBJBT75SX9 tag=8VTHC7F91YPL type=write size=2083468 2024-09-14T11:20:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.903+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=RLTOMB3TR7N8 type=del 2024-09-14T11:20:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.904+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=D3G9ICJG480V type=del size=649953 2024-09-14T11:20:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.905+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=YP5JBDYFBEYL type=write size=196691 2024-09-14T11:20:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.906+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=BGUY5QBGKM76 type=del size=1325946 2024-09-14T11:20:58.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.907+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~37LVV4I408GP.0 size=733926 2024-09-14T11:20:58.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.909+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=37LVV4I408GP tag=Y929O4NY1TED type=write size=1782502 2024-09-14T11:20:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.911+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~LGH1QFUOP246.0 size=891888 2024-09-14T11:20:58.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.911+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=LGH1QFUOP246 tag=VSZNEDO0JIJQ type=write size=1940464 2024-09-14T11:20:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.913+0000 7fc354693780 1 < completed write operation key=4Z3KI5X3WQ0I tag=9CLQOOQ7TNR8 type=write size=980358 2024-09-14T11:20:58.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.915+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.0 size=1048576 2024-09-14T11:20:58.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.916+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.1 size=1048576 2024-09-14T11:20:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.916+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.2 size=503980 2024-09-14T11:20:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.916+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=425U0C175OWG tag=YZW3HSDGHYWI type=write size=3649708 2024-09-14T11:20:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.919+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=SWNTTIR3OGYC type=del size=3732278 2024-09-14T11:20:58.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.920+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=AA6NR52MBJ4A type=del size=3294216 2024-09-14T11:20:58.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.921+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=VFVOS8IGO1EX type=write size=707962 2024-09-14T11:20:58.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.922+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=XO04OGPC8CKK type=del size=776989 2024-09-14T11:20:58.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.923+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=E2K1N3Q0FXD3 type=del 2024-09-14T11:20:58.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.924+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=EUFXXCSPUK5G type=del size=4072773 2024-09-14T11:20:58.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.926+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~B32SF0L3NH9P.0 size=1048576 2024-09-14T11:20:58.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.927+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~B32SF0L3NH9P.1 size=140213 2024-09-14T11:20:58.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.928+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=B32SF0L3NH9P tag=VGA1K5VZLFN4 type=write size=2237365 2024-09-14T11:20:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.930+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~IG3WF86AJCOD.0 size=1048576 2024-09-14T11:20:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.931+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~IG3WF86AJCOD.1 size=162574 2024-09-14T11:20:58.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.931+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=IG3WF86AJCOD tag=G6BNKJYJSJS2 type=write size=2259726 2024-09-14T11:20:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.932+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~4OUX8ECLRO2N.0 size=657402 2024-09-14T11:20:58.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.934+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=4OUX8ECLRO2N tag=EWO5JQT73R2W type=write size=1705978 2024-09-14T11:20:58.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.936+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~5A6KT7I9MH60.0 size=957012 2024-09-14T11:20:58.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.936+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=5A6KT7I9MH60 tag=JLJJ8FANCVLE type=write size=2005588 2024-09-14T11:20:58.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.937+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~E2GA5NF6JTBC.0 size=759884 2024-09-14T11:20:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.940+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=E2GA5NF6JTBC tag=FDJOVJ51L6F7 type=write size=1808460 2024-09-14T11:20:58.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.941+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=TWGKGTU9TN02 type=del size=1128235 2024-09-14T11:20:58.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.943+0000 7fc354693780 1 < suggested update operation key=MQ5V2G5U43J1 tag=70NRUB2L29KS type=write size=463077 2024-09-14T11:20:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.944+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=42FBDI263J1Y type=del size=2852095 2024-09-14T11:20:58.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.945+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=04DNUVCIIOQX type=del 2024-09-14T11:20:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.947+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.0 size=1048576 2024-09-14T11:20:58.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.948+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.1 size=1048576 2024-09-14T11:20:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.949+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.2 size=1017971 2024-09-14T11:20:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.949+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=0UNMXAHKNSG9 tag=EAYGH1QL8LMV type=write size=4163699 2024-09-14T11:20:58.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.950+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~72U7QPSQE95L.0 size=1032779 2024-09-14T11:20:58.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.952+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=72U7QPSQE95L tag=Z546QRAI2731 type=write size=2081355 2024-09-14T11:20:58.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.954+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~GN1UGNWL1453.0 size=747674 2024-09-14T11:20:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.954+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=GN1UGNWL1453 tag=HTHHYLV6W3AS type=write size=1796250 2024-09-14T11:20:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.955+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=KYZL2AEVLR4U type=del 2024-09-14T11:20:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.957+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~3V2ECVO0ATKX.0 size=964164 2024-09-14T11:20:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.957+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=3V2ECVO0ATKX tag=WVYOAPNW4NDU type=write size=2012740 2024-09-14T11:20:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.959+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~N7AAAAGYWCTT.0 size=1048576 2024-09-14T11:20:58.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.959+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~N7AAAAGYWCTT.1 size=387547 2024-09-14T11:20:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.960+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=N7AAAAGYWCTT tag=QI0K36CUTSGK type=write size=2484699 2024-09-14T11:20:58.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.962+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~YL87IN0669IJ.0 size=1048576 2024-09-14T11:20:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.963+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~YL87IN0669IJ.1 size=958134 2024-09-14T11:20:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.963+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=YL87IN0669IJ tag=4R6FQI26B028 type=write size=3055286 2024-09-14T11:20:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.965+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~J6KBJBT75SX9.0 size=1034892 2024-09-14T11:20:58.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.966+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=J6KBJBT75SX9 tag=8VTHC7F91YPL type=write size=2083468 2024-09-14T11:20:58.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.968+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.0 size=1048576 2024-09-14T11:20:58.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.969+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.1 size=1048576 2024-09-14T11:20:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.970+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.2 size=625872 2024-09-14T11:20:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.970+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=O29O1M5QN8CQ tag=MKEPOWT6HCP0 type=write size=3771600 2024-09-14T11:20:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.971+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=D3G9ICJG480V type=del 2024-09-14T11:20:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.972+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=1PNVRF5CCUWL type=del size=128486 2024-09-14T11:20:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.973+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=BGUY5QBGKM76 type=del 2024-09-14T11:20:58.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.974+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=ELQ3WUD0PF9Y type=write size=863863 2024-09-14T11:20:58.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.976+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~LGH1QFUOP246.0 size=891888 2024-09-14T11:20:58.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.977+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=LGH1QFUOP246 tag=VSZNEDO0JIJQ type=write size=1940464 2024-09-14T11:20:58.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.978+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=O3AAY1FNDNZJ type=del size=521154 2024-09-14T11:20:58.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.980+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.0 size=1048576 2024-09-14T11:20:58.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.980+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.1 size=1048576 2024-09-14T11:20:58.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.981+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~425U0C175OWG.2 size=503980 2024-09-14T11:20:58.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.983+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=425U0C175OWG tag=YZW3HSDGHYWI type=write size=3649708 2024-09-14T11:20:58.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.985+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~1WZAC61BH6AE.0 size=1048576 2024-09-14T11:20:58.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.986+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~1WZAC61BH6AE.1 size=657943 2024-09-14T11:20:58.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.986+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=1WZAC61BH6AE tag=XPN1E7M1LW67 type=write size=2755095 2024-09-14T11:20:58.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.989+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=AA6NR52MBJ4A type=del 2024-09-14T11:20:58.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.990+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=1T032M7IUBA7 type=del size=2523160 2024-09-14T11:20:58.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.991+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=XO04OGPC8CKK type=del 2024-09-14T11:20:58.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.992+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=F3HMOJQ8MO6Z type=del size=127449 2024-09-14T11:20:58.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.993+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=EUFXXCSPUK5G type=del 2024-09-14T11:20:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.994+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=SAN783T3G0UJ type=del size=80658 2024-09-14T11:20:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.995+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~IG3WF86AJCOD.0 size=1048576 2024-09-14T11:20:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.996+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~IG3WF86AJCOD.1 size=162574 2024-09-14T11:20:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:58.998+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=IG3WF86AJCOD tag=G6BNKJYJSJS2 type=write size=2259726 2024-09-14T11:20:58.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.000+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~Y1LKT3T21XTL.0 size=969711 2024-09-14T11:20:58.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.000+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=Y1LKT3T21XTL tag=WCYKOANSZ37M type=write size=2018287 2024-09-14T11:20:58.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.001+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~5A6KT7I9MH60.0 size=957012 2024-09-14T11:20:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.003+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=5A6KT7I9MH60 tag=JLJJ8FANCVLE type=write size=2005588 2024-09-14T11:20:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.005+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.0 size=1048576 2024-09-14T11:20:59.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.006+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.1 size=1048576 2024-09-14T11:20:59.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.007+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.2 size=925603 2024-09-14T11:20:59.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.007+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=GA91HZIC0PAB tag=B8K4FG4AUG3Y type=write size=4071331 2024-09-14T11:20:59.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.008+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=TWGKGTU9TN02 type=del 2024-09-14T11:20:59.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.010+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~U1MQCDBFQIU9.0 size=1048576 2024-09-14T11:20:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.011+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~U1MQCDBFQIU9.1 size=801316 2024-09-14T11:20:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.011+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=U1MQCDBFQIU9 tag=GWYGH9S0DQRW type=write size=2898468 2024-09-14T11:20:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.012+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=42FBDI263J1Y type=del 2024-09-14T11:20:59.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.013+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=K9EWUVI1M1SI type=del size=2910787 2024-09-14T11:20:59.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.013+0000 7fc354693780 1 < canceled part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.0 size=1048576 2024-09-14T11:20:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.014+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.1 size=1048576 2024-09-14T11:20:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.015+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~0UNMXAHKNSG9.2 size=1017971 2024-09-14T11:20:59.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.017+0000 7fc354693780 1 < canceled multipart upload key=IJZB38U355GG upload=0UNMXAHKNSG9 tag=EAYGH1QL8LMV type=write size=4163699 2024-09-14T11:20:59.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.018+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=348ZCPJQB4UC type=del size=2787058 2024-09-14T11:20:59.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.019+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~GN1UGNWL1453.0 size=747674 2024-09-14T11:20:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.021+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=GN1UGNWL1453 tag=HTHHYLV6W3AS type=write size=1796250 2024-09-14T11:20:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.022+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=86P22JXQP9H1 type=write size=78840 2024-09-14T11:20:59.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.023+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~3V2ECVO0ATKX.0 size=964164 2024-09-14T11:20:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.025+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=3V2ECVO0ATKX tag=WVYOAPNW4NDU type=write size=2012740 2024-09-14T11:20:59.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.026+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=S0E6Q9U0Z0KJ type=del size=1866612 2024-09-14T11:20:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.027+0000 7fc354693780 1 < canceled part key=_multipart_TFTKNNCGN88D.2~YL87IN0669IJ.0 size=1048576 2024-09-14T11:20:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.027+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~YL87IN0669IJ.1 size=958134 2024-09-14T11:20:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.029+0000 7fc354693780 1 < canceled multipart upload key=TFTKNNCGN88D upload=YL87IN0669IJ tag=4R6FQI26B028 type=write size=3055286 2024-09-14T11:20:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.030+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=OAB4H0AMZJR4 type=del size=580838 2024-09-14T11:20:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.032+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.0 size=1048576 2024-09-14T11:20:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.033+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.1 size=1048576 2024-09-14T11:20:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.034+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~O29O1M5QN8CQ.2 size=625872 2024-09-14T11:20:59.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.035+0000 7fc354693780 1 < completed multipart upload key=4IDBIAE3VAY4 upload=O29O1M5QN8CQ tag=MKEPOWT6HCP0 type=write size=3771600 2024-09-14T11:20:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.037+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=T9TA7VIACUU3 type=del size=1063124 2024-09-14T11:20:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.038+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=1PNVRF5CCUWL type=del 2024-09-14T11:20:59.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.039+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=ZG0CH3LWG6A6 type=del size=3985768 2024-09-14T11:20:59.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.041+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=ELQ3WUD0PF9Y type=write size=863863 2024-09-14T11:20:59.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.042+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=YD42QUJG1VX6 type=del size=416022 2024-09-14T11:20:59.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.043+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=O3AAY1FNDNZJ type=del 2024-09-14T11:20:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.045+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~HM0OFJ3VD09Q.0 size=1043316 2024-09-14T11:20:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.045+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=HM0OFJ3VD09Q tag=QK5JGE15V9V8 type=write size=2091892 2024-09-14T11:20:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.046+0000 7fc354693780 1 < canceled part key=_multipart_MQ5V2G5U43J1.2~1WZAC61BH6AE.0 size=1048576 2024-09-14T11:20:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.047+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~1WZAC61BH6AE.1 size=657943 2024-09-14T11:20:59.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.048+0000 7fc354693780 1 < canceled multipart upload key=MQ5V2G5U43J1 upload=1WZAC61BH6AE tag=XPN1E7M1LW67 type=write size=2755095 2024-09-14T11:20:59.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.050+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=TDVASHVHDOJQ type=del size=531094 2024-09-14T11:20:59.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.051+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=1T032M7IUBA7 type=del 2024-09-14T11:20:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.053+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~GKRQ9QF7I3TI.0 size=329742 2024-09-14T11:20:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.053+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=GKRQ9QF7I3TI tag=55OTE1BLEKUE type=write size=1378318 2024-09-14T11:20:59.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.056+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=F3HMOJQ8MO6Z type=del 2024-09-14T11:20:59.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.058+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~0HO6I26XEVAH.0 size=1048576 2024-09-14T11:20:59.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.058+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~0HO6I26XEVAH.1 size=15977 2024-09-14T11:20:59.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.058+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=0HO6I26XEVAH tag=JUYJQFOHU5R9 type=write size=2113129 2024-09-14T11:20:59.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.060+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=SAN783T3G0UJ type=del 2024-09-14T11:20:59.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.061+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=699M119J2SCG type=del size=728471 2024-09-14T11:20:59.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.062+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~Y1LKT3T21XTL.0 size=969711 2024-09-14T11:20:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.064+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=Y1LKT3T21XTL tag=WCYKOANSZ37M type=write size=2018287 2024-09-14T11:20:59.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.066+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~O5ILEF6VUSO7.0 size=502427 2024-09-14T11:20:59.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.066+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=O5ILEF6VUSO7 tag=DJXSZUIAPMY3 type=write size=1551003 2024-09-14T11:20:59.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.067+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.0 size=1048576 2024-09-14T11:20:59.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.068+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.1 size=1048576 2024-09-14T11:20:59.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.069+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~GA91HZIC0PAB.2 size=925603 2024-09-14T11:20:59.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.071+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=GA91HZIC0PAB tag=B8K4FG4AUG3Y type=write size=4071331 2024-09-14T11:20:59.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.072+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=PXI7RKWZU3KT type=del size=2476193 2024-09-14T11:20:59.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.073+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~U1MQCDBFQIU9.0 size=1048576 2024-09-14T11:20:59.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.074+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~U1MQCDBFQIU9.1 size=801316 2024-09-14T11:20:59.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.076+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=U1MQCDBFQIU9 tag=GWYGH9S0DQRW type=write size=2898468 2024-09-14T11:20:59.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.077+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=GXB855EIU2V1 type=del size=4146570 2024-09-14T11:20:59.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.079+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=K9EWUVI1M1SI type=del 2024-09-14T11:20:59.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.081+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=GYX9O7MTEPW7 type=del size=3269610 2024-09-14T11:20:59.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.082+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=348ZCPJQB4UC type=del size=2787058 2024-09-14T11:20:59.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.084+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~F6RSBU3ZKFHL.0 size=773988 2024-09-14T11:20:59.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.084+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=F6RSBU3ZKFHL tag=0QH74H6X55DV type=write size=1822564 2024-09-14T11:20:59.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.085+0000 7fc354693780 1 < completed write operation key=GE83T07IQG0S tag=86P22JXQP9H1 type=write size=78840 2024-09-14T11:20:59.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.086+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=DMK36Y15D4NY type=del size=1311096 2024-09-14T11:20:59.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.087+0000 7fc354693780 -1 < failed to complete operation key=BKW08T86L2ZF tag=S0E6Q9U0Z0KJ type=del size=1866612: (22) Invalid argument 2024-09-14T11:20:59.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.089+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~R90LA56GF9LF.0 size=168950 2024-09-14T11:20:59.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.089+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=R90LA56GF9LF tag=DO6U29P9TKKD type=write size=1217526 2024-09-14T11:20:59.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.091+0000 7fc354693780 1 < suggested remove operation key=RHVF0Z2PRDA8 tag=OAB4H0AMZJR4 type=del 2024-09-14T11:20:59.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.094+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~OLUYG4J3PD80.0 size=1048576 2024-09-14T11:20:59.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.095+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~OLUYG4J3PD80.1 size=848190 2024-09-14T11:20:59.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.095+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=OLUYG4J3PD80 tag=ZAJWL029HIXO type=write size=2945342 2024-09-14T11:20:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.097+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=T9TA7VIACUU3 type=del 2024-09-14T11:20:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.099+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=O6TPL9QLK3CZ type=del size=4074151 2024-09-14T11:20:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.100+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=ZG0CH3LWG6A6 type=del 2024-09-14T11:20:59.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.101+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=4QZ3SRTN6BOJ type=del size=2600098 2024-09-14T11:20:59.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.102+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=YD42QUJG1VX6 type=del 2024-09-14T11:20:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.103+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=8ICBDKWPQZQP type=del size=3436139 2024-09-14T11:20:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.103+0000 7fc354693780 1 < canceled part key=_multipart_4IDBIAE3VAY4.2~HM0OFJ3VD09Q.0 size=1043316 2024-09-14T11:20:59.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.105+0000 7fc354693780 1 < canceled multipart upload key=4IDBIAE3VAY4 upload=HM0OFJ3VD09Q tag=QK5JGE15V9V8 type=write size=2091892 2024-09-14T11:20:59.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.106+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=Y6QJER9V9KY3 type=del size=1016381 2024-09-14T11:20:59.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.107+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=TDVASHVHDOJQ type=del 2024-09-14T11:20:59.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.109+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.0 size=1048576 2024-09-14T11:20:59.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.110+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.1 size=1048576 2024-09-14T11:20:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.111+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.2 size=1038609 2024-09-14T11:20:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.111+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=9N2LPA49IP8P tag=RCTS5SED9G9V type=write size=4184337 2024-09-14T11:20:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.112+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~GKRQ9QF7I3TI.0 size=329742 2024-09-14T11:20:59.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.114+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=GKRQ9QF7I3TI tag=55OTE1BLEKUE type=write size=1378318 2024-09-14T11:20:59.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.115+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=1SLVNZSUXGYC type=del size=4154861 2024-09-14T11:20:59.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.116+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~0HO6I26XEVAH.0 size=1048576 2024-09-14T11:20:59.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.116+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~0HO6I26XEVAH.1 size=15977 2024-09-14T11:20:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.118+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=0HO6I26XEVAH tag=JUYJQFOHU5R9 type=write size=2113129 2024-09-14T11:20:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.120+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~6EZYE1VFU25S.0 size=1048576 2024-09-14T11:20:59.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.121+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~6EZYE1VFU25S.1 size=155594 2024-09-14T11:20:59.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.121+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=6EZYE1VFU25S tag=HF0AOR7Z8VFV type=write size=2252746 2024-09-14T11:20:59.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.122+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=699M119J2SCG type=del 2024-09-14T11:20:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.123+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=YEEHJW4KTA65 type=del size=311179 2024-09-14T11:20:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.125+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~O5ILEF6VUSO7.0 size=502427 2024-09-14T11:20:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.127+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=O5ILEF6VUSO7 tag=DJXSZUIAPMY3 type=write size=1551003 2024-09-14T11:20:59.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.128+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=5JZ9VY81F5FY type=del size=302854 2024-09-14T11:20:59.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.130+0000 7fc354693780 1 < suggested update operation key=Z3ZFX1354IRF tag=PXI7RKWZU3KT type=del size=2476193 2024-09-14T11:20:59.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.131+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=ASZ575S3R9EF type=del size=2605603 2024-09-14T11:20:59.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.132+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=GXB855EIU2V1 type=del 2024-09-14T11:20:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.134+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~1O6MT2X5HXHV.0 size=321525 2024-09-14T11:20:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.134+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=1O6MT2X5HXHV tag=FJU0H89Q1ALI type=write size=1370101 2024-09-14T11:20:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.136+0000 7fc354693780 -1 < failed to complete operation key=ICNEXZMA3VQV tag=GYX9O7MTEPW7 type=del size=3269610: (22) Invalid argument 2024-09-14T11:20:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.137+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=DJE6M8H9GJ3A type=write size=22028 2024-09-14T11:20:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.137+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~F6RSBU3ZKFHL.0 size=773988 2024-09-14T11:20:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.139+0000 7fc354693780 1 < canceled multipart upload key=QWMHFF32M37W upload=F6RSBU3ZKFHL tag=0QH74H6X55DV type=write size=1822564 2024-09-14T11:20:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.140+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=K3RWDWEC3I69 type=del size=1827330 2024-09-14T11:20:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.141+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=DMK36Y15D4NY type=del 2024-09-14T11:20:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.142+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=F33Q21ZOL3X6 type=del size=1870005 2024-09-14T11:20:59.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.144+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~R90LA56GF9LF.0 size=168950 2024-09-14T11:20:59.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.146+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=R90LA56GF9LF tag=DO6U29P9TKKD type=write size=1217526 2024-09-14T11:20:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.148+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.0 size=1048576 2024-09-14T11:20:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.149+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.1 size=1048576 2024-09-14T11:20:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.150+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.2 size=196650 2024-09-14T11:20:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.150+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=JHQI2ZGNDZRC tag=9LE8KPPWQ1XA type=write size=3342378 2024-09-14T11:20:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.150+0000 7fc354693780 1 < canceled part key=_multipart_FMG2DNGS0LZ3.2~OLUYG4J3PD80.0 size=1048576 2024-09-14T11:20:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.151+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~OLUYG4J3PD80.1 size=848190 2024-09-14T11:20:59.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.153+0000 7fc354693780 1 < canceled multipart upload key=FMG2DNGS0LZ3 upload=OLUYG4J3PD80 tag=ZAJWL029HIXO type=write size=2945342 2024-09-14T11:20:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.155+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~CSZYTA2FIL4X.0 size=755754 2024-09-14T11:20:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.155+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=CSZYTA2FIL4X tag=4S9VF8YRP7SK type=write size=1804330 2024-09-14T11:20:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.157+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=O6TPL9QLK3CZ type=del size=4074151 2024-09-14T11:20:59.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.158+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=RZM9YYJGZYOR type=del size=3286128 2024-09-14T11:20:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.160+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=4QZ3SRTN6BOJ type=del size=2600098 2024-09-14T11:20:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.161+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=GUIT8XYI8F3Q type=write size=259698 2024-09-14T11:20:59.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.162+0000 7fc354693780 -1 < failed to complete operation key=BKW08T86L2ZF tag=8ICBDKWPQZQP type=del size=3436139: (22) Invalid argument 2024-09-14T11:20:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.163+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=3KYPZKC1EA5Q type=del size=4137495 2024-09-14T11:20:59.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.164+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=Y6QJER9V9KY3 type=del 2024-09-14T11:20:59.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.167+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~Z4LAUK4KMD81.0 size=1048576 2024-09-14T11:20:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.167+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~Z4LAUK4KMD81.1 size=1036238 2024-09-14T11:20:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.167+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=Z4LAUK4KMD81 tag=1JRUCLZE4Y6P type=write size=3133390 2024-09-14T11:20:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.169+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.0 size=1048576 2024-09-14T11:20:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.170+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.1 size=1048576 2024-09-14T11:20:59.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.170+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~9N2LPA49IP8P.2 size=1038609 2024-09-14T11:20:59.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.172+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=9N2LPA49IP8P tag=RCTS5SED9G9V type=write size=4184337 2024-09-14T11:20:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.173+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=OJQ9FWTJ9BED type=write size=930334 2024-09-14T11:20:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.175+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=1SLVNZSUXGYC type=del 2024-09-14T11:20:59.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.176+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=5KRNFJ1X398N type=del size=1344744 2024-09-14T11:20:59.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.177+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~6EZYE1VFU25S.0 size=1048576 2024-09-14T11:20:59.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.178+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~6EZYE1VFU25S.1 size=155594 2024-09-14T11:20:59.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.180+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=6EZYE1VFU25S tag=HF0AOR7Z8VFV type=write size=2252746 2024-09-14T11:20:59.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.181+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=GSE7W0FFV9C6 type=del size=502641 2024-09-14T11:20:59.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.183+0000 7fc354693780 1 < suggested update operation key=NENG5XNJ7M5Z tag=YEEHJW4KTA65 type=del size=311179 2024-09-14T11:20:59.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.184+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=RR5LSEA2MT8W type=del size=3409804 2024-09-14T11:20:59.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.186+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=5JZ9VY81F5FY type=del 2024-09-14T11:20:59.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.187+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=VTX7WDD8LKXK type=write size=707946 2024-09-14T11:20:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.190+0000 7fc354693780 1 < suggested remove operation key=H1S2CBHNW6GI tag=ASZ575S3R9EF type=del 2024-09-14T11:20:59.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.192+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~CLKA135ZSCAP.0 size=1048576 2024-09-14T11:20:59.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.193+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~CLKA135ZSCAP.1 size=314949 2024-09-14T11:20:59.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.193+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=CLKA135ZSCAP tag=TIPPBBZX5VC5 type=write size=2412101 2024-09-14T11:20:59.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.195+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~1O6MT2X5HXHV.0 size=321525 2024-09-14T11:20:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.197+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=1O6MT2X5HXHV tag=FJU0H89Q1ALI type=write size=1370101 2024-09-14T11:20:59.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.198+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=W62AD6K53F0Y type=del size=4144690 2024-09-14T11:20:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.199+0000 7fc354693780 1 < completed write operation key=MQ5V2G5U43J1 tag=DJE6M8H9GJ3A type=write size=22028 2024-09-14T11:20:59.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.202+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KG3KIJBCJJD3.0 size=1048576 2024-09-14T11:20:59.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.203+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KG3KIJBCJJD3.1 size=788197 2024-09-14T11:20:59.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.203+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=KG3KIJBCJJD3 tag=RZ2JKRQ84EW1 type=write size=2885349 2024-09-14T11:20:59.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.205+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=K3RWDWEC3I69 type=del 2024-09-14T11:20:59.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.207+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=29QMESDN620W type=del size=147983 2024-09-14T11:20:59.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.208+0000 7fc354693780 -1 < failed to complete operation key=NENG5XNJ7M5Z tag=F33Q21ZOL3X6 type=del size=1870005: (22) Invalid argument 2024-09-14T11:20:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.209+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=U62H0UK68UBB type=del size=1809154 2024-09-14T11:20:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.211+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.0 size=1048576 2024-09-14T11:20:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.212+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.1 size=1048576 2024-09-14T11:20:59.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.212+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~JHQI2ZGNDZRC.2 size=196650 2024-09-14T11:20:59.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.214+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=JHQI2ZGNDZRC tag=9LE8KPPWQ1XA type=write size=3342378 2024-09-14T11:20:59.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.216+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=Z59I1N7W5YSY type=del size=3775293 2024-09-14T11:20:59.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.217+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~CSZYTA2FIL4X.0 size=755754 2024-09-14T11:20:59.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.219+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=CSZYTA2FIL4X tag=4S9VF8YRP7SK type=write size=1804330 2024-09-14T11:20:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.220+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=UANBYTOZVBI4 type=del size=2730971 2024-09-14T11:20:59.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.221+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=RZM9YYJGZYOR type=del 2024-09-14T11:20:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.223+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=O5MG8VQJUB4T type=del size=2665470 2024-09-14T11:20:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.224+0000 7fc354693780 1 < completed write operation key=PRBZQWTFXQ7R tag=GUIT8XYI8F3Q type=write size=259698 2024-09-14T11:20:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.225+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=HD0OUYKWUXSX type=write size=540178 2024-09-14T11:20:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.227+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=3KYPZKC1EA5Q type=del 2024-09-14T11:20:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.229+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.0 size=1048576 2024-09-14T11:20:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.230+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.1 size=1048576 2024-09-14T11:20:59.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.231+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.2 size=864512 2024-09-14T11:20:59.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.231+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=Y21M1U9FRKOQ tag=P9II7QMXFHBW type=write size=4010240 2024-09-14T11:20:59.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.231+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~Z4LAUK4KMD81.0 size=1048576 2024-09-14T11:20:59.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.232+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~Z4LAUK4KMD81.1 size=1036238 2024-09-14T11:20:59.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.234+0000 7fc354693780 1 < canceled multipart upload key=4Z3KI5X3WQ0I upload=Z4LAUK4KMD81 tag=1JRUCLZE4Y6P type=write size=3133390 2024-09-14T11:20:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.236+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~C6J67GE5F7V1.0 size=875816 2024-09-14T11:20:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.236+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=C6J67GE5F7V1 tag=DQXMQ6LMGBAR type=write size=1924392 2024-09-14T11:20:59.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.239+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=OJQ9FWTJ9BED type=write size=930334 2024-09-14T11:20:59.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.240+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=W95XCGT824S3 type=del size=3187231 2024-09-14T11:20:59.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.241+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=5KRNFJ1X398N type=del 2024-09-14T11:20:59.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.243+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.0 size=1048576 2024-09-14T11:20:59.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.244+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.1 size=1048576 2024-09-14T11:20:59.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.245+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.2 size=272476 2024-09-14T11:20:59.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.245+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=LKXL3TYHSBG5 tag=7SCS2ATQY7QP type=write size=3418204 2024-09-14T11:20:59.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.246+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=GSE7W0FFV9C6 type=del 2024-09-14T11:20:59.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.248+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=QXKWMBYJCSE9 type=del size=860714 2024-09-14T11:20:59.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.250+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=RR5LSEA2MT8W type=del 2024-09-14T11:20:59.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.251+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=LJ53T01ODUZE type=del size=3982711 2024-09-14T11:20:59.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.252+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=VTX7WDD8LKXK type=write size=707946 2024-09-14T11:20:59.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.253+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=2A285K3Y05FT type=del size=1576962 2024-09-14T11:20:59.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.254+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~CLKA135ZSCAP.0 size=1048576 2024-09-14T11:20:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.255+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~CLKA135ZSCAP.1 size=314949 2024-09-14T11:20:59.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.257+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=CLKA135ZSCAP tag=TIPPBBZX5VC5 type=write size=2412101 2024-09-14T11:20:59.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.259+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~XMYTGEWAH574.0 size=434100 2024-09-14T11:20:59.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.259+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=XMYTGEWAH574 tag=2L6KRGL6Q2AZ type=write size=1482676 2024-09-14T11:20:59.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.260+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=W62AD6K53F0Y type=del 2024-09-14T11:20:59.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.262+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=SBOJ6OEQBXQ2 type=write size=59731 2024-09-14T11:20:59.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.263+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KG3KIJBCJJD3.0 size=1048576 2024-09-14T11:20:59.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.264+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KG3KIJBCJJD3.1 size=788197 2024-09-14T11:20:59.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.265+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=KG3KIJBCJJD3 tag=RZ2JKRQ84EW1 type=write size=2885349 2024-09-14T11:20:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.268+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~X8VDUSD7QO8D.0 size=997326 2024-09-14T11:20:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.268+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=X8VDUSD7QO8D tag=GJZWWIC1N7O3 type=write size=2045902 2024-09-14T11:20:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.268+0000 7fc354693780 -1 < no bi entry to suggest for operation key=NENG5XNJ7M5Z tag=29QMESDN620W type=del size=147983: (2) No such file or directory 2024-09-14T11:20:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.269+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=8GW4WM3ZSZYJ type=del size=235009 2024-09-14T11:20:59.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.270+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=U62H0UK68UBB type=del 2024-09-14T11:20:59.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.272+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=QWEY5S2EPBB6 type=del size=1462275 2024-09-14T11:20:59.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.273+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=Z59I1N7W5YSY type=del size=3775293 2024-09-14T11:20:59.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.274+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=0N0H73DT4OLZ type=del size=2926768 2024-09-14T11:20:59.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.275+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=UANBYTOZVBI4 type=del 2024-09-14T11:20:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.276+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=X1EZJVMVFJSA type=del size=738576 2024-09-14T11:20:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.277+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=O5MG8VQJUB4T type=del 2024-09-14T11:20:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.279+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~X91DLYYQFJF2.0 size=1048576 2024-09-14T11:20:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.280+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~X91DLYYQFJF2.1 size=759698 2024-09-14T11:20:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.280+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=X91DLYYQFJF2 tag=QE6N4B5U17JP type=write size=2856850 2024-09-14T11:20:59.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.282+0000 7fc354693780 1 < completed write operation key=RHVF0Z2PRDA8 tag=HD0OUYKWUXSX type=write size=540178 2024-09-14T11:20:59.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.283+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=9YX15QYFD8W9 type=del size=1923615 2024-09-14T11:20:59.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.283+0000 7fc354693780 1 < canceled part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.0 size=1048576 2024-09-14T11:20:59.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.284+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.1 size=1048576 2024-09-14T11:20:59.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.285+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~Y21M1U9FRKOQ.2 size=864512 2024-09-14T11:20:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.287+0000 7fc354693780 1 < canceled multipart upload key=6SIWH1BHPFGM upload=Y21M1U9FRKOQ tag=P9II7QMXFHBW type=write size=4010240 2024-09-14T11:20:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.288+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=ONFAXH11SXXX type=write size=584052 2024-09-14T11:20:59.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.289+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~C6J67GE5F7V1.0 size=875816 2024-09-14T11:20:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.291+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=C6J67GE5F7V1 tag=DQXMQ6LMGBAR type=write size=1924392 2024-09-14T11:20:59.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.292+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=I1H4CDGO85AB type=write size=99523 2024-09-14T11:20:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.293+0000 7fc354693780 1 < canceled operation key=OOFM3K1KEB9V tag=W95XCGT824S3 type=del size=3187231 2024-09-14T11:20:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.294+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=9JHD0QA4FS8D type=del size=110943 2024-09-14T11:20:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.295+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.0 size=1048576 2024-09-14T11:20:59.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.296+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.1 size=1048576 2024-09-14T11:20:59.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.296+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~LKXL3TYHSBG5.2 size=272476 2024-09-14T11:20:59.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.298+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=LKXL3TYHSBG5 tag=7SCS2ATQY7QP type=write size=3418204 2024-09-14T11:20:59.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.300+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.0 size=1048576 2024-09-14T11:20:59.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.301+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.1 size=1048576 2024-09-14T11:20:59.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.302+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.2 size=154726 2024-09-14T11:20:59.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.302+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=VAE01OF1PU6T tag=9CMDY5ZL6G8Y type=write size=3300454 2024-09-14T11:20:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.303+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=QXKWMBYJCSE9 type=del 2024-09-14T11:20:59.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.305+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~F7V2FNL90YF9.0 size=305175 2024-09-14T11:20:59.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.305+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=F7V2FNL90YF9 tag=W239WXEB2BB9 type=write size=1353751 2024-09-14T11:20:59.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.306+0000 7fc354693780 1 < canceled operation key=T0Z8NK20DS5K tag=LJ53T01ODUZE type=del size=3982711 2024-09-14T11:20:59.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.308+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.0 size=1048576 2024-09-14T11:20:59.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.309+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.1 size=1048576 2024-09-14T11:20:59.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.310+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.2 size=944790 2024-09-14T11:20:59.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.310+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=MUUCPA71AQV8 tag=N3HV5QTALMQR type=write size=4090518 2024-09-14T11:20:59.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.312+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=2A285K3Y05FT type=del size=1576962 2024-09-14T11:20:59.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.313+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=7SOUWHRBDYL2 type=del size=1821162 2024-09-14T11:20:59.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.315+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~XMYTGEWAH574.0 size=434100 2024-09-14T11:20:59.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.317+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=XMYTGEWAH574 tag=2L6KRGL6Q2AZ type=write size=1482676 2024-09-14T11:20:59.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.319+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.0 size=1048576 2024-09-14T11:20:59.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.320+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.1 size=1048576 2024-09-14T11:20:59.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.320+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.2 size=917176 2024-09-14T11:20:59.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.320+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=V5NCWKXKQHOE tag=BO7LHP9OIC0H type=write size=4062904 2024-09-14T11:20:59.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.322+0000 7fc354693780 1 < completed write operation key=ICNEXZMA3VQV tag=SBOJ6OEQBXQ2 type=write size=59731 2024-09-14T11:20:59.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.323+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~X3GXQ7UU0LUK.0 size=100627 2024-09-14T11:20:59.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.323+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=X3GXQ7UU0LUK tag=10C7TH88VYSX type=write size=1149203 2024-09-14T11:20:59.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.324+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~X8VDUSD7QO8D.0 size=997326 2024-09-14T11:20:59.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.326+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=X8VDUSD7QO8D tag=GJZWWIC1N7O3 type=write size=2045902 2024-09-14T11:20:59.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.327+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=ZSJMNY927IY8 type=del size=1698007 2024-09-14T11:20:59.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.328+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=8GW4WM3ZSZYJ type=del 2024-09-14T11:20:59.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.329+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=2PPE1QN1CNRH type=write size=783208 2024-09-14T11:20:59.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.331+0000 7fc354693780 1 < suggested remove operation key=TFTKNNCGN88D tag=QWEY5S2EPBB6 type=del 2024-09-14T11:20:59.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.333+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~T0VSKOG3VNHG.0 size=299616 2024-09-14T11:20:59.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.333+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=T0VSKOG3VNHG tag=CM2PICGXEH89 type=write size=1348192 2024-09-14T11:20:59.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.334+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=0N0H73DT4OLZ type=del 2024-09-14T11:20:59.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.336+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=521Y8WS998H4 type=del size=1717184 2024-09-14T11:20:59.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.337+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=X1EZJVMVFJSA type=del 2024-09-14T11:20:59.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.338+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=FA5ZQYWDHML4 type=del size=1338982 2024-09-14T11:20:59.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.339+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~X91DLYYQFJF2.0 size=1048576 2024-09-14T11:20:59.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.340+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~X91DLYYQFJF2.1 size=759698 2024-09-14T11:20:59.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.342+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=X91DLYYQFJF2 tag=QE6N4B5U17JP type=write size=2856850 2024-09-14T11:20:59.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.343+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=2NWL6EAMSZ3I type=del size=2127016 2024-09-14T11:20:59.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.345+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=9YX15QYFD8W9 type=del 2024-09-14T11:20:59.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.346+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=27HERXHQD6B7 type=del size=149668 2024-09-14T11:20:59.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.347+0000 7fc354693780 1 < completed write operation key=BTET4HD5NY0D tag=ONFAXH11SXXX type=write size=584052 2024-09-14T11:20:59.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.348+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=8AK2NB2IBJIR type=write size=569827 2024-09-14T11:20:59.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.349+0000 7fc354693780 1 < completed write operation key=WYD70VR8OKAN tag=I1H4CDGO85AB type=write size=99523 2024-09-14T11:20:59.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.352+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~TJLC2PU01VO6.0 size=1048576 2024-09-14T11:20:59.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.353+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~TJLC2PU01VO6.1 size=389120 2024-09-14T11:20:59.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.353+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=TJLC2PU01VO6 tag=JKKZGFE712PC type=write size=2486272 2024-09-14T11:20:59.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.355+0000 7fc354693780 1 < suggested remove operation key=WYD70VR8OKAN tag=9JHD0QA4FS8D type=del 2024-09-14T11:20:59.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.356+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=VO8P2K7FJIV8 type=write size=59223 2024-09-14T11:20:59.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.357+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.0 size=1048576 2024-09-14T11:20:59.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.358+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.1 size=1048576 2024-09-14T11:20:59.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.359+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~VAE01OF1PU6T.2 size=154726 2024-09-14T11:20:59.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.361+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=VAE01OF1PU6T tag=9CMDY5ZL6G8Y type=write size=3300454 2024-09-14T11:20:59.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.362+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=4T0Y7DL09TSF type=del size=1739110 2024-09-14T11:20:59.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.363+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~F7V2FNL90YF9.0 size=305175 2024-09-14T11:20:59.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.365+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=F7V2FNL90YF9 tag=W239WXEB2BB9 type=write size=1353751 2024-09-14T11:20:59.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.366+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=Z2CPW2PLGL66 type=del size=1165660 2024-09-14T11:20:59.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.367+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.0 size=1048576 2024-09-14T11:20:59.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.368+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.1 size=1048576 2024-09-14T11:20:59.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.369+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~MUUCPA71AQV8.2 size=944790 2024-09-14T11:20:59.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.371+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=MUUCPA71AQV8 tag=N3HV5QTALMQR type=write size=4090518 2024-09-14T11:20:59.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.373+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~LG46DHB3T492.0 size=515469 2024-09-14T11:20:59.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.373+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=LG46DHB3T492 tag=X7DFEIE312Z9 type=write size=1564045 2024-09-14T11:20:59.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.374+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=7SOUWHRBDYL2 type=del size=1821162 2024-09-14T11:20:59.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.376+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=O3CT5XM5O7EC type=write size=857320 2024-09-14T11:20:59.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.377+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.0 size=1048576 2024-09-14T11:20:59.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.378+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.1 size=1048576 2024-09-14T11:20:59.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.379+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~V5NCWKXKQHOE.2 size=917176 2024-09-14T11:20:59.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.380+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=V5NCWKXKQHOE tag=BO7LHP9OIC0H type=write size=4062904 2024-09-14T11:20:59.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.382+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=4N2SK1C3TMJM type=del size=2064566 2024-09-14T11:20:59.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.383+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~X3GXQ7UU0LUK.0 size=100627 2024-09-14T11:20:59.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.385+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=X3GXQ7UU0LUK tag=10C7TH88VYSX type=write size=1149203 2024-09-14T11:20:59.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.386+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=YYR9R807W6BT type=write size=235700 2024-09-14T11:20:59.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.387+0000 7fc354693780 -1 < failed to complete operation key=WYD70VR8OKAN tag=ZSJMNY927IY8 type=del size=1698007: (22) Invalid argument 2024-09-14T11:20:59.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.389+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~I8SZDHLF2PVL.0 size=892577 2024-09-14T11:20:59.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.389+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=I8SZDHLF2PVL tag=O1LW6VDWV36O type=write size=1941153 2024-09-14T11:20:59.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.392+0000 7fc354693780 1 < suggested remove operation key=Z3ZFX1354IRF tag=2PPE1QN1CNRH type=write 2024-09-14T11:20:59.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.393+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=MMEM2J1MPZ4X type=del size=799128 2024-09-14T11:20:59.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.394+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~T0VSKOG3VNHG.0 size=299616 2024-09-14T11:20:59.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.396+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=T0VSKOG3VNHG tag=CM2PICGXEH89 type=write size=1348192 2024-09-14T11:20:59.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.397+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=5PQFGMW8AXCX type=del size=1242259 2024-09-14T11:20:59.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.399+0000 7fc354693780 1 < suggested update operation key=BJ7AARJEIT8W tag=521Y8WS998H4 type=del size=1717184 2024-09-14T11:20:59.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.401+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~3MJP210OW2YR.0 size=827381 2024-09-14T11:20:59.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.401+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=3MJP210OW2YR tag=SDMGQ07LLDF2 type=write size=1875957 2024-09-14T11:20:59.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.402+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=FA5ZQYWDHML4 type=del 2024-09-14T11:20:59.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.404+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~387VU5HFUBBK.0 size=1048576 2024-09-14T11:20:59.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.405+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~387VU5HFUBBK.1 size=1024763 2024-09-14T11:20:59.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.405+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=387VU5HFUBBK tag=2LPCTM8TEP4R type=write size=3121915 2024-09-14T11:20:59.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.406+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=2NWL6EAMSZ3I type=del 2024-09-14T11:20:59.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.408+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~LDQMBTUVLBG6.0 size=1048576 2024-09-14T11:20:59.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.409+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~LDQMBTUVLBG6.1 size=840540 2024-09-14T11:20:59.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.409+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=LDQMBTUVLBG6 tag=K55XOBNCUZ6T type=write size=2937692 2024-09-14T11:20:59.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.410+0000 7fc354693780 -1 < failed to complete operation key=WYD70VR8OKAN tag=27HERXHQD6B7 type=del size=149668: (22) Invalid argument 2024-09-14T11:20:59.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.412+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~MO686R21VW99.0 size=1048576 2024-09-14T11:20:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.413+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~MO686R21VW99.1 size=847709 2024-09-14T11:20:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.413+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=MO686R21VW99 tag=9D1P0JHMQFUD type=write size=2944861 2024-09-14T11:20:59.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.414+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=8AK2NB2IBJIR type=write size=569827 2024-09-14T11:20:59.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.416+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=UN6O2MRVWB7K type=del size=379172 2024-09-14T11:20:59.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.417+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~TJLC2PU01VO6.0 size=1048576 2024-09-14T11:20:59.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.418+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~TJLC2PU01VO6.1 size=389120 2024-09-14T11:20:59.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.421+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=TJLC2PU01VO6 tag=JKKZGFE712PC type=write size=2486272 2024-09-14T11:20:59.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.422+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=D4URKZPIHO2O type=del size=2989563 2024-09-14T11:20:59.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.423+0000 7fc354693780 1 < canceled operation key=N23XJJD7YYG0 tag=VO8P2K7FJIV8 type=write size=59223 2024-09-14T11:20:59.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.425+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=8C09XFJIFM3B type=del size=793179 2024-09-14T11:20:59.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.427+0000 7fc354693780 1 < suggested update operation key=BKW08T86L2ZF tag=4T0Y7DL09TSF type=del size=1739110 2024-09-14T11:20:59.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.428+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=NQEHR2V40L5Z type=del size=3313996 2024-09-14T11:20:59.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.429+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=Z2CPW2PLGL66 type=del 2024-09-14T11:20:59.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.431+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.0 size=1048576 2024-09-14T11:20:59.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.432+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.1 size=1048576 2024-09-14T11:20:59.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.433+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.2 size=626330 2024-09-14T11:20:59.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.433+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=XFUQD5QPO0XO tag=3PZI0L4O2DG6 type=write size=3772058 2024-09-14T11:20:59.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.434+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~LG46DHB3T492.0 size=515469 2024-09-14T11:20:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.436+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=LG46DHB3T492 tag=X7DFEIE312Z9 type=write size=1564045 2024-09-14T11:20:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.437+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=3SVBCLDWH8UE type=del size=2228418 2024-09-14T11:20:59.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.439+0000 7fc354693780 1 < canceled operation key=NENG5XNJ7M5Z tag=O3CT5XM5O7EC type=write size=857320 2024-09-14T11:20:59.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.440+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=DORXX02S1MXW type=del size=2446510 2024-09-14T11:20:59.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.442+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=4N2SK1C3TMJM type=del 2024-09-14T11:20:59.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.443+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=VVR81PL1RY28 type=del size=3066605 2024-09-14T11:20:59.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.445+0000 7fc354693780 1 < suggested update operation key=X4VH2WYJJ8GI tag=YYR9R807W6BT type=write size=235700 2024-09-14T11:20:59.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.447+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~FE192G3RKKE5.0 size=76201 2024-09-14T11:20:59.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.447+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=FE192G3RKKE5 tag=SQ2U8QZAS9AR type=write size=1124777 2024-09-14T11:20:59.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.449+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~I8SZDHLF2PVL.0 size=892577 2024-09-14T11:20:59.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.451+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=I8SZDHLF2PVL tag=O1LW6VDWV36O type=write size=1941153 2024-09-14T11:20:59.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.452+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=RBKOBF11CFT3 type=del size=2339479 2024-09-14T11:20:59.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.454+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=MMEM2J1MPZ4X type=del 2024-09-14T11:20:59.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.457+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.0 size=1048576 2024-09-14T11:20:59.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.457+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.1 size=1048576 2024-09-14T11:20:59.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.458+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.2 size=574400 2024-09-14T11:20:59.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.458+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=WJ8BGPS9WOOD tag=KQNJ4ZWFL5QG type=write size=3720128 2024-09-14T11:20:59.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.459+0000 7fc354693780 -1 < failed to complete operation key=X4VH2WYJJ8GI tag=5PQFGMW8AXCX type=del size=1242259: (22) Invalid argument 2024-09-14T11:20:59.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.461+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=FCDZ5I41WLO7 type=del size=1281512 2024-09-14T11:20:59.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.462+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~3MJP210OW2YR.0 size=827381 2024-09-14T11:20:59.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.464+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=3MJP210OW2YR tag=SDMGQ07LLDF2 type=write size=1875957 2024-09-14T11:20:59.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.465+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=C9RS5VJ3DO7H type=del size=1311122 2024-09-14T11:20:59.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.466+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~387VU5HFUBBK.0 size=1048576 2024-09-14T11:20:59.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.467+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~387VU5HFUBBK.1 size=1024763 2024-09-14T11:20:59.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.469+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=387VU5HFUBBK tag=2LPCTM8TEP4R type=write size=3121915 2024-09-14T11:20:59.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.471+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.0 size=1048576 2024-09-14T11:20:59.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.471+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.1 size=1048576 2024-09-14T11:20:59.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.472+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.2 size=236189 2024-09-14T11:20:59.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.472+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=YS7OCWM9FVEM tag=RX4AAR45TG6D type=write size=3381917 2024-09-14T11:20:59.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.473+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~LDQMBTUVLBG6.0 size=1048576 2024-09-14T11:20:59.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.474+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~LDQMBTUVLBG6.1 size=840540 2024-09-14T11:20:59.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.476+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=LDQMBTUVLBG6 tag=K55XOBNCUZ6T type=write size=2937692 2024-09-14T11:20:59.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.477+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=6O3ISJQML366 type=del size=678476 2024-09-14T11:20:59.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.478+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~MO686R21VW99.0 size=1048576 2024-09-14T11:20:59.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.479+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~MO686R21VW99.1 size=847709 2024-09-14T11:20:59.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.481+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=MO686R21VW99 tag=9D1P0JHMQFUD type=write size=2944861 2024-09-14T11:20:59.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.482+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=8AIMSD0WW9DR type=del size=2483366 2024-09-14T11:20:59.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.483+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=UN6O2MRVWB7K type=del 2024-09-14T11:20:59.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.485+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=MDQIUFO0190M type=del size=3080937 2024-09-14T11:20:59.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.486+0000 7fc354693780 -1 < failed to complete operation key=BKW08T86L2ZF tag=D4URKZPIHO2O type=del size=2989563: (22) Invalid argument 2024-09-14T11:20:59.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.487+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=9NF73S8XZ1CH type=del size=1698703 2024-09-14T11:20:59.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.488+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=8C09XFJIFM3B type=del 2024-09-14T11:20:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.490+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~NEFUX6AIINU4.0 size=498602 2024-09-14T11:20:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.490+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=NEFUX6AIINU4 tag=49WGVYL23RJN type=write size=1547178 2024-09-14T11:20:59.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.491+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=NQEHR2V40L5Z type=del 2024-09-14T11:20:59.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.492+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=VBDNV744DIXQ type=del size=2066223 2024-09-14T11:20:59.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.493+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.0 size=1048576 2024-09-14T11:20:59.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.493+0000 7fc354693780 1 < canceled part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.1 size=1048576 2024-09-14T11:20:59.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.494+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~XFUQD5QPO0XO.2 size=626330 2024-09-14T11:20:59.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.496+0000 7fc354693780 1 < canceled multipart upload key=T0Z8NK20DS5K upload=XFUQD5QPO0XO tag=3PZI0L4O2DG6 type=write size=3772058 2024-09-14T11:20:59.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.498+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~FWVKYAGH098X.0 size=326491 2024-09-14T11:20:59.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.498+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=FWVKYAGH098X tag=82N6PT9OOEJV type=write size=1375067 2024-09-14T11:20:59.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.500+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=3SVBCLDWH8UE type=del 2024-09-14T11:20:59.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.502+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=A1PD5HLE4X9I type=del size=3076550 2024-09-14T11:20:59.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.503+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=DORXX02S1MXW type=del 2024-09-14T11:20:59.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.504+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=10T38P2SR4DE type=del size=1661706 2024-09-14T11:20:59.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.505+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=VVR81PL1RY28 type=del 2024-09-14T11:20:59.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.506+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=78Y9B835PTKU type=del size=3154369 2024-09-14T11:20:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.508+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~FE192G3RKKE5.0 size=76201 2024-09-14T11:20:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.510+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=FE192G3RKKE5 tag=SQ2U8QZAS9AR type=write size=1124777 2024-09-14T11:20:59.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.512+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~GVGE8YKR3WOQ.0 size=52603 2024-09-14T11:20:59.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.512+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=GVGE8YKR3WOQ tag=5EPISAGZ1IIO type=write size=1101179 2024-09-14T11:20:59.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.513+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=RBKOBF11CFT3 type=del 2024-09-14T11:20:59.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.515+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~PWOEDTUMFIA4.0 size=656542 2024-09-14T11:20:59.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.515+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=PWOEDTUMFIA4 tag=SBB9A55O4YDK type=write size=1705118 2024-09-14T11:20:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.517+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.0 size=1048576 2024-09-14T11:20:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.517+0000 7fc354693780 1 < canceled part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.1 size=1048576 2024-09-14T11:20:59.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.518+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~WJ8BGPS9WOOD.2 size=574400 2024-09-14T11:20:59.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.520+0000 7fc354693780 1 < canceled multipart upload key=IGZK9BWJFCV3 upload=WJ8BGPS9WOOD tag=KQNJ4ZWFL5QG type=write size=3720128 2024-09-14T11:20:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.522+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~U6M9MLGNT717.0 size=1048576 2024-09-14T11:20:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.523+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~U6M9MLGNT717.1 size=85883 2024-09-14T11:20:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.523+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=U6M9MLGNT717 tag=5FNADCRG287I type=write size=2183035 2024-09-14T11:20:59.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.524+0000 7fc354693780 -1 < failed to complete operation key=FMG2DNGS0LZ3 tag=FCDZ5I41WLO7 type=del size=1281512: (22) Invalid argument 2024-09-14T11:20:59.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.526+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=A4BOY1CXBVD6 type=del size=1793946 2024-09-14T11:20:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.527+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=C9RS5VJ3DO7H type=del 2024-09-14T11:20:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.528+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=U7ICN9XIEUT5 type=del size=2975805 2024-09-14T11:20:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.528+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.0 size=1048576 2024-09-14T11:20:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.530+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.1 size=1048576 2024-09-14T11:20:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.530+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~YS7OCWM9FVEM.2 size=236189 2024-09-14T11:20:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.532+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=YS7OCWM9FVEM tag=RX4AAR45TG6D type=write size=3381917 2024-09-14T11:20:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.533+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=5I42EOS5X3YT type=del size=346315 2024-09-14T11:20:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.534+0000 7fc354693780 1 < canceled operation key=P061QWG9J16V tag=6O3ISJQML366 type=del size=678476 2024-09-14T11:20:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.535+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=O24KBTP6TECZ type=write size=160618 2024-09-14T11:20:59.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.536+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=8AIMSD0WW9DR type=del 2024-09-14T11:20:59.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.538+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=CV2QTIC4NKDN type=del size=1963876 2024-09-14T11:20:59.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.539+0000 7fc354693780 1 < canceled operation key=JGVLT0K0CEGQ tag=MDQIUFO0190M type=del size=3080937 2024-09-14T11:20:59.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.540+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=53S8TDMA8RWH type=del size=2343859 2024-09-14T11:20:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.541+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=9NF73S8XZ1CH type=del 2024-09-14T11:20:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.542+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=7QQBSVO3QPKH type=del size=1708756 2024-09-14T11:20:59.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.543+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~NEFUX6AIINU4.0 size=498602 2024-09-14T11:20:59.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.545+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=NEFUX6AIINU4 tag=49WGVYL23RJN type=write size=1547178 2024-09-14T11:20:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.547+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~T38QVU0X0MK4.0 size=115182 2024-09-14T11:20:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.547+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=T38QVU0X0MK4 tag=6RMD6GBVFWTU type=write size=1163758 2024-09-14T11:20:59.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.549+0000 7fc354693780 1 < suggested update operation key=JGVLT0K0CEGQ tag=VBDNV744DIXQ type=del size=2066223 2024-09-14T11:20:59.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.551+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~KPASQGQWILUO.0 size=1048576 2024-09-14T11:20:59.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.552+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~KPASQGQWILUO.1 size=849949 2024-09-14T11:20:59.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.552+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=KPASQGQWILUO tag=5CHKFV52THA8 type=write size=2947101 2024-09-14T11:20:59.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.553+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~FWVKYAGH098X.0 size=326491 2024-09-14T11:20:59.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.555+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=FWVKYAGH098X tag=82N6PT9OOEJV type=write size=1375067 2024-09-14T11:20:59.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.556+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=MX26BGZAZKFK type=del size=1395564 2024-09-14T11:20:59.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.559+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=A1PD5HLE4X9I type=del 2024-09-14T11:20:59.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.560+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=B9GX5U7TRR5X type=write size=796914 2024-09-14T11:20:59.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.561+0000 7fc354693780 1 < canceled operation key=PRBZQWTFXQ7R tag=10T38P2SR4DE type=del size=1661706 2024-09-14T11:20:59.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.563+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~KMFBXC1UJBGU.0 size=1048576 2024-09-14T11:20:59.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.565+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~KMFBXC1UJBGU.1 size=821933 2024-09-14T11:20:59.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.565+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=KMFBXC1UJBGU tag=9W3YEVVRMGGK type=write size=2919085 2024-09-14T11:20:59.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.567+0000 7fc354693780 1 < suggested remove operation key=BTET4HD5NY0D tag=78Y9B835PTKU type=del 2024-09-14T11:20:59.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.568+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=T1NEWFFMWZ91 type=del size=783852 2024-09-14T11:20:59.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.570+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~GVGE8YKR3WOQ.0 size=52603 2024-09-14T11:20:59.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.572+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=GVGE8YKR3WOQ tag=5EPISAGZ1IIO type=write size=1101179 2024-09-14T11:20:59.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.574+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~B3YD9LNA8KAZ.0 size=1048576 2024-09-14T11:20:59.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.575+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~B3YD9LNA8KAZ.1 size=416917 2024-09-14T11:20:59.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.575+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=B3YD9LNA8KAZ tag=34728BTS2S1Y type=write size=2514069 2024-09-14T11:20:59.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.576+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~PWOEDTUMFIA4.0 size=656542 2024-09-14T11:20:59.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.578+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=PWOEDTUMFIA4 tag=SBB9A55O4YDK type=write size=1705118 2024-09-14T11:20:59.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.581+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~XFFH8NBJ9B3A.0 size=1048576 2024-09-14T11:20:59.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.582+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~XFFH8NBJ9B3A.1 size=83167 2024-09-14T11:20:59.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.582+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=XFFH8NBJ9B3A tag=5F5S41V7SLAE type=write size=2180319 2024-09-14T11:20:59.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.583+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~U6M9MLGNT717.0 size=1048576 2024-09-14T11:20:59.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.583+0000 7fc354693780 1 < canceled part key=_multipart_ICNEXZMA3VQV.2~U6M9MLGNT717.1 size=85883 2024-09-14T11:20:59.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.585+0000 7fc354693780 1 < canceled multipart upload key=ICNEXZMA3VQV upload=U6M9MLGNT717 tag=5FNADCRG287I type=write size=2183035 2024-09-14T11:20:59.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.587+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~TXGX2DW52XRC.0 size=1048576 2024-09-14T11:20:59.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.588+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~TXGX2DW52XRC.1 size=46075 2024-09-14T11:20:59.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.588+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=TXGX2DW52XRC tag=STH7U3EP3WVX type=write size=2143227 2024-09-14T11:20:59.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.589+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=A4BOY1CXBVD6 type=del 2024-09-14T11:20:59.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.590+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=8ALAEUNPQ2IZ type=del size=157142 2024-09-14T11:20:59.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.592+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=U7ICN9XIEUT5 type=del 2024-09-14T11:20:59.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.593+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=BW1VISE32URV type=del size=3021466 2024-09-14T11:20:59.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.594+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=5I42EOS5X3YT type=del 2024-09-14T11:20:59.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.595+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=9V6V504O2Q29 type=del size=1804020 2024-09-14T11:20:59.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.597+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=O24KBTP6TECZ type=write size=160618 2024-09-14T11:20:59.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.599+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.0 size=1048576 2024-09-14T11:20:59.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.600+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.1 size=1048576 2024-09-14T11:20:59.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.601+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.2 size=804284 2024-09-14T11:20:59.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.601+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=GN3QKLD9D0Y5 tag=KKGVAVEQ9STG type=write size=3950012 2024-09-14T11:20:59.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.603+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=CV2QTIC4NKDN type=del size=1963876 2024-09-14T11:20:59.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.604+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=L45EJ6JX64M3 type=write size=174349 2024-09-14T11:20:59.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.607+0000 7fc354693780 1 < suggested remove operation key=4Z3KI5X3WQ0I tag=53S8TDMA8RWH type=del 2024-09-14T11:20:59.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.609+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.0 size=1048576 2024-09-14T11:20:59.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.610+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.1 size=1048576 2024-09-14T11:20:59.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.611+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.2 size=318120 2024-09-14T11:20:59.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.611+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=1G2JASN53B8Q tag=6PY0N1FAHDYC type=write size=3463848 2024-09-14T11:20:59.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.612+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=7QQBSVO3QPKH type=del 2024-09-14T11:20:59.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.613+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=G3NR5TJPGZTH type=write size=673678 2024-09-14T11:20:59.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.614+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~T38QVU0X0MK4.0 size=115182 2024-09-14T11:20:59.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.616+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=T38QVU0X0MK4 tag=6RMD6GBVFWTU type=write size=1163758 2024-09-14T11:20:59.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.619+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~27LM3FCH36OQ.0 size=1048576 2024-09-14T11:20:59.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.620+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~27LM3FCH36OQ.1 size=851998 2024-09-14T11:20:59.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.620+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=27LM3FCH36OQ tag=B1X8RSGJ9XVU type=write size=2949150 2024-09-14T11:20:59.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.621+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~KPASQGQWILUO.0 size=1048576 2024-09-14T11:20:59.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.622+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~KPASQGQWILUO.1 size=849949 2024-09-14T11:20:59.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.624+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=KPASQGQWILUO tag=5CHKFV52THA8 type=write size=2947101 2024-09-14T11:20:59.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.625+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=F7MIOS3V3D0Y type=del size=933248 2024-09-14T11:20:59.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.626+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=MX26BGZAZKFK type=del 2024-09-14T11:20:59.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.629+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.0 size=1048576 2024-09-14T11:20:59.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.629+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.1 size=1048576 2024-09-14T11:20:59.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.630+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.2 size=1016731 2024-09-14T11:20:59.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.630+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=EUSB52AQB9LO tag=RQRS1M29Y7KK type=write size=4162459 2024-09-14T11:20:59.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.632+0000 7fc354693780 1 < completed write operation key=FMG2DNGS0LZ3 tag=B9GX5U7TRR5X type=write size=796914 2024-09-14T11:20:59.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.633+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=LM5GV7YYJMK8 type=del size=1917206 2024-09-14T11:20:59.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.634+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~KMFBXC1UJBGU.0 size=1048576 2024-09-14T11:20:59.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.635+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~KMFBXC1UJBGU.1 size=821933 2024-09-14T11:20:59.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.637+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=KMFBXC1UJBGU tag=9W3YEVVRMGGK type=write size=2919085 2024-09-14T11:20:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.639+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~J7VOA07UHZA4.0 size=1048576 2024-09-14T11:20:59.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.641+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~J7VOA07UHZA4.1 size=923774 2024-09-14T11:20:59.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.641+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=J7VOA07UHZA4 tag=N56EAJZKO5ZV type=write size=3020926 2024-09-14T11:20:59.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.642+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=T1NEWFFMWZ91 type=del 2024-09-14T11:20:59.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.644+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~438Z940AJRZK.0 size=1048576 2024-09-14T11:20:59.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.645+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~438Z940AJRZK.1 size=373507 2024-09-14T11:20:59.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.645+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=438Z940AJRZK tag=K1ON8Z8BIS8K type=write size=2470659 2024-09-14T11:20:59.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.646+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~B3YD9LNA8KAZ.0 size=1048576 2024-09-14T11:20:59.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.647+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~B3YD9LNA8KAZ.1 size=416917 2024-09-14T11:20:59.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.649+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=B3YD9LNA8KAZ tag=34728BTS2S1Y type=write size=2514069 2024-09-14T11:20:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.650+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=1MTFC3AE6Z27 type=del size=674364 2024-09-14T11:20:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.651+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~XFFH8NBJ9B3A.0 size=1048576 2024-09-14T11:20:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.652+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~XFFH8NBJ9B3A.1 size=83167 2024-09-14T11:20:59.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.654+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=XFFH8NBJ9B3A tag=5F5S41V7SLAE type=write size=2180319 2024-09-14T11:20:59.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.656+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.0 size=1048576 2024-09-14T11:20:59.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.657+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.1 size=1048576 2024-09-14T11:20:59.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.658+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.2 size=98076 2024-09-14T11:20:59.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.658+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=OUPNIIR56OH4 tag=DRE79H5ARCFQ type=write size=3243804 2024-09-14T11:20:59.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.659+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~TXGX2DW52XRC.0 size=1048576 2024-09-14T11:20:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.660+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~TXGX2DW52XRC.1 size=46075 2024-09-14T11:20:59.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.662+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=TXGX2DW52XRC tag=STH7U3EP3WVX type=write size=2143227 2024-09-14T11:20:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.663+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=5TZXTLF4ME0J type=del size=1503712 2024-09-14T11:20:59.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.664+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=8ALAEUNPQ2IZ type=del 2024-09-14T11:20:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.665+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=MZNN7QUQTD0D type=del size=2262751 2024-09-14T11:20:59.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.666+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=BW1VISE32URV type=del 2024-09-14T11:20:59.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.668+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.0 size=1048576 2024-09-14T11:20:59.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.669+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.1 size=1048576 2024-09-14T11:20:59.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.670+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.2 size=205662 2024-09-14T11:20:59.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.670+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=ULQBCTY2B9YY tag=QETOLX59GFNG type=write size=3351390 2024-09-14T11:20:59.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.672+0000 7fc354693780 1 < suggested update operation key=WYD70VR8OKAN tag=9V6V504O2Q29 type=del size=1804020 2024-09-14T11:20:59.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.673+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=0GPJH4PDXCWX type=write size=40017 2024-09-14T11:20:59.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.674+0000 7fc354693780 1 < canceled part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.0 size=1048576 2024-09-14T11:20:59.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.674+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.1 size=1048576 2024-09-14T11:20:59.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.675+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~GN3QKLD9D0Y5.2 size=804284 2024-09-14T11:20:59.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.677+0000 7fc354693780 1 < canceled multipart upload key=FMG2DNGS0LZ3 upload=GN3QKLD9D0Y5 tag=KKGVAVEQ9STG type=write size=3950012 2024-09-14T11:20:59.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.678+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=A0XCYNEHV4J1 type=write size=12768 2024-09-14T11:20:59.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.680+0000 7fc354693780 1 < canceled operation key=ICNEXZMA3VQV tag=L45EJ6JX64M3 type=write size=174349 2024-09-14T11:20:59.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.682+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~MEVZBXSWA1ZN.0 size=1048576 2024-09-14T11:20:59.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.683+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~MEVZBXSWA1ZN.1 size=154408 2024-09-14T11:20:59.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.683+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=MEVZBXSWA1ZN tag=ZY43JFGCA2AB type=write size=2251560 2024-09-14T11:20:59.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.684+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.0 size=1048576 2024-09-14T11:20:59.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.684+0000 7fc354693780 1 < canceled part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.1 size=1048576 2024-09-14T11:20:59.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.685+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~1G2JASN53B8Q.2 size=318120 2024-09-14T11:20:59.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.687+0000 7fc354693780 1 < canceled multipart upload key=PRBZQWTFXQ7R upload=1G2JASN53B8Q tag=6PY0N1FAHDYC type=write size=3463848 2024-09-14T11:20:59.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.688+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=T5UP0P1KK7Z3 type=write size=635011 2024-09-14T11:20:59.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.689+0000 7fc354693780 1 < completed write operation key=977GI7HKD9JJ tag=G3NR5TJPGZTH type=write size=673678 2024-09-14T11:20:59.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.691+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~HW2RDF2R6KQ4.0 size=1048576 2024-09-14T11:20:59.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.692+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~HW2RDF2R6KQ4.1 size=215097 2024-09-14T11:20:59.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.692+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=HW2RDF2R6KQ4 tag=TFGCB5DTTCWQ type=write size=2312249 2024-09-14T11:20:59.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.694+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~27LM3FCH36OQ.0 size=1048576 2024-09-14T11:20:59.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.694+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~27LM3FCH36OQ.1 size=851998 2024-09-14T11:20:59.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.696+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=27LM3FCH36OQ tag=B1X8RSGJ9XVU type=write size=2949150 2024-09-14T11:20:59.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.697+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=T7PTRU6024Y0 type=del size=3096067 2024-09-14T11:20:59.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.699+0000 7fc354693780 1 < canceled operation key=BKW08T86L2ZF tag=F7MIOS3V3D0Y type=del size=933248 2024-09-14T11:20:59.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.701+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~05CXZ9EIV475.0 size=231532 2024-09-14T11:20:59.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.701+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=05CXZ9EIV475 tag=6YKR8PX2SDFS type=write size=1280108 2024-09-14T11:20:59.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.702+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.0 size=1048576 2024-09-14T11:20:59.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.703+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.1 size=1048576 2024-09-14T11:20:59.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.704+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EUSB52AQB9LO.2 size=1016731 2024-09-14T11:20:59.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.705+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=EUSB52AQB9LO tag=RQRS1M29Y7KK type=write size=4162459 2024-09-14T11:20:59.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.707+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.0 size=1048576 2024-09-14T11:20:59.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.708+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.1 size=1048576 2024-09-14T11:20:59.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.709+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.2 size=1006827 2024-09-14T11:20:59.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.709+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=OSVSFOZ0A0HK tag=ULPKZU9ZCXZJ type=write size=4152555 2024-09-14T11:20:59.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.711+0000 7fc354693780 1 < suggested remove operation key=JGVLT0K0CEGQ tag=LM5GV7YYJMK8 type=del 2024-09-14T11:20:59.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.713+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~HR7RMI7E6K8H.0 size=1048576 2024-09-14T11:20:59.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.714+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~HR7RMI7E6K8H.1 size=33048 2024-09-14T11:20:59.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.714+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=HR7RMI7E6K8H tag=IVYX57VIXDL5 type=write size=2130200 2024-09-14T11:20:59.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.715+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~J7VOA07UHZA4.0 size=1048576 2024-09-14T11:20:59.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.715+0000 7fc354693780 1 < canceled part key=_multipart_4Z3KI5X3WQ0I.2~J7VOA07UHZA4.1 size=923774 2024-09-14T11:20:59.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.717+0000 7fc354693780 1 < canceled multipart upload key=4Z3KI5X3WQ0I upload=J7VOA07UHZA4 tag=N56EAJZKO5ZV type=write size=3020926 2024-09-14T11:20:59.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.718+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=W6QO607SWVJG type=del size=1444296 2024-09-14T11:20:59.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.720+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~438Z940AJRZK.0 size=1048576 2024-09-14T11:20:59.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.720+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~438Z940AJRZK.1 size=373507 2024-09-14T11:20:59.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.722+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=438Z940AJRZK tag=K1ON8Z8BIS8K type=write size=2470659 2024-09-14T11:20:59.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.723+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=BTU7YGZVJG8E type=del size=2796728 2024-09-14T11:20:59.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.724+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=1MTFC3AE6Z27 type=del 2024-09-14T11:20:59.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.726+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=1AW8XYF16URK type=del size=2010441 2024-09-14T11:20:59.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.727+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.0 size=1048576 2024-09-14T11:20:59.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.728+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.1 size=1048576 2024-09-14T11:20:59.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.728+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~OUPNIIR56OH4.2 size=98076 2024-09-14T11:20:59.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.730+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=OUPNIIR56OH4 tag=DRE79H5ARCFQ type=write size=3243804 2024-09-14T11:20:59.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.731+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=U5QMWIFXK8I6 type=del size=937940 2024-09-14T11:20:59.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.733+0000 7fc354693780 1 < canceled operation key=JF6PHF17N5WE tag=5TZXTLF4ME0J type=del size=1503712 2024-09-14T11:20:59.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.734+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=U47G7WFDW0OS type=del size=3182646 2024-09-14T11:20:59.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.736+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=MZNN7QUQTD0D type=del 2024-09-14T11:20:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.738+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~FKF0GPD0Y0CB.0 size=16430 2024-09-14T11:20:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.738+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=FKF0GPD0Y0CB tag=A3078RJQLXFI type=write size=1065006 2024-09-14T11:20:59.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.739+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.0 size=1048576 2024-09-14T11:20:59.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.740+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.1 size=1048576 2024-09-14T11:20:59.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.741+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~ULQBCTY2B9YY.2 size=205662 2024-09-14T11:20:59.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.744+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=ULQBCTY2B9YY tag=QETOLX59GFNG type=write size=3351390 2024-09-14T11:20:59.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.746+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.0 size=1048576 2024-09-14T11:20:59.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.747+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.1 size=1048576 2024-09-14T11:20:59.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.748+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.2 size=406928 2024-09-14T11:20:59.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.748+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=UQCLIHPHRELM tag=LY35SQ3DB5DV type=write size=3552656 2024-09-14T11:20:59.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.749+0000 7fc354693780 1 < canceled operation key=4IDBIAE3VAY4 tag=0GPJH4PDXCWX type=write size=40017 2024-09-14T11:20:59.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.750+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=A3XNNOSA2D6P type=write size=285899 2024-09-14T11:20:59.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.751+0000 7fc354693780 1 < completed write operation key=QWMHFF32M37W tag=A0XCYNEHV4J1 type=write size=12768 2024-09-14T11:20:59.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.752+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=AQ6MI3PRFR99 type=write size=937292 2024-09-14T11:20:59.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.754+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~MEVZBXSWA1ZN.0 size=1048576 2024-09-14T11:20:59.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.755+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~MEVZBXSWA1ZN.1 size=154408 2024-09-14T11:20:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.757+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=MEVZBXSWA1ZN tag=ZY43JFGCA2AB type=write size=2251560 2024-09-14T11:20:59.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.759+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~Q6ZJKLNGKV5C.0 size=790894 2024-09-14T11:20:59.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.759+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=Q6ZJKLNGKV5C tag=5JKBBT31WXGH type=write size=1839470 2024-09-14T11:20:59.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.760+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=T5UP0P1KK7Z3 type=write size=635011 2024-09-14T11:20:59.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.762+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~3J9Q6F2JRXAE.0 size=990222 2024-09-14T11:20:59.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.762+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=3J9Q6F2JRXAE tag=8R4SZK1I391N type=write size=2038798 2024-09-14T11:20:59.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.763+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~HW2RDF2R6KQ4.0 size=1048576 2024-09-14T11:20:59.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.764+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~HW2RDF2R6KQ4.1 size=215097 2024-09-14T11:20:59.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.766+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=HW2RDF2R6KQ4 tag=TFGCB5DTTCWQ type=write size=2312249 2024-09-14T11:20:59.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.767+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=FSGSJXP0809G type=write size=910420 2024-09-14T11:20:59.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.768+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=T7PTRU6024Y0 type=del size=3096067 2024-09-14T11:20:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.769+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=J629V110Y4PI type=del size=1478341 2024-09-14T11:20:59.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.770+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~05CXZ9EIV475.0 size=231532 2024-09-14T11:20:59.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.772+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=05CXZ9EIV475 tag=6YKR8PX2SDFS type=write size=1280108 2024-09-14T11:20:59.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.773+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=HRL6HRMB4L6D type=del size=979061 2024-09-14T11:20:59.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.774+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.0 size=1048576 2024-09-14T11:20:59.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.775+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.1 size=1048576 2024-09-14T11:20:59.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.776+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~OSVSFOZ0A0HK.2 size=1006827 2024-09-14T11:20:59.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.778+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=OSVSFOZ0A0HK tag=ULPKZU9ZCXZJ type=write size=4152555 2024-09-14T11:20:59.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.779+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=8L8G3S3PV2WU type=del size=185360 2024-09-14T11:20:59.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.780+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~HR7RMI7E6K8H.0 size=1048576 2024-09-14T11:20:59.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.781+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~HR7RMI7E6K8H.1 size=33048 2024-09-14T11:20:59.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.783+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=HR7RMI7E6K8H tag=IVYX57VIXDL5 type=write size=2130200 2024-09-14T11:20:59.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.785+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.0 size=1048576 2024-09-14T11:20:59.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.786+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.1 size=1048576 2024-09-14T11:20:59.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.787+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.2 size=359875 2024-09-14T11:20:59.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.787+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=NA2X05XZEETD tag=Z1R9ULM9TAQ5 type=write size=3505603 2024-09-14T11:20:59.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.788+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=W6QO607SWVJG type=del 2024-09-14T11:20:59.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.789+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=6B5OZIT55Q1G type=del size=3357511 2024-09-14T11:20:59.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.790+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=BTU7YGZVJG8E type=del 2024-09-14T11:20:59.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.791+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=R8G2ML9KCFR7 type=del size=2265202 2024-09-14T11:20:59.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.794+0000 7fc354693780 1 < suggested update operation key=BTET4HD5NY0D tag=1AW8XYF16URK type=del size=2010441 2024-09-14T11:20:59.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.795+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=Q82QNIYSTHUZ type=write size=274698 2024-09-14T11:20:59.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.796+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=U5QMWIFXK8I6 type=del 2024-09-14T11:20:59.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.798+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~WYF115HMXNWA.0 size=960844 2024-09-14T11:20:59.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.798+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=WYF115HMXNWA tag=09SJUVZ1GI9C type=write size=2009420 2024-09-14T11:20:59.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.800+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=U47G7WFDW0OS type=del 2024-09-14T11:20:59.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.801+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=V60CIZ4WKCU6 type=del size=3583452 2024-09-14T11:20:59.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.803+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~FKF0GPD0Y0CB.0 size=16430 2024-09-14T11:20:59.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.805+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=FKF0GPD0Y0CB tag=A3078RJQLXFI type=write size=1065006 2024-09-14T11:20:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.807+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.0 size=1048576 2024-09-14T11:20:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.808+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.1 size=1048576 2024-09-14T11:20:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.809+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.2 size=694224 2024-09-14T11:20:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.809+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=SOW0Z1GMMYAV tag=8WHDDJYAQ6N0 type=write size=3839952 2024-09-14T11:20:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.809+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.0 size=1048576 2024-09-14T11:20:59.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.810+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.1 size=1048576 2024-09-14T11:20:59.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.810+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~UQCLIHPHRELM.2 size=406928 2024-09-14T11:20:59.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.812+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=UQCLIHPHRELM tag=LY35SQ3DB5DV type=write size=3552656 2024-09-14T11:20:59.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.813+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=2F4UTFZ30Q4P type=del size=2007680 2024-09-14T11:20:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.815+0000 7fc354693780 1 < suggested remove operation key=IGZK9BWJFCV3 tag=A3XNNOSA2D6P type=write 2024-09-14T11:20:59.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.817+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~O4LKDRI9IQRQ.0 size=393423 2024-09-14T11:20:59.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.817+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=O4LKDRI9IQRQ tag=ZEIIYSPPUXL5 type=write size=1441999 2024-09-14T11:20:59.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.819+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=AQ6MI3PRFR99 type=write size=937292 2024-09-14T11:20:59.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.820+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=ZAV7Q98OK1D1 type=del size=1182090 2024-09-14T11:20:59.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.821+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~Q6ZJKLNGKV5C.0 size=790894 2024-09-14T11:20:59.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.822+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=Q6ZJKLNGKV5C tag=5JKBBT31WXGH type=write size=1839470 2024-09-14T11:20:59.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.824+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=70U1AFZB53MK type=write size=917943 2024-09-14T11:20:59.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.825+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~3J9Q6F2JRXAE.0 size=990222 2024-09-14T11:20:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.827+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=3J9Q6F2JRXAE tag=8R4SZK1I391N type=write size=2038798 2024-09-14T11:20:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.828+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=KLFL0K2WIPTI type=del size=3256734 2024-09-14T11:20:59.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.829+0000 7fc354693780 1 < completed write operation key=N23XJJD7YYG0 tag=FSGSJXP0809G type=write size=910420 2024-09-14T11:20:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.830+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=A75E0HIO93A9 type=del size=2005420 2024-09-14T11:20:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.831+0000 7fc354693780 -1 < no bi entry to suggest for operation key=IGZK9BWJFCV3 tag=J629V110Y4PI type=del size=1478341: (2) No such file or directory 2024-09-14T11:20:59.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.833+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~VJZK86ONL73U.0 size=1048576 2024-09-14T11:20:59.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.834+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~VJZK86ONL73U.1 size=827759 2024-09-14T11:20:59.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.834+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=VJZK86ONL73U tag=JQABCNC6ROZ0 type=write size=2924911 2024-09-14T11:20:59.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.835+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=HRL6HRMB4L6D type=del 2024-09-14T11:20:59.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.837+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=8L02O62Y0VHG type=del size=1949362 2024-09-14T11:20:59.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.838+0000 7fc354693780 1 < canceled operation key=QWMHFF32M37W tag=8L8G3S3PV2WU type=del size=185360 2024-09-14T11:20:59.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.840+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~N5PZE6YQ5YSP.0 size=1048576 2024-09-14T11:20:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.841+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~N5PZE6YQ5YSP.1 size=322679 2024-09-14T11:20:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.841+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=N5PZE6YQ5YSP tag=V31AD8XDIA7W type=write size=2419831 2024-09-14T11:20:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.842+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.0 size=1048576 2024-09-14T11:20:59.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.843+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.1 size=1048576 2024-09-14T11:20:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.844+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~NA2X05XZEETD.2 size=359875 2024-09-14T11:20:59.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.846+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=NA2X05XZEETD tag=Z1R9ULM9TAQ5 type=write size=3505603 2024-09-14T11:20:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.847+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=V3S96CY4P4X1 type=del size=1366663 2024-09-14T11:20:59.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.848+0000 7fc354693780 -1 < failed to complete operation key=IGZK9BWJFCV3 tag=6B5OZIT55Q1G type=del size=3357511: (22) Invalid argument 2024-09-14T11:20:59.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.849+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=QK8FSU062HRI type=del size=3713282 2024-09-14T11:20:59.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.852+0000 7fc354693780 1 < completed delete operation key=QWMHFF32M37W tag=R8G2ML9KCFR7 type=del 2024-09-14T11:20:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.854+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~7OP72FUKDADF.0 size=1048576 2024-09-14T11:20:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.855+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~7OP72FUKDADF.1 size=273509 2024-09-14T11:20:59.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.855+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=7OP72FUKDADF tag=X2RYOBQX0QKK type=write size=2370661 2024-09-14T11:20:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.856+0000 7fc354693780 1 < completed write operation key=4Z3KI5X3WQ0I tag=Q82QNIYSTHUZ type=write size=274698 2024-09-14T11:20:59.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.858+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=H6E6QKZC0TXK type=del size=3141288 2024-09-14T11:20:59.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.859+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~WYF115HMXNWA.0 size=960844 2024-09-14T11:20:59.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.861+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=WYF115HMXNWA tag=09SJUVZ1GI9C type=write size=2009420 2024-09-14T11:20:59.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.863+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.0 size=1048576 2024-09-14T11:20:59.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.864+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.1 size=1048576 2024-09-14T11:20:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.865+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.2 size=950300 2024-09-14T11:20:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.865+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=I5E5WUNZHFWZ tag=DZS061CN39DA type=write size=4096028 2024-09-14T11:20:59.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.868+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=V60CIZ4WKCU6 type=del size=3583452 2024-09-14T11:20:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.869+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=AT1MB527N57D type=del size=952801 2024-09-14T11:20:59.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.870+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.0 size=1048576 2024-09-14T11:20:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.871+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.1 size=1048576 2024-09-14T11:20:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.872+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~SOW0Z1GMMYAV.2 size=694224 2024-09-14T11:20:59.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.874+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=SOW0Z1GMMYAV tag=8WHDDJYAQ6N0 type=write size=3839952 2024-09-14T11:20:59.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.876+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=DR6ADRHNWN9Z type=del size=3862345 2024-09-14T11:20:59.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.877+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=2F4UTFZ30Q4P type=del 2024-09-14T11:20:59.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.879+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~JLIGOFI1KICF.0 size=577360 2024-09-14T11:20:59.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.879+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=JLIGOFI1KICF tag=9DS70FLKFL3O type=write size=1625936 2024-09-14T11:20:59.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.880+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~O4LKDRI9IQRQ.0 size=393423 2024-09-14T11:20:59.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.882+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=O4LKDRI9IQRQ tag=ZEIIYSPPUXL5 type=write size=1441999 2024-09-14T11:20:59.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.883+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=ABZFXCHN44B1 type=write size=249887 2024-09-14T11:20:59.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.884+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=ZAV7Q98OK1D1 type=del 2024-09-14T11:20:59.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.885+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=9HSC8RFMY0M2 type=del size=3753687 2024-09-14T11:20:59.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.887+0000 7fc354693780 1 < canceled operation key=PRBZQWTFXQ7R tag=70U1AFZB53MK type=write size=917943 2024-09-14T11:20:59.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.888+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=G395E8X8J612 type=del size=269607 2024-09-14T11:20:59.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.890+0000 7fc354693780 1 < suggested remove operation key=GE83T07IQG0S tag=KLFL0K2WIPTI type=del 2024-09-14T11:20:59.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.892+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=EGEURTJFH1IO type=del size=770008 2024-09-14T11:20:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.893+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=A75E0HIO93A9 type=del 2024-09-14T11:20:59.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.894+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=9FSJJZRH9EI6 type=del size=1929066 2024-09-14T11:20:59.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.895+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~VJZK86ONL73U.0 size=1048576 2024-09-14T11:20:59.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.896+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~VJZK86ONL73U.1 size=827759 2024-09-14T11:20:59.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.898+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=VJZK86ONL73U tag=JQABCNC6ROZ0 type=write size=2924911 2024-09-14T11:20:59.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.899+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=TQN1RO3M16PE type=del size=83697 2024-09-14T11:20:59.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.900+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=8L02O62Y0VHG type=del 2024-09-14T11:20:59.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.901+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=12N41Q2R6O1M type=del size=4058042 2024-09-14T11:20:59.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.903+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~N5PZE6YQ5YSP.0 size=1048576 2024-09-14T11:20:59.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.903+0000 7fc354693780 1 < canceled part key=_multipart_BKW08T86L2ZF.2~N5PZE6YQ5YSP.1 size=322679 2024-09-14T11:20:59.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.904+0000 7fc354693780 1 < canceled multipart upload key=BKW08T86L2ZF upload=N5PZE6YQ5YSP tag=V31AD8XDIA7W type=write size=2419831 2024-09-14T11:20:59.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.907+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.0 size=1048576 2024-09-14T11:20:59.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.907+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.1 size=1048576 2024-09-14T11:20:59.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.908+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.2 size=721962 2024-09-14T11:20:59.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.908+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=6IBDSR42T53O tag=I9UK5BY4B1YL type=write size=3867690 2024-09-14T11:20:59.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.910+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=V3S96CY4P4X1 type=del 2024-09-14T11:20:59.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.911+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=PF1LKNJGXAG1 type=write size=364739 2024-09-14T11:20:59.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.912+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=QK8FSU062HRI type=del 2024-09-14T11:20:59.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.914+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~YC8WF6WIM5ZF.0 size=1048576 2024-09-14T11:20:59.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.915+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~YC8WF6WIM5ZF.1 size=554849 2024-09-14T11:20:59.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.915+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=YC8WF6WIM5ZF tag=VD5IW01TQG23 type=write size=2652001 2024-09-14T11:20:59.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.915+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~7OP72FUKDADF.0 size=1048576 2024-09-14T11:20:59.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.916+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~7OP72FUKDADF.1 size=273509 2024-09-14T11:20:59.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.918+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=7OP72FUKDADF tag=X2RYOBQX0QKK type=write size=2370661 2024-09-14T11:20:59.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.919+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=O2V10C7L1W2P type=del size=1874481 2024-09-14T11:20:59.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.920+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=H6E6QKZC0TXK type=del 2024-09-14T11:20:59.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.922+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=ZGO1AQQPS6ZQ type=del size=2633150 2024-09-14T11:20:59.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.923+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.0 size=1048576 2024-09-14T11:20:59.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.924+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.1 size=1048576 2024-09-14T11:20:59.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.925+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~I5E5WUNZHFWZ.2 size=950300 2024-09-14T11:20:59.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.927+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=I5E5WUNZHFWZ tag=DZS061CN39DA type=write size=4096028 2024-09-14T11:20:59.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.929+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.0 size=1048576 2024-09-14T11:20:59.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.930+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.1 size=1048576 2024-09-14T11:20:59.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.931+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.2 size=782245 2024-09-14T11:20:59.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.931+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=EKD00U2F925O tag=06V71WSQEOH4 type=write size=3927973 2024-09-14T11:20:59.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.932+0000 7fc354693780 1 < canceled operation key=BJ7AARJEIT8W tag=AT1MB527N57D type=del size=952801 2024-09-14T11:20:59.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.934+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=KA5U2FEPE5KT type=write size=191977 2024-09-14T11:20:59.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.935+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=DR6ADRHNWN9Z type=del 2024-09-14T11:20:59.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.936+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=AFZZTN504PDM type=del size=3865538 2024-09-14T11:20:59.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.937+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~JLIGOFI1KICF.0 size=577360 2024-09-14T11:20:59.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.939+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=JLIGOFI1KICF tag=9DS70FLKFL3O type=write size=1625936 2024-09-14T11:20:59.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.940+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=SNIZE5MZEFE0 type=del size=1784123 2024-09-14T11:20:59.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.942+0000 7fc354693780 1 < suggested update operation key=FMG2DNGS0LZ3 tag=ABZFXCHN44B1 type=write size=249887 2024-09-14T11:20:59.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.944+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.0 size=1048576 2024-09-14T11:20:59.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.945+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.1 size=1048576 2024-09-14T11:20:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.946+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.2 size=496348 2024-09-14T11:20:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.946+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=OS4W3SCZDYAE tag=3P4HKEZ0BE6Y type=write size=3642076 2024-09-14T11:20:59.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.947+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=9HSC8RFMY0M2 type=del 2024-09-14T11:20:59.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.949+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=EM9GASOOO0MO type=del size=3059501 2024-09-14T11:20:59.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.950+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=G395E8X8J612 type=del 2024-09-14T11:20:59.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.951+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=YT5BSQ0WBZ51 type=del size=1966629 2024-09-14T11:20:59.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.952+0000 7fc354693780 1 < canceled operation key=4Z3KI5X3WQ0I tag=EGEURTJFH1IO type=del size=770008 2024-09-14T11:20:59.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.953+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=RFIG169BFQH8 type=del size=2679015 2024-09-14T11:20:59.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.956+0000 7fc354693780 1 < suggested update operation key=54EUIL28P2H1 tag=9FSJJZRH9EI6 type=del size=1929066 2024-09-14T11:20:59.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.957+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=U00YM94A2NFD type=del size=259700 2024-09-14T11:20:59.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.958+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=TQN1RO3M16PE type=del 2024-09-14T11:20:59.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.960+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~POAC41HVI2UO.0 size=1048576 2024-09-14T11:20:59.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.961+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~POAC41HVI2UO.1 size=254423 2024-09-14T11:20:59.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.961+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=POAC41HVI2UO tag=44104TTXQEXK type=write size=2351575 2024-09-14T11:20:59.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.963+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=12N41Q2R6O1M type=del 2024-09-14T11:20:59.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.965+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=SYPKZFW9SZW8 type=del size=1096010 2024-09-14T11:20:59.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.966+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.0 size=1048576 2024-09-14T11:20:59.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.967+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.1 size=1048576 2024-09-14T11:20:59.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.968+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~6IBDSR42T53O.2 size=721962 2024-09-14T11:20:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.970+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=6IBDSR42T53O tag=I9UK5BY4B1YL type=write size=3867690 2024-09-14T11:20:59.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.971+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=UL39C3B3LCG1 type=del size=2909656 2024-09-14T11:20:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.972+0000 7fc354693780 -1 < failed to complete operation key=54EUIL28P2H1 tag=PF1LKNJGXAG1 type=write size=364739: (22) Invalid argument 2024-09-14T11:20:59.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.974+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=VEEEMYO801VA type=del size=917513 2024-09-14T11:20:59.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.975+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~YC8WF6WIM5ZF.0 size=1048576 2024-09-14T11:20:59.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.976+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~YC8WF6WIM5ZF.1 size=554849 2024-09-14T11:20:59.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.978+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=YC8WF6WIM5ZF tag=VD5IW01TQG23 type=write size=2652001 2024-09-14T11:20:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.979+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=Z0PG2IRO7EYV type=del size=1721519 2024-09-14T11:20:59.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.980+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=O2V10C7L1W2P type=del 2024-09-14T11:20:59.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.982+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=7CFVXFUJG9LV type=write size=703294 2024-09-14T11:20:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.983+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=ZGO1AQQPS6ZQ type=del 2024-09-14T11:20:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.984+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=15D397REUEHE type=del size=662441 2024-09-14T11:20:59.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.985+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.0 size=1048576 2024-09-14T11:20:59.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.986+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.1 size=1048576 2024-09-14T11:20:59.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.987+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~EKD00U2F925O.2 size=782245 2024-09-14T11:20:59.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.989+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=EKD00U2F925O tag=06V71WSQEOH4 type=write size=3927973 2024-09-14T11:20:59.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.991+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~NOZFL1VZJG0M.0 size=1048576 2024-09-14T11:20:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.992+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~NOZFL1VZJG0M.1 size=413961 2024-09-14T11:20:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.992+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=NOZFL1VZJG0M tag=GSFRPGZHWPLV type=write size=2511113 2024-09-14T11:20:59.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.993+0000 7fc354693780 1 < completed write operation key=ICNEXZMA3VQV tag=KA5U2FEPE5KT type=write size=191977 2024-09-14T11:20:59.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.994+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=88K2IAH3EVP1 type=del size=3308747 2024-09-14T11:20:59.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.995+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=AFZZTN504PDM type=del 2024-09-14T11:20:59.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.997+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~M3SMRKL9ECGT.0 size=473285 2024-09-14T11:20:59.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.997+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=M3SMRKL9ECGT tag=SN6PPHND44J8 type=write size=1521861 2024-09-14T11:20:59.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:20:59.999+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=SNIZE5MZEFE0 type=del 2024-09-14T11:20:59.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.000+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=5OEQGIRRI2YE type=del size=86646 2024-09-14T11:20:59.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.001+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.0 size=1048576 2024-09-14T11:21:00.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.002+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.1 size=1048576 2024-09-14T11:21:00.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.003+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~OS4W3SCZDYAE.2 size=496348 2024-09-14T11:21:00.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.005+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=OS4W3SCZDYAE tag=3P4HKEZ0BE6Y type=write size=3642076 2024-09-14T11:21:00.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.006+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=4LCYLHZQAT6W type=del size=2409089 2024-09-14T11:21:00.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.007+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=EM9GASOOO0MO type=del 2024-09-14T11:21:00.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.009+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~GGESQE7WMD6P.0 size=1048576 2024-09-14T11:21:00.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.010+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~GGESQE7WMD6P.1 size=766062 2024-09-14T11:21:00.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.010+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=GGESQE7WMD6P tag=PZAUD35XXA70 type=write size=2863214 2024-09-14T11:21:00.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.011+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=YT5BSQ0WBZ51 type=del 2024-09-14T11:21:00.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.012+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=CUN8LEH3I6Q4 type=del size=3421385 2024-09-14T11:21:00.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.014+0000 7fc354693780 1 < canceled operation key=IGZK9BWJFCV3 tag=RFIG169BFQH8 type=del size=2679015 2024-09-14T11:21:00.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.015+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=16DY0KL6JW9J type=del size=513135 2024-09-14T11:21:00.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.017+0000 7fc354693780 1 < suggested update operation key=PRBZQWTFXQ7R tag=U00YM94A2NFD type=del size=259700 2024-09-14T11:21:00.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.018+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=FYY96H125NQ0 type=del size=2751593 2024-09-14T11:21:00.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.019+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~POAC41HVI2UO.0 size=1048576 2024-09-14T11:21:00.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.020+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~POAC41HVI2UO.1 size=254423 2024-09-14T11:21:00.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.022+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=POAC41HVI2UO tag=44104TTXQEXK type=write size=2351575 2024-09-14T11:21:00.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.024+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~OG0ZF0253KHU.0 size=427586 2024-09-14T11:21:00.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.024+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=OG0ZF0253KHU tag=7T7JBTHEETVV type=write size=1476162 2024-09-14T11:21:00.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.025+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=SYPKZFW9SZW8 type=del 2024-09-14T11:21:00.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.027+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~BNTJG8UVTL4O.0 size=1048576 2024-09-14T11:21:00.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.028+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~BNTJG8UVTL4O.1 size=915920 2024-09-14T11:21:00.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.028+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=BNTJG8UVTL4O tag=P8WZPLLXNOQW type=write size=3013072 2024-09-14T11:21:00.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.029+0000 7fc354693780 1 < canceled operation key=OOFM3K1KEB9V tag=UL39C3B3LCG1 type=del size=2909656 2024-09-14T11:21:00.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.030+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=GX9HCPTZG6VX type=del size=937446 2024-09-14T11:21:00.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.032+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=VEEEMYO801VA type=del size=917513 2024-09-14T11:21:00.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.033+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=EKA3B5D9QMV8 type=del size=1442751 2024-09-14T11:21:00.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.035+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=Z0PG2IRO7EYV type=del 2024-09-14T11:21:00.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.037+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~U0LIMIZ2BOLP.0 size=1048576 2024-09-14T11:21:00.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.037+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~U0LIMIZ2BOLP.1 size=814546 2024-09-14T11:21:00.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.037+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=U0LIMIZ2BOLP tag=1B6SYI92DZEL type=write size=2911698 2024-09-14T11:21:00.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.039+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=7CFVXFUJG9LV type=write size=703294 2024-09-14T11:21:00.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.041+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~O1SRKQ4J6CPV.0 size=1048576 2024-09-14T11:21:00.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.041+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~O1SRKQ4J6CPV.1 size=15317 2024-09-14T11:21:00.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.041+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=O1SRKQ4J6CPV tag=XH4JWHCTQUU3 type=write size=2112469 2024-09-14T11:21:00.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.042+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=15D397REUEHE type=del 2024-09-14T11:21:00.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.044+0000 7fc354693780 1 > prepared part key=_multipart_AUL8F0SZVZX2.2~38U4QJ56LFOS.0 size=1016736 2024-09-14T11:21:00.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.044+0000 7fc354693780 1 > prepared multipart upload key=AUL8F0SZVZX2 upload=38U4QJ56LFOS tag=R8IYNKU4VW8U type=write size=2065312 2024-09-14T11:21:00.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.045+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~NOZFL1VZJG0M.0 size=1048576 2024-09-14T11:21:00.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.046+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~NOZFL1VZJG0M.1 size=413961 2024-09-14T11:21:00.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.048+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=NOZFL1VZJG0M tag=GSFRPGZHWPLV type=write size=2511113 2024-09-14T11:21:00.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.049+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=U5ZIF83C9WXR type=del size=2138826 2024-09-14T11:21:00.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.050+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=88K2IAH3EVP1 type=del 2024-09-14T11:21:00.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.051+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=YUL9KW1IW3DX type=del size=994742 2024-09-14T11:21:00.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.052+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~M3SMRKL9ECGT.0 size=473285 2024-09-14T11:21:00.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.054+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=M3SMRKL9ECGT tag=SN6PPHND44J8 type=write size=1521861 2024-09-14T11:21:00.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.055+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=DKWF4W537SBU type=write size=526652 2024-09-14T11:21:00.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.057+0000 7fc354693780 1 < suggested remove operation key=EFX0VXGHRUDR tag=5OEQGIRRI2YE type=del 2024-09-14T11:21:00.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.059+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=514XDHZ3DN0O type=del size=3299585 2024-09-14T11:21:00.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.060+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=4LCYLHZQAT6W type=del 2024-09-14T11:21:00.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.062+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~UBK2D7ONJPAF.0 size=603489 2024-09-14T11:21:00.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.062+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=UBK2D7ONJPAF tag=5BO5H54ZUV6K type=write size=1652065 2024-09-14T11:21:00.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.062+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~GGESQE7WMD6P.0 size=1048576 2024-09-14T11:21:00.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.063+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~GGESQE7WMD6P.1 size=766062 2024-09-14T11:21:00.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.065+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=GGESQE7WMD6P tag=PZAUD35XXA70 type=write size=2863214 2024-09-14T11:21:00.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.066+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=NQT8BWZG6D68 type=del size=43244 2024-09-14T11:21:00.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.067+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=CUN8LEH3I6Q4 type=del 2024-09-14T11:21:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.070+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~QBBGOLE8SDK9.0 size=582354 2024-09-14T11:21:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.070+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=QBBGOLE8SDK9 tag=A8WESBNNR3J5 type=write size=1630930 2024-09-14T11:21:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.071+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=16DY0KL6JW9J type=del 2024-09-14T11:21:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.072+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=CZV4V4E58Q9U type=del size=1297630 2024-09-14T11:21:00.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.073+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=FYY96H125NQ0 type=del 2024-09-14T11:21:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.074+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=DI7S7K8ASRAV type=del size=735124 2024-09-14T11:21:00.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.076+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~OG0ZF0253KHU.0 size=427586 2024-09-14T11:21:00.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.077+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=OG0ZF0253KHU tag=7T7JBTHEETVV type=write size=1476162 2024-09-14T11:21:00.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.078+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=HF2AJD076FTI type=del size=1632393 2024-09-14T11:21:00.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.080+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~BNTJG8UVTL4O.0 size=1048576 2024-09-14T11:21:00.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.080+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~BNTJG8UVTL4O.1 size=915920 2024-09-14T11:21:00.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.081+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=BNTJG8UVTL4O tag=P8WZPLLXNOQW type=write size=3013072 2024-09-14T11:21:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.084+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~DJGBRY9OZBMB.0 size=1048576 2024-09-14T11:21:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.084+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~DJGBRY9OZBMB.1 size=108899 2024-09-14T11:21:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.084+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=DJGBRY9OZBMB tag=8SMVZ3TUHXRP type=write size=2206051 2024-09-14T11:21:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.085+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=GX9HCPTZG6VX type=del 2024-09-14T11:21:00.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.087+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.0 size=1048576 2024-09-14T11:21:00.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.088+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.1 size=1048576 2024-09-14T11:21:00.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.089+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.2 size=160347 2024-09-14T11:21:00.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.089+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=EBF79A4496G7 tag=XTD82KXP650K type=write size=3306075 2024-09-14T11:21:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.090+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=EKA3B5D9QMV8 type=del 2024-09-14T11:21:00.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.092+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.0 size=1048576 2024-09-14T11:21:00.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.093+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.1 size=1048576 2024-09-14T11:21:00.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.094+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.2 size=737330 2024-09-14T11:21:00.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.094+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=UY5AX4JXNY4U tag=SIA5XOLP33WH type=write size=3883058 2024-09-14T11:21:00.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.096+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~U0LIMIZ2BOLP.0 size=1048576 2024-09-14T11:21:00.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.097+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~U0LIMIZ2BOLP.1 size=814546 2024-09-14T11:21:00.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.099+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=U0LIMIZ2BOLP tag=1B6SYI92DZEL type=write size=2911698 2024-09-14T11:21:00.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.101+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~L1LSTJFHT1BB.0 size=107210 2024-09-14T11:21:00.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.101+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=L1LSTJFHT1BB tag=1YJDT4M0Z29I type=write size=1155786 2024-09-14T11:21:00.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.103+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~O1SRKQ4J6CPV.0 size=1048576 2024-09-14T11:21:00.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.104+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~O1SRKQ4J6CPV.1 size=15317 2024-09-14T11:21:00.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.106+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=O1SRKQ4J6CPV tag=XH4JWHCTQUU3 type=write size=2112469 2024-09-14T11:21:00.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.107+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=G9K1O59ATJKS type=del size=901684 2024-09-14T11:21:00.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.107+0000 7fc354693780 1 < canceled part key=_multipart_AUL8F0SZVZX2.2~38U4QJ56LFOS.0 size=1016736 2024-09-14T11:21:00.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.109+0000 7fc354693780 1 < canceled multipart upload key=AUL8F0SZVZX2 upload=38U4QJ56LFOS tag=R8IYNKU4VW8U type=write size=2065312 2024-09-14T11:21:00.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.111+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~BJWTBSUW0YYH.0 size=836321 2024-09-14T11:21:00.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.111+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=BJWTBSUW0YYH tag=9IVQUR0K487X type=write size=1884897 2024-09-14T11:21:00.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.113+0000 7fc354693780 1 < suggested remove operation key=RHVF0Z2PRDA8 tag=U5ZIF83C9WXR type=del 2024-09-14T11:21:00.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.114+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=IRFZOI4ZB9RE type=del size=1002050 2024-09-14T11:21:00.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.115+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=YUL9KW1IW3DX type=del 2024-09-14T11:21:00.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.117+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~CKQR9N3RX30J.0 size=1048576 2024-09-14T11:21:00.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.118+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~CKQR9N3RX30J.1 size=478479 2024-09-14T11:21:00.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.118+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=CKQR9N3RX30J tag=EEZFIL9VVLOK type=write size=2575631 2024-09-14T11:21:00.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.119+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=DKWF4W537SBU type=write size=526652 2024-09-14T11:21:00.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.120+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=7UQ0L81NUFEZ type=del size=1707940 2024-09-14T11:21:00.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.121+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=514XDHZ3DN0O type=del 2024-09-14T11:21:00.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.123+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.0 size=1048576 2024-09-14T11:21:00.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.124+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.1 size=1048576 2024-09-14T11:21:00.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.125+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.2 size=424923 2024-09-14T11:21:00.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.125+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=PVD099GDLTI3 tag=1DBH4GPXTV33 type=write size=3570651 2024-09-14T11:21:00.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.125+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~UBK2D7ONJPAF.0 size=603489 2024-09-14T11:21:00.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.127+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=UBK2D7ONJPAF tag=5BO5H54ZUV6K type=write size=1652065 2024-09-14T11:21:00.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.128+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=NG21N1LM6DAM type=del size=1748341 2024-09-14T11:21:00.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.130+0000 7fc354693780 1 < canceled operation key=AUL8F0SZVZX2 tag=NQT8BWZG6D68 type=del size=43244 2024-09-14T11:21:00.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.131+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=GRWK8ZO84BEG type=del size=2063454 2024-09-14T11:21:00.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.133+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~QBBGOLE8SDK9.0 size=582354 2024-09-14T11:21:00.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.134+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=QBBGOLE8SDK9 tag=A8WESBNNR3J5 type=write size=1630930 2024-09-14T11:21:00.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.136+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=MLEC3GWSSFNJ type=del size=250743 2024-09-14T11:21:00.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.137+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=CZV4V4E58Q9U type=del 2024-09-14T11:21:00.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.138+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=0ILSEG0O2P4U type=del size=1683301 2024-09-14T11:21:00.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.139+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=DI7S7K8ASRAV type=del 2024-09-14T11:21:00.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.141+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~QLGCIY6R9ATZ.0 size=793359 2024-09-14T11:21:00.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.141+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=QLGCIY6R9ATZ tag=BNISAQZHLFLS type=write size=1841935 2024-09-14T11:21:00.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.143+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=HF2AJD076FTI type=del 2024-09-14T11:21:00.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.145+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~HIYISRRJ22OU.0 size=39043 2024-09-14T11:21:00.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.145+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=HIYISRRJ22OU tag=0P42CCEEERQ2 type=write size=1087619 2024-09-14T11:21:00.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.146+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~DJGBRY9OZBMB.0 size=1048576 2024-09-14T11:21:00.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.147+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~DJGBRY9OZBMB.1 size=108899 2024-09-14T11:21:00.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.149+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=DJGBRY9OZBMB tag=8SMVZ3TUHXRP type=write size=2206051 2024-09-14T11:21:00.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.150+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=KYDPE316W37P type=write size=19368 2024-09-14T11:21:00.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.152+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.0 size=1048576 2024-09-14T11:21:00.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.153+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.1 size=1048576 2024-09-14T11:21:00.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.154+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EBF79A4496G7.2 size=160347 2024-09-14T11:21:00.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.156+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=EBF79A4496G7 tag=XTD82KXP650K type=write size=3306075 2024-09-14T11:21:00.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.157+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=DNA3K91SI9Y5 type=del size=1033333 2024-09-14T11:21:00.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.159+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.0 size=1048576 2024-09-14T11:21:00.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.160+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.1 size=1048576 2024-09-14T11:21:00.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.161+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~UY5AX4JXNY4U.2 size=737330 2024-09-14T11:21:00.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.163+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=UY5AX4JXNY4U tag=SIA5XOLP33WH type=write size=3883058 2024-09-14T11:21:00.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.164+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=XQ41TUHDPF8Q type=del size=2630056 2024-09-14T11:21:00.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.165+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~L1LSTJFHT1BB.0 size=107210 2024-09-14T11:21:00.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.167+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=L1LSTJFHT1BB tag=1YJDT4M0Z29I type=write size=1155786 2024-09-14T11:21:00.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.169+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=81S5H6JDX622 type=del size=2692555 2024-09-14T11:21:00.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.171+0000 7fc354693780 1 < suggested remove operation key=BJ7AARJEIT8W tag=G9K1O59ATJKS type=del 2024-09-14T11:21:00.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.173+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.0 size=1048576 2024-09-14T11:21:00.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.174+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.1 size=1048576 2024-09-14T11:21:00.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.175+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.2 size=459414 2024-09-14T11:21:00.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.175+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=635MKG40KN9P tag=LXXTSKEP6MVY type=write size=3605142 2024-09-14T11:21:00.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.176+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~BJWTBSUW0YYH.0 size=836321 2024-09-14T11:21:00.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.179+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=BJWTBSUW0YYH tag=9IVQUR0K487X type=write size=1884897 2024-09-14T11:21:00.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.181+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~ARTBZ3E3119E.0 size=106908 2024-09-14T11:21:00.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.181+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=ARTBZ3E3119E tag=51IK8PLUTBS4 type=write size=1155484 2024-09-14T11:21:00.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.183+0000 7fc354693780 1 < canceled operation key=TFTKNNCGN88D tag=IRFZOI4ZB9RE type=del size=1002050 2024-09-14T11:21:00.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.184+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=AJF15UJ6Q4NU type=del size=299850 2024-09-14T11:21:00.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.185+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~CKQR9N3RX30J.0 size=1048576 2024-09-14T11:21:00.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.186+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~CKQR9N3RX30J.1 size=478479 2024-09-14T11:21:00.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.188+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=CKQR9N3RX30J tag=EEZFIL9VVLOK type=write size=2575631 2024-09-14T11:21:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.189+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=Q7NQXQ1WQY7L type=write size=629421 2024-09-14T11:21:00.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.191+0000 7fc354693780 1 < suggested remove operation key=OOFM3K1KEB9V tag=7UQ0L81NUFEZ type=del 2024-09-14T11:21:00.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.192+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=COKT0BFGDF1Q type=write size=304332 2024-09-14T11:21:00.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.193+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.0 size=1048576 2024-09-14T11:21:00.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.194+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.1 size=1048576 2024-09-14T11:21:00.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.194+0000 7fc354693780 1 < canceled part key=_multipart_977GI7HKD9JJ.2~PVD099GDLTI3.2 size=424923 2024-09-14T11:21:00.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.196+0000 7fc354693780 1 < canceled multipart upload key=977GI7HKD9JJ upload=PVD099GDLTI3 tag=1DBH4GPXTV33 type=write size=3570651 2024-09-14T11:21:00.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.197+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=4RBYHLOVRVHS type=del size=4027433 2024-09-14T11:21:00.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.198+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=NG21N1LM6DAM type=del 2024-09-14T11:21:00.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.199+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=6A47VNAHU4Z7 type=write size=684243 2024-09-14T11:21:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.200+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=GRWK8ZO84BEG type=del 2024-09-14T11:21:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.202+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~SGA26IE34JLQ.0 size=700249 2024-09-14T11:21:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.202+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=SGA26IE34JLQ tag=9HCEIVVS6LNF type=write size=1748825 2024-09-14T11:21:00.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.204+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=MLEC3GWSSFNJ type=del size=250743 2024-09-14T11:21:00.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.206+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.0 size=1048576 2024-09-14T11:21:00.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.207+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.1 size=1048576 2024-09-14T11:21:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.207+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.2 size=554933 2024-09-14T11:21:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.207+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=U82PN13DGS4L tag=RDGGQ2E77MIY type=write size=3700661 2024-09-14T11:21:00.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.209+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=0ILSEG0O2P4U type=del 2024-09-14T11:21:00.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.210+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=NOALWIF6O9Y8 type=del size=3879850 2024-09-14T11:21:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.211+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~QLGCIY6R9ATZ.0 size=793359 2024-09-14T11:21:00.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.213+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=QLGCIY6R9ATZ tag=BNISAQZHLFLS type=write size=1841935 2024-09-14T11:21:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.214+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=ZVI2XI9WTTHN type=del size=4002497 2024-09-14T11:21:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.214+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~HIYISRRJ22OU.0 size=39043 2024-09-14T11:21:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.216+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=HIYISRRJ22OU tag=0P42CCEEERQ2 type=write size=1087619 2024-09-14T11:21:00.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.217+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=1ZC5HCYO189P type=del size=1489303 2024-09-14T11:21:00.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.220+0000 7fc354693780 1 < suggested update operation key=WBT3M1NMEEAY tag=KYDPE316W37P type=write size=19368 2024-09-14T11:21:00.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.221+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=KFJB1SGPG8EH type=del size=2025985 2024-09-14T11:21:00.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.222+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=DNA3K91SI9Y5 type=del 2024-09-14T11:21:00.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.223+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=6DKV3XPL1Y6I type=del size=3251245 2024-09-14T11:21:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.225+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=XQ41TUHDPF8Q type=del 2024-09-14T11:21:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.226+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=X426ZIXI7545 type=del size=855728 2024-09-14T11:21:00.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.228+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=81S5H6JDX622 type=del 2024-09-14T11:21:00.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.230+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~1X6KEJTXV82J.0 size=1048576 2024-09-14T11:21:00.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.231+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~1X6KEJTXV82J.1 size=461218 2024-09-14T11:21:00.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.231+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=1X6KEJTXV82J tag=5C0OQSJLM5PH type=write size=2558370 2024-09-14T11:21:00.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.232+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.0 size=1048576 2024-09-14T11:21:00.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.232+0000 7fc354693780 1 < canceled part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.1 size=1048576 2024-09-14T11:21:00.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.233+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~635MKG40KN9P.2 size=459414 2024-09-14T11:21:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.235+0000 7fc354693780 1 < canceled multipart upload key=OOFM3K1KEB9V upload=635MKG40KN9P tag=LXXTSKEP6MVY type=write size=3605142 2024-09-14T11:21:00.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.236+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=2T87SGTRTS94 type=del size=3075929 2024-09-14T11:21:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.238+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~ARTBZ3E3119E.0 size=106908 2024-09-14T11:21:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.239+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=ARTBZ3E3119E tag=51IK8PLUTBS4 type=write size=1155484 2024-09-14T11:21:00.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.241+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=Y93IAJB05KDG type=del size=3638859 2024-09-14T11:21:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.242+0000 7fc354693780 1 < completed delete operation key=Z3ZFX1354IRF tag=AJF15UJ6Q4NU type=del 2024-09-14T11:21:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.243+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=PN7OO0I5H52D type=del size=2852285 2024-09-14T11:21:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.245+0000 7fc354693780 1 < canceled operation key=FMG2DNGS0LZ3 tag=Q7NQXQ1WQY7L type=write size=629421 2024-09-14T11:21:00.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.247+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.0 size=1048576 2024-09-14T11:21:00.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.248+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.1 size=1048576 2024-09-14T11:21:00.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.248+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.2 size=305104 2024-09-14T11:21:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.248+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=0KE101S03GJ1 tag=9P9Y10HHWKJC type=write size=3450832 2024-09-14T11:21:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.250+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=COKT0BFGDF1Q type=write size=304332 2024-09-14T11:21:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.252+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~S6N4VGZ79QD7.0 size=13236 2024-09-14T11:21:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.252+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=S6N4VGZ79QD7 tag=3400QNLJOAJH type=write size=1061812 2024-09-14T11:21:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.253+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=4RBYHLOVRVHS type=del 2024-09-14T11:21:00.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.254+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=1PZBP0Z1JZQ4 type=del size=4193643 2024-09-14T11:21:00.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.256+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=6A47VNAHU4Z7 type=write size=684243 2024-09-14T11:21:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.258+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~NFXDRFGWI0DM.0 size=718926 2024-09-14T11:21:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.258+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=NFXDRFGWI0DM tag=SYQIXJQDDQ8N type=write size=1767502 2024-09-14T11:21:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.259+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~SGA26IE34JLQ.0 size=700249 2024-09-14T11:21:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.261+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=SGA26IE34JLQ tag=9HCEIVVS6LNF type=write size=1748825 2024-09-14T11:21:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.263+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~L4HFUNFYQ3YU.0 size=1048576 2024-09-14T11:21:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.264+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~L4HFUNFYQ3YU.1 size=655874 2024-09-14T11:21:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.264+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=L4HFUNFYQ3YU tag=YIAZLIN7XO21 type=write size=2753026 2024-09-14T11:21:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.265+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.0 size=1048576 2024-09-14T11:21:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.265+0000 7fc354693780 1 < canceled part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.1 size=1048576 2024-09-14T11:21:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.266+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~U82PN13DGS4L.2 size=554933 2024-09-14T11:21:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.268+0000 7fc354693780 1 < canceled multipart upload key=54EUIL28P2H1 upload=U82PN13DGS4L tag=RDGGQ2E77MIY type=write size=3700661 2024-09-14T11:21:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.270+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~GSBA6TVW3ZE0.0 size=959113 2024-09-14T11:21:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.270+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=GSBA6TVW3ZE0 tag=DWVWHVBJ3NQ4 type=write size=2007689 2024-09-14T11:21:00.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.272+0000 7fc354693780 1 < suggested remove operation key=H1S2CBHNW6GI tag=NOALWIF6O9Y8 type=del 2024-09-14T11:21:00.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.273+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=3JT2DLH7Q278 type=del size=1822434 2024-09-14T11:21:00.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.274+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=ZVI2XI9WTTHN type=del 2024-09-14T11:21:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.276+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=E7UUX1US3GOF type=write size=706197 2024-09-14T11:21:00.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.278+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=1ZC5HCYO189P type=del 2024-09-14T11:21:00.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.280+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~BWUX1FVYSMNU.0 size=767155 2024-09-14T11:21:00.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.280+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=BWUX1FVYSMNU tag=EZERVUF62VEF type=write size=1815731 2024-09-14T11:21:00.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.281+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=KFJB1SGPG8EH type=del 2024-09-14T11:21:00.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.282+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=925D7CVEGPJ1 type=del size=3601103 2024-09-14T11:21:00.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.283+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=6DKV3XPL1Y6I type=del 2024-09-14T11:21:00.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.284+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=GM4AUK0Z1FKR type=del size=461763 2024-09-14T11:21:00.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.285+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=X426ZIXI7545 type=del 2024-09-14T11:21:00.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.286+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=IDSECGTKE3HJ type=del size=800232 2024-09-14T11:21:00.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.289+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~1X6KEJTXV82J.0 size=1048576 2024-09-14T11:21:00.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.290+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~1X6KEJTXV82J.1 size=461218 2024-09-14T11:21:00.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.291+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=1X6KEJTXV82J tag=5C0OQSJLM5PH type=write size=2558370 2024-09-14T11:21:00.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.293+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=XOHK2BDNV2JS type=del size=163734 2024-09-14T11:21:00.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.294+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=2T87SGTRTS94 type=del 2024-09-14T11:21:00.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.296+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~99R46J1PSOLL.0 size=1048576 2024-09-14T11:21:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.297+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~99R46J1PSOLL.1 size=637853 2024-09-14T11:21:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.297+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=99R46J1PSOLL tag=FN55P87PG6CJ type=write size=2735005 2024-09-14T11:21:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.298+0000 7fc354693780 1 < canceled operation key=QWMHFF32M37W tag=Y93IAJB05KDG type=del size=3638859 2024-09-14T11:21:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.299+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=Y8B0JSRD06D3 type=write size=223927 2024-09-14T11:21:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.300+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=PN7OO0I5H52D type=del 2024-09-14T11:21:00.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.301+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=FUJEUABVXZN9 type=del size=3116753 2024-09-14T11:21:00.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.302+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.0 size=1048576 2024-09-14T11:21:00.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.303+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.1 size=1048576 2024-09-14T11:21:00.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.304+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~0KE101S03GJ1.2 size=305104 2024-09-14T11:21:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.306+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=0KE101S03GJ1 tag=9P9Y10HHWKJC type=write size=3450832 2024-09-14T11:21:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.307+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=8EO2KXG940XZ type=del size=3122776 2024-09-14T11:21:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.308+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~S6N4VGZ79QD7.0 size=13236 2024-09-14T11:21:00.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.310+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=S6N4VGZ79QD7 tag=3400QNLJOAJH type=write size=1061812 2024-09-14T11:21:00.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.311+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=VFRB3RIBXIVK type=del size=375201 2024-09-14T11:21:00.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.313+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=1PZBP0Z1JZQ4 type=del 2024-09-14T11:21:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.315+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~F52UCUNWQB9P.0 size=1048576 2024-09-14T11:21:00.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.315+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~F52UCUNWQB9P.1 size=475897 2024-09-14T11:21:00.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.315+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=F52UCUNWQB9P tag=7HDA13L4NKH9 type=write size=2573049 2024-09-14T11:21:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.317+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~NFXDRFGWI0DM.0 size=718926 2024-09-14T11:21:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.318+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=NFXDRFGWI0DM tag=SYQIXJQDDQ8N type=write size=1767502 2024-09-14T11:21:00.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.320+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=TCQBULU6MW7H type=del size=1621062 2024-09-14T11:21:00.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.320+0000 7fc354693780 1 < canceled part key=_multipart_EFX0VXGHRUDR.2~L4HFUNFYQ3YU.0 size=1048576 2024-09-14T11:21:00.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.321+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~L4HFUNFYQ3YU.1 size=655874 2024-09-14T11:21:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.323+0000 7fc354693780 1 < canceled multipart upload key=EFX0VXGHRUDR upload=L4HFUNFYQ3YU tag=YIAZLIN7XO21 type=write size=2753026 2024-09-14T11:21:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.325+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.0 size=1048576 2024-09-14T11:21:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.325+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.1 size=1048576 2024-09-14T11:21:00.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.326+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.2 size=467501 2024-09-14T11:21:00.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.326+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=OD3CP3MXBCP5 tag=741PGGI94H2N type=write size=3613229 2024-09-14T11:21:00.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.327+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~GSBA6TVW3ZE0.0 size=959113 2024-09-14T11:21:00.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.329+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=GSBA6TVW3ZE0 tag=DWVWHVBJ3NQ4 type=write size=2007689 2024-09-14T11:21:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.331+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~8GB1JFAZQH4N.0 size=21033 2024-09-14T11:21:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.331+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=8GB1JFAZQH4N tag=6J01HK2N3Z5W type=write size=1069609 2024-09-14T11:21:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.332+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=3JT2DLH7Q278 type=del 2024-09-14T11:21:00.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.333+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=4F6KRNT8A0YG type=del size=301123 2024-09-14T11:21:00.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.335+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=E7UUX1US3GOF type=write 2024-09-14T11:21:00.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.337+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~GOK2LL635H3V.0 size=87511 2024-09-14T11:21:00.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.337+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=GOK2LL635H3V tag=K7MMETN01YX0 type=write size=1136087 2024-09-14T11:21:00.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.338+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~BWUX1FVYSMNU.0 size=767155 2024-09-14T11:21:00.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.340+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=BWUX1FVYSMNU tag=EZERVUF62VEF type=write size=1815731 2024-09-14T11:21:00.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.342+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~U62U5SQUYMBF.0 size=912280 2024-09-14T11:21:00.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.342+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=U62U5SQUYMBF tag=VUF04D4HRFNM type=write size=1960856 2024-09-14T11:21:00.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.343+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=925D7CVEGPJ1 type=del 2024-09-14T11:21:00.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.345+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.0 size=1048576 2024-09-14T11:21:00.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.346+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.1 size=1048576 2024-09-14T11:21:00.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.347+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.2 size=694127 2024-09-14T11:21:00.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.347+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=KWYHQ7X7VFON tag=H3F3OFLCWCF8 type=write size=3839855 2024-09-14T11:21:00.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.348+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=GM4AUK0Z1FKR type=del 2024-09-14T11:21:00.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.349+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=6DVJ4OM7AH7O type=del size=1813704 2024-09-14T11:21:00.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.351+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=IDSECGTKE3HJ type=del 2024-09-14T11:21:00.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.352+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=QEGUYSIGT3KY type=write size=774516 2024-09-14T11:21:00.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.353+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=XOHK2BDNV2JS type=del 2024-09-14T11:21:00.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.354+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=6M0ZN2GVKWZS type=del size=2402405 2024-09-14T11:21:00.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.355+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~99R46J1PSOLL.0 size=1048576 2024-09-14T11:21:00.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.356+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~99R46J1PSOLL.1 size=637853 2024-09-14T11:21:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.358+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=99R46J1PSOLL tag=FN55P87PG6CJ type=write size=2735005 2024-09-14T11:21:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.359+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=GZEQMOMTGZDX type=del size=1295846 2024-09-14T11:21:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.360+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=Y8B0JSRD06D3 type=write size=223927 2024-09-14T11:21:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.362+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.0 size=1048576 2024-09-14T11:21:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.363+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.1 size=1048576 2024-09-14T11:21:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.364+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.2 size=494737 2024-09-14T11:21:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.364+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=PME0R7VOU3R8 tag=D2CA5PHAOF1P type=write size=3640465 2024-09-14T11:21:00.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.366+0000 7fc354693780 1 < suggested remove operation key=P061QWG9J16V tag=FUJEUABVXZN9 type=del 2024-09-14T11:21:00.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.368+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.0 size=1048576 2024-09-14T11:21:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.369+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.1 size=1048576 2024-09-14T11:21:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.370+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.2 size=546567 2024-09-14T11:21:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.370+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=IXDSUS875BLI tag=7I6C0R7GYH3K type=write size=3692295 2024-09-14T11:21:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.371+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=8EO2KXG940XZ type=del 2024-09-14T11:21:00.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.373+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=L0EQ2TSBHQP9 type=del size=2903992 2024-09-14T11:21:00.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.374+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=VFRB3RIBXIVK type=del 2024-09-14T11:21:00.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.376+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~OVOO7RWKY29N.0 size=430917 2024-09-14T11:21:00.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.376+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=OVOO7RWKY29N tag=GSEKFGQF55YU type=write size=1479493 2024-09-14T11:21:00.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.377+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~F52UCUNWQB9P.0 size=1048576 2024-09-14T11:21:00.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.378+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~F52UCUNWQB9P.1 size=475897 2024-09-14T11:21:00.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.381+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=F52UCUNWQB9P tag=7HDA13L4NKH9 type=write size=2573049 2024-09-14T11:21:00.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.383+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~DICA4S90IGH3.0 size=1048576 2024-09-14T11:21:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.383+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~DICA4S90IGH3.1 size=328969 2024-09-14T11:21:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.383+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=DICA4S90IGH3 tag=KZZYWIB2NWXQ type=write size=2426121 2024-09-14T11:21:00.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.385+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=TCQBULU6MW7H type=del 2024-09-14T11:21:00.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.387+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.0 size=1048576 2024-09-14T11:21:00.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.388+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.1 size=1048576 2024-09-14T11:21:00.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.389+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.2 size=984733 2024-09-14T11:21:00.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.389+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=VGVQE1MHDQCS tag=KVDQO8K91RFC type=write size=4130461 2024-09-14T11:21:00.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.390+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.0 size=1048576 2024-09-14T11:21:00.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.390+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.1 size=1048576 2024-09-14T11:21:00.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.391+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~OD3CP3MXBCP5.2 size=467501 2024-09-14T11:21:00.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.394+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=OD3CP3MXBCP5 tag=741PGGI94H2N type=write size=3613229 2024-09-14T11:21:00.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.396+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~H0K0ZRNZKAN2.0 size=1048576 2024-09-14T11:21:00.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.397+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~H0K0ZRNZKAN2.1 size=537034 2024-09-14T11:21:00.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.397+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=H0K0ZRNZKAN2 tag=WQVWL3AXSMB1 type=write size=2634186 2024-09-14T11:21:00.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.398+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~8GB1JFAZQH4N.0 size=21033 2024-09-14T11:21:00.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.400+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=8GB1JFAZQH4N tag=6J01HK2N3Z5W type=write size=1069609 2024-09-14T11:21:00.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.401+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=B6251OO6F38A type=del size=2617924 2024-09-14T11:21:00.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.403+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=4F6KRNT8A0YG type=del 2024-09-14T11:21:00.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.405+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~CTNODS59E3PE.0 size=833143 2024-09-14T11:21:00.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.405+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=CTNODS59E3PE tag=WR6O4650K0RG type=write size=1881719 2024-09-14T11:21:00.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.406+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~GOK2LL635H3V.0 size=87511 2024-09-14T11:21:00.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.407+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=GOK2LL635H3V tag=K7MMETN01YX0 type=write size=1136087 2024-09-14T11:21:00.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.409+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=OJHYJ1SCUQ8X type=write size=650090 2024-09-14T11:21:00.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.410+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~U62U5SQUYMBF.0 size=912280 2024-09-14T11:21:00.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.412+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=U62U5SQUYMBF tag=VUF04D4HRFNM type=write size=1960856 2024-09-14T11:21:00.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.414+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~YVSB9V6OWN7W.0 size=525834 2024-09-14T11:21:00.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.414+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=YVSB9V6OWN7W tag=RJ7B04WVUHC0 type=write size=1574410 2024-09-14T11:21:00.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.415+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.0 size=1048576 2024-09-14T11:21:00.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.416+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.1 size=1048576 2024-09-14T11:21:00.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.417+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KWYHQ7X7VFON.2 size=694127 2024-09-14T11:21:00.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.419+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=KWYHQ7X7VFON tag=H3F3OFLCWCF8 type=write size=3839855 2024-09-14T11:21:00.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.420+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=IBCXIEQY55XM type=del size=2756548 2024-09-14T11:21:00.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.422+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=6DVJ4OM7AH7O type=del size=1813704 2024-09-14T11:21:00.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.424+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=U2STR5DU372Q type=del size=130408 2024-09-14T11:21:00.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.425+0000 7fc354693780 1 < completed write operation key=N23XJJD7YYG0 tag=QEGUYSIGT3KY type=write size=774516 2024-09-14T11:21:00.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.426+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=UIEKY6YQ2TYR type=del size=1119099 2024-09-14T11:21:00.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.428+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=6M0ZN2GVKWZS type=del 2024-09-14T11:21:00.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.429+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=2A3RAE1QLBUY type=write size=1021742 2024-09-14T11:21:00.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.431+0000 7fc354693780 1 < suggested remove operation key=EFX0VXGHRUDR tag=GZEQMOMTGZDX type=del 2024-09-14T11:21:00.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.434+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.0 size=1048576 2024-09-14T11:21:00.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.435+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.1 size=1048576 2024-09-14T11:21:00.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.436+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.2 size=210898 2024-09-14T11:21:00.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.436+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=5H66FIRMGJ20 tag=JF3XJNE6Y7G8 type=write size=3356626 2024-09-14T11:21:00.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.436+0000 7fc354693780 1 < canceled part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.0 size=1048576 2024-09-14T11:21:00.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.437+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.1 size=1048576 2024-09-14T11:21:00.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.438+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~PME0R7VOU3R8.2 size=494737 2024-09-14T11:21:00.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.440+0000 7fc354693780 1 < canceled multipart upload key=RHVF0Z2PRDA8 upload=PME0R7VOU3R8 tag=D2CA5PHAOF1P type=write size=3640465 2024-09-14T11:21:00.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.443+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~7TREVJ0I2KTT.0 size=451956 2024-09-14T11:21:00.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.443+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=7TREVJ0I2KTT tag=QUN00Y9TN7RJ type=write size=1500532 2024-09-14T11:21:00.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.443+0000 7fc354693780 1 < canceled part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.0 size=1048576 2024-09-14T11:21:00.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.444+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.1 size=1048576 2024-09-14T11:21:00.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.445+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~IXDSUS875BLI.2 size=546567 2024-09-14T11:21:00.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.447+0000 7fc354693780 1 < canceled multipart upload key=N23XJJD7YYG0 upload=IXDSUS875BLI tag=7I6C0R7GYH3K type=write size=3692295 2024-09-14T11:21:00.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.448+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=A1S5554F7CJV type=del size=1923797 2024-09-14T11:21:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.449+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=L0EQ2TSBHQP9 type=del 2024-09-14T11:21:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.451+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=AI64E9SMLASE type=del size=3305579 2024-09-14T11:21:00.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.452+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~OVOO7RWKY29N.0 size=430917 2024-09-14T11:21:00.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.454+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=OVOO7RWKY29N tag=GSEKFGQF55YU type=write size=1479493 2024-09-14T11:21:00.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.455+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=FWVN1C4947KX type=del size=3329847 2024-09-14T11:21:00.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.457+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~DICA4S90IGH3.0 size=1048576 2024-09-14T11:21:00.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.458+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~DICA4S90IGH3.1 size=328969 2024-09-14T11:21:00.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.459+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=DICA4S90IGH3 tag=KZZYWIB2NWXQ type=write size=2426121 2024-09-14T11:21:00.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.460+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=B0JNSCRT8PX0 type=del size=1570177 2024-09-14T11:21:00.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.462+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.0 size=1048576 2024-09-14T11:21:00.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.463+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.1 size=1048576 2024-09-14T11:21:00.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.463+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~VGVQE1MHDQCS.2 size=984733 2024-09-14T11:21:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.465+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=VGVQE1MHDQCS tag=KVDQO8K91RFC type=write size=4130461 2024-09-14T11:21:00.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.468+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~SMC28AZIS2K2.0 size=78651 2024-09-14T11:21:00.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.468+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=SMC28AZIS2K2 tag=TP0U0582PX9O type=write size=1127227 2024-09-14T11:21:00.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.468+0000 7fc354693780 1 < canceled part key=_multipart_4IDBIAE3VAY4.2~H0K0ZRNZKAN2.0 size=1048576 2024-09-14T11:21:00.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.469+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~H0K0ZRNZKAN2.1 size=537034 2024-09-14T11:21:00.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.470+0000 7fc354693780 1 < canceled multipart upload key=4IDBIAE3VAY4 upload=H0K0ZRNZKAN2 tag=WQVWL3AXSMB1 type=write size=2634186 2024-09-14T11:21:00.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.472+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=IY0QCRRPIQS3 type=del size=1291061 2024-09-14T11:21:00.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.473+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=B6251OO6F38A type=del 2024-09-14T11:21:00.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.474+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=B6YSB3C9KBOE type=del size=663091 2024-09-14T11:21:00.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.475+0000 7fc354693780 1 < completed part key=_multipart_NENG5XNJ7M5Z.2~CTNODS59E3PE.0 size=833143 2024-09-14T11:21:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.477+0000 7fc354693780 1 < completed multipart upload key=NENG5XNJ7M5Z upload=CTNODS59E3PE tag=WR6O4650K0RG type=write size=1881719 2024-09-14T11:21:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.479+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.0 size=1048576 2024-09-14T11:21:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.479+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.1 size=1048576 2024-09-14T11:21:00.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.480+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.2 size=864756 2024-09-14T11:21:00.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.480+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=4LQ2YC3OQBA6 tag=7ZCPDF5COLOT type=write size=4010484 2024-09-14T11:21:00.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.481+0000 7fc354693780 1 < canceled operation key=MQ5V2G5U43J1 tag=OJHYJ1SCUQ8X type=write size=650090 2024-09-14T11:21:00.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.483+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~PCL6X8K16696.0 size=792921 2024-09-14T11:21:00.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.483+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=PCL6X8K16696 tag=HCVIBF97E94V type=write size=1841497 2024-09-14T11:21:00.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.484+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~YVSB9V6OWN7W.0 size=525834 2024-09-14T11:21:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.486+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=YVSB9V6OWN7W tag=RJ7B04WVUHC0 type=write size=1574410 2024-09-14T11:21:00.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.488+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=1P1ILJ5PVCDZ type=del size=1887403 2024-09-14T11:21:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.490+0000 7fc354693780 1 < suggested remove operation key=QWMHFF32M37W tag=IBCXIEQY55XM type=del 2024-09-14T11:21:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.491+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=6ZKG5WYUH55F type=del size=3335372 2024-09-14T11:21:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.492+0000 7fc354693780 1 < canceled operation key=54EUIL28P2H1 tag=U2STR5DU372Q type=del size=130408 2024-09-14T11:21:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.494+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~UY9PWBJYVJUO.0 size=1048576 2024-09-14T11:21:00.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.494+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~UY9PWBJYVJUO.1 size=62358 2024-09-14T11:21:00.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.494+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=UY9PWBJYVJUO tag=2DWONX32SRR6 type=write size=2159510 2024-09-14T11:21:00.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.496+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=UIEKY6YQ2TYR type=del 2024-09-14T11:21:00.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.497+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=L389XPXU5XO3 type=del size=3703099 2024-09-14T11:21:00.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.498+0000 7fc354693780 1 < completed write operation key=Z3ZFX1354IRF tag=2A3RAE1QLBUY type=write size=1021742 2024-09-14T11:21:00.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.499+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=UXHDMRLTJAQI type=write size=419307 2024-09-14T11:21:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.501+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.0 size=1048576 2024-09-14T11:21:00.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.502+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.1 size=1048576 2024-09-14T11:21:00.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.503+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~5H66FIRMGJ20.2 size=210898 2024-09-14T11:21:00.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.504+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=5H66FIRMGJ20 tag=JF3XJNE6Y7G8 type=write size=3356626 2024-09-14T11:21:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.505+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=5NJFFBPMBYQF type=del size=483970 2024-09-14T11:21:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.506+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~7TREVJ0I2KTT.0 size=451956 2024-09-14T11:21:00.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.508+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=7TREVJ0I2KTT tag=QUN00Y9TN7RJ type=write size=1500532 2024-09-14T11:21:00.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.510+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~SF7NJFR5B5XA.0 size=1048576 2024-09-14T11:21:00.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.511+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~SF7NJFR5B5XA.1 size=685731 2024-09-14T11:21:00.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.511+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=SF7NJFR5B5XA tag=O02X1TFTHN68 type=write size=2782883 2024-09-14T11:21:00.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.512+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=A1S5554F7CJV type=del 2024-09-14T11:21:00.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.514+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~32YCZLH3NGZY.0 size=89290 2024-09-14T11:21:00.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.514+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=32YCZLH3NGZY tag=Y6VZ6CDBLBC1 type=write size=1137866 2024-09-14T11:21:00.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.515+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=AI64E9SMLASE type=del 2024-09-14T11:21:00.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.517+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~ZBIH1ARA05OF.0 size=1048576 2024-09-14T11:21:00.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.518+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~ZBIH1ARA05OF.1 size=216571 2024-09-14T11:21:00.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.518+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=ZBIH1ARA05OF tag=GJOZ1G2EQ9IJ type=write size=2313723 2024-09-14T11:21:00.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.521+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=FWVN1C4947KX type=del 2024-09-14T11:21:00.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.522+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=DG5YG121SAPW type=del size=1397907 2024-09-14T11:21:00.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.523+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=B0JNSCRT8PX0 type=del 2024-09-14T11:21:00.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.526+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.0 size=1048576 2024-09-14T11:21:00.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.527+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.1 size=1048576 2024-09-14T11:21:00.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.528+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.2 size=651997 2024-09-14T11:21:00.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.528+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=NE2P75GELE9H tag=ILRWI670PCZ8 type=write size=3797725 2024-09-14T11:21:00.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.529+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~SMC28AZIS2K2.0 size=78651 2024-09-14T11:21:00.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.531+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=SMC28AZIS2K2 tag=TP0U0582PX9O type=write size=1127227 2024-09-14T11:21:00.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.534+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~1O5RCCLDGKO7.0 size=431169 2024-09-14T11:21:00.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.534+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=1O5RCCLDGKO7 tag=CJBC2ONXAFNR type=write size=1479745 2024-09-14T11:21:00.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.535+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=IY0QCRRPIQS3 type=del 2024-09-14T11:21:00.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.536+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=BNTM08WNYI2D type=write size=961405 2024-09-14T11:21:00.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.537+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=B6YSB3C9KBOE type=del 2024-09-14T11:21:00.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.539+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=AATQX1YMJPG2 type=del size=1414915 2024-09-14T11:21:00.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.540+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.0 size=1048576 2024-09-14T11:21:00.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.541+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.1 size=1048576 2024-09-14T11:21:00.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.542+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~4LQ2YC3OQBA6.2 size=864756 2024-09-14T11:21:00.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.544+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=4LQ2YC3OQBA6 tag=7ZCPDF5COLOT type=write size=4010484 2024-09-14T11:21:00.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.546+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.0 size=1048576 2024-09-14T11:21:00.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.547+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.1 size=1048576 2024-09-14T11:21:00.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.548+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.2 size=618439 2024-09-14T11:21:00.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.548+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=YL8Y5DQ80FS7 tag=9BX3094WP4Q5 type=write size=3764167 2024-09-14T11:21:00.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.550+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~PCL6X8K16696.0 size=792921 2024-09-14T11:21:00.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.552+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=PCL6X8K16696 tag=HCVIBF97E94V type=write size=1841497 2024-09-14T11:21:00.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.554+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.0 size=1048576 2024-09-14T11:21:00.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.554+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.1 size=1048576 2024-09-14T11:21:00.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.555+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.2 size=342340 2024-09-14T11:21:00.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.555+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=UCHYF10Z1C1G tag=YXUANH2WO2LD type=write size=3488068 2024-09-14T11:21:00.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.557+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=1P1ILJ5PVCDZ type=del 2024-09-14T11:21:00.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.558+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=WU5SQAZ5G9ZH type=del size=1260334 2024-09-14T11:21:00.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.559+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=6ZKG5WYUH55F type=del 2024-09-14T11:21:00.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.560+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=DSWZMUNV130X type=del size=3468221 2024-09-14T11:21:00.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.562+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~UY9PWBJYVJUO.0 size=1048576 2024-09-14T11:21:00.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.563+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~UY9PWBJYVJUO.1 size=62358 2024-09-14T11:21:00.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.565+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=UY9PWBJYVJUO tag=2DWONX32SRR6 type=write size=2159510 2024-09-14T11:21:00.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.566+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=9Y1REVJO0FUI type=write size=287045 2024-09-14T11:21:00.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.567+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=L389XPXU5XO3 type=del 2024-09-14T11:21:00.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.569+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~OGTHQPGP90CL.0 size=1048576 2024-09-14T11:21:00.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.570+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~OGTHQPGP90CL.1 size=159053 2024-09-14T11:21:00.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.570+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=OGTHQPGP90CL tag=D5R7HG15G9L4 type=write size=2256205 2024-09-14T11:21:00.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.572+0000 7fc354693780 1 < suggested update operation key=EFX0VXGHRUDR tag=UXHDMRLTJAQI type=write size=419307 2024-09-14T11:21:00.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.574+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~GYJD3ORPHF6E.0 size=1048576 2024-09-14T11:21:00.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.575+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~GYJD3ORPHF6E.1 size=748018 2024-09-14T11:21:00.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.575+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=GYJD3ORPHF6E tag=YQQSWHHQ1PVI type=write size=2845170 2024-09-14T11:21:00.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.576+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=5NJFFBPMBYQF type=del 2024-09-14T11:21:00.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.577+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=EA1FMNMPVK7S type=del size=1873190 2024-09-14T11:21:00.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.578+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~SF7NJFR5B5XA.0 size=1048576 2024-09-14T11:21:00.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.579+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~SF7NJFR5B5XA.1 size=685731 2024-09-14T11:21:00.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.581+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=SF7NJFR5B5XA tag=O02X1TFTHN68 type=write size=2782883 2024-09-14T11:21:00.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.582+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=VP6YKZMJUR6I type=del size=1021781 2024-09-14T11:21:00.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.583+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~32YCZLH3NGZY.0 size=89290 2024-09-14T11:21:00.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.585+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=32YCZLH3NGZY tag=Y6VZ6CDBLBC1 type=write size=1137866 2024-09-14T11:21:00.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.586+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=N0TI5K1ZTXVZ type=write size=83962 2024-09-14T11:21:00.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.587+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~ZBIH1ARA05OF.0 size=1048576 2024-09-14T11:21:00.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.588+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~ZBIH1ARA05OF.1 size=216571 2024-09-14T11:21:00.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.590+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=ZBIH1ARA05OF tag=GJOZ1G2EQ9IJ type=write size=2313723 2024-09-14T11:21:00.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.591+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=0C7OTITMBZJG type=del size=2527335 2024-09-14T11:21:00.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.592+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=DG5YG121SAPW type=del 2024-09-14T11:21:00.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.594+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=2NOGSFSQA8P1 type=del size=171038 2024-09-14T11:21:00.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.594+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.0 size=1048576 2024-09-14T11:21:00.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.595+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.1 size=1048576 2024-09-14T11:21:00.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.596+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~NE2P75GELE9H.2 size=651997 2024-09-14T11:21:00.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.598+0000 7fc354693780 1 < canceled multipart upload key=QWMHFF32M37W upload=NE2P75GELE9H tag=ILRWI670PCZ8 type=write size=3797725 2024-09-14T11:21:00.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.600+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.0 size=1048576 2024-09-14T11:21:00.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.601+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.1 size=1048576 2024-09-14T11:21:00.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.601+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.2 size=1006674 2024-09-14T11:21:00.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.601+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=UF7QS4GM2GSK tag=2NFARZFPEZ3N type=write size=4152402 2024-09-14T11:21:00.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.603+0000 7fc354693780 1 < completed part key=_multipart_RHVF0Z2PRDA8.2~1O5RCCLDGKO7.0 size=431169 2024-09-14T11:21:00.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.605+0000 7fc354693780 1 < completed multipart upload key=RHVF0Z2PRDA8 upload=1O5RCCLDGKO7 tag=CJBC2ONXAFNR type=write size=1479745 2024-09-14T11:21:00.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.606+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=J73CJ0F13L32 type=del size=2962316 2024-09-14T11:21:00.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.609+0000 7fc354693780 1 < suggested update operation key=P061QWG9J16V tag=BNTM08WNYI2D type=write size=961405 2024-09-14T11:21:00.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.611+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~ACSNWEF1ZV41.0 size=289227 2024-09-14T11:21:00.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.611+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=ACSNWEF1ZV41 tag=QT285501AS0G type=write size=1337803 2024-09-14T11:21:00.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.613+0000 7fc354693780 1 < suggested remove operation key=4Z3KI5X3WQ0I tag=AATQX1YMJPG2 type=del 2024-09-14T11:21:00.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.614+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=TB4Z6B7NWSPJ type=write size=484685 2024-09-14T11:21:00.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.615+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.0 size=1048576 2024-09-14T11:21:00.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.616+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.1 size=1048576 2024-09-14T11:21:00.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.617+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~YL8Y5DQ80FS7.2 size=618439 2024-09-14T11:21:00.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.619+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=YL8Y5DQ80FS7 tag=9BX3094WP4Q5 type=write size=3764167 2024-09-14T11:21:00.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.620+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=SOYT8HJ8XOP8 type=del size=3273460 2024-09-14T11:21:00.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.622+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.0 size=1048576 2024-09-14T11:21:00.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.623+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.1 size=1048576 2024-09-14T11:21:00.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.624+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~UCHYF10Z1C1G.2 size=342340 2024-09-14T11:21:00.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.626+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=UCHYF10Z1C1G tag=YXUANH2WO2LD type=write size=3488068 2024-09-14T11:21:00.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.628+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~VRXBEP9FKB3I.0 size=896483 2024-09-14T11:21:00.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.628+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=VRXBEP9FKB3I tag=S8I6C5BS6EOE type=write size=1945059 2024-09-14T11:21:00.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.629+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=WU5SQAZ5G9ZH type=del 2024-09-14T11:21:00.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.630+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=7GL1E92R9HC4 type=del size=3271141 2024-09-14T11:21:00.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.633+0000 7fc354693780 1 < suggested update operation key=AUL8F0SZVZX2 tag=DSWZMUNV130X type=del size=3468221 2024-09-14T11:21:00.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.634+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=C5P7HZU2P2JP type=del size=3870308 2024-09-14T11:21:00.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.635+0000 7fc354693780 -1 < failed to complete operation key=EFX0VXGHRUDR tag=9Y1REVJO0FUI type=write size=287045: (22) Invalid argument 2024-09-14T11:21:00.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.636+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=LTUQL1IYG02R type=write size=125498 2024-09-14T11:21:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.637+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~OGTHQPGP90CL.0 size=1048576 2024-09-14T11:21:00.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.638+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~OGTHQPGP90CL.1 size=159053 2024-09-14T11:21:00.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.640+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=OGTHQPGP90CL tag=D5R7HG15G9L4 type=write size=2256205 2024-09-14T11:21:00.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.641+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=QSQDVLYMZQKT type=write size=53633 2024-09-14T11:21:00.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.642+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~GYJD3ORPHF6E.0 size=1048576 2024-09-14T11:21:00.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.643+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~GYJD3ORPHF6E.1 size=748018 2024-09-14T11:21:00.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.645+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=GYJD3ORPHF6E tag=YQQSWHHQ1PVI type=write size=2845170 2024-09-14T11:21:00.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.647+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=AN5FOT58CG92 type=write size=518610 2024-09-14T11:21:00.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.648+0000 7fc354693780 1 < canceled operation key=977GI7HKD9JJ tag=EA1FMNMPVK7S type=del size=1873190 2024-09-14T11:21:00.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.650+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~SCV7BBRN1DP3.0 size=751289 2024-09-14T11:21:00.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.650+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=SCV7BBRN1DP3 tag=XOH5OTVYVX5G type=write size=1799865 2024-09-14T11:21:00.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.652+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=VP6YKZMJUR6I type=del size=1021781 2024-09-14T11:21:00.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.653+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=G0ETPEJRMIW1 type=del size=5143 2024-09-14T11:21:00.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.654+0000 7fc354693780 1 < completed write operation key=X4VH2WYJJ8GI tag=N0TI5K1ZTXVZ type=write size=83962 2024-09-14T11:21:00.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.655+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=LSE4BWSG91N5 type=del size=2041873 2024-09-14T11:21:00.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.656+0000 7fc354693780 1 < canceled operation key=IGZK9BWJFCV3 tag=0C7OTITMBZJG type=del size=2527335 2024-09-14T11:21:00.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.657+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=9WF0MTE3N76V type=write size=562735 2024-09-14T11:21:00.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.659+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=2NOGSFSQA8P1 type=del 2024-09-14T11:21:00.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.660+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=JSEMOT3Z1JYK type=del size=2092226 2024-09-14T11:21:00.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.661+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.0 size=1048576 2024-09-14T11:21:00.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.662+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.1 size=1048576 2024-09-14T11:21:00.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.663+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~UF7QS4GM2GSK.2 size=1006674 2024-09-14T11:21:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.664+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=UF7QS4GM2GSK tag=2NFARZFPEZ3N type=write size=4152402 2024-09-14T11:21:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.666+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=DIA5SZVLU5C7 type=del size=1493200 2024-09-14T11:21:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.667+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=J73CJ0F13L32 type=del 2024-09-14T11:21:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.668+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=OF09S2QS0SSS type=del size=3478515 2024-09-14T11:21:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.669+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~ACSNWEF1ZV41.0 size=289227 2024-09-14T11:21:00.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.671+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=ACSNWEF1ZV41 tag=QT285501AS0G type=write size=1337803 2024-09-14T11:21:00.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.673+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~RMX41DGWW285.0 size=1048576 2024-09-14T11:21:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.674+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~RMX41DGWW285.1 size=664618 2024-09-14T11:21:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.674+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=RMX41DGWW285 tag=T2YLPNIWJ3AU type=write size=2761770 2024-09-14T11:21:00.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.675+0000 7fc354693780 1 < canceled operation key=N23XJJD7YYG0 tag=TB4Z6B7NWSPJ type=write size=484685 2024-09-14T11:21:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.677+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~57JWFT5T6ZQ4.0 size=17208 2024-09-14T11:21:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.677+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=57JWFT5T6ZQ4 tag=5S7M8Y1DFY20 type=write size=1065784 2024-09-14T11:21:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.678+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=SOYT8HJ8XOP8 type=del 2024-09-14T11:21:00.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.680+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~PWBRCWPN22CA.0 size=1048576 2024-09-14T11:21:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.681+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~PWBRCWPN22CA.1 size=545544 2024-09-14T11:21:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.681+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=PWBRCWPN22CA tag=EB698NGGV771 type=write size=2642696 2024-09-14T11:21:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.682+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~VRXBEP9FKB3I.0 size=896483 2024-09-14T11:21:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.684+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=VRXBEP9FKB3I tag=S8I6C5BS6EOE type=write size=1945059 2024-09-14T11:21:00.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.685+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=C40A302W2FEX type=del size=2211644 2024-09-14T11:21:00.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.687+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=7GL1E92R9HC4 type=del 2024-09-14T11:21:00.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.688+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=LE42JYFX973J type=del size=2111829 2024-09-14T11:21:00.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.689+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=C5P7HZU2P2JP type=del 2024-09-14T11:21:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.690+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=6LE3VOCQCUX9 type=del size=2289107 2024-09-14T11:21:00.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.691+0000 7fc354693780 1 < completed write operation key=54EUIL28P2H1 tag=LTUQL1IYG02R type=write size=125498 2024-09-14T11:21:00.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.694+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~WB07J3YJ722V.0 size=561244 2024-09-14T11:21:00.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.694+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=WB07J3YJ722V tag=LQLHI0WM6ZDB type=write size=1609820 2024-09-14T11:21:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.696+0000 7fc354693780 1 < suggested update operation key=NENG5XNJ7M5Z tag=QSQDVLYMZQKT type=write size=53633 2024-09-14T11:21:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.697+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=830K6WIUOP9T type=del size=1656648 2024-09-14T11:21:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.698+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=AN5FOT58CG92 type=write size=518610 2024-09-14T11:21:00.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.700+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~BYYZWSMFULN3.0 size=510788 2024-09-14T11:21:00.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.700+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=BYYZWSMFULN3 tag=APPMU5D81BBI type=write size=1559364 2024-09-14T11:21:00.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.702+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~SCV7BBRN1DP3.0 size=751289 2024-09-14T11:21:00.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.704+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=SCV7BBRN1DP3 tag=XOH5OTVYVX5G type=write size=1799865 2024-09-14T11:21:00.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.705+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=I52I917FIHWL type=del size=1256516 2024-09-14T11:21:00.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.708+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=G0ETPEJRMIW1 type=del size=5143 2024-09-14T11:21:00.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.710+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.0 size=1048576 2024-09-14T11:21:00.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.711+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.1 size=1048576 2024-09-14T11:21:00.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.712+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.2 size=571863 2024-09-14T11:21:00.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.712+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=CKYXY2P9EN4T tag=OL954EPIRABG type=write size=3717591 2024-09-14T11:21:00.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.713+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=LSE4BWSG91N5 type=del 2024-09-14T11:21:00.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.715+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~HHIKEJV8TQ7F.0 size=673764 2024-09-14T11:21:00.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.715+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=HHIKEJV8TQ7F tag=IZSZ3SZ4KTQO type=write size=1722340 2024-09-14T11:21:00.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.718+0000 7fc354693780 1 < suggested update operation key=GE83T07IQG0S tag=9WF0MTE3N76V type=write size=562735 2024-09-14T11:21:00.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.719+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=39FDJIBWDI4K type=del size=3297208 2024-09-14T11:21:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.721+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=JSEMOT3Z1JYK type=del 2024-09-14T11:21:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.722+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=YHE4N0NSV6XS type=del size=391139 2024-09-14T11:21:00.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.724+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=DIA5SZVLU5C7 type=del 2024-09-14T11:21:00.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.726+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=AW67QSK7AK4S type=del size=575423 2024-09-14T11:21:00.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.728+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=OF09S2QS0SSS type=del 2024-09-14T11:21:00.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.729+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=AVUSVAQ3M780 type=del size=966093 2024-09-14T11:21:00.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.730+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~RMX41DGWW285.0 size=1048576 2024-09-14T11:21:00.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.731+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~RMX41DGWW285.1 size=664618 2024-09-14T11:21:00.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.733+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=RMX41DGWW285 tag=T2YLPNIWJ3AU type=write size=2761770 2024-09-14T11:21:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.735+0000 7fc354693780 1 > prepared part key=_multipart_T0Z8NK20DS5K.2~I4OZJXI0QBM1.0 size=494194 2024-09-14T11:21:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.735+0000 7fc354693780 1 > prepared multipart upload key=T0Z8NK20DS5K upload=I4OZJXI0QBM1 tag=O5F5L8U1CYVB type=write size=1542770 2024-09-14T11:21:00.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.736+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~57JWFT5T6ZQ4.0 size=17208 2024-09-14T11:21:00.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.738+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=57JWFT5T6ZQ4 tag=5S7M8Y1DFY20 type=write size=1065784 2024-09-14T11:21:00.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.739+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=U32BV6SQYUPT type=del size=4529 2024-09-14T11:21:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.741+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~PWBRCWPN22CA.0 size=1048576 2024-09-14T11:21:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.741+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~PWBRCWPN22CA.1 size=545544 2024-09-14T11:21:00.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.743+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=PWBRCWPN22CA tag=EB698NGGV771 type=write size=2642696 2024-09-14T11:21:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.745+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~G4I6I7HSM4RU.0 size=186820 2024-09-14T11:21:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.745+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=G4I6I7HSM4RU tag=URPACUNPQS3E type=write size=1235396 2024-09-14T11:21:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.747+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=C40A302W2FEX type=del 2024-09-14T11:21:00.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.748+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=Y8KHOZYFYKQD type=del size=4063884 2024-09-14T11:21:00.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.749+0000 7fc354693780 -1 < failed to complete operation key=NENG5XNJ7M5Z tag=LE42JYFX973J type=del size=2111829: (22) Invalid argument 2024-09-14T11:21:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.751+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.0 size=1048576 2024-09-14T11:21:00.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.752+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.1 size=1048576 2024-09-14T11:21:00.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.753+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.2 size=721366 2024-09-14T11:21:00.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.753+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=17WVRYRO7OL2 tag=EKP8GIL2SUIU type=write size=3867094 2024-09-14T11:21:00.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.754+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=6LE3VOCQCUX9 type=del 2024-09-14T11:21:00.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.755+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=YCQTUAX54IB7 type=del size=1741535 2024-09-14T11:21:00.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.756+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~WB07J3YJ722V.0 size=561244 2024-09-14T11:21:00.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.758+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=WB07J3YJ722V tag=LQLHI0WM6ZDB type=write size=1609820 2024-09-14T11:21:00.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.759+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=OB3Q7TH520D6 type=del size=1807422 2024-09-14T11:21:00.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.760+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=830K6WIUOP9T type=del 2024-09-14T11:21:00.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.762+0000 7fc354693780 1 > prepared operation key=54EUIL28P2H1 tag=OISJBW2IYXYV type=del size=3371145 2024-09-14T11:21:00.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.763+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~BYYZWSMFULN3.0 size=510788 2024-09-14T11:21:00.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.765+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=BYYZWSMFULN3 tag=APPMU5D81BBI type=write size=1559364 2024-09-14T11:21:00.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.766+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=JJ8OQZJZ9IP1 type=write size=637299 2024-09-14T11:21:00.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.767+0000 7fc354693780 1 < completed delete operation key=T0Z8NK20DS5K tag=I52I917FIHWL type=del 2024-09-14T11:21:00.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.769+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~CB7TS5TK0E9C.0 size=1048576 2024-09-14T11:21:00.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.770+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~CB7TS5TK0E9C.1 size=138933 2024-09-14T11:21:00.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.770+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=CB7TS5TK0E9C tag=96R3GSM1TMTL type=write size=2236085 2024-09-14T11:21:00.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.771+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.0 size=1048576 2024-09-14T11:21:00.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.772+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.1 size=1048576 2024-09-14T11:21:00.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.773+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~CKYXY2P9EN4T.2 size=571863 2024-09-14T11:21:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.775+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=CKYXY2P9EN4T tag=OL954EPIRABG type=write size=3717591 2024-09-14T11:21:00.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.776+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=U6NNMCAAUE3G type=del size=131516 2024-09-14T11:21:00.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.777+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~HHIKEJV8TQ7F.0 size=673764 2024-09-14T11:21:00.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.779+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=HHIKEJV8TQ7F tag=IZSZ3SZ4KTQO type=write size=1722340 2024-09-14T11:21:00.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.781+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~85AGZAYXMLMX.0 size=659161 2024-09-14T11:21:00.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.782+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=85AGZAYXMLMX tag=86JSW5LE7PSE type=write size=1707737 2024-09-14T11:21:00.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.783+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=39FDJIBWDI4K type=del 2024-09-14T11:21:00.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.785+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.0 size=1048576 2024-09-14T11:21:00.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.786+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.1 size=1048576 2024-09-14T11:21:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.787+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.2 size=877820 2024-09-14T11:21:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.787+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=ML3ECNWRKXQQ tag=KGAIUBELJEXX type=write size=4023548 2024-09-14T11:21:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.790+0000 7fc354693780 1 < suggested remove operation key=Z3ZFX1354IRF tag=YHE4N0NSV6XS type=del 2024-09-14T11:21:00.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.792+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~CWKRL4D09BE3.0 size=580502 2024-09-14T11:21:00.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.792+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=CWKRL4D09BE3 tag=EAAYO5E1NUY5 type=write size=1629078 2024-09-14T11:21:00.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.794+0000 7fc354693780 1 < suggested update operation key=TFTKNNCGN88D tag=AW67QSK7AK4S type=del size=575423 2024-09-14T11:21:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.796+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=73W79A7WKLI3 type=del size=1852620 2024-09-14T11:21:00.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.798+0000 7fc354693780 1 < suggested update operation key=4Z3KI5X3WQ0I tag=AVUSVAQ3M780 type=del size=966093 2024-09-14T11:21:00.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.799+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=N9KSEIOGX43P type=del size=2380894 2024-09-14T11:21:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.800+0000 7fc354693780 1 < completed part key=_multipart_T0Z8NK20DS5K.2~I4OZJXI0QBM1.0 size=494194 2024-09-14T11:21:00.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.802+0000 7fc354693780 1 < completed multipart upload key=T0Z8NK20DS5K upload=I4OZJXI0QBM1 tag=O5F5L8U1CYVB type=write size=1542770 2024-09-14T11:21:00.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.805+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.0 size=1048576 2024-09-14T11:21:00.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.805+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.1 size=1048576 2024-09-14T11:21:00.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.806+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.2 size=182843 2024-09-14T11:21:00.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.806+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=A23V26QBSU53 tag=M27O0JMHIHY1 type=write size=3328571 2024-09-14T11:21:00.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.807+0000 7fc354693780 -1 < failed to complete operation key=TFTKNNCGN88D tag=U32BV6SQYUPT type=del size=4529: (22) Invalid argument 2024-09-14T11:21:00.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.809+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=JJZ4JGNIKG7D type=del size=1275704 2024-09-14T11:21:00.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.810+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~G4I6I7HSM4RU.0 size=186820 2024-09-14T11:21:00.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.812+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=G4I6I7HSM4RU tag=URPACUNPQS3E type=write size=1235396 2024-09-14T11:21:00.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.813+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=GK5BNEUZK6BO type=del size=3504965 2024-09-14T11:21:00.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.814+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=Y8KHOZYFYKQD type=del 2024-09-14T11:21:00.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.816+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.0 size=1048576 2024-09-14T11:21:00.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.817+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.1 size=1048576 2024-09-14T11:21:00.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.818+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.2 size=541259 2024-09-14T11:21:00.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.818+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=76SP2QYMM478 tag=TCT2XFLFOM06 type=write size=3686987 2024-09-14T11:21:00.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.819+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.0 size=1048576 2024-09-14T11:21:00.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.820+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.1 size=1048576 2024-09-14T11:21:00.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.821+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~17WVRYRO7OL2.2 size=721366 2024-09-14T11:21:00.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.822+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=17WVRYRO7OL2 tag=EKP8GIL2SUIU type=write size=3867094 2024-09-14T11:21:00.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.826+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.0 size=1048576 2024-09-14T11:21:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.827+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.1 size=1048576 2024-09-14T11:21:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.828+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.2 size=311440 2024-09-14T11:21:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.828+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=96TUCRY9R5QT tag=TZQ7DXXHVA8M type=write size=3457168 2024-09-14T11:21:00.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.830+0000 7fc354693780 1 < suggested update operation key=RHVF0Z2PRDA8 tag=YCQTUAX54IB7 type=del size=1741535 2024-09-14T11:21:00.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.831+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=WVHL6J4TD39Y type=write size=519681 2024-09-14T11:21:00.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.832+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=OB3Q7TH520D6 type=del 2024-09-14T11:21:00.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.834+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~PDJ1VU3REJBE.0 size=811191 2024-09-14T11:21:00.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.834+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=PDJ1VU3REJBE tag=J1MMHI4KJW9X type=write size=1859767 2024-09-14T11:21:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.835+0000 7fc354693780 1 < completed delete operation key=54EUIL28P2H1 tag=OISJBW2IYXYV type=del 2024-09-14T11:21:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.836+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=E6F126IEFZOK type=write size=846663 2024-09-14T11:21:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.837+0000 7fc354693780 1 < canceled operation key=6SIWH1BHPFGM tag=JJ8OQZJZ9IP1 type=write size=637299 2024-09-14T11:21:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.838+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=H4E3PNFNKPJX type=del size=3767051 2024-09-14T11:21:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.839+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~CB7TS5TK0E9C.0 size=1048576 2024-09-14T11:21:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.840+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~CB7TS5TK0E9C.1 size=138933 2024-09-14T11:21:00.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.842+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=CB7TS5TK0E9C tag=96R3GSM1TMTL type=write size=2236085 2024-09-14T11:21:00.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.844+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.0 size=1048576 2024-09-14T11:21:00.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.845+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.1 size=1048576 2024-09-14T11:21:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.846+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.2 size=1044487 2024-09-14T11:21:00.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.846+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=GMT316K48L99 tag=WUFL9UT14YTV type=write size=4190215 2024-09-14T11:21:00.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.847+0000 7fc354693780 -1 < failed to complete operation key=RHVF0Z2PRDA8 tag=U6NNMCAAUE3G type=del size=131516: (22) Invalid argument 2024-09-14T11:21:00.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.849+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~CLZBDT9HCB2E.0 size=1048576 2024-09-14T11:21:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.850+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~CLZBDT9HCB2E.1 size=236584 2024-09-14T11:21:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.850+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=CLZBDT9HCB2E tag=F4DZ80LGUND7 type=write size=2333736 2024-09-14T11:21:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.851+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~85AGZAYXMLMX.0 size=659161 2024-09-14T11:21:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.853+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=85AGZAYXMLMX tag=86JSW5LE7PSE type=write size=1707737 2024-09-14T11:21:00.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.854+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=D48438IN63BV type=write size=1028295 2024-09-14T11:21:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.855+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.0 size=1048576 2024-09-14T11:21:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.856+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.1 size=1048576 2024-09-14T11:21:00.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.857+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~ML3ECNWRKXQQ.2 size=877820 2024-09-14T11:21:00.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.859+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=ML3ECNWRKXQQ tag=KGAIUBELJEXX type=write size=4023548 2024-09-14T11:21:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.861+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~UQE9SDYURJNT.0 size=1048576 2024-09-14T11:21:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.862+0000 7fc354693780 1 > prepared part key=_multipart_BKW08T86L2ZF.2~UQE9SDYURJNT.1 size=423908 2024-09-14T11:21:00.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.862+0000 7fc354693780 1 > prepared multipart upload key=BKW08T86L2ZF upload=UQE9SDYURJNT tag=93HKA9UN3QOP type=write size=2521060 2024-09-14T11:21:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.863+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~CWKRL4D09BE3.0 size=580502 2024-09-14T11:21:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.865+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=CWKRL4D09BE3 tag=EAAYO5E1NUY5 type=write size=1629078 2024-09-14T11:21:00.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.866+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=C95401RPI824 type=del size=859319 2024-09-14T11:21:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.867+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=73W79A7WKLI3 type=del 2024-09-14T11:21:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.868+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=LRKIFLQ8JMA0 type=del size=4075032 2024-09-14T11:21:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.871+0000 7fc354693780 1 < suggested update operation key=OOFM3K1KEB9V tag=N9KSEIOGX43P type=del size=2380894 2024-09-14T11:21:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.872+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=LQQJ9WLVJF6V type=write size=788139 2024-09-14T11:21:00.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.873+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.0 size=1048576 2024-09-14T11:21:00.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.874+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.1 size=1048576 2024-09-14T11:21:00.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.875+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~A23V26QBSU53.2 size=182843 2024-09-14T11:21:00.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.877+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=A23V26QBSU53 tag=M27O0JMHIHY1 type=write size=3328571 2024-09-14T11:21:00.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.878+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~1866CH7BIFNA.0 size=1048576 2024-09-14T11:21:00.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.879+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~1866CH7BIFNA.1 size=259497 2024-09-14T11:21:00.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.879+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=1866CH7BIFNA tag=T2QVMYBEY8A3 type=write size=2356649 2024-09-14T11:21:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.880+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=JJZ4JGNIKG7D type=del 2024-09-14T11:21:00.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.882+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~QK4E0OAJXZI6.0 size=1048576 2024-09-14T11:21:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.883+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~QK4E0OAJXZI6.1 size=897574 2024-09-14T11:21:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.883+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=QK4E0OAJXZI6 tag=Y27RACHBIC12 type=write size=2994726 2024-09-14T11:21:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.884+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=GK5BNEUZK6BO type=del 2024-09-14T11:21:00.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.886+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=MMSJCOSF55GN type=del size=2802491 2024-09-14T11:21:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.887+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.0 size=1048576 2024-09-14T11:21:00.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.888+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.1 size=1048576 2024-09-14T11:21:00.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.888+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~76SP2QYMM478.2 size=541259 2024-09-14T11:21:00.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.890+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=76SP2QYMM478 tag=TCT2XFLFOM06 type=write size=3686987 2024-09-14T11:21:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.892+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.0 size=1048576 2024-09-14T11:21:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.893+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.1 size=1048576 2024-09-14T11:21:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.894+0000 7fc354693780 1 > prepared part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.2 size=28875 2024-09-14T11:21:00.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.894+0000 7fc354693780 1 > prepared multipart upload key=N23XJJD7YYG0 upload=DFQTWF9WA4U6 tag=XFU65L90QOMO type=write size=3174603 2024-09-14T11:21:00.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.895+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.0 size=1048576 2024-09-14T11:21:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.896+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.1 size=1048576 2024-09-14T11:21:00.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.897+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~96TUCRY9R5QT.2 size=311440 2024-09-14T11:21:00.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.899+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=96TUCRY9R5QT tag=TZQ7DXXHVA8M type=write size=3457168 2024-09-14T11:21:00.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.900+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=FU4CLLJX9XGY type=write size=501197 2024-09-14T11:21:00.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.901+0000 7fc354693780 -1 < failed to complete operation key=OOFM3K1KEB9V tag=WVHL6J4TD39Y type=write size=519681: (22) Invalid argument 2024-09-14T11:21:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.902+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=2BWAXIP8B1ZZ type=del size=2583645 2024-09-14T11:21:00.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.904+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~PDJ1VU3REJBE.0 size=811191 2024-09-14T11:21:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.905+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=PDJ1VU3REJBE tag=J1MMHI4KJW9X type=write size=1859767 2024-09-14T11:21:00.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.907+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=6889G5BBRAG5 type=del size=3376919 2024-09-14T11:21:00.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.909+0000 7fc354693780 1 < suggested remove operation key=T0Z8NK20DS5K tag=E6F126IEFZOK type=write 2024-09-14T11:21:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.910+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=4X63B0OYUZUF type=del size=1062290 2024-09-14T11:21:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.911+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=H4E3PNFNKPJX type=del 2024-09-14T11:21:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.912+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=CCQ506G4YH41 type=del size=277028 2024-09-14T11:21:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.913+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.0 size=1048576 2024-09-14T11:21:00.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.914+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.1 size=1048576 2024-09-14T11:21:00.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.915+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~GMT316K48L99.2 size=1044487 2024-09-14T11:21:00.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.917+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=GMT316K48L99 tag=WUFL9UT14YTV type=write size=4190215 2024-09-14T11:21:00.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.918+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=MW8WGN2YV8XT type=del size=3335229 2024-09-14T11:21:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.920+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~CLZBDT9HCB2E.0 size=1048576 2024-09-14T11:21:00.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.921+0000 7fc354693780 1 < completed part key=_multipart_X4VH2WYJJ8GI.2~CLZBDT9HCB2E.1 size=236584 2024-09-14T11:21:00.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.922+0000 7fc354693780 1 < completed multipart upload key=X4VH2WYJJ8GI upload=CLZBDT9HCB2E tag=F4DZ80LGUND7 type=write size=2333736 2024-09-14T11:21:00.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.925+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~5SZMTB9Z7CZU.0 size=1048576 2024-09-14T11:21:00.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.925+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~5SZMTB9Z7CZU.1 size=182067 2024-09-14T11:21:00.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.925+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=5SZMTB9Z7CZU tag=5UAR5AKF2GPS type=write size=2279219 2024-09-14T11:21:00.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.929+0000 7fc354693780 1 < suggested remove operation key=IJZB38U355GG tag=D48438IN63BV type=write 2024-09-14T11:21:00.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.931+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~GN7RQUQFK4PZ.0 size=1023870 2024-09-14T11:21:00.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.931+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=GN7RQUQFK4PZ tag=1GA5BB23ITUN type=write size=2072446 2024-09-14T11:21:00.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.932+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~UQE9SDYURJNT.0 size=1048576 2024-09-14T11:21:00.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.933+0000 7fc354693780 1 < completed part key=_multipart_BKW08T86L2ZF.2~UQE9SDYURJNT.1 size=423908 2024-09-14T11:21:00.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.934+0000 7fc354693780 1 < completed multipart upload key=BKW08T86L2ZF upload=UQE9SDYURJNT tag=93HKA9UN3QOP type=write size=2521060 2024-09-14T11:21:00.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.936+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=FGGSBVAA12RW type=del size=2950982 2024-09-14T11:21:00.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.937+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=C95401RPI824 type=del 2024-09-14T11:21:00.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.938+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=RCMIGJ3OHENS type=write size=710791 2024-09-14T11:21:00.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.939+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=LRKIFLQ8JMA0 type=del 2024-09-14T11:21:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.941+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.0 size=1048576 2024-09-14T11:21:00.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.942+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.1 size=1048576 2024-09-14T11:21:00.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.943+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.2 size=21310 2024-09-14T11:21:00.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.943+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=4ZN03D36D6GP tag=XW29VCXLZ9BH type=write size=3167038 2024-09-14T11:21:00.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.944+0000 7fc354693780 1 < completed write operation key=TFTKNNCGN88D tag=LQQJ9WLVJF6V type=write size=788139 2024-09-14T11:21:00.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.945+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=JMI17SAG6FB8 type=del size=207179 2024-09-14T11:21:00.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.946+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~1866CH7BIFNA.0 size=1048576 2024-09-14T11:21:00.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.947+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~1866CH7BIFNA.1 size=259497 2024-09-14T11:21:00.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.949+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=1866CH7BIFNA tag=T2QVMYBEY8A3 type=write size=2356649 2024-09-14T11:21:00.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.951+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.0 size=1048576 2024-09-14T11:21:00.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.952+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.1 size=1048576 2024-09-14T11:21:00.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.953+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.2 size=387338 2024-09-14T11:21:00.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.953+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=C1EDSXUGDVRH tag=YO8QQ3YDINM3 type=write size=3533066 2024-09-14T11:21:00.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.954+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~QK4E0OAJXZI6.0 size=1048576 2024-09-14T11:21:00.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.955+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~QK4E0OAJXZI6.1 size=897574 2024-09-14T11:21:00.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.957+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=QK4E0OAJXZI6 tag=Y27RACHBIC12 type=write size=2994726 2024-09-14T11:21:00.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.959+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~5BE7S4U3NM90.0 size=1048576 2024-09-14T11:21:00.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.960+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~5BE7S4U3NM90.1 size=874153 2024-09-14T11:21:00.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.960+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=5BE7S4U3NM90 tag=NTATSUAHZZJO type=write size=2971305 2024-09-14T11:21:00.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.961+0000 7fc354693780 1 < canceled operation key=H1S2CBHNW6GI tag=MMSJCOSF55GN type=del size=2802491 2024-09-14T11:21:00.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.962+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=WZ06FWXKCH68 type=del size=1864327 2024-09-14T11:21:00.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.963+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.0 size=1048576 2024-09-14T11:21:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.964+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.1 size=1048576 2024-09-14T11:21:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.965+0000 7fc354693780 1 < completed part key=_multipart_N23XJJD7YYG0.2~DFQTWF9WA4U6.2 size=28875 2024-09-14T11:21:00.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.966+0000 7fc354693780 1 < completed multipart upload key=N23XJJD7YYG0 upload=DFQTWF9WA4U6 tag=XFU65L90QOMO type=write size=3174603 2024-09-14T11:21:00.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.968+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~1LFQJXHM0JP2.0 size=964603 2024-09-14T11:21:00.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.968+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=1LFQJXHM0JP2 tag=B4RTI158Q3JB type=write size=2013179 2024-09-14T11:21:00.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.971+0000 7fc354693780 1 < suggested remove operation key=X4VH2WYJJ8GI tag=FU4CLLJX9XGY type=write 2024-09-14T11:21:00.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.972+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=NZQ73GPT2SMI type=del size=614993 2024-09-14T11:21:00.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.973+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=2BWAXIP8B1ZZ type=del 2024-09-14T11:21:00.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.974+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=0AXH7K0JXLF6 type=del size=331652 2024-09-14T11:21:00.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.975+0000 7fc354693780 -1 < failed to complete operation key=T0Z8NK20DS5K tag=6889G5BBRAG5 type=del size=3376919: (22) Invalid argument 2024-09-14T11:21:00.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.976+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=RCDX2YTJXRT7 type=write size=818468 2024-09-14T11:21:00.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.978+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=4X63B0OYUZUF type=del 2024-09-14T11:21:00.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.979+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=BKQRS0VEQZZJ type=del size=3375587 2024-09-14T11:21:00.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.980+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=CCQ506G4YH41 type=del 2024-09-14T11:21:00.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.982+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=Q7YL8E01C5IZ type=del size=2129558 2024-09-14T11:21:00.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.983+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=MW8WGN2YV8XT type=del 2024-09-14T11:21:00.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.985+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.0 size=1048576 2024-09-14T11:21:00.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.986+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.1 size=1048576 2024-09-14T11:21:00.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.986+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.2 size=81806 2024-09-14T11:21:00.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.986+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=J48DCBCT8Z02 tag=SCDSP6AGGTC0 type=write size=3227534 2024-09-14T11:21:00.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.988+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~5SZMTB9Z7CZU.0 size=1048576 2024-09-14T11:21:00.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.988+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~5SZMTB9Z7CZU.1 size=182067 2024-09-14T11:21:00.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.990+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=5SZMTB9Z7CZU tag=5UAR5AKF2GPS type=write size=2279219 2024-09-14T11:21:00.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.991+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=V0LT14570DEQ type=write size=111308 2024-09-14T11:21:00.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.993+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~GN7RQUQFK4PZ.0 size=1023870 2024-09-14T11:21:00.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.995+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=GN7RQUQFK4PZ tag=1GA5BB23ITUN type=write size=2072446 2024-09-14T11:21:00.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.997+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~NN1VBGA8K722.0 size=1048576 2024-09-14T11:21:00.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.997+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~NN1VBGA8K722.1 size=437959 2024-09-14T11:21:00.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.997+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=NN1VBGA8K722 tag=U0KQXI0ZRZKJ type=write size=2535111 2024-09-14T11:21:00.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:00.999+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=FGGSBVAA12RW type=del 2024-09-14T11:21:00.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.000+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=UYZJJ3DOA3F1 type=del size=3609558 2024-09-14T11:21:00.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.001+0000 7fc354693780 1 < completed write operation key=FMG2DNGS0LZ3 tag=RCMIGJ3OHENS type=write size=710791 2024-09-14T11:21:01.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.002+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=DHKWYCUDNYM3 type=del size=2233484 2024-09-14T11:21:01.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.003+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.0 size=1048576 2024-09-14T11:21:01.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.004+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.1 size=1048576 2024-09-14T11:21:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.005+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~4ZN03D36D6GP.2 size=21310 2024-09-14T11:21:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.007+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=4ZN03D36D6GP tag=XW29VCXLZ9BH type=write size=3167038 2024-09-14T11:21:01.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.008+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=IV3T010SKLRO type=del size=253829 2024-09-14T11:21:01.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.010+0000 7fc354693780 1 < suggested update operation key=IJZB38U355GG tag=JMI17SAG6FB8 type=del size=207179 2024-09-14T11:21:01.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.011+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=5QF17DCAO82I type=del size=2198483 2024-09-14T11:21:01.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.012+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.0 size=1048576 2024-09-14T11:21:01.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.013+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.1 size=1048576 2024-09-14T11:21:01.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.014+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~C1EDSXUGDVRH.2 size=387338 2024-09-14T11:21:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.016+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=C1EDSXUGDVRH tag=YO8QQ3YDINM3 type=write size=3533066 2024-09-14T11:21:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.018+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~J5RXMZZWAZ0P.0 size=1048576 2024-09-14T11:21:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.019+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~J5RXMZZWAZ0P.1 size=945469 2024-09-14T11:21:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.019+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=J5RXMZZWAZ0P tag=RDCVD3QHNC8Q type=write size=3042621 2024-09-14T11:21:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.020+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~5BE7S4U3NM90.0 size=1048576 2024-09-14T11:21:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.021+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~5BE7S4U3NM90.1 size=874153 2024-09-14T11:21:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.023+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=5BE7S4U3NM90 tag=NTATSUAHZZJO type=write size=2971305 2024-09-14T11:21:01.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.025+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.0 size=1048576 2024-09-14T11:21:01.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.026+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.1 size=1048576 2024-09-14T11:21:01.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.027+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.2 size=510885 2024-09-14T11:21:01.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.027+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=I25ZNPPH7DN8 tag=PRLPRLRRQ9GG type=write size=3656613 2024-09-14T11:21:01.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.028+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=WZ06FWXKCH68 type=del 2024-09-14T11:21:01.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.029+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=H060C7SNNO8C type=write size=815537 2024-09-14T11:21:01.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.031+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~1LFQJXHM0JP2.0 size=964603 2024-09-14T11:21:01.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.033+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=1LFQJXHM0JP2 tag=B4RTI158Q3JB type=write size=2013179 2024-09-14T11:21:01.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.035+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.0 size=1048576 2024-09-14T11:21:01.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.036+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.1 size=1048576 2024-09-14T11:21:01.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.037+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.2 size=953573 2024-09-14T11:21:01.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.037+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=X9LAQBQPCGV4 tag=FB7Z5XXJ8CU0 type=write size=4099301 2024-09-14T11:21:01.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.039+0000 7fc354693780 1 < suggested remove operation key=FMG2DNGS0LZ3 tag=NZQ73GPT2SMI type=del 2024-09-14T11:21:01.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.041+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~7I9AN4JZWFQM.0 size=1048576 2024-09-14T11:21:01.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.042+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~7I9AN4JZWFQM.1 size=687713 2024-09-14T11:21:01.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.042+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=7I9AN4JZWFQM tag=QQIUJ3SPVU7A type=write size=2784865 2024-09-14T11:21:01.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.043+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=0AXH7K0JXLF6 type=del 2024-09-14T11:21:01.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.044+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=P4PIKHEM9BLT type=del size=2032806 2024-09-14T11:21:01.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.045+0000 7fc354693780 1 < completed write operation key=EFX0VXGHRUDR tag=RCDX2YTJXRT7 type=write size=818468 2024-09-14T11:21:01.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.047+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~SP7I0J922UJY.0 size=295670 2024-09-14T11:21:01.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.047+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=SP7I0J922UJY tag=NG265KGRR0EB type=write size=1344246 2024-09-14T11:21:01.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.048+0000 7fc354693780 1 < canceled operation key=EFX0VXGHRUDR tag=BKQRS0VEQZZJ type=del size=3375587 2024-09-14T11:21:01.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.050+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~RJ0M1I1IWNB2.0 size=1048576 2024-09-14T11:21:01.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.051+0000 7fc354693780 1 > prepared part key=_multipart_WYD70VR8OKAN.2~RJ0M1I1IWNB2.1 size=480658 2024-09-14T11:21:01.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.051+0000 7fc354693780 1 > prepared multipart upload key=WYD70VR8OKAN upload=RJ0M1I1IWNB2 tag=JC191EP1U6L6 type=write size=2577810 2024-09-14T11:21:01.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.052+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=Q7YL8E01C5IZ type=del 2024-09-14T11:21:01.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.054+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=XPA7QYOFEPHZ type=write size=305118 2024-09-14T11:21:01.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.055+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.0 size=1048576 2024-09-14T11:21:01.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.056+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.1 size=1048576 2024-09-14T11:21:01.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.057+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~J48DCBCT8Z02.2 size=81806 2024-09-14T11:21:01.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.059+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=J48DCBCT8Z02 tag=SCDSP6AGGTC0 type=write size=3227534 2024-09-14T11:21:01.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.060+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=OZWZ6HY1X9MU type=write size=155912 2024-09-14T11:21:01.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.061+0000 7fc354693780 1 < completed write operation key=NENG5XNJ7M5Z tag=V0LT14570DEQ type=write size=111308 2024-09-14T11:21:01.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.063+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.0 size=1048576 2024-09-14T11:21:01.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.064+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.1 size=1048576 2024-09-14T11:21:01.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.065+0000 7fc354693780 1 > prepared part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.2 size=546714 2024-09-14T11:21:01.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.065+0000 7fc354693780 1 > prepared multipart upload key=4IDBIAE3VAY4 upload=Z9XDEWPWFYEB tag=8YDMWIBXHY8S type=write size=3692442 2024-09-14T11:21:01.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.065+0000 7fc354693780 1 < canceled part key=_multipart_QWMHFF32M37W.2~NN1VBGA8K722.0 size=1048576 2024-09-14T11:21:01.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.066+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~NN1VBGA8K722.1 size=437959 2024-09-14T11:21:01.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.068+0000 7fc354693780 1 < canceled multipart upload key=QWMHFF32M37W upload=NN1VBGA8K722 tag=U0KQXI0ZRZKJ type=write size=2535111 2024-09-14T11:21:01.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.069+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=YVUKDPJ8ZY94 type=del size=31928 2024-09-14T11:21:01.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.070+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=UYZJJ3DOA3F1 type=del 2024-09-14T11:21:01.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.071+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=R6W9X1UHADFG type=del size=3572321 2024-09-14T11:21:01.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.072+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=DHKWYCUDNYM3 type=del 2024-09-14T11:21:01.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.073+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=HNQNAID1BEEU type=del size=1615652 2024-09-14T11:21:01.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.074+0000 7fc354693780 1 < completed delete operation key=BTET4HD5NY0D tag=IV3T010SKLRO type=del 2024-09-14T11:21:01.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.075+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=QVX01WVKN3FG type=del size=55025 2024-09-14T11:21:01.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.076+0000 7fc354693780 1 < canceled operation key=N23XJJD7YYG0 tag=5QF17DCAO82I type=del size=2198483 2024-09-14T11:21:01.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.078+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=S96CNP1Z33ZM type=del size=2373924 2024-09-14T11:21:01.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.079+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~J5RXMZZWAZ0P.0 size=1048576 2024-09-14T11:21:01.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.080+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~J5RXMZZWAZ0P.1 size=945469 2024-09-14T11:21:01.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.082+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=J5RXMZZWAZ0P tag=RDCVD3QHNC8Q type=write size=3042621 2024-09-14T11:21:01.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.083+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=0R1K5NSXR24A type=del size=2466474 2024-09-14T11:21:01.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.084+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.0 size=1048576 2024-09-14T11:21:01.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.085+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.1 size=1048576 2024-09-14T11:21:01.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.086+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~I25ZNPPH7DN8.2 size=510885 2024-09-14T11:21:01.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.087+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=I25ZNPPH7DN8 tag=PRLPRLRRQ9GG type=write size=3656613 2024-09-14T11:21:01.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.088+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=FIGI5JNY3J37 type=del size=862645 2024-09-14T11:21:01.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.090+0000 7fc354693780 1 < completed write operation key=T0Z8NK20DS5K tag=H060C7SNNO8C type=write size=815537 2024-09-14T11:21:01.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.092+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~K69DMS6GLG3U.0 size=1048576 2024-09-14T11:21:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.093+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~K69DMS6GLG3U.1 size=259954 2024-09-14T11:21:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.093+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=K69DMS6GLG3U tag=O93KE2JEKMND type=write size=2357106 2024-09-14T11:21:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.094+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.0 size=1048576 2024-09-14T11:21:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.095+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.1 size=1048576 2024-09-14T11:21:01.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.096+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~X9LAQBQPCGV4.2 size=953573 2024-09-14T11:21:01.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.098+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=X9LAQBQPCGV4 tag=FB7Z5XXJ8CU0 type=write size=4099301 2024-09-14T11:21:01.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.099+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=29DC2SKJD9D0 type=del size=981980 2024-09-14T11:21:01.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.100+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~7I9AN4JZWFQM.0 size=1048576 2024-09-14T11:21:01.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.100+0000 7fc354693780 1 < canceled part key=_multipart_GE83T07IQG0S.2~7I9AN4JZWFQM.1 size=687713 2024-09-14T11:21:01.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.102+0000 7fc354693780 1 < canceled multipart upload key=GE83T07IQG0S upload=7I9AN4JZWFQM tag=QQIUJ3SPVU7A type=write size=2784865 2024-09-14T11:21:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.103+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=SNDC754AFZCU type=del size=880475 2024-09-14T11:21:01.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.105+0000 7fc354693780 1 < suggested remove operation key=NENG5XNJ7M5Z tag=P4PIKHEM9BLT type=del 2024-09-14T11:21:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.107+0000 7fc354693780 1 > prepared part key=_multipart_977GI7HKD9JJ.2~8K1TMEV3WQH9.0 size=226987 2024-09-14T11:21:01.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.107+0000 7fc354693780 1 > prepared multipart upload key=977GI7HKD9JJ upload=8K1TMEV3WQH9 tag=G9N8I3PZ3V5P type=write size=1275563 2024-09-14T11:21:01.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.109+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~SP7I0J922UJY.0 size=295670 2024-09-14T11:21:01.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.111+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=SP7I0J922UJY tag=NG265KGRR0EB type=write size=1344246 2024-09-14T11:21:01.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.112+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=JBGXYKZ09USN type=del size=3578504 2024-09-14T11:21:01.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.113+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~RJ0M1I1IWNB2.0 size=1048576 2024-09-14T11:21:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.114+0000 7fc354693780 1 < completed part key=_multipart_WYD70VR8OKAN.2~RJ0M1I1IWNB2.1 size=480658 2024-09-14T11:21:01.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.115+0000 7fc354693780 1 < completed multipart upload key=WYD70VR8OKAN upload=RJ0M1I1IWNB2 tag=JC191EP1U6L6 type=write size=2577810 2024-09-14T11:21:01.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.118+0000 7fc354693780 1 > prepared part key=_multipart_QWMHFF32M37W.2~6MYPK45NYJKV.0 size=402761 2024-09-14T11:21:01.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.118+0000 7fc354693780 1 > prepared multipart upload key=QWMHFF32M37W upload=6MYPK45NYJKV tag=TIEB1DFA8KSP type=write size=1451337 2024-09-14T11:21:01.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.120+0000 7fc354693780 1 < suggested remove operation key=Z3ZFX1354IRF tag=XPA7QYOFEPHZ type=write 2024-09-14T11:21:01.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.122+0000 7fc354693780 1 > prepared part key=_multipart_ICNEXZMA3VQV.2~I182TX2QG346.0 size=131123 2024-09-14T11:21:01.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.122+0000 7fc354693780 1 > prepared multipart upload key=ICNEXZMA3VQV upload=I182TX2QG346 tag=HQ057KGP7JA9 type=write size=1179699 2024-09-14T11:21:01.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.123+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=OZWZ6HY1X9MU type=write size=155912 2024-09-14T11:21:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.125+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.0 size=1048576 2024-09-14T11:21:01.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.126+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.1 size=1048576 2024-09-14T11:21:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.127+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.2 size=987197 2024-09-14T11:21:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.127+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=W1U2RS7TFRND tag=RA15STRLT8MI type=write size=4132925 2024-09-14T11:21:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.128+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.0 size=1048576 2024-09-14T11:21:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.129+0000 7fc354693780 1 < completed part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.1 size=1048576 2024-09-14T11:21:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.129+0000 7fc354693780 1 < canceled part key=_multipart_4IDBIAE3VAY4.2~Z9XDEWPWFYEB.2 size=546714 2024-09-14T11:21:01.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.131+0000 7fc354693780 1 < canceled multipart upload key=4IDBIAE3VAY4 upload=Z9XDEWPWFYEB tag=8YDMWIBXHY8S type=write size=3692442 2024-09-14T11:21:01.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.133+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~394G6O5LO0C9.0 size=1048576 2024-09-14T11:21:01.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.136+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~394G6O5LO0C9.1 size=504168 2024-09-14T11:21:01.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.136+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=394G6O5LO0C9 tag=D3A2LA76V4IB type=write size=2601320 2024-09-14T11:21:01.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.137+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=YVUKDPJ8ZY94 type=del 2024-09-14T11:21:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.138+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=UHU4095765XI type=del size=3049834 2024-09-14T11:21:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.138+0000 7fc354693780 -1 < no bi entry to suggest for operation key=NENG5XNJ7M5Z tag=R6W9X1UHADFG type=del size=3572321: (2) No such file or directory 2024-09-14T11:21:01.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.139+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=ZPZPFZRZJDBZ type=write size=683900 2024-09-14T11:21:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.142+0000 7fc354693780 1 < suggested update operation key=N23XJJD7YYG0 tag=HNQNAID1BEEU type=del size=1615652 2024-09-14T11:21:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.143+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=5CPJRX1E8P89 type=del size=1595887 2024-09-14T11:21:01.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.144+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=QVX01WVKN3FG type=del 2024-09-14T11:21:01.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.145+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=0QYX2YYUFP4P type=del size=179923 2024-09-14T11:21:01.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.146+0000 7fc354693780 1 < completed delete operation key=4Z3KI5X3WQ0I tag=S96CNP1Z33ZM type=del 2024-09-14T11:21:01.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.147+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=P696QWAOQ0ES type=del size=1019622 2024-09-14T11:21:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.148+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=0R1K5NSXR24A type=del 2024-09-14T11:21:01.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.149+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=96301D3FZAZ7 type=del size=719319 2024-09-14T11:21:01.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.150+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=FIGI5JNY3J37 type=del 2024-09-14T11:21:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.152+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=BSTODJV08US3 type=write size=653257 2024-09-14T11:21:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.153+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~K69DMS6GLG3U.0 size=1048576 2024-09-14T11:21:01.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.154+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~K69DMS6GLG3U.1 size=259954 2024-09-14T11:21:01.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.155+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=K69DMS6GLG3U tag=O93KE2JEKMND type=write size=2357106 2024-09-14T11:21:01.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.157+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~H30UPYS2QCYF.0 size=1048576 2024-09-14T11:21:01.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.158+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~H30UPYS2QCYF.1 size=941146 2024-09-14T11:21:01.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.158+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=H30UPYS2QCYF tag=QNNOO7MI0LPJ type=write size=3038298 2024-09-14T11:21:01.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.159+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=29DC2SKJD9D0 type=del 2024-09-14T11:21:01.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.161+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~43GHMI73V0TN.0 size=48141 2024-09-14T11:21:01.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.161+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=43GHMI73V0TN tag=6B95GZPO0246 type=write size=1096717 2024-09-14T11:21:01.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.162+0000 7fc354693780 1 < canceled operation key=4IDBIAE3VAY4 tag=SNDC754AFZCU type=del size=880475 2024-09-14T11:21:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.163+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=Q5CU1G5BCQB8 type=del size=4174113 2024-09-14T11:21:01.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.164+0000 7fc354693780 1 < completed part key=_multipart_977GI7HKD9JJ.2~8K1TMEV3WQH9.0 size=226987 2024-09-14T11:21:01.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.166+0000 7fc354693780 1 < completed multipart upload key=977GI7HKD9JJ upload=8K1TMEV3WQH9 tag=G9N8I3PZ3V5P type=write size=1275563 2024-09-14T11:21:01.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.167+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=S31FGPXS4TD6 type=del size=1263836 2024-09-14T11:21:01.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.168+0000 7fc354693780 1 < completed delete operation key=BKW08T86L2ZF tag=JBGXYKZ09USN type=del 2024-09-14T11:21:01.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.169+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=XNI7K1KDMV59 type=del size=3422162 2024-09-14T11:21:01.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.170+0000 7fc354693780 1 < completed part key=_multipart_QWMHFF32M37W.2~6MYPK45NYJKV.0 size=402761 2024-09-14T11:21:01.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.172+0000 7fc354693780 1 < completed multipart upload key=QWMHFF32M37W upload=6MYPK45NYJKV tag=TIEB1DFA8KSP type=write size=1451337 2024-09-14T11:21:01.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.174+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~KBUPBJZM3C6K.0 size=1048576 2024-09-14T11:21:01.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.175+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~KBUPBJZM3C6K.1 size=174456 2024-09-14T11:21:01.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.175+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=KBUPBJZM3C6K tag=1M8NM9AZBA6H type=write size=2271608 2024-09-14T11:21:01.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.176+0000 7fc354693780 1 < completed part key=_multipart_ICNEXZMA3VQV.2~I182TX2QG346.0 size=131123 2024-09-14T11:21:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.178+0000 7fc354693780 1 < completed multipart upload key=ICNEXZMA3VQV upload=I182TX2QG346 tag=HQ057KGP7JA9 type=write size=1179699 2024-09-14T11:21:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.179+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=UAAU7VWRL52N type=write size=924256 2024-09-14T11:21:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.180+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.0 size=1048576 2024-09-14T11:21:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.181+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.1 size=1048576 2024-09-14T11:21:01.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.182+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~W1U2RS7TFRND.2 size=987197 2024-09-14T11:21:01.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.185+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=W1U2RS7TFRND tag=RA15STRLT8MI type=write size=4132925 2024-09-14T11:21:01.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.186+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=B1YUVFI96S78 type=del size=1526835 2024-09-14T11:21:01.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.187+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~394G6O5LO0C9.0 size=1048576 2024-09-14T11:21:01.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.188+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~394G6O5LO0C9.1 size=504168 2024-09-14T11:21:01.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.190+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=394G6O5LO0C9 tag=D3A2LA76V4IB type=write size=2601320 2024-09-14T11:21:01.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.191+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=ABERXUT7CK56 type=del size=3864803 2024-09-14T11:21:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.192+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=UHU4095765XI type=del 2024-09-14T11:21:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.193+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=WA2H7GSN1IVK type=del size=3376021 2024-09-14T11:21:01.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.194+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=ZPZPFZRZJDBZ type=write size=683900 2024-09-14T11:21:01.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.196+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=JHU192ROZ3R4 type=write size=95934 2024-09-14T11:21:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.197+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=5CPJRX1E8P89 type=del 2024-09-14T11:21:01.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.198+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=TTRXY4NXDNS1 type=write size=129961 2024-09-14T11:21:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.199+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=0QYX2YYUFP4P type=del 2024-09-14T11:21:01.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.202+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.0 size=1048576 2024-09-14T11:21:01.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.203+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.1 size=1048576 2024-09-14T11:21:01.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.203+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.2 size=853569 2024-09-14T11:21:01.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.203+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=7QXDE5ZMGSPR tag=MRKFETVA1YP8 type=write size=3999297 2024-09-14T11:21:01.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.206+0000 7fc354693780 1 < suggested remove operation key=MQ5V2G5U43J1 tag=P696QWAOQ0ES type=del 2024-09-14T11:21:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.207+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=J3R2AKI1WKG9 type=del size=1216125 2024-09-14T11:21:01.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.208+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=96301D3FZAZ7 type=del 2024-09-14T11:21:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.209+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=OQ7WUUVT0SCC type=del size=2417328 2024-09-14T11:21:01.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.211+0000 7fc354693780 1 < completed write operation key=WYD70VR8OKAN tag=BSTODJV08US3 type=write size=653257 2024-09-14T11:21:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.213+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.0 size=1048576 2024-09-14T11:21:01.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.214+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.1 size=1048576 2024-09-14T11:21:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.215+0000 7fc354693780 1 > prepared part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.2 size=489557 2024-09-14T11:21:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.215+0000 7fc354693780 1 > prepared multipart upload key=IJZB38U355GG upload=8V662L4YU2JE tag=PWFN4EJAOQVM type=write size=3635285 2024-09-14T11:21:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.217+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~H30UPYS2QCYF.0 size=1048576 2024-09-14T11:21:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.217+0000 7fc354693780 1 < canceled part key=_multipart_BJ7AARJEIT8W.2~H30UPYS2QCYF.1 size=941146 2024-09-14T11:21:01.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.219+0000 7fc354693780 1 < canceled multipart upload key=BJ7AARJEIT8W upload=H30UPYS2QCYF tag=QNNOO7MI0LPJ type=write size=3038298 2024-09-14T11:21:01.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.220+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=P6SKK5P0YN7N type=del size=1620981 2024-09-14T11:21:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.222+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~43GHMI73V0TN.0 size=48141 2024-09-14T11:21:01.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.224+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=43GHMI73V0TN tag=6B95GZPO0246 type=write size=1096717 2024-09-14T11:21:01.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.225+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=XVVTIDSSG7TE type=del size=1140715 2024-09-14T11:21:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.226+0000 7fc354693780 1 < canceled operation key=BTET4HD5NY0D tag=Q5CU1G5BCQB8 type=del size=4174113 2024-09-14T11:21:01.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.227+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=AM5AV72WGJ7F type=del size=2457120 2024-09-14T11:21:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.228+0000 7fc354693780 1 < completed delete operation key=6SIWH1BHPFGM tag=S31FGPXS4TD6 type=del 2024-09-14T11:21:01.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.229+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=TAL80AR5AUY4 type=del size=2465751 2024-09-14T11:21:01.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.232+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=XNI7K1KDMV59 type=del 2024-09-14T11:21:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.234+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~NLMVS1R5TTCQ.0 size=975811 2024-09-14T11:21:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.234+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=NLMVS1R5TTCQ tag=EGS9EYE5ZTVH type=write size=2024387 2024-09-14T11:21:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.234+0000 7fc354693780 1 < canceled part key=_multipart_P061QWG9J16V.2~KBUPBJZM3C6K.0 size=1048576 2024-09-14T11:21:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.235+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~KBUPBJZM3C6K.1 size=174456 2024-09-14T11:21:01.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.237+0000 7fc354693780 1 < canceled multipart upload key=P061QWG9J16V upload=KBUPBJZM3C6K tag=1M8NM9AZBA6H type=write size=2271608 2024-09-14T11:21:01.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.238+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=7KCBTIDLI146 type=del size=310729 2024-09-14T11:21:01.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.239+0000 7fc354693780 1 < completed write operation key=4IDBIAE3VAY4 tag=UAAU7VWRL52N type=write size=924256 2024-09-14T11:21:01.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.241+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=4492QI885CI8 type=del size=1260013 2024-09-14T11:21:01.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.243+0000 7fc354693780 1 < suggested update operation key=TFTKNNCGN88D tag=B1YUVFI96S78 type=del size=1526835 2024-09-14T11:21:01.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.244+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=17T225H9TUMJ type=del size=983601 2024-09-14T11:21:01.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.246+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=ABERXUT7CK56 type=del 2024-09-14T11:21:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.248+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~IG5W25CJ8DU9.0 size=1048576 2024-09-14T11:21:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.249+0000 7fc354693780 1 > prepared part key=_multipart_MQ5V2G5U43J1.2~IG5W25CJ8DU9.1 size=295200 2024-09-14T11:21:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.249+0000 7fc354693780 1 > prepared multipart upload key=MQ5V2G5U43J1 upload=IG5W25CJ8DU9 tag=GMABW52LNB54 type=write size=2392352 2024-09-14T11:21:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.250+0000 7fc354693780 1 < completed delete operation key=PRBZQWTFXQ7R tag=WA2H7GSN1IVK type=del 2024-09-14T11:21:01.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.252+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~MFBJFQMYO1HR.0 size=1048576 2024-09-14T11:21:01.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.253+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~MFBJFQMYO1HR.1 size=582583 2024-09-14T11:21:01.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.253+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=MFBJFQMYO1HR tag=M50QA368GI9I type=write size=2679735 2024-09-14T11:21:01.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.254+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=JHU192ROZ3R4 type=write size=95934 2024-09-14T11:21:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.256+0000 7fc354693780 1 > prepared part key=_multipart_TFTKNNCGN88D.2~R80RP2NMK48M.0 size=1040705 2024-09-14T11:21:01.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.256+0000 7fc354693780 1 > prepared multipart upload key=TFTKNNCGN88D upload=R80RP2NMK48M tag=BH80Q4TUQGA0 type=write size=2089281 2024-09-14T11:21:01.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.257+0000 7fc354693780 1 < completed write operation key=OOFM3K1KEB9V tag=TTRXY4NXDNS1 type=write size=129961 2024-09-14T11:21:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.258+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=FAVSXOCFI4UX type=del size=299011 2024-09-14T11:21:01.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.260+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.0 size=1048576 2024-09-14T11:21:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.261+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.1 size=1048576 2024-09-14T11:21:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.262+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~7QXDE5ZMGSPR.2 size=853569 2024-09-14T11:21:01.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.264+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=7QXDE5ZMGSPR tag=MRKFETVA1YP8 type=write size=3999297 2024-09-14T11:21:01.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.266+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~FK73M3M152AN.0 size=1048576 2024-09-14T11:21:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.267+0000 7fc354693780 1 > prepared part key=_multipart_P061QWG9J16V.2~FK73M3M152AN.1 size=40978 2024-09-14T11:21:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.267+0000 7fc354693780 1 > prepared multipart upload key=P061QWG9J16V upload=FK73M3M152AN tag=NY5MCOOQZV73 type=write size=2138130 2024-09-14T11:21:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.268+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=J3R2AKI1WKG9 type=del 2024-09-14T11:21:01.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.269+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=VOOWYGXRUIVW type=write size=322699 2024-09-14T11:21:01.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.270+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=OQ7WUUVT0SCC type=del 2024-09-14T11:21:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.272+0000 7fc354693780 1 > prepared part key=_multipart_FMG2DNGS0LZ3.2~YAJENQFO3Q63.0 size=21828 2024-09-14T11:21:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.272+0000 7fc354693780 1 > prepared multipart upload key=FMG2DNGS0LZ3 upload=YAJENQFO3Q63 tag=5CMSKDIDHE86 type=write size=1070404 2024-09-14T11:21:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.273+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.0 size=1048576 2024-09-14T11:21:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.274+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.1 size=1048576 2024-09-14T11:21:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.275+0000 7fc354693780 1 < completed part key=_multipart_IJZB38U355GG.2~8V662L4YU2JE.2 size=489557 2024-09-14T11:21:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.277+0000 7fc354693780 1 < completed multipart upload key=IJZB38U355GG upload=8V662L4YU2JE tag=PWFN4EJAOQVM type=write size=3635285 2024-09-14T11:21:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.279+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~BJOQOHMSNB59.0 size=1048576 2024-09-14T11:21:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.280+0000 7fc354693780 1 > prepared part key=_multipart_6SIWH1BHPFGM.2~BJOQOHMSNB59.1 size=247309 2024-09-14T11:21:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.280+0000 7fc354693780 1 > prepared multipart upload key=6SIWH1BHPFGM upload=BJOQOHMSNB59 tag=RH9Z10ECX5UF type=write size=2344461 2024-09-14T11:21:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.282+0000 7fc354693780 1 < suggested update operation key=RHVF0Z2PRDA8 tag=P6SKK5P0YN7N type=del size=1620981 2024-09-14T11:21:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.284+0000 7fc354693780 1 > prepared operation key=T0Z8NK20DS5K tag=FRX2L1WHQYFW type=del size=1068316 2024-09-14T11:21:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.285+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=XVVTIDSSG7TE type=del 2024-09-14T11:21:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.286+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=1F06CXWOE6FK type=del size=3494747 2024-09-14T11:21:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.287+0000 7fc354693780 -1 < failed to complete operation key=RHVF0Z2PRDA8 tag=AM5AV72WGJ7F type=del size=2457120: (22) Invalid argument 2024-09-14T11:21:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.288+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=NNOM3AP5NU2F type=del size=521629 2024-09-14T11:21:01.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.290+0000 7fc354693780 1 < suggested update operation key=JGVLT0K0CEGQ tag=TAL80AR5AUY4 type=del size=2465751 2024-09-14T11:21:01.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.291+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=HYIWGLBCA7Q6 type=del size=741377 2024-09-14T11:21:01.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.293+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~NLMVS1R5TTCQ.0 size=975811 2024-09-14T11:21:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.294+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=NLMVS1R5TTCQ tag=EGS9EYE5ZTVH type=write size=2024387 2024-09-14T11:21:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.295+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=9SVPO1O3UEC0 type=del size=2646571 2024-09-14T11:21:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.297+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=7KCBTIDLI146 type=del 2024-09-14T11:21:01.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.299+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~LB6JVS5375ST.0 size=1048576 2024-09-14T11:21:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.300+0000 7fc354693780 1 > prepared part key=_multipart_PRBZQWTFXQ7R.2~LB6JVS5375ST.1 size=804702 2024-09-14T11:21:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.300+0000 7fc354693780 1 > prepared multipart upload key=PRBZQWTFXQ7R upload=LB6JVS5375ST tag=QMI3L5JL2H2M type=write size=2901854 2024-09-14T11:21:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.301+0000 7fc354693780 -1 < failed to complete operation key=TFTKNNCGN88D tag=4492QI885CI8 type=del size=1260013: (22) Invalid argument 2024-09-14T11:21:01.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.303+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.0 size=1048576 2024-09-14T11:21:01.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.304+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.1 size=1048576 2024-09-14T11:21:01.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.305+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.2 size=1023806 2024-09-14T11:21:01.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.305+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=D09AKQ7EKYA3 tag=V2HBKBW6LBOM type=write size=4169534 2024-09-14T11:21:01.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.307+0000 7fc354693780 1 < suggested update operation key=QWMHFF32M37W tag=17T225H9TUMJ type=del size=983601 2024-09-14T11:21:01.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.308+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=AVYJA4KRT7ZC type=write size=979169 2024-09-14T11:21:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.309+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~IG5W25CJ8DU9.0 size=1048576 2024-09-14T11:21:01.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.310+0000 7fc354693780 1 < completed part key=_multipart_MQ5V2G5U43J1.2~IG5W25CJ8DU9.1 size=295200 2024-09-14T11:21:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.312+0000 7fc354693780 1 < completed multipart upload key=MQ5V2G5U43J1 upload=IG5W25CJ8DU9 tag=GMABW52LNB54 type=write size=2392352 2024-09-14T11:21:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.314+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~EDJ8C74QOLDC.0 size=1048576 2024-09-14T11:21:01.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.315+0000 7fc354693780 1 > prepared part key=_multipart_BTET4HD5NY0D.2~EDJ8C74QOLDC.1 size=183126 2024-09-14T11:21:01.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.315+0000 7fc354693780 1 > prepared multipart upload key=BTET4HD5NY0D upload=EDJ8C74QOLDC tag=ICKCS4Y2JYZC type=write size=2280278 2024-09-14T11:21:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.316+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~MFBJFQMYO1HR.0 size=1048576 2024-09-14T11:21:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.317+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~MFBJFQMYO1HR.1 size=582583 2024-09-14T11:21:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.319+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=MFBJFQMYO1HR tag=M50QA368GI9I type=write size=2679735 2024-09-14T11:21:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.320+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=QR8L00GZCMUH type=write size=57911 2024-09-14T11:21:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.321+0000 7fc354693780 1 < completed part key=_multipart_TFTKNNCGN88D.2~R80RP2NMK48M.0 size=1040705 2024-09-14T11:21:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.323+0000 7fc354693780 1 < completed multipart upload key=TFTKNNCGN88D upload=R80RP2NMK48M tag=BH80Q4TUQGA0 type=write size=2089281 2024-09-14T11:21:01.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.324+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=K52GS5AW8KK8 type=del size=1380088 2024-09-14T11:21:01.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.325+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=FAVSXOCFI4UX type=del 2024-09-14T11:21:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.327+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.0 size=1048576 2024-09-14T11:21:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.328+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.1 size=1048576 2024-09-14T11:21:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.329+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.2 size=863387 2024-09-14T11:21:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.329+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=TDT8SHVCZJ0V tag=HVBVDSCJYXDZ type=write size=4009115 2024-09-14T11:21:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.330+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~FK73M3M152AN.0 size=1048576 2024-09-14T11:21:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.331+0000 7fc354693780 1 < completed part key=_multipart_P061QWG9J16V.2~FK73M3M152AN.1 size=40978 2024-09-14T11:21:01.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.333+0000 7fc354693780 1 < completed multipart upload key=P061QWG9J16V upload=FK73M3M152AN tag=NY5MCOOQZV73 type=write size=2138130 2024-09-14T11:21:01.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.334+0000 7fc354693780 1 > prepared operation key=IGZK9BWJFCV3 tag=MB59321YZLHE type=del size=2301515 2024-09-14T11:21:01.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.335+0000 7fc354693780 1 < completed write operation key=IJZB38U355GG tag=VOOWYGXRUIVW type=write size=322699 2024-09-14T11:21:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.337+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=7RCRT18J58L8 type=del size=3458809 2024-09-14T11:21:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.338+0000 7fc354693780 1 < completed part key=_multipart_FMG2DNGS0LZ3.2~YAJENQFO3Q63.0 size=21828 2024-09-14T11:21:01.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.340+0000 7fc354693780 1 < completed multipart upload key=FMG2DNGS0LZ3 upload=YAJENQFO3Q63 tag=5CMSKDIDHE86 type=write size=1070404 2024-09-14T11:21:01.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.341+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=JINHPU4LFOUT type=write size=963771 2024-09-14T11:21:01.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.342+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~BJOQOHMSNB59.0 size=1048576 2024-09-14T11:21:01.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.343+0000 7fc354693780 1 < completed part key=_multipart_6SIWH1BHPFGM.2~BJOQOHMSNB59.1 size=247309 2024-09-14T11:21:01.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.345+0000 7fc354693780 1 < completed multipart upload key=6SIWH1BHPFGM upload=BJOQOHMSNB59 tag=RH9Z10ECX5UF type=write size=2344461 2024-09-14T11:21:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.346+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=80VM9WA2TU5K type=del size=3727927 2024-09-14T11:21:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.347+0000 7fc354693780 1 < canceled operation key=T0Z8NK20DS5K tag=FRX2L1WHQYFW type=del size=1068316 2024-09-14T11:21:01.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.348+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=4JKLWLZCDAX7 type=write size=948012 2024-09-14T11:21:01.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.349+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=1F06CXWOE6FK type=del 2024-09-14T11:21:01.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.352+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=MPTGE3E6GA4D type=write size=252251 2024-09-14T11:21:01.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.353+0000 7fc354693780 1 < completed delete operation key=P061QWG9J16V tag=NNOM3AP5NU2F type=del 2024-09-14T11:21:01.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.354+0000 7fc354693780 1 > prepared operation key=NENG5XNJ7M5Z tag=W332TEJXDPJ0 type=del size=1822368 2024-09-14T11:21:01.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.357+0000 7fc354693780 1 < suggested update operation key=6SIWH1BHPFGM tag=HYIWGLBCA7Q6 type=del size=741377 2024-09-14T11:21:01.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.358+0000 7fc354693780 1 > prepared operation key=Z3ZFX1354IRF tag=5FMMI0IHA4P5 type=del size=3366992 2024-09-14T11:21:01.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.359+0000 7fc354693780 -1 < failed to complete operation key=6SIWH1BHPFGM tag=9SVPO1O3UEC0 type=del size=2646571: (22) Invalid argument 2024-09-14T11:21:01.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.360+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=UZA0GJF1XWGZ type=write size=409247 2024-09-14T11:21:01.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.361+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~LB6JVS5375ST.0 size=1048576 2024-09-14T11:21:01.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.362+0000 7fc354693780 1 < completed part key=_multipart_PRBZQWTFXQ7R.2~LB6JVS5375ST.1 size=804702 2024-09-14T11:21:01.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.364+0000 7fc354693780 1 < completed multipart upload key=PRBZQWTFXQ7R upload=LB6JVS5375ST tag=QMI3L5JL2H2M type=write size=2901854 2024-09-14T11:21:01.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.365+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=8LX3270ZV3RL type=write size=467459 2024-09-14T11:21:01.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.366+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.0 size=1048576 2024-09-14T11:21:01.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.367+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.1 size=1048576 2024-09-14T11:21:01.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.368+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~D09AKQ7EKYA3.2 size=1023806 2024-09-14T11:21:01.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.370+0000 7fc354693780 1 < completed multipart upload key=BTET4HD5NY0D upload=D09AKQ7EKYA3 tag=V2HBKBW6LBOM type=write size=4169534 2024-09-14T11:21:01.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.371+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=YPXY7XZJMYGY type=del size=2712124 2024-09-14T11:21:01.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.372+0000 7fc354693780 1 < completed write operation key=RHVF0Z2PRDA8 tag=AVYJA4KRT7ZC type=write size=979169 2024-09-14T11:21:01.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.374+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.0 size=1048576 2024-09-14T11:21:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.375+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.1 size=1048576 2024-09-14T11:21:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.376+0000 7fc354693780 1 > prepared part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.2 size=692491 2024-09-14T11:21:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.376+0000 7fc354693780 1 > prepared multipart upload key=IGZK9BWJFCV3 upload=KQSIQS08D0LD tag=DL3QMN5PVCE8 type=write size=3838219 2024-09-14T11:21:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.376+0000 7fc354693780 1 < canceled part key=_multipart_BTET4HD5NY0D.2~EDJ8C74QOLDC.0 size=1048576 2024-09-14T11:21:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.377+0000 7fc354693780 1 < completed part key=_multipart_BTET4HD5NY0D.2~EDJ8C74QOLDC.1 size=183126 2024-09-14T11:21:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.379+0000 7fc354693780 1 < canceled multipart upload key=BTET4HD5NY0D upload=EDJ8C74QOLDC tag=ICKCS4Y2JYZC type=write size=2280278 2024-09-14T11:21:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.380+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=V2K3LUSZQ17T type=del size=1172427 2024-09-14T11:21:01.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.381+0000 7fc354693780 1 < completed write operation key=X4VH2WYJJ8GI tag=QR8L00GZCMUH type=write size=57911 2024-09-14T11:21:01.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.382+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=L79TW334QKZC type=del size=929029 2024-09-14T11:21:01.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.384+0000 7fc354693780 1 < completed delete operation key=IGZK9BWJFCV3 tag=K52GS5AW8KK8 type=del 2024-09-14T11:21:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.385+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=YX3NLIHOV9YS type=del size=2266847 2024-09-14T11:21:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.386+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.0 size=1048576 2024-09-14T11:21:01.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.387+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.1 size=1048576 2024-09-14T11:21:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.388+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~TDT8SHVCZJ0V.2 size=863387 2024-09-14T11:21:01.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.389+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=TDT8SHVCZJ0V tag=HVBVDSCJYXDZ type=write size=4009115 2024-09-14T11:21:01.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.391+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=PDF0USUQSTE9 type=write size=311598 2024-09-14T11:21:01.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.393+0000 7fc354693780 1 < suggested update operation key=IGZK9BWJFCV3 tag=MB59321YZLHE type=del size=2301515 2024-09-14T11:21:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.395+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.0 size=1048576 2024-09-14T11:21:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.396+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.1 size=1048576 2024-09-14T11:21:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.397+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.2 size=98860 2024-09-14T11:21:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.397+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=AUYS1DC5FR2V tag=09S69R9UM02F type=write size=3244588 2024-09-14T11:21:01.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.398+0000 7fc354693780 1 < completed delete operation key=WBT3M1NMEEAY tag=7RCRT18J58L8 type=del 2024-09-14T11:21:01.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.399+0000 7fc354693780 1 > prepared operation key=TFTKNNCGN88D tag=8S03L868OP80 type=del size=678995 2024-09-14T11:21:01.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.400+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=JINHPU4LFOUT type=write size=963771 2024-09-14T11:21:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.402+0000 7fc354693780 1 > prepared part key=_multipart_Z3ZFX1354IRF.2~EKSCT4WBUWLH.0 size=832729 2024-09-14T11:21:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.402+0000 7fc354693780 1 > prepared multipart upload key=Z3ZFX1354IRF upload=EKSCT4WBUWLH tag=ZKU3UUWU21M6 type=write size=1881305 2024-09-14T11:21:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.404+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=80VM9WA2TU5K type=del 2024-09-14T11:21:01.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.405+0000 7fc354693780 1 > prepared operation key=MQ5V2G5U43J1 tag=G1BPAI5S49CB type=del size=1279166 2024-09-14T11:21:01.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.406+0000 7fc354693780 1 < completed write operation key=JGVLT0K0CEGQ tag=4JKLWLZCDAX7 type=write size=948012 2024-09-14T11:21:01.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.407+0000 7fc354693780 1 > prepared operation key=BTET4HD5NY0D tag=0OFZ6EIQGI2J type=del size=1955879 2024-09-14T11:21:01.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.408+0000 7fc354693780 1 < canceled operation key=OOFM3K1KEB9V tag=MPTGE3E6GA4D type=write size=252251 2024-09-14T11:21:01.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.409+0000 7fc354693780 1 > prepared operation key=H1S2CBHNW6GI tag=GH8HMIRQYW4A type=del size=2510342 2024-09-14T11:21:01.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.410+0000 7fc354693780 1 < completed delete operation key=NENG5XNJ7M5Z tag=W332TEJXDPJ0 type=del 2024-09-14T11:21:01.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.411+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=HKZI7CAZ1BKL type=del size=4188054 2024-09-14T11:21:01.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.414+0000 7fc354693780 1 < suggested update operation key=Z3ZFX1354IRF tag=5FMMI0IHA4P5 type=del size=3366992 2024-09-14T11:21:01.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.415+0000 7fc354693780 1 > prepared operation key=OOFM3K1KEB9V tag=YHALKN92DATZ type=del size=1696891 2024-09-14T11:21:01.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.416+0000 7fc354693780 1 < completed write operation key=ICNEXZMA3VQV tag=UZA0GJF1XWGZ type=write size=409247 2024-09-14T11:21:01.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.418+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~XKY0F4546B66.0 size=1048576 2024-09-14T11:21:01.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.419+0000 7fc354693780 1 > prepared part key=_multipart_4Z3KI5X3WQ0I.2~XKY0F4546B66.1 size=754940 2024-09-14T11:21:01.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.419+0000 7fc354693780 1 > prepared multipart upload key=4Z3KI5X3WQ0I upload=XKY0F4546B66 tag=HBPSWQYJ85MR type=write size=2852092 2024-09-14T11:21:01.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.422+0000 7fc354693780 1 < suggested remove operation key=ICNEXZMA3VQV tag=8LX3270ZV3RL type=write 2024-09-14T11:21:01.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.423+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~7FOFJMSJHLW3.0 size=1006265 2024-09-14T11:21:01.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.423+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=7FOFJMSJHLW3 tag=AKPEYUX14OWH type=write size=2054841 2024-09-14T11:21:01.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.425+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=YPXY7XZJMYGY type=del 2024-09-14T11:21:01.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.426+0000 7fc354693780 1 > prepared operation key=QWMHFF32M37W tag=1C1QUL15ULIK type=del size=444254 2024-09-14T11:21:01.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.427+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.0 size=1048576 2024-09-14T11:21:01.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.428+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.1 size=1048576 2024-09-14T11:21:01.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.429+0000 7fc354693780 1 < completed part key=_multipart_IGZK9BWJFCV3.2~KQSIQS08D0LD.2 size=692491 2024-09-14T11:21:01.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.431+0000 7fc354693780 1 < completed multipart upload key=IGZK9BWJFCV3 upload=KQSIQS08D0LD tag=DL3QMN5PVCE8 type=write size=3838219 2024-09-14T11:21:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.432+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=6279YNPG975F type=write size=1031683 2024-09-14T11:21:01.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.433+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=V2K3LUSZQ17T type=del 2024-09-14T11:21:01.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.434+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=7LCZRMLP0P9V type=del size=3079026 2024-09-14T11:21:01.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.435+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=L79TW334QKZC type=del 2024-09-14T11:21:01.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.436+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=8N3NDTYMP47F type=del size=3417592 2024-09-14T11:21:01.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.437+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=YX3NLIHOV9YS type=del 2024-09-14T11:21:01.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.438+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=T0FSDMX3J2W3 type=del size=821358 2024-09-14T11:21:01.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.440+0000 7fc354693780 1 < completed write operation key=AUL8F0SZVZX2 tag=PDF0USUQSTE9 type=write size=311598 2024-09-14T11:21:01.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.441+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=JG8WRT6ZH27S type=write size=577634 2024-09-14T11:21:01.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.442+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.0 size=1048576 2024-09-14T11:21:01.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.443+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.1 size=1048576 2024-09-14T11:21:01.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.444+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~AUYS1DC5FR2V.2 size=98860 2024-09-14T11:21:01.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.446+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=AUYS1DC5FR2V tag=09S69R9UM02F type=write size=3244588 2024-09-14T11:21:01.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.447+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=R3GHZOHSLWOK type=del size=1461765 2024-09-14T11:21:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.448+0000 7fc354693780 1 < completed delete operation key=TFTKNNCGN88D tag=8S03L868OP80 type=del 2024-09-14T11:21:01.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.450+0000 7fc354693780 1 > prepared operation key=WYD70VR8OKAN tag=H7RT4TFCXQI8 type=del size=2866690 2024-09-14T11:21:01.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.451+0000 7fc354693780 1 < completed part key=_multipart_Z3ZFX1354IRF.2~EKSCT4WBUWLH.0 size=832729 2024-09-14T11:21:01.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.453+0000 7fc354693780 1 < completed multipart upload key=Z3ZFX1354IRF upload=EKSCT4WBUWLH tag=ZKU3UUWU21M6 type=write size=1881305 2024-09-14T11:21:01.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.454+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=HY10YND25IAH type=del size=2074259 2024-09-14T11:21:01.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.456+0000 7fc354693780 1 < completed delete operation key=MQ5V2G5U43J1 tag=G1BPAI5S49CB type=del 2024-09-14T11:21:01.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.457+0000 7fc354693780 1 > prepared operation key=BJ7AARJEIT8W tag=QWMHXZ72YRY3 type=del size=1373264 2024-09-14T11:21:01.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.458+0000 7fc354693780 1 < canceled operation key=BTET4HD5NY0D tag=0OFZ6EIQGI2J type=del size=1955879 2024-09-14T11:21:01.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.459+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=QNE0WOOGPBFE type=del size=3551637 2024-09-14T11:21:01.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.462+0000 7fc354693780 1 < completed delete operation key=H1S2CBHNW6GI tag=GH8HMIRQYW4A type=del 2024-09-14T11:21:01.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.464+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~UBNGZEA57XBB.0 size=1048576 2024-09-14T11:21:01.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.464+0000 7fc354693780 1 > prepared part key=_multipart_GE83T07IQG0S.2~UBNGZEA57XBB.1 size=982667 2024-09-14T11:21:01.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.464+0000 7fc354693780 1 > prepared multipart upload key=GE83T07IQG0S upload=UBNGZEA57XBB tag=6L5LAQYK0D1V type=write size=3079819 2024-09-14T11:21:01.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.465+0000 7fc354693780 1 < canceled operation key=OOFM3K1KEB9V tag=HKZI7CAZ1BKL type=del size=4188054 2024-09-14T11:21:01.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.467+0000 7fc354693780 1 > prepared operation key=WBT3M1NMEEAY tag=R578CWPF7MST type=write size=146627 2024-09-14T11:21:01.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.468+0000 7fc354693780 1 < completed delete operation key=OOFM3K1KEB9V tag=YHALKN92DATZ type=del 2024-09-14T11:21:01.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.470+0000 7fc354693780 1 > prepared part key=_multipart_JF6PHF17N5WE.2~50CKSFCDHTXQ.0 size=386667 2024-09-14T11:21:01.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.470+0000 7fc354693780 1 > prepared multipart upload key=JF6PHF17N5WE upload=50CKSFCDHTXQ tag=SUD52Y4M4FN4 type=write size=1435243 2024-09-14T11:21:01.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.471+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~XKY0F4546B66.0 size=1048576 2024-09-14T11:21:01.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.472+0000 7fc354693780 1 < completed part key=_multipart_4Z3KI5X3WQ0I.2~XKY0F4546B66.1 size=754940 2024-09-14T11:21:01.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.474+0000 7fc354693780 1 < completed multipart upload key=4Z3KI5X3WQ0I upload=XKY0F4546B66 tag=HBPSWQYJ85MR type=write size=2852092 2024-09-14T11:21:01.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.475+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=RLLROKJ2BE5C type=del size=3265634 2024-09-14T11:21:01.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.476+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~7FOFJMSJHLW3.0 size=1006265 2024-09-14T11:21:01.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.478+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=7FOFJMSJHLW3 tag=AKPEYUX14OWH type=write size=2054841 2024-09-14T11:21:01.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.479+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=U5A7TQ53UQMN type=del size=405868 2024-09-14T11:21:01.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.481+0000 7fc354693780 1 < suggested update operation key=QWMHFF32M37W tag=1C1QUL15ULIK type=del size=444254 2024-09-14T11:21:01.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.483+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~6U1H2KVGAL6V.0 size=1048576 2024-09-14T11:21:01.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.484+0000 7fc354693780 1 > prepared part key=_multipart_EFX0VXGHRUDR.2~6U1H2KVGAL6V.1 size=248945 2024-09-14T11:21:01.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.484+0000 7fc354693780 1 > prepared multipart upload key=EFX0VXGHRUDR upload=6U1H2KVGAL6V tag=9RBUUT0Y6C5J type=write size=2346097 2024-09-14T11:21:01.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.485+0000 7fc354693780 1 < completed write operation key=X4VH2WYJJ8GI tag=6279YNPG975F type=write size=1031683 2024-09-14T11:21:01.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.486+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=3TSXQI9GEJGC type=del size=1133422 2024-09-14T11:21:01.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.488+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=7LCZRMLP0P9V type=del 2024-09-14T11:21:01.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.490+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~6AW1EET3TK5V.0 size=1048576 2024-09-14T11:21:01.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.490+0000 7fc354693780 1 > prepared part key=_multipart_JGVLT0K0CEGQ.2~6AW1EET3TK5V.1 size=1047528 2024-09-14T11:21:01.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.490+0000 7fc354693780 1 > prepared multipart upload key=JGVLT0K0CEGQ upload=6AW1EET3TK5V tag=4LF1QLDQIJFK type=write size=3144680 2024-09-14T11:21:01.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.492+0000 7fc354693780 1 < completed delete operation key=N23XJJD7YYG0 tag=8N3NDTYMP47F type=del 2024-09-14T11:21:01.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.493+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=G855YYSTE024 type=del size=2905201 2024-09-14T11:21:01.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.494+0000 7fc354693780 1 < completed delete operation key=IJZB38U355GG tag=T0FSDMX3J2W3 type=del 2024-09-14T11:21:01.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.495+0000 7fc354693780 1 > prepared operation key=FMG2DNGS0LZ3 tag=0U8GE5HI475U type=del size=1028861 2024-09-14T11:21:01.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.496+0000 7fc354693780 1 < completed write operation key=PRBZQWTFXQ7R tag=JG8WRT6ZH27S type=write size=577634 2024-09-14T11:21:01.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.497+0000 7fc354693780 1 > prepared operation key=AUL8F0SZVZX2 tag=NVO9C0C2OYAL type=del size=892968 2024-09-14T11:21:01.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.499+0000 7fc354693780 1 < suggested remove operation key=RHVF0Z2PRDA8 tag=R3GHZOHSLWOK type=del 2024-09-14T11:21:01.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.500+0000 7fc354693780 1 > prepared operation key=P061QWG9J16V tag=19973QB28P6S type=write size=39909 2024-09-14T11:21:01.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.501+0000 7fc354693780 1 < completed delete operation key=WYD70VR8OKAN tag=H7RT4TFCXQI8 type=del 2024-09-14T11:21:01.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.503+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=NT5EGPQS0L29 type=del size=22392 2024-09-14T11:21:01.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.504+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=HY10YND25IAH type=del 2024-09-14T11:21:01.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.505+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=GLO80HLJJ4B2 type=del size=241928 2024-09-14T11:21:01.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.506+0000 7fc354693780 1 < completed delete operation key=BJ7AARJEIT8W tag=QWMHXZ72YRY3 type=del 2024-09-14T11:21:01.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.507+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=WU7VRUFKX4X4 type=write size=72364 2024-09-14T11:21:01.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.508+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=QNE0WOOGPBFE type=del 2024-09-14T11:21:01.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.509+0000 7fc354693780 1 > prepared operation key=BKW08T86L2ZF tag=9TR2UF0BLHG2 type=write size=53386 2024-09-14T11:21:01.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.510+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~UBNGZEA57XBB.0 size=1048576 2024-09-14T11:21:01.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.511+0000 7fc354693780 1 < completed part key=_multipart_GE83T07IQG0S.2~UBNGZEA57XBB.1 size=982667 2024-09-14T11:21:01.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.513+0000 7fc354693780 1 < completed multipart upload key=GE83T07IQG0S upload=UBNGZEA57XBB tag=6L5LAQYK0D1V type=write size=3079819 2024-09-14T11:21:01.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.514+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=K0BT1NSAX38S type=write size=948573 2024-09-14T11:21:01.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.515+0000 7fc354693780 1 < completed write operation key=WBT3M1NMEEAY tag=R578CWPF7MST type=write size=146627 2024-09-14T11:21:01.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.516+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=4SCTQO1ON3EG type=write size=62325 2024-09-14T11:21:01.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.517+0000 7fc354693780 1 < completed part key=_multipart_JF6PHF17N5WE.2~50CKSFCDHTXQ.0 size=386667 2024-09-14T11:21:01.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.519+0000 7fc354693780 1 < completed multipart upload key=JF6PHF17N5WE upload=50CKSFCDHTXQ tag=SUD52Y4M4FN4 type=write size=1435243 2024-09-14T11:21:01.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.520+0000 7fc354693780 1 > prepared operation key=4IDBIAE3VAY4 tag=WQV0MD3R61SQ type=del size=2034847 2024-09-14T11:21:01.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.521+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=RLLROKJ2BE5C type=del 2024-09-14T11:21:01.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.522+0000 7fc354693780 1 > prepared operation key=X4VH2WYJJ8GI tag=Q5O0RV7NFJB1 type=del size=609755 2024-09-14T11:21:01.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.524+0000 7fc354693780 1 < completed delete operation key=GE83T07IQG0S tag=U5A7TQ53UQMN type=del 2024-09-14T11:21:01.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.525+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~BHAM4R6CMPDI.0 size=1048576 2024-09-14T11:21:01.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.526+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~BHAM4R6CMPDI.1 size=335210 2024-09-14T11:21:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.526+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=BHAM4R6CMPDI tag=9R1UV2BGOOP6 type=write size=2432362 2024-09-14T11:21:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.527+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~6U1H2KVGAL6V.0 size=1048576 2024-09-14T11:21:01.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.528+0000 7fc354693780 1 < completed part key=_multipart_EFX0VXGHRUDR.2~6U1H2KVGAL6V.1 size=248945 2024-09-14T11:21:01.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.530+0000 7fc354693780 1 < completed multipart upload key=EFX0VXGHRUDR upload=6U1H2KVGAL6V tag=9RBUUT0Y6C5J type=write size=2346097 2024-09-14T11:21:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.531+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=M8BNPT4BP4UI type=del size=1016140 2024-09-14T11:21:01.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.532+0000 7fc354693780 1 < completed delete operation key=EFX0VXGHRUDR tag=3TSXQI9GEJGC type=del 2024-09-14T11:21:01.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.534+0000 7fc354693780 1 > prepared part key=_multipart_NENG5XNJ7M5Z.2~E4GF6U5CZKAM.0 size=966782 2024-09-14T11:21:01.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.534+0000 7fc354693780 1 > prepared multipart upload key=NENG5XNJ7M5Z upload=E4GF6U5CZKAM tag=L09RWK5SQC10 type=write size=2015358 2024-09-14T11:21:01.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.535+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~6AW1EET3TK5V.0 size=1048576 2024-09-14T11:21:01.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.536+0000 7fc354693780 1 < completed part key=_multipart_JGVLT0K0CEGQ.2~6AW1EET3TK5V.1 size=1047528 2024-09-14T11:21:01.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.538+0000 7fc354693780 1 < completed multipart upload key=JGVLT0K0CEGQ upload=6AW1EET3TK5V tag=4LF1QLDQIJFK type=write size=3144680 2024-09-14T11:21:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.540+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~RAVHSTBGEQGU.0 size=1048576 2024-09-14T11:21:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.541+0000 7fc354693780 1 > prepared part key=_multipart_H1S2CBHNW6GI.2~RAVHSTBGEQGU.1 size=654262 2024-09-14T11:21:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.541+0000 7fc354693780 1 > prepared multipart upload key=H1S2CBHNW6GI upload=RAVHSTBGEQGU tag=DMJL98MOZLYT type=write size=2751414 2024-09-14T11:21:01.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.542+0000 7fc354693780 1 < completed delete operation key=JGVLT0K0CEGQ tag=G855YYSTE024 type=del 2024-09-14T11:21:01.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.544+0000 7fc354693780 1 > prepared operation key=ICNEXZMA3VQV tag=MAAQY721X7OB type=del size=2729493 2024-09-14T11:21:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.545+0000 7fc354693780 1 < completed delete operation key=FMG2DNGS0LZ3 tag=0U8GE5HI475U type=del 2024-09-14T11:21:01.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.547+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~DD7L0ACT4TA5.0 size=1048576 2024-09-14T11:21:01.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.548+0000 7fc354693780 1 > prepared part key=_multipart_WBT3M1NMEEAY.2~DD7L0ACT4TA5.1 size=1002758 2024-09-14T11:21:01.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.548+0000 7fc354693780 1 > prepared multipart upload key=WBT3M1NMEEAY upload=DD7L0ACT4TA5 tag=5928P1DEN72Y type=write size=3099910 2024-09-14T11:21:01.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.549+0000 7fc354693780 1 < completed delete operation key=AUL8F0SZVZX2 tag=NVO9C0C2OYAL type=del 2024-09-14T11:21:01.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.550+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=G2ZXR9SA02NJ type=del size=2705409 2024-09-14T11:21:01.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.551+0000 7fc354693780 1 < completed write operation key=P061QWG9J16V tag=19973QB28P6S type=write size=39909 2024-09-14T11:21:01.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.552+0000 7fc354693780 1 > prepared operation key=977GI7HKD9JJ tag=T8HR3PQ5V5MO type=del size=2312419 2024-09-14T11:21:01.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.554+0000 7fc354693780 1 < completed delete operation key=977GI7HKD9JJ tag=NT5EGPQS0L29 type=del 2024-09-14T11:21:01.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.556+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.0 size=1048576 2024-09-14T11:21:01.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.556+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.1 size=1048576 2024-09-14T11:21:01.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.557+0000 7fc354693780 1 > prepared part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.2 size=446484 2024-09-14T11:21:01.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.557+0000 7fc354693780 1 > prepared multipart upload key=54EUIL28P2H1 upload=LISZR3NWWGU1 tag=EOSWIHXYFVJ8 type=write size=3592212 2024-09-14T11:21:01.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.559+0000 7fc354693780 1 < suggested remove operation key=N23XJJD7YYG0 tag=GLO80HLJJ4B2 type=del 2024-09-14T11:21:01.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.561+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~I3GBEOS5YTH8.0 size=1048576 2024-09-14T11:21:01.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.562+0000 7fc354693780 1 > prepared part key=_multipart_BJ7AARJEIT8W.2~I3GBEOS5YTH8.1 size=316574 2024-09-14T11:21:01.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.562+0000 7fc354693780 1 > prepared multipart upload key=BJ7AARJEIT8W upload=I3GBEOS5YTH8 tag=X4816V71O1JP type=write size=2413726 2024-09-14T11:21:01.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.564+0000 7fc354693780 1 < suggested update operation key=GE83T07IQG0S tag=WU7VRUFKX4X4 type=write size=72364 2024-09-14T11:21:01.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.567+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=BOUVK3URC2LG type=del size=2101967 2024-09-14T11:21:01.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.568+0000 7fc354693780 1 < completed write operation key=BKW08T86L2ZF tag=9TR2UF0BLHG2 type=write size=53386 2024-09-14T11:21:01.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.569+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=V52N5V9S2NYH type=del size=2600673 2024-09-14T11:21:01.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.570+0000 7fc354693780 -1 < failed to complete operation key=GE83T07IQG0S tag=K0BT1NSAX38S type=write size=948573: (22) Invalid argument 2024-09-14T11:21:01.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.571+0000 7fc354693780 1 > prepared operation key=N23XJJD7YYG0 tag=DS0DH3FVQ38R type=del size=599966 2024-09-14T11:21:01.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.572+0000 7fc354693780 -1 < failed to complete operation key=N23XJJD7YYG0 tag=4SCTQO1ON3EG type=write size=62325: (22) Invalid argument 2024-09-14T11:21:01.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.574+0000 7fc354693780 1 > prepared part key=_multipart_OOFM3K1KEB9V.2~GK5U1DX1ATZC.0 size=949220 2024-09-14T11:21:01.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.574+0000 7fc354693780 1 > prepared multipart upload key=OOFM3K1KEB9V upload=GK5U1DX1ATZC tag=5YPYY70TO3O4 type=write size=1997796 2024-09-14T11:21:01.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.575+0000 7fc354693780 1 < completed delete operation key=4IDBIAE3VAY4 tag=WQV0MD3R61SQ type=del 2024-09-14T11:21:01.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.576+0000 7fc354693780 1 > prepared operation key=RHVF0Z2PRDA8 tag=BOJ6LXXD0XFI type=del size=1680444 2024-09-14T11:21:01.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.578+0000 7fc354693780 1 < completed delete operation key=X4VH2WYJJ8GI tag=Q5O0RV7NFJB1 type=del 2024-09-14T11:21:01.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.579+0000 7fc354693780 1 > prepared operation key=4Z3KI5X3WQ0I tag=N8NAIRN1XMGQ type=del size=271533 2024-09-14T11:21:01.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.580+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~BHAM4R6CMPDI.0 size=1048576 2024-09-14T11:21:01.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.581+0000 7fc354693780 1 < completed part key=_multipart_OOFM3K1KEB9V.2~BHAM4R6CMPDI.1 size=335210 2024-09-14T11:21:01.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.583+0000 7fc354693780 1 < completed multipart upload key=OOFM3K1KEB9V upload=BHAM4R6CMPDI tag=9R1UV2BGOOP6 type=write size=2432362 2024-09-14T11:21:01.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.584+0000 7fc354693780 1 > prepared operation key=GE83T07IQG0S tag=GADIR2BRNCRJ type=del size=2937749 2024-09-14T11:21:01.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.585+0000 7fc354693780 1 < completed delete operation key=RHVF0Z2PRDA8 tag=M8BNPT4BP4UI type=del 2024-09-14T11:21:01.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.587+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~YCE4UNQ2ALEO.0 size=1048576 2024-09-14T11:21:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.588+0000 7fc354693780 1 > prepared part key=_multipart_X4VH2WYJJ8GI.2~YCE4UNQ2ALEO.1 size=81507 2024-09-14T11:21:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.588+0000 7fc354693780 1 > prepared multipart upload key=X4VH2WYJJ8GI upload=YCE4UNQ2ALEO tag=9N13O74PUBW2 type=write size=2178659 2024-09-14T11:21:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.588+0000 7fc354693780 1 < canceled part key=_multipart_NENG5XNJ7M5Z.2~E4GF6U5CZKAM.0 size=966782 2024-09-14T11:21:01.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.590+0000 7fc354693780 1 < canceled multipart upload key=NENG5XNJ7M5Z upload=E4GF6U5CZKAM tag=L09RWK5SQC10 type=write size=2015358 2024-09-14T11:21:01.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.591+0000 7fc354693780 1 > prepared operation key=6SIWH1BHPFGM tag=JV4T70LZI8WS type=del size=3611124 2024-09-14T11:21:01.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.592+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~RAVHSTBGEQGU.0 size=1048576 2024-09-14T11:21:01.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.593+0000 7fc354693780 1 < completed part key=_multipart_H1S2CBHNW6GI.2~RAVHSTBGEQGU.1 size=654262 2024-09-14T11:21:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.595+0000 7fc354693780 1 < completed multipart upload key=H1S2CBHNW6GI upload=RAVHSTBGEQGU tag=DMJL98MOZLYT type=write size=2751414 2024-09-14T11:21:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.596+0000 7fc354693780 1 > prepared operation key=EFX0VXGHRUDR tag=VHU0VQRUGDI1 type=write size=269529 2024-09-14T11:21:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.597+0000 7fc354693780 1 < completed delete operation key=ICNEXZMA3VQV tag=MAAQY721X7OB type=del 2024-09-14T11:21:01.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.598+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=E8SX58FTGGQ8 type=write size=144666 2024-09-14T11:21:01.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.599+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~DD7L0ACT4TA5.0 size=1048576 2024-09-14T11:21:01.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.600+0000 7fc354693780 1 < completed part key=_multipart_WBT3M1NMEEAY.2~DD7L0ACT4TA5.1 size=1002758 2024-09-14T11:21:01.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.602+0000 7fc354693780 1 < completed multipart upload key=WBT3M1NMEEAY upload=DD7L0ACT4TA5 tag=5928P1DEN72Y type=write size=3099910 2024-09-14T11:21:01.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.603+0000 7fc354693780 1 > prepared operation key=JGVLT0K0CEGQ tag=RBMYXGOGL58E type=del size=3947320 2024-09-14T11:21:01.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.605+0000 7fc354693780 1 < completed delete operation key=JF6PHF17N5WE tag=G2ZXR9SA02NJ type=del 2024-09-14T11:21:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.607+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~AJT6BCQRCTH2.0 size=1048576 2024-09-14T11:21:01.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.607+0000 7fc354693780 1 > prepared part key=_multipart_RHVF0Z2PRDA8.2~AJT6BCQRCTH2.1 size=99315 2024-09-14T11:21:01.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.607+0000 7fc354693780 1 > prepared multipart upload key=RHVF0Z2PRDA8 upload=AJT6BCQRCTH2 tag=IEZ0YTI3GCXZ type=write size=2196467 2024-09-14T11:21:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.610+0000 7fc354693780 1 < suggested remove operation key=977GI7HKD9JJ tag=T8HR3PQ5V5MO type=del 2024-09-14T11:21:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.611+0000 7fc354693780 1 > prepared operation key=JF6PHF17N5WE tag=OEDQSO0NU7NX type=del size=1983069 2024-09-14T11:21:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.612+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.0 size=1048576 2024-09-14T11:21:01.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.613+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.1 size=1048576 2024-09-14T11:21:01.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.614+0000 7fc354693780 1 < completed part key=_multipart_54EUIL28P2H1.2~LISZR3NWWGU1.2 size=446484 2024-09-14T11:21:01.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.616+0000 7fc354693780 1 < completed multipart upload key=54EUIL28P2H1 upload=LISZR3NWWGU1 tag=EOSWIHXYFVJ8 type=write size=3592212 2024-09-14T11:21:01.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.617+0000 7fc354693780 1 > prepared operation key=PRBZQWTFXQ7R tag=FY4LH9ZFO8B6 type=del size=4122722 2024-09-14T11:21:01.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.618+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~I3GBEOS5YTH8.0 size=1048576 2024-09-14T11:21:01.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.619+0000 7fc354693780 1 < completed part key=_multipart_BJ7AARJEIT8W.2~I3GBEOS5YTH8.1 size=316574 2024-09-14T11:21:01.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.621+0000 7fc354693780 1 < completed multipart upload key=BJ7AARJEIT8W upload=I3GBEOS5YTH8 tag=X4816V71O1JP type=write size=2413726 2024-09-14T11:21:01.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:21:01.622+0000 7fc354693780 1 > prepared operation key=IJZB38U355GG tag=6PE1QN3F0NUX type=del size=736899 2024-09-14T11:21:01.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_stats.simulate (8416 ms) 2024-09-14T11:21:01.621 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats (8416 ms total) 2024-09-14T11:21:01.621 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:21:01.621 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:02.226 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 1 test from 1 test suite ran. (10882 ms total) 2024-09-14T11:21:02.226 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 1 test. 2024-09-14T11:21:02.231 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:02.232 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:02.313 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:21:02.314 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:21:02.314 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:21:02.397 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:21:02.397 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:21:02.398 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:04.239 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:21:04.239 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:21:04.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-14T11:21:04.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:21:04.264 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (9 ms) 2024-09-14T11:21:04.264 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:21:04.269 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-09-14T11:21:04.269 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:21:04.272 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-14T11:21:04.272 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:21:04.278 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-14T11:21:04.278 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:21:04.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-09-14T11:21:04.284 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:21:04.287 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-14T11:21:04.287 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:21:04.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-14T11:21:04.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:21:04.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:21:04.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:21:04.299 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-14T11:21:04.299 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:21:04.300 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:21:04.300 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:21:04.300 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-14T11:21:04.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:21:04.307 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:21:04.307 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:21:04.314 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-14T11:21:04.314 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:21:04.320 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-14T11:21:04.320 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:21:04.326 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T11:21:04.326 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:21:04.333 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-09-14T11:21:04.333 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:21:04.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T11:21:04.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:21:04.344 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:21:04.344 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:21:04.346 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-14T11:21:04.347 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:21:04.347 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:21:04.347 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:21:04.348 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T11:21:04.348 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:21:04.354 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-14T11:21:04.354 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:21:04.361 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T11:21:04.361 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:21:04.367 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (6 ms) 2024-09-14T11:21:04.367 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:21:04.375 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-14T11:21:04.375 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:21:04.377 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:21:04.378 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:21:04.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-14T11:21:04.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:21:04.381 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:21:04.381 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:21:04.381 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-14T11:21:04.381 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:21:04.388 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (6 ms) 2024-09-14T11:21:04.388 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap (149 ms total) 2024-09-14T11:21:04.388 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:21:04.388 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:05.251 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 31 tests from 1 test suite ran. (2854 ms total) 2024-09-14T11:21:05.252 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 31 tests. 2024-09-14T11:21:05.254 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:05.255 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:05.296 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:21:05.297 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:21:05.297 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:21:05.384 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:21:05.385 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:21:05.385 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:05.385 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:21:05.385 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:21:08.276 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2891 ms) 2024-09-14T11:21:08.276 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:21:11.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3019 ms) 2024-09-14T11:21:11.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:21:14.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Reserve (3017 ms) 2024-09-14T11:21:14.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:21:17.329 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3018 ms) 2024-09-14T11:21:17.329 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:21:20.345 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Commit (3015 ms) 2024-09-14T11:21:20.345 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:21:23.363 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Stats (3018 ms) 2024-09-14T11:21:23.363 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:21:27.383 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4020 ms) 2024-09-14T11:21:27.383 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:21:30.401 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Abort (3019 ms) 2024-09-14T11:21:30.401 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:21:33.422 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-09-14T11:21:33.422 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:21:36.437 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitError (3015 ms) 2024-09-14T11:21:36.437 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:21:39.445 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortError (3008 ms) 2024-09-14T11:21:39.446 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:21:42.474 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3029 ms) 2024-09-14T11:21:42.474 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:21:45.500 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3026 ms) 2024-09-14T11:21:45.500 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:21:48.514 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3012 ms) 2024-09-14T11:21:48.514 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:21:51.538 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3025 ms) 2024-09-14T11:21:51.538 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:21:54.556 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3017 ms) 2024-09-14T11:21:54.556 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:21:57.572 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3017 ms) 2024-09-14T11:21:57.572 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:22:00.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Cleanup (3013 ms) 2024-09-14T11:22:00.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:22:10.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10037 ms) 2024-09-14T11:22:10.622 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:22:13.649 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3028 ms) 2024-09-14T11:22:13.650 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:22:26.693 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13043 ms) 2024-09-14T11:22:26.693 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:22:30.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4025 ms) 2024-09-14T11:22:30.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:22:36.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6030 ms) 2024-09-14T11:22:36.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5033 ms) 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue (96396 ms total) 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (96396 ms total) 2024-09-14T11:22:41.781 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-14T11:22:41.784 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:41.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:41.831 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:22:41.832 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:22:41.832 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:22:41.886 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:41.886 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:41.887 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:22:41.887 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:43.790 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:22:43.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:22:43.807 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.add (17 ms) 2024-09-14T11:22:43.807 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:22:43.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:22:43.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:22:43.865 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.rm (54 ms) 2024-09-14T11:22:43.865 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:22:43.886 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.list (20 ms) 2024-09-14T11:22:43.886 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount (96 ms total) 2024-09-14T11:22:43.886 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:22:43.886 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:44.795 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (2908 ms total) 2024-09-14T11:22:44.795 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-14T11:22:44.799 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:44.799 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:44.841 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:22:44.842 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:22:44.842 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:22:44.934 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:44.934 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:44.935 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:22:44.935 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:46.805 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:22:46.805 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:22:46.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_queue (17 ms) 2024-09-14T11:22:46.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:22:46.825 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-14T11:22:46.825 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:22:46.829 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-14T11:22:46.830 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:22:46.831 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:22:46.831 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:22:46.834 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-14T11:22:46.834 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:22:46.836 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:22:46.836 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log (30 ms total) 2024-09-14T11:22:46.836 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:22:46.836 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:47.812 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 6 tests from 1 test suite ran. (2877 ms total) 2024-09-14T11:22:47.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 6 tests. 2024-09-14T11:22:47.815 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:47.816 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:47.858 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:22:47.859 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:22:47.859 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:22:47.956 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:47.956 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:22:47.956 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:47.956 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.957 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.958 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.959 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.960 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.961 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.962 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.963 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.964 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.965 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.966 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.967 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.968 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.969 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.970 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.971 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.972 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.973 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.974 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.975 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.976 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.977 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.978 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.979 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.980 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.981 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.982 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.983 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.984 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.985 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:47.986 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.987 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.988 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.989 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.990 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.991 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.992 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.993 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.994 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.995 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:47.996 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.997 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:47.998 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:47.999 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.000 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.001 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-14T11:22:48.002 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-14T11:22:48.003 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.004 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.005 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-14T11:22:48.006 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.007 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.008 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.009 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.010 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.011 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.012 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.013 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.014 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.015 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.016 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.017 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.018 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.019 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.020 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.021 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.022 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.023 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.024 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.025 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.026 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:48.027 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.028 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.029 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.030 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.031 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.032 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.033 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.034 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.035 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.036 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.037 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.038 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.039 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.040 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.041 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.042 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.043 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.044 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.045 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.046 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.047 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.048 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.049 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.050 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.051 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.052 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.053 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.054 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.055 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.056 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.057 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.058 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.059 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.060 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.061 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.062 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.063 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.064 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.065 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.066 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.067 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.068 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.069 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.070 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.071 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.072 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.073 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.074 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.075 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.076 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.077 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.078 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.079 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.080 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.081 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.082 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.083 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.084 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.085 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.086 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.087 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.088 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.089 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.090 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.091 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.092 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.093 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.094 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.095 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.096 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.097 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.098 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.099 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.100 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.101 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.102 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.103 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.104 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.105 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.106 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.107 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.108 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.109 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.110 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.111 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.112 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.113 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:22:48.114 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.115 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:22:48.116 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.117 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.118 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.119 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.120 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.121 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.122 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.123 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.124 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.125 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.126 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.127 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.128 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.129 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.130 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.131 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.132 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.133 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.134 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.135 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.136 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.137 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.138 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.139 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.140 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.141 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.142 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.143 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.144 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:22:48.145 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.146 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.147 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-14T11:22:48.148 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-14T11:22:48.149 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:22:48.150 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:48.150 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2024-09-14T11:22:48.150 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-14T11:22:48.150 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:48.150 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:48.189 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:22:48.190 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:22:48.191 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:22:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.342+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 realm 2024-09-14T11:22:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.344+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.345+0000 7f1c8fc96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:48.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.345+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.345+0000 7f1c8fc96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:48.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.345+0000 7f1c8fc96800 20 searching for the correct realm 2024-09-14T11:22:48.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.348+0000 7f1c8cf7f640 0 -- 172.21.15.94:0/79766071 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f1c80077ae0 msgr2=0x7f1c8005f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:48.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.556+0000 7f1c8d780640 0 -- 172.21.15.94:0/79766071 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f1c840ae930 msgr2=0x7f1c84088400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:48.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:22:48.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.763+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 zone default found 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 4 Realm: () 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:22:48.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 zonegroup default 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.764+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.765+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.765+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.765+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.765+0000 7f1c8fc96800 20 started sync module instance, tier type = 2024-09-14T11:22:48.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.765+0000 7f1c8fc96800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=0 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=1 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=2 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=3 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=4 2024-09-14T11:22:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=5 2024-09-14T11:22:48.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.775+0000 7f1c8fc96800 20 add_watcher() i=6 2024-09-14T11:22:48.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.776+0000 7f1c8fc96800 20 add_watcher() i=7 2024-09-14T11:22:48.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.776+0000 7f1c8fc96800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:48.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.778+0000 7f1b437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:48.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.778+0000 7f1c8fc96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:48.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.778+0000 7f1c8fc96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:48.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.778+0000 7f1c8fc96800 5 note: GC not initialized 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1b427e4640 20 reqs_thread_entry: start 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1c8fc96800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1c8fc96800 20 Filter name: none 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1ab3fff640 20 reqs_thread_entry: start 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1c8fc96800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.779+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:22:48.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache get: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= : miss 2024-09-14T11:22:48.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 20 rados->read ofs=0 len=0 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= info.flags=0x0 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 adding default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= to cache LRU end 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache get: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= : hit (negative entry) 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.780+0000 7f1c8fc96800 10 cache get: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= : hit (negative entry) 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1c8fc96800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1c8fc96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:22:48.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94715745578048 notifier 5309 bl.length()=697 2024-09-14T11:22:48.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:22:48.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.782+0000 7f1b70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1c8fc96800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1c8fc96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94715745569952 notifier 5309 bl.length()=194 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:22:48.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.784+0000 7f1b70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1c8fc96800 10 cache put: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= info.flags=0x7 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1c8fc96800 10 moving default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= to cache LRU end 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1c8fc96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:xwJYADipfDkKQqGC3PFq3JccwTs=, ofs0, ns] 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856707 cookie 94715745588736 notifier 5309 bl.length()=203 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= info.flags=0x7 2024-09-14T11:22:48.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.786+0000 7f1b70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+xwJYADipfDkKQqGC3PFq3JccwTs= to cache LRU end 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "librgw test user", 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "librgw@example.com", 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-14T11:22:48.785 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "xwJYADipfDkKQqGC3PFq3JccwTs=", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "p6B1c1XaLnbOcs+/toMJv6Ztb1j9UbrQ1Zci3+uSlovPgpwxqN64Kg==", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:22:48.781390Z" 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-14T11:22:48.786 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-14T11:22:48.787 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:22:48.781379Z", 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:22:48.788 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:22:48.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.787+0000 7f1b437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:48.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.790+0000 7f1c8fc96800 20 remove_watcher() i=0 2024-09-14T11:22:48.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.790+0000 7f1c8fc96800 2 removed watcher, disabling cache 2024-09-14T11:22:48.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.791+0000 7f1c8fc96800 20 remove_watcher() i=1 2024-09-14T11:22:48.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.792+0000 7f1c8fc96800 20 remove_watcher() i=2 2024-09-14T11:22:48.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.793+0000 7f1c8fc96800 20 remove_watcher() i=3 2024-09-14T11:22:48.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.794+0000 7f1c8fc96800 20 remove_watcher() i=4 2024-09-14T11:22:48.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.795+0000 7f1c8fc96800 20 remove_watcher() i=5 2024-09-14T11:22:48.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.796+0000 7f1c8fc96800 20 remove_watcher() i=6 2024-09-14T11:22:48.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:48.797+0000 7f1c8fc96800 20 remove_watcher() i=7 2024-09-14T11:22:48.805 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.1 2024-09-14T11:22:48.827 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:22:48.827 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:48.827 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:22:48.827 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:49.412 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (585 ms) 2024-09-14T11:22:49.413 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:22:49.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:22:49.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:49.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:22:49.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:22:49.423 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:22:49.427 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f1 2024-09-14T11:22:49.431 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f2 2024-09-14T11:22:49.433 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:22:49.437 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:22:49.439 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:22:49.442 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:22:49.445 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:22:49.448 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:22:49.451 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:22:49.454 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:22:49.457 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:22:49.460 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (45 ms) 2024-09-14T11:22:49.460 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:22:49.572 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (113 ms) 2024-09-14T11:22:49.598 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:22:49.598 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:22:49.599 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:22:49.599 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-14T11:22:49.599 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:22:49.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (39 ms) 2024-09-14T11:22:49.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:22:49.630 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:22:49.636 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-14T11:22:49.636 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:22:49.636 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:22:49.642 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:22:49.643 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:49.644 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:22:49.645 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:49.645 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:22:49.646 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:22:49.647 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:49.647 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:22:49.648 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:49.648 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:22:49.648 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:22:49.649 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:22:49.649 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:22:49.650 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:22:49.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-14T11:22:49.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (175 ms) 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:22:49.826 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:22:49.827 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:22:49.832 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:22:49.833 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:22:49.836 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:22:49.837 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:22:49.840 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:22:49.841 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:22:49.841 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:22:49.842 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:22:49.843 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:22:49.843 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:22:49.844 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:22:49.846 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:22:49.846 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:22:49.846 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:22:49.846 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:22:49.846 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:49.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:49.848 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:49.848 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:49.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:49.848+0000 7f225ff248c0 -1 shutting down 2024-09-14T11:22:49.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:22:49.849+0000 7f2137e89640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64864, si_uid : 1000, si_addr0x3e80000fd60, si_status0 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29909 ms) 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30927 ms total) 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30928 ms total) 2024-09-14T11:23:19.755 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-14T11:23:19.761 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.2 2024-09-14T11:23:19.785 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:23:19.785 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:19.786 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:23:19.786 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:19.793 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:19.793 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:20.170 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-09-14T11:23:20.170 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:23:20.171 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:23:20.171 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:20.171 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:23:20.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:23:20.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:20.174 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:20.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:23:20.171+0000 7f74d41398c0 -1 shutting down 2024-09-14T11:23:20.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:23:20.173+0000 7f73ac0d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65483, si_uid : 1000, si_addr0x3e80000ffcb, si_status0 2024-09-14T11:23:50.328 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30157 ms) 2024-09-14T11:23:50.328 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30542 ms total) 2024-09-14T11:23:50.329 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:23:50.329 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:50.329 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30542 ms total) 2024-09-14T11:23:50.329 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-14T11:23:50.334 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.3 2024-09-14T11:23:50.357 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:23:50.357 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:50.357 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:23:50.357 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:50.367 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:50.559 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (201 ms) 2024-09-14T11:23:50.559 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:23:50.559 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:23:50.559 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:50.560 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:23:50.560 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:23:50.564 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-14T11:23:50.564 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:23:50.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.627 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:50.628 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:23:50.629 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:50.629 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:23:50.629 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:23:50.630 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:50.630 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:23:50.632 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:50.632 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:23:50.632 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:23:50.633 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:23:50.633 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:50.635 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:23:50.636 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:23:50.641 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:23:50.642 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:23:50.645 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:23:50.646 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:23:50.649 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:23:50.649 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:23:50.650 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:23:50.650 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:23:50.651 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:23:50.651 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:23:50.652 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:23:50.654 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:50.655 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:23:50.656+0000 7f91c09238c0 -1 shutting down 2024-09-14T11:23:50.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:23:50.657+0000 7f9097eb2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66102, si_uid : 1000, si_addr0x3e800010236, si_status0 2024-09-14T11:24:20.971 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30316 ms) 2024-09-14T11:24:20.971 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30613 ms total) 2024-09-14T11:24:20.971 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:24:20.971 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:20.971 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30613 ms total) 2024-09-14T11:24:20.972 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-14T11:24:20.978 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.1 2024-09-14T11:24:21.003 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:24:21.003 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:21.003 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:24:21.003 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:21.210 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (207 ms) 2024-09-14T11:24:21.211 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:21.211 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:21.211 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:21.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:24:21.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:21.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:24:21.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:24:21.227 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-14T11:24:21.238 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-14T11:24:21.245 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-14T11:24:21.253 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-14T11:24:21.261 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-14T11:24:21.269 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-14T11:24:21.277 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-14T11:24:21.284 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-14T11:24:21.292 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-14T11:24:21.301 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-14T11:24:21.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (81 ms) 2024-09-14T11:24:21.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:24:21.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (269 ms) 2024-09-14T11:24:21.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:21.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:21.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:21.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:21.570 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:21.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:24:21.570+0000 7f60b41508c0 -1 shutting down 2024-09-14T11:24:21.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:24:21.571+0000 7f5f8de8d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66721, si_uid : 1000, si_addr0x3e8000104a1, si_status0 2024-09-14T11:24:51.389 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29820 ms) 2024-09-14T11:24:51.390 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30386 ms total) 2024-09-14T11:24:51.390 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:24:51.390 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:51.390 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30386 ms total) 2024-09-14T11:24:51.390 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-14T11:24:51.395 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.2 2024-09-14T11:24:51.420 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:24:51.420 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:51.420 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:24:51.421 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:51.846 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (425 ms) 2024-09-14T11:24:51.846 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:51.846 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:51.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:51.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:24:51.847 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:51.874 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-14T11:24:51.874 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:24:51.881 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-14T11:24:51.889 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-14T11:24:51.897 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-14T11:24:51.905 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-14T11:24:51.912 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-14T11:24:51.920 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-14T11:24:51.928 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-14T11:24:51.937 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-14T11:24:51.948 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-14T11:24:51.955 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-14T11:24:51.955 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (81 ms) 2024-09-14T11:24:51.955 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:24:52.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (264 ms) 2024-09-14T11:24:52.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:52.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:52.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:52.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:52.220 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:52.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:24:52.221+0000 7fcf9b8bc8c0 -1 shutting down 2024-09-14T11:24:52.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:24:52.222+0000 7fce755f9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67340, si_uid : 1000, si_addr0x3e80001070c, si_status0 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29807 ms) 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30606 ms total) 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30606 ms total) 2024-09-14T11:25:22.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-14T11:25:22.033 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.1 2024-09-14T11:25:22.350 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:25:22.350 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:22.351 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:25:22.351 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:22.359 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:22.359 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:22.532 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (181 ms) 2024-09-14T11:25:22.532 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:22.532 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:22.533 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:25:22.542 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-14T11:25:22.542 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:25:22.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:25:22.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:25:22.546 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:25:22.546 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:25:22.598 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-14T11:25:22.599 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (45 ms) 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:25:22.644 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:25:22.645+0000 7ff4f67258c0 -1 shutting down 2024-09-14T11:25:22.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:25:22.646+0000 7ff3ce6f7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67959, si_uid : 1000, si_addr0x3e800010977, si_status0 2024-09-14T11:25:52.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30044 ms) 2024-09-14T11:25:52.689 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30337 ms total) 2024-09-14T11:25:52.689 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:25:52.689 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:52.689 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30337 ms total) 2024-09-14T11:25:52.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-14T11:25:52.695 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.2 2024-09-14T11:25:53.013 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:25:53.013 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:53.013 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:25:53.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:53.021 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:53.021 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:53.393 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (381 ms) 2024-09-14T11:25:53.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:53.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:53.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:25:53.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:25:53.394 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:25:53.398 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:25:53.398 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:25:53.402 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:25:53.402 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (51 ms) 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:25:53.454 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:25:53.459 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:25:53.459 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:25:53.484 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (25 ms) 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:25:53.486+0000 7f885ed218c0 -1 shutting down 2024-09-14T11:25:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:25:53.487+0000 7f8736c9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68578, si_uid : 1000, si_addr0x3e800010be2, si_status0 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30101 ms) 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30573 ms total) 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30573 ms total) 2024-09-14T11:26:23.586 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-14T11:26:23.593 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.1 2024-09-14T11:26:23.619 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:26:23.619 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:23.619 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:26:23.619 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:26:23.619 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-14T11:26:23.620 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-14T11:26:23.620 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:26:23.620 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:23.630 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:23.630 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:23.807 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (188 ms) 2024-09-14T11:26:23.807 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:23.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:23.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:26:23.824 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-09-14T11:26:23.824 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:26:24.406 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_0 2024-09-14T11:26:24.406 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_1 2024-09-14T11:26:24.406 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_2 2024-09-14T11:26:24.406 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_3 2024-09-14T11:26:24.406 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_4 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_5 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_6 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_7 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_8 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_9 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_10 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_11 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_12 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_13 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_14 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_15 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_16 2024-09-14T11:26:24.407 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_17 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_18 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_19 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_20 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_21 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_22 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_23 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_24 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_25 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_26 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_27 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_28 2024-09-14T11:26:24.408 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_29 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_30 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_31 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_32 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_33 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_34 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_35 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_36 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_37 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_38 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_39 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_40 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_41 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_42 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_43 2024-09-14T11:26:24.409 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_44 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_45 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_46 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_47 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_48 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_49 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_50 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_51 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_52 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_53 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_54 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_55 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_56 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_57 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_58 2024-09-14T11:26:24.410 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_59 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_60 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_61 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_62 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_63 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_64 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_65 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_66 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_67 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_68 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_69 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_70 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_71 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_72 2024-09-14T11:26:24.411 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_73 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_74 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_75 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_76 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_77 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_78 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_79 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_80 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_81 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_82 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_83 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_84 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_85 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_86 2024-09-14T11:26:24.412 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_87 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_88 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_89 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_90 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_91 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_92 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_93 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_94 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_95 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_96 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_97 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_98 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_99 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (582 ms) 2024-09-14T11:26:24.413 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:26:24.415 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:26:24.416 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:26:24.417 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:26:24.418 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:26:24.419 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:26:24.420 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:26:24.421 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:26:24.422 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:26:24.423 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:26:24.424 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:26:24.425 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:26:24.426 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:26:24.427 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:26:24.428 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:26:24.429 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:24.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:24.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:26:24.411+0000 7f8dc2f1d8c0 -1 shutting down 2024-09-14T11:26:24.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:26:24.412+0000 7f8c9cc5c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69198, si_uid : 1000, si_addr0x3e800010e4e, si_status0 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29528 ms) 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30319 ms total) 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30319 ms total) 2024-09-14T11:26:53.939 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-14T11:26:53.946 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.2 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:26:53.971 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:53.979 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:53.979 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:54.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-09-14T11:26:54.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:54.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:54.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:26:54.163 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:26:54.166 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:26:54.167 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:26:54.168 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:26:54.169 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:26:54.170 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:26:54.171 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:26:54.172 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:26:54.167+0000 7f35bfcbc8c0 -1 shutting down 2024-09-14T11:26:54.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:26:54.169+0000 7f34999fb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69817, si_uid : 1000, si_addr0x3e8000110b9, si_status0 2024-09-14T11:27:24.556 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30390 ms) 2024-09-14T11:27:24.557 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30584 ms total) 2024-09-14T11:27:24.557 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:27:24.557 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:24.557 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30584 ms total) 2024-09-14T11:27:24.557 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-14T11:27:24.562 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.1 2024-09-14T11:27:24.595 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:27:24.595 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:24.595 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:27:24.595 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:24.605 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:24.605 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:24.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-14T11:27:24.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:24.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:24.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:24.787 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:27:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:27:24.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:27:24.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:27:24.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:27:24.791 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:27:24.792 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:27:24.792 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:27:24.792 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:27:24.793 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:27:24.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-14T11:27:24.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:27:24.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-14T11:27:24.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:27:24.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:27:24.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:27:24.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:27:24.800+0000 7f06157288c0 -1 shutting down 2024-09-14T11:27:24.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:27:24.801+0000 7f04ed588640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70436, si_uid : 1000, si_addr0x3e800011324, si_status0 2024-09-14T11:27:55.116 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30318 ms) 2024-09-14T11:27:55.116 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30522 ms total) 2024-09-14T11:27:55.116 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:27:55.116 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:55.116 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30522 ms total) 2024-09-14T11:27:55.117 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-14T11:27:55.122 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.2 2024-09-14T11:27:55.154 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:27:55.154 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:55.154 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:27:55.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:55.161 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:55.161 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:55.335 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (181 ms) 2024-09-14T11:27:55.335 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:55.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:55.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:55.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:27:55.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:27:55.340 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:27:55.341 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:27:55.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:27:55.347 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-14T11:27:55.347 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:55.374 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-14T11:27:55.374 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:55.374 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:55.374 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:55.374 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:55.375 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:27:55.376+0000 7f87735208c0 -1 shutting down 2024-09-14T11:27:55.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:27:55.377+0000 7f864b399640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71057, si_uid : 1000, si_addr0x3e800011591, si_status0 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30210 ms) 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30430 ms total) 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30430 ms total) 2024-09-14T11:28:25.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-14T11:28:25.591 INFO:tasks.workunit.client.0.smithi094.stdout:phase 6.1 2024-09-14T11:28:25.616 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:28:25.617 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-14T11:28:25.617 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:28:25.617 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:28:25.624 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:25.624 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:26.211 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (595 ms) 2024-09-14T11:28:26.211 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:28:26.212 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:28:26.212 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:28:26.229 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKETS (17 ms) 2024-09-14T11:28:26.229 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:28:26.235 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-14T11:28:26.235 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:28:26.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-14T11:28:26.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:28:26.277 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-14T11:28:26.277 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (24 ms) 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:28:26.301 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:28:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:26.302+0000 7fea8ec878c0 -1 shutting down 2024-09-14T11:28:26.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:26.303+0000 7fe9689c4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71677, si_uid : 1000, si_addr0x3e8000117fd, si_status0 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30024 ms) 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW (30709 ms total) 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (30709 ms total) 2024-09-14T11:28:56.326 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-14T11:28:56.333 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:28:56.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:28:56.377 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:28:56.378 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:28:56.379 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:28:56.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:28:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:56.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.532+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.533+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.533+0000 7fa6a132a800 20 realm 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.533+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.534+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.534+0000 7fa6a132a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.534+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.534+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:56.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.534+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.535+0000 7fa6a132a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.535+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.535+0000 7fa6a132a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.535+0000 7fa6a132a800 20 searching for the correct realm 2024-09-14T11:28:56.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.538+0000 7fa694816640 0 -- 172.21.15.94:0/541058847 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fa690096420 msgr2=0x7fa690096820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:56.541+0000 7fa69d017640 0 -- 172.21.15.94:0/541058847 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa688009040 msgr2=0x7fa688068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:57.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.149+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:57.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 zone default found 2024-09-14T11:28:57.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 4 Realm: () 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 zonegroup default 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.150+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 started sync module instance, tier type = 2024-09-14T11:28:57.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.151+0000 7fa6a132a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=0 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=1 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=2 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=3 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=4 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=5 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.161+0000 7fa6a132a800 20 add_watcher() i=6 2024-09-14T11:28:57.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.162+0000 7fa6a132a800 20 add_watcher() i=7 2024-09-14T11:28:57.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.162+0000 7fa6a132a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:57.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa5537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa6a132a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa6a132a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa6a132a800 5 note: GC not initialized 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa5527e4640 20 reqs_thread_entry: start 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa6a132a800 20 init_complete bucket index max shards: 11 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa6a132a800 20 Filter name: none 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.164+0000 7fa4c3fff640 20 reqs_thread_entry: start 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:57.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:28:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:28:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:57.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.165+0000 7fa6a132a800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:28:57.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:28:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa6a132a800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa6a132a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:28:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856712 cookie 94898339476704 notifier 5778 bl.length()=677 2024-09-14T11:28:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa580ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:28:57.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.167+0000 7fa580ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa6a132a800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa6a132a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 94898339469280 notifier 5778 bl.length()=187 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa580ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:28:57.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.169+0000 7fa580ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa6a132a800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa6a132a800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa6a132a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa580ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856714 cookie 94898339469280 notifier 5778 bl.length()=197 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa580ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:28:57.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.171+0000 7fa580ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "maven test user", 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "sigv4@example.com", 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-14T11:28:57.170 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-maven", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:28:57.166649Z" 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:28:57.171 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-14T11:28:57.172 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:28:57.166635Z", 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.173+0000 7fa5537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.175+0000 7fa6a132a800 20 remove_watcher() i=0 2024-09-14T11:28:57.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.175+0000 7fa6a132a800 2 removed watcher, disabling cache 2024-09-14T11:28:57.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.176+0000 7fa6a132a800 20 remove_watcher() i=1 2024-09-14T11:28:57.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.177+0000 7fa6a132a800 20 remove_watcher() i=2 2024-09-14T11:28:57.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.178+0000 7fa6a132a800 20 remove_watcher() i=3 2024-09-14T11:28:57.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.180+0000 7fa6a132a800 20 remove_watcher() i=4 2024-09-14T11:28:57.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.181+0000 7fa6a132a800 20 remove_watcher() i=5 2024-09-14T11:28:57.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.182+0000 7fa6a132a800 20 remove_watcher() i=6 2024-09-14T11:28:57.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:28:57.183+0000 7fa6a132a800 20 remove_watcher() i=7 2024-09-14T11:28:57.191 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-14T11:28:57.191 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:28:57.191 INFO:tasks.workunit.client.0.smithi094.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:28:57.193 INFO:tasks.workunit.client.0.smithi094.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi094.front.sepia.ceph.com:443 2024-09-14T11:28:57.193 INFO:tasks.workunit.client.0.smithi094.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi094.front.sepia.ceph.com:443 2024-09-14T11:28:57.193 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:28:57.193 INFO:tasks.workunit.client.0.smithi094.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:28:57.193 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw clean package 2024-09-14T11:28:57.201 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:28:58.586 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-14T11:28:58.707 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:28:58.785 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 70 kB/s) 2024-09-14T11:28:58.796 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:28:58.835 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:28:58.842 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:28:58.861 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:28:58.884 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:28:58.884 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:28:58.884 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:28:58.884 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-14T11:28:58.884 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:28:58.887 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:28:58.902 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:28:58.908 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:28:58.923 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T11:28:58.927 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:28:58.942 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:28:58.949 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:28:58.964 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:28:58.975 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:28:58.991 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T11:28:58.997 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:28:59.011 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:28:59.014 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:28:59.028 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:28:59.030 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:28:59.045 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-14T11:28:59.049 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:28:59.063 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.5 MB/s) 2024-09-14T11:28:59.068 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:28:59.083 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.2 MB/s) 2024-09-14T11:28:59.089 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:28:59.103 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 701 kB/s) 2024-09-14T11:28:59.109 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:28:59.125 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-14T11:28:59.131 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:28:59.145 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 380 kB/s) 2024-09-14T11:28:59.148 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:28:59.162 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.6 MB/s) 2024-09-14T11:28:59.166 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:28:59.181 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:28:59.185 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:28:59.200 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:28:59.205 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:28:59.219 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-14T11:28:59.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:28:59.238 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 3.0 MB/s) 2024-09-14T11:28:59.245 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:28:59.260 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:28:59.261 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:28:59.276 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-14T11:28:59.278 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:28:59.293 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-14T11:28:59.296 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:28:59.311 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:28:59.315 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:28:59.330 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:28:59.343 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:28:59.357 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 435 kB/s) 2024-09-14T11:28:59.359 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:28:59.373 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.5 MB/s) 2024-09-14T11:28:59.378 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:28:59.392 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.4 MB/s) 2024-09-14T11:28:59.399 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:28:59.413 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 286 kB/s) 2024-09-14T11:28:59.415 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:28:59.430 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-14T11:28:59.449 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:28:59.464 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 260 kB/s) 2024-09-14T11:28:59.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:28:59.482 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 230 kB/s) 2024-09-14T11:28:59.486 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:28:59.500 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 783 kB/s) 2024-09-14T11:28:59.504 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:28:59.518 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 120 kB/s) 2024-09-14T11:28:59.522 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:28:59.536 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-14T11:28:59.540 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:28:59.553 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-14T11:28:59.556 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:28:59.570 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-14T11:28:59.572 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:28:59.587 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-14T11:28:59.589 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:28:59.603 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-14T11:28:59.605 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:28:59.619 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:28:59.623 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:28:59.639 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-14T11:28:59.643 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:28:59.657 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:28:59.660 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:28:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 529 kB/s) 2024-09-14T11:28:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:28:59.692 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T11:28:59.695 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:28:59.709 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-14T11:28:59.712 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:28:59.726 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 314 kB/s) 2024-09-14T11:28:59.729 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:28:59.743 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:28:59.746 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:28:59.760 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:28:59.764 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:28:59.778 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-14T11:28:59.782 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:28:59.795 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 229 kB/s) 2024-09-14T11:28:59.799 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:28:59.813 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-14T11:28:59.817 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:28:59.831 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 314 kB/s) 2024-09-14T11:28:59.832 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:28:59.846 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:28:59.849 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:28:59.864 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-14T11:28:59.866 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:28:59.881 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-14T11:28:59.885 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:28:59.899 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-14T11:28:59.902 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:28:59.916 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:28:59.920 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:28:59.934 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:28:59.937 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:28:59.951 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-14T11:28:59.954 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:28:59.988 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:28:59.993 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:29:00.007 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.2 MB/s) 2024-09-14T11:29:00.011 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:29:00.025 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:29:00.026 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:29:00.042 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:29:00.046 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:29:00.061 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T11:29:00.065 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:29:00.080 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-14T11:29:00.082 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:29:00.098 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-14T11:29:00.103 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:29:00.117 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:29:00.119 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:29:00.133 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:29:00.135 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:29:00.149 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:29:00.152 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:29:00.165 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 245 kB/s) 2024-09-14T11:29:00.167 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:29:00.181 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:29:00.183 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:29:00.197 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:29:00.199 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:29:00.213 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T11:29:00.215 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:29:00.229 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 246 kB/s) 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:29:00.309 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:29:00.310 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:29:00.312 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:29:00.325 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 233 kB/s) 2024-09-14T11:29:00.327 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:29:00.341 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:29:00.343 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:29:00.357 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:29:00.358 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:29:00.373 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:29:00.389 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:29:00.466 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 43 MB/s) 2024-09-14T11:29:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:29:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:29:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:29:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:29:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:29:00.484 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.1 MB/s) 2024-09-14T11:29:00.485 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:29:00.498 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 535 kB/s) 2024-09-14T11:29:00.498 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:29:00.517 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/71 kB Progress (2): 1.4/71 kB | 1.4/98 kB Progress (2): 2.8/71 kB | 1.4/98 kB Progress (2): 2.8/71 kB | 2.8/98 kB Progress (2): 4.1/71 kB | 2.8/98 kB Progress (2): 4.1/71 kB | 4.1/98 kB Progress (2): 5.5/71 kB | 4.1/98 kB Progress (2): 5.5/71 kB | 5.5/98 kB Progress (2): 6.9/71 kB | 5.5/98 kB Progress (2): 6.9/71 kB | 6.9/98 kB Progress (2): 8.3/71 kB | 6.9/98 kB Progress (3): 8.3/71 kB | 6.9/98 kB | 1.4/49 kB Progress (3): 8.3/71 kB | 8.3/98 kB | 1.4/49 kB Progress (3): 9.7/71 kB | 8.3/98 kB | 1.4/49 kB Progress (3): 9.7/71 kB | 9.7/98 kB | 1.4/49 kB Progress (3): 9.7/71 kB | 9.7/98 kB | 2.8/49 kB Progress (3): 11/71 kB | 9.7/98 kB | 2.8/49 kB Progress (3): 11/71 kB | 11/98 kB | 2.8/49 kB Progress (3): 11/71 kB | 11/98 kB | 4.1/49 kB Progress (3): 11/71 kB | 12/98 kB | 4.1/49 kB Progress (3): 12/71 kB | 12/98 kB | 4.1/49 kB Progress (3): 12/71 kB | 14/98 kB | 4.1/49 kB Progress (3): 12/71 kB | 14/98 kB | 5.5/49 kB Progress (3): 12/71 kB | 15/98 kB | 5.5/49 kB Progress (3): 12/71 kB | 15/98 kB | 6.9/49 kB Progress (3): 14/71 kB | 15/98 kB | 6.9/49 kB Progress (3): 14/71 kB | 15/98 kB | 8.3/49 kB Progress (3): 14/71 kB | 16/98 kB | 8.3/49 kB Progress (3): 14/71 kB | 16/98 kB | 9.7/49 kB Progress (3): 15/71 kB | 16/98 kB | 9.7/49 kB Progress (3): 15/71 kB | 16/98 kB | 11/49 kB Progress (3): 17/71 kB | 16/98 kB | 11/49 kB Progress (3): 17/71 kB | 16/98 kB | 12/49 kB Progress (4): 17/71 kB | 16/98 kB | 12/49 kB | 16/782 kB Progress (4): 17/71 kB | 18/98 kB | 12/49 kB | 16/782 kB Progress (4): 18/71 kB | 18/98 kB | 12/49 kB | 16/782 kB Progress (4): 18/71 kB | 18/98 kB | 12/49 kB | 33/782 kB Progress (4): 18/71 kB | 18/98 kB | 14/49 kB | 33/782 kB Progress (4): 19/71 kB | 18/98 kB | 14/49 kB | 33/782 kB Progress (4): 19/71 kB | 19/98 kB | 14/49 kB | 33/782 kB Progress (4): 21/71 kB | 19/98 kB | 14/49 kB | 33/782 kB Progress (4): 21/71 kB | 19/98 kB | 14/49 kB | 49/782 kB Progress (4): 21/71 kB | 19/98 kB | 15/49 kB | 49/782 kB Progress (4): 22/71 kB | 19/98 kB | 15/49 kB | 49/782 kB Progress (4): 22/71 kB | 21/98 kB | 15/49 kB | 49/782 kB Progress (4): 23/71 kB | 21/98 kB | 15/49 kB | 49/782 kB Progress (4): 23/71 kB | 21/98 kB | 15/49 kB | 66/782 kB Progress (4): 25/71 kB | 21/98 kB | 15/49 kB | 66/782 kB Progress (4): 25/71 kB | 21/98 kB | 16/49 kB | 66/782 kB Progress (4): 26/71 kB | 21/98 kB | 16/49 kB | 66/782 kB Progress (4): 26/71 kB | 22/98 kB | 16/49 kB | 66/782 kB Progress (4): 28/71 kB | 22/98 kB | 16/49 kB | 66/782 kB Progress (4): 28/71 kB | 22/98 kB | 16/49 kB | 82/782 kB Progress (4): 28/71 kB | 22/98 kB | 18/49 kB | 82/782 kB Progress (4): 29/71 kB | 22/98 kB | 18/49 kB | 82/782 kB Progress (4): 29/71 kB | 23/98 kB | 18/49 kB | 82/782 kB Progress (4): 29/71 kB | 23/98 kB | 18/49 kB | 98/782 kB Progress (4): 30/71 kB | 23/98 kB | 18/49 kB | 98/782 kB Progress (4): 30/71 kB | 23/98 kB | 19/49 kB | 98/782 kB Progress (5): 30/71 kB | 23/98 kB | 19/49 kB | 98/782 kB | 1.4/16 kB Progress (5): 30/71 kB | 23/98 kB | 21/49 kB | 98/782 kB | 1.4/16 kB Progress (5): 30/71 kB | 23/98 kB | 21/49 kB | 115/782 kB | 1.4/16 kB Progress (5): 30/71 kB | 23/98 kB | 22/49 kB | 115/782 kB | 1.4/16 kB Progress (5): 30/71 kB | 25/98 kB | 22/49 kB | 115/782 kB | 1.4/16 kB Progress (5): 30/71 kB | 25/98 kB | 22/49 kB | 115/782 kB | 2.8/16 kB Progress (5): 30/71 kB | 26/98 kB | 22/49 kB | 115/782 kB | 2.8/16 kB Progress (5): 30/71 kB | 26/98 kB | 23/49 kB | 115/782 kB | 2.8/16 kB Progress (5): 30/71 kB | 27/98 kB | 23/49 kB | 115/782 kB | 2.8/16 kB Progress (5): 30/71 kB | 27/98 kB | 25/49 kB | 115/782 kB | 2.8/16 kB Progress (5): 30/71 kB | 27/98 kB | 25/49 kB | 115/782 kB | 4.1/16 kB Progress (5): 30/71 kB | 27/98 kB | 26/49 kB | 115/782 kB | 4.1/16 kB Progress (5): 30/71 kB | 27/98 kB | 26/49 kB | 131/782 kB | 4.1/16 kB Progress (5): 30/71 kB | 27/98 kB | 27/49 kB | 131/782 kB | 4.1/16 kB Progress (5): 30/71 kB | 27/98 kB | 27/49 kB | 131/782 kB | 5.5/16 kB Progress (5): 30/71 kB | 29/98 kB | 27/49 kB | 131/782 kB | 5.5/16 kB Progress (5): 30/71 kB | 29/98 kB | 27/49 kB | 147/782 kB | 5.5/16 kB Progress (5): 30/71 kB | 29/98 kB | 27/49 kB | 147/782 kB | 6.9/16 kB Progress (5): 30/71 kB | 29/98 kB | 29/49 kB | 147/782 kB | 6.9/16 kB Progress (5): 30/71 kB | 29/98 kB | 29/49 kB | 147/782 kB | 8.3/16 kB Progress (5): 30/71 kB | 30/98 kB | 29/49 kB | 147/782 kB | 8.3/16 kB Progress (5): 30/71 kB | 30/98 kB | 29/49 kB | 147/782 kB | 9.7/16 kB Progress (5): 30/71 kB | 30/98 kB | 29/49 kB | 164/782 kB | 9.7/16 kB Progress (5): 30/71 kB | 30/98 kB | 29/49 kB | 164/782 kB | 11/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 164/782 kB | 11/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 164/782 kB | 12/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 180/782 kB | 12/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 180/782 kB | 14/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 180/782 kB | 15/16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 180/782 kB | 16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 197/782 kB | 16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 213/782 kB | 16 kB Progress (5): 30/71 kB | 30/98 kB | 30/49 kB | 229/782 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 316 kB/s) 2024-09-14T11:29:00.518 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:29:00.527 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 246/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 262/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 278/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 295/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 311/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 328/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 344/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 360/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 377/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 393/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 410/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 426/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 442/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 459/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 475/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 491/782 kB Progress (4): 30/71 kB | 30/98 kB | 30/49 kB | 508/782 kB Progress (4): 32/71 kB | 30/98 kB | 30/49 kB | 508/782 kB Progress (4): 32/71 kB | 32/98 kB | 30/49 kB | 508/782 kB Progress (4): 33/71 kB | 32/98 kB | 30/49 kB | 508/782 kB Progress (4): 34/71 kB | 32/98 kB | 30/49 kB | 508/782 kB Progress (4): 34/71 kB | 32/98 kB | 30/49 kB | 524/782 kB Progress (4): 34/71 kB | 33/98 kB | 30/49 kB | 524/782 kB Progress (4): 36/71 kB | 33/98 kB | 30/49 kB | 524/782 kB Progress (4): 36/71 kB | 34/98 kB | 30/49 kB | 524/782 kB Progress (4): 36/71 kB | 34/98 kB | 30/49 kB | 541/782 kB Progress (4): 36/71 kB | 34/98 kB | 32/49 kB | 541/782 kB Progress (4): 36/71 kB | 34/98 kB | 33/49 kB | 541/782 kB Progress (4): 36/71 kB | 34/98 kB | 33/49 kB | 557/782 kB Progress (4): 36/71 kB | 34/98 kB | 34/49 kB | 557/782 kB Progress (4): 37/71 kB | 34/98 kB | 34/49 kB | 557/782 kB Progress (4): 37/71 kB | 36/98 kB | 34/49 kB | 557/782 kB Progress (4): 37/71 kB | 36/98 kB | 36/49 kB | 557/782 kB Progress (4): 37/71 kB | 37/98 kB | 36/49 kB | 557/782 kB Progress (4): 39/71 kB | 37/98 kB | 36/49 kB | 557/782 kB Progress (4): 39/71 kB | 38/98 kB | 36/49 kB | 557/782 kB Progress (4): 40/71 kB | 38/98 kB | 36/49 kB | 557/782 kB Progress (4): 40/71 kB | 40/98 kB | 36/49 kB | 557/782 kB Progress (4): 41/71 kB | 40/98 kB | 36/49 kB | 557/782 kB Progress (4): 41/71 kB | 40/98 kB | 37/49 kB | 557/782 kB Progress (4): 41/71 kB | 40/98 kB | 37/49 kB | 573/782 kB Progress (4): 43/71 kB | 40/98 kB | 37/49 kB | 573/782 kB Progress (4): 43/71 kB | 41/98 kB | 37/49 kB | 573/782 kB Progress (4): 43/71 kB | 41/98 kB | 38/49 kB | 573/782 kB Progress (4): 44/71 kB | 41/98 kB | 38/49 kB | 573/782 kB Progress (4): 44/71 kB | 41/98 kB | 40/49 kB | 573/782 kB Progress (4): 44/71 kB | 41/98 kB | 40/49 kB | 590/782 kB Progress (4): 44/71 kB | 41/98 kB | 41/49 kB | 590/782 kB Progress (4): 44/71 kB | 41/98 kB | 43/49 kB | 590/782 kB Progress (4): 44/71 kB | 41/98 kB | 43/49 kB | 606/782 kB Progress (4): 46/71 kB | 41/98 kB | 43/49 kB | 606/782 kB Progress (4): 46/71 kB | 41/98 kB | 44/49 kB | 606/782 kB Progress (4): 47/71 kB | 41/98 kB | 44/49 kB | 606/782 kB Progress (4): 47/71 kB | 43/98 kB | 44/49 kB | 606/782 kB Progress (4): 47/71 kB | 43/98 kB | 45/49 kB | 606/782 kB Progress (4): 47/71 kB | 43/98 kB | 45/49 kB | 623/782 kB Progress (4): 47/71 kB | 44/98 kB | 45/49 kB | 623/782 kB Progress (4): 48/71 kB | 44/98 kB | 45/49 kB | 623/782 kB Progress (4): 48/71 kB | 45/98 kB | 45/49 kB | 623/782 kB Progress (4): 50/71 kB | 45/98 kB | 45/49 kB | 623/782 kB Progress (4): 50/71 kB | 47/98 kB | 45/49 kB | 623/782 kB Progress (4): 50/71 kB | 47/98 kB | 45/49 kB | 639/782 kB Progress (4): 50/71 kB | 48/98 kB | 45/49 kB | 639/782 kB Progress (4): 51/71 kB | 48/98 kB | 45/49 kB | 639/782 kB Progress (4): 51/71 kB | 49/98 kB | 45/49 kB | 639/782 kB Progress (4): 51/71 kB | 51/98 kB | 45/49 kB | 639/782 kB Progress (4): 51/71 kB | 51/98 kB | 45/49 kB | 655/782 kB Progress (4): 51/71 kB | 52/98 kB | 45/49 kB | 655/782 kB Progress (4): 51/71 kB | 53/98 kB | 45/49 kB | 655/782 kB Progress (4): 51/71 kB | 55/98 kB | 45/49 kB | 655/782 kB Progress (4): 51/71 kB | 55/98 kB | 45/49 kB | 672/782 kB Progress (4): 51/71 kB | 56/98 kB | 45/49 kB | 672/782 kB Progress (4): 51/71 kB | 56/98 kB | 47/49 kB | 672/782 kB Progress (4): 51/71 kB | 56/98 kB | 47/49 kB | 688/782 kB Progress (4): 51/71 kB | 56/98 kB | 48/49 kB | 688/782 kB Progress (4): 52/71 kB | 56/98 kB | 48/49 kB | 688/782 kB Progress (4): 52/71 kB | 56/98 kB | 49 kB | 688/782 kB Progress (4): 52/71 kB | 57/98 kB | 49 kB | 688/782 kB Progress (4): 54/71 kB | 57/98 kB | 49 kB | 688/782 kB Progress (4): 54/71 kB | 59/98 kB | 49 kB | 688/782 kB Progress (4): 54/71 kB | 59/98 kB | 49 kB | 704/782 kB Progress (4): 54/71 kB | 60/98 kB | 49 kB | 704/782 kB Progress (4): 55/71 kB | 60/98 kB | 49 kB | 704/782 kB Progress (4): 55/71 kB | 62/98 kB | 49 kB | 704/782 kB Progress (4): 57/71 kB | 62/98 kB | 49 kB | 704/782 kB Progress (4): 58/71 kB | 62/98 kB | 49 kB | 704/782 kB Progress (4): 58/71 kB | 62/98 kB | 49 kB | 721/782 kB Progress (4): 59/71 kB | 62/98 kB | 49 kB | 721/782 kB Progress (4): 61/71 kB | 62/98 kB | 49 kB | 721/782 kB Progress (4): 61/71 kB | 62/98 kB | 49 kB | 737/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-14T11:29:00.527 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:29:00.528 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 61/71 kB | 62/98 kB | 754/782 kB Progress (3): 61/71 kB | 62/98 kB | 770/782 kB Progress (3): 61/71 kB | 62/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 13 MB/s) 2024-09-14T11:29:00.528 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:29:00.533 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 61/71 kB | 62/98 kB | 1.4/11 kB Progress (3): 61/71 kB | 62/98 kB | 2.8/11 kB Progress (3): 61/71 kB | 62/98 kB | 4.1/11 kB Progress (3): 61/71 kB | 62/98 kB | 5.5/11 kB Progress (3): 61/71 kB | 62/98 kB | 6.9/11 kB Progress (3): 61/71 kB | 62/98 kB | 8.3/11 kB Progress (3): 61/71 kB | 62/98 kB | 9.7/11 kB Progress (3): 61/71 kB | 62/98 kB | 11/11 kB Progress (3): 61/71 kB | 62/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 175 kB/s) 2024-09-14T11:29:00.533 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 61/71 kB | 63/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:29:00.534 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 62/71 kB | 63/98 kB Progress (2): 63/71 kB | 63/98 kB Progress (2): 63/71 kB | 63/98 kB Progress (2): 71 kB | 63/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.1 MB/s) 2024-09-14T11:29:00.534 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:29:00.537 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-14T11:29:00.537 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:29:00.544 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15/205 kB Progress (1): 31/205 kB Progress (1): 48/205 kB Progress (1): 64/205 kB Progress (1): 77/205 kB Progress (2): 77/205 kB | 16/30 kB Progress (2): 94/205 kB | 16/30 kB Progress (2): 110/205 kB | 16/30 kB Progress (2): 110/205 kB | 30 kB Progress (2): 127/205 kB | 30 kB Progress (2): 143/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 397 kB/s) 2024-09-14T11:29:00.544 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:29:00.546 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 159/205 kB Progress (1): 176/205 kB Progress (1): 192/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.7 MB/s) 2024-09-14T11:29:00.546 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:29:00.551 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/798 kB Progress (2): 16/798 kB | 16/81 kB Progress (2): 33/798 kB | 16/81 kB Progress (3): 33/798 kB | 16/81 kB | 13 kB Progress (3): 49/798 kB | 16/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 161 kB/s) 2024-09-14T11:29:00.551 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:29:00.564 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 62/798 kB | 16/81 kB Progress (3): 62/798 kB | 16/81 kB | 15/182 kB Progress (3): 62/798 kB | 33/81 kB | 15/182 kB Progress (3): 62/798 kB | 33/81 kB | 31/182 kB Progress (4): 62/798 kB | 33/81 kB | 31/182 kB | 15/151 kB Progress (4): 78/798 kB | 33/81 kB | 31/182 kB | 15/151 kB Progress (4): 78/798 kB | 33/81 kB | 31/182 kB | 31/151 kB Progress (4): 78/798 kB | 33/81 kB | 31/182 kB | 48/151 kB Progress (4): 78/798 kB | 33/81 kB | 48/182 kB | 48/151 kB Progress (4): 78/798 kB | 49/81 kB | 48/182 kB | 48/151 kB Progress (4): 95/798 kB | 49/81 kB | 48/182 kB | 48/151 kB Progress (4): 95/798 kB | 49/81 kB | 48/182 kB | 64/151 kB Progress (4): 95/798 kB | 49/81 kB | 48/182 kB | 79/151 kB Progress (4): 111/798 kB | 49/81 kB | 48/182 kB | 79/151 kB Progress (4): 111/798 kB | 49/81 kB | 48/182 kB | 95/151 kB Progress (4): 111/798 kB | 49/81 kB | 48/182 kB | 111/151 kB Progress (4): 111/798 kB | 49/81 kB | 48/182 kB | 128/151 kB Progress (4): 111/798 kB | 66/81 kB | 48/182 kB | 128/151 kB Progress (4): 111/798 kB | 66/81 kB | 64/182 kB | 128/151 kB Progress (4): 128/798 kB | 66/81 kB | 64/182 kB | 128/151 kB Progress (4): 128/798 kB | 66/81 kB | 64/182 kB | 144/151 kB Progress (4): 128/798 kB | 66/81 kB | 64/182 kB | 151 kB Progress (4): 144/798 kB | 66/81 kB | 64/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.6 MB/s) 2024-09-14T11:29:00.564 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:29:00.565 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 144/798 kB | 81 kB | 64/182 kB Progress (4): 144/798 kB | 81 kB | 64/182 kB | 16/27 kB Progress (4): 160/798 kB | 81 kB | 64/182 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 846 kB/s) 2024-09-14T11:29:00.565 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:29:00.566 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 160/798 kB | 64/182 kB | 27 kB Progress (3): 177/798 kB | 64/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 281 kB/s) 2024-09-14T11:29:00.566 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:29:00.575 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 193/798 kB | 64/182 kB Progress (2): 209/798 kB | 64/182 kB Progress (2): 209/798 kB | 81/182 kB Progress (2): 209/798 kB | 97/182 kB Progress (2): 209/798 kB | 111/182 kB Progress (2): 226/798 kB | 111/182 kB Progress (2): 226/798 kB | 127/182 kB Progress (2): 242/798 kB | 127/182 kB Progress (2): 242/798 kB | 143/182 kB Progress (2): 259/798 kB | 143/182 kB Progress (2): 275/798 kB | 143/182 kB Progress (2): 275/798 kB | 160/182 kB Progress (2): 291/798 kB | 160/182 kB Progress (2): 308/798 kB | 160/182 kB Progress (2): 308/798 kB | 176/182 kB Progress (2): 324/798 kB | 176/182 kB Progress (2): 324/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:29:00.575 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 341/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:29:00.579 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 357/798 kB Progress (1): 373/798 kB Progress (1): 390/798 kB Progress (1): 406/798 kB Progress (1): 422/798 kB Progress (1): 439/798 kB Progress (1): 455/798 kB Progress (1): 472/798 kB Progress (2): 472/798 kB | 16/385 kB Progress (2): 488/798 kB | 16/385 kB Progress (3): 488/798 kB | 16/385 kB | 16/30 kB Progress (3): 488/798 kB | 16/385 kB | 30 kB Progress (3): 488/798 kB | 33/385 kB | 30 kB Progress (4): 488/798 kB | 33/385 kB | 30 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 273 kB/s) 2024-09-14T11:29:00.580 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:29:00.580 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 120 kB/s) 2024-09-14T11:29:00.580 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:29:00.589 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 488/798 kB | 49/385 kB Progress (2): 488/798 kB | 65/385 kB Progress (2): 488/798 kB | 82/385 kB Progress (2): 504/798 kB | 82/385 kB Progress (2): 504/798 kB | 98/385 kB Progress (2): 521/798 kB | 98/385 kB Progress (2): 537/798 kB | 98/385 kB Progress (2): 554/798 kB | 98/385 kB Progress (2): 570/798 kB | 98/385 kB Progress (2): 586/798 kB | 98/385 kB Progress (2): 603/798 kB | 98/385 kB Progress (2): 619/798 kB | 98/385 kB Progress (2): 635/798 kB | 98/385 kB Progress (2): 652/798 kB | 98/385 kB Progress (2): 668/798 kB | 98/385 kB Progress (2): 685/798 kB | 98/385 kB Progress (2): 701/798 kB | 98/385 kB Progress (2): 717/798 kB | 98/385 kB Progress (2): 734/798 kB | 98/385 kB Progress (2): 750/798 kB | 98/385 kB Progress (2): 766/798 kB | 98/385 kB Progress (2): 783/798 kB | 98/385 kB Progress (2): 798 kB | 98/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.7 MB/s) 2024-09-14T11:29:00.589 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:29:00.590 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 98/385 kB | 16/75 kB Progress (2): 98/385 kB | 33/75 kB Progress (2): 98/385 kB | 49/75 kB Progress (2): 114/385 kB | 49/75 kB Progress (2): 114/385 kB | 61/75 kB Progress (2): 114/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 616 kB/s) 2024-09-14T11:29:00.591 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:29:00.605 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (2): 196/385 kB | 16/780 kB Progress (2): 196/385 kB | 33/780 kB Progress (2): 213/385 kB | 33/780 kB Progress (3): 213/385 kB | 33/780 kB | 16/329 kB Progress (3): 213/385 kB | 49/780 kB | 16/329 kB Progress (3): 229/385 kB | 49/780 kB | 16/329 kB Progress (3): 229/385 kB | 49/780 kB | 32/329 kB Progress (3): 229/385 kB | 62/780 kB | 32/329 kB Progress (3): 229/385 kB | 79/780 kB | 32/329 kB Progress (3): 229/385 kB | 95/780 kB | 32/329 kB Progress (3): 229/385 kB | 95/780 kB | 49/329 kB Progress (3): 245/385 kB | 95/780 kB | 49/329 kB Progress (3): 262/385 kB | 95/780 kB | 49/329 kB Progress (3): 262/385 kB | 111/780 kB | 49/329 kB Progress (3): 262/385 kB | 128/780 kB | 49/329 kB Progress (3): 262/385 kB | 128/780 kB | 65/329 kB Progress (3): 278/385 kB | 128/780 kB | 65/329 kB Progress (3): 278/385 kB | 144/780 kB | 65/329 kB Progress (3): 295/385 kB | 144/780 kB | 65/329 kB Progress (3): 295/385 kB | 160/780 kB | 65/329 kB Progress (3): 295/385 kB | 160/780 kB | 81/329 kB Progress (3): 295/385 kB | 177/780 kB | 81/329 kB Progress (3): 295/385 kB | 193/780 kB | 81/329 kB Progress (3): 295/385 kB | 210/780 kB | 81/329 kB Progress (3): 295/385 kB | 210/780 kB | 98/329 kB Progress (3): 295/385 kB | 226/780 kB | 98/329 kB Progress (3): 295/385 kB | 242/780 kB | 98/329 kB Progress (3): 295/385 kB | 242/780 kB | 114/329 kB Progress (3): 295/385 kB | 259/780 kB | 114/329 kB Progress (3): 295/385 kB | 275/780 kB | 114/329 kB Progress (3): 295/385 kB | 292/780 kB | 114/329 kB Progress (3): 295/385 kB | 308/780 kB | 114/329 kB Progress (3): 295/385 kB | 324/780 kB | 114/329 kB Progress (3): 295/385 kB | 341/780 kB | 114/329 kB Progress (3): 295/385 kB | 357/780 kB | 114/329 kB Progress (3): 295/385 kB | 373/780 kB | 114/329 kB Progress (3): 311/385 kB | 373/780 kB | 114/329 kB Progress (3): 311/385 kB | 390/780 kB | 114/329 kB Progress (3): 311/385 kB | 406/780 kB | 114/329 kB Progress (3): 327/385 kB | 406/780 kB | 114/329 kB Progress (3): 327/385 kB | 423/780 kB | 114/329 kB Progress (3): 344/385 kB | 423/780 kB | 114/329 kB Progress (3): 360/385 kB | 423/780 kB | 114/329 kB Progress (3): 360/385 kB | 439/780 kB | 114/329 kB Progress (3): 376/385 kB | 439/780 kB | 114/329 kB Progress (4): 376/385 kB | 439/780 kB | 114/329 kB | 16/501 kB Progress (4): 376/385 kB | 455/780 kB | 114/329 kB | 16/501 kB Progress (4): 385 kB | 455/780 kB | 114/329 kB | 16/501 kB Progress (4): 385 kB | 455/780 kB | 114/329 kB | 33/501 kB Progress (4): 385 kB | 472/780 kB | 114/329 kB | 33/501 kB Progress (4): 385 kB | 472/780 kB | 114/329 kB | 49/501 kB Progress (4): 385 kB | 488/780 kB | 114/329 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.8 MB/s) 2024-09-14T11:29:00.605 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 488/780 kB | 114/329 kB | 49/501 kB | 16/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:29:00.612 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 488/780 kB | 114/329 kB | 66/501 kB | 16/354 kB Progress (4): 505/780 kB | 114/329 kB | 66/501 kB | 16/354 kB Progress (4): 505/780 kB | 114/329 kB | 66/501 kB | 33/354 kB Progress (4): 505/780 kB | 114/329 kB | 82/501 kB | 33/354 kB Progress (4): 521/780 kB | 114/329 kB | 82/501 kB | 33/354 kB Progress (4): 521/780 kB | 114/329 kB | 82/501 kB | 49/354 kB Progress (4): 521/780 kB | 114/329 kB | 98/501 kB | 49/354 kB Progress (4): 537/780 kB | 114/329 kB | 98/501 kB | 49/354 kB Progress (4): 537/780 kB | 114/329 kB | 98/501 kB | 65/354 kB Progress (4): 537/780 kB | 131/329 kB | 98/501 kB | 65/354 kB Progress (4): 537/780 kB | 131/329 kB | 115/501 kB | 65/354 kB Progress (4): 554/780 kB | 131/329 kB | 115/501 kB | 65/354 kB Progress (4): 554/780 kB | 131/329 kB | 115/501 kB | 81/354 kB Progress (4): 554/780 kB | 131/329 kB | 131/501 kB | 81/354 kB Progress (4): 570/780 kB | 131/329 kB | 131/501 kB | 81/354 kB Progress (4): 570/780 kB | 147/329 kB | 131/501 kB | 81/354 kB Progress (4): 570/780 kB | 147/329 kB | 131/501 kB | 97/354 kB Progress (4): 570/780 kB | 147/329 kB | 147/501 kB | 97/354 kB Progress (4): 586/780 kB | 147/329 kB | 147/501 kB | 97/354 kB Progress (4): 586/780 kB | 163/329 kB | 147/501 kB | 97/354 kB Progress (4): 586/780 kB | 163/329 kB | 147/501 kB | 114/354 kB Progress (4): 586/780 kB | 163/329 kB | 164/501 kB | 114/354 kB Progress (4): 603/780 kB | 163/329 kB | 164/501 kB | 114/354 kB Progress (4): 603/780 kB | 180/329 kB | 164/501 kB | 114/354 kB Progress (4): 603/780 kB | 180/329 kB | 164/501 kB | 130/354 kB Progress (4): 603/780 kB | 180/329 kB | 180/501 kB | 130/354 kB Progress (4): 619/780 kB | 180/329 kB | 180/501 kB | 130/354 kB Progress (4): 619/780 kB | 180/329 kB | 180/501 kB | 146/354 kB Progress (4): 619/780 kB | 180/329 kB | 197/501 kB | 146/354 kB Progress (4): 636/780 kB | 180/329 kB | 197/501 kB | 146/354 kB Progress (4): 636/780 kB | 196/329 kB | 197/501 kB | 146/354 kB Progress (4): 636/780 kB | 196/329 kB | 197/501 kB | 163/354 kB Progress (4): 636/780 kB | 196/329 kB | 213/501 kB | 163/354 kB Progress (4): 652/780 kB | 196/329 kB | 213/501 kB | 163/354 kB Progress (4): 652/780 kB | 196/329 kB | 213/501 kB | 179/354 kB Progress (4): 652/780 kB | 212/329 kB | 213/501 kB | 179/354 kB Progress (4): 652/780 kB | 212/329 kB | 229/501 kB | 179/354 kB Progress (4): 668/780 kB | 212/329 kB | 229/501 kB | 179/354 kB Progress (4): 668/780 kB | 229/329 kB | 229/501 kB | 179/354 kB Progress (4): 668/780 kB | 229/329 kB | 229/501 kB | 196/354 kB Progress (4): 668/780 kB | 229/329 kB | 246/501 kB | 196/354 kB Progress (4): 685/780 kB | 229/329 kB | 246/501 kB | 196/354 kB Progress (4): 685/780 kB | 229/329 kB | 246/501 kB | 212/354 kB Progress (4): 685/780 kB | 229/329 kB | 262/501 kB | 212/354 kB Progress (4): 701/780 kB | 229/329 kB | 262/501 kB | 212/354 kB Progress (4): 701/780 kB | 245/329 kB | 262/501 kB | 212/354 kB Progress (4): 701/780 kB | 245/329 kB | 262/501 kB | 228/354 kB Progress (4): 701/780 kB | 245/329 kB | 279/501 kB | 228/354 kB Progress (4): 718/780 kB | 245/329 kB | 279/501 kB | 228/354 kB Progress (4): 718/780 kB | 262/329 kB | 279/501 kB | 228/354 kB Progress (4): 718/780 kB | 262/329 kB | 279/501 kB | 245/354 kB Progress (4): 718/780 kB | 262/329 kB | 295/501 kB | 245/354 kB Progress (4): 734/780 kB | 262/329 kB | 295/501 kB | 245/354 kB Progress (4): 734/780 kB | 262/329 kB | 311/501 kB | 245/354 kB Progress (4): 742/780 kB | 262/329 kB | 311/501 kB | 245/354 kB Progress (4): 742/780 kB | 262/329 kB | 328/501 kB | 245/354 kB Progress (4): 742/780 kB | 278/329 kB | 328/501 kB | 245/354 kB Progress (4): 758/780 kB | 278/329 kB | 328/501 kB | 245/354 kB Progress (4): 758/780 kB | 278/329 kB | 344/501 kB | 245/354 kB Progress (4): 758/780 kB | 294/329 kB | 344/501 kB | 245/354 kB Progress (4): 758/780 kB | 294/329 kB | 360/501 kB | 245/354 kB Progress (4): 775/780 kB | 294/329 kB | 360/501 kB | 245/354 kB Progress (4): 780 kB | 294/329 kB | 360/501 kB | 245/354 kB Progress (4): 780 kB | 294/329 kB | 377/501 kB | 245/354 kB Progress (4): 780 kB | 311/329 kB | 377/501 kB | 245/354 kB Progress (4): 780 kB | 311/329 kB | 393/501 kB | 245/354 kB Progress (4): 780 kB | 327/329 kB | 393/501 kB | 245/354 kB Progress (4): 780 kB | 329 kB | 393/501 kB | 245/354 kB Progress (4): 780 kB | 329 kB | 410/501 kB | 245/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.5 MB/s) 2024-09-14T11:29:00.612 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 329 kB | 426/501 kB | 245/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:29:00.612 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-14T11:29:00.612 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 442/501 kB | 245/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:29:00.613 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 459/501 kB | 245/354 kB Progress (2): 475/501 kB | 245/354 kB Progress (2): 492/501 kB | 245/354 kB Progress (2): 501 kB | 245/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.5 MB/s) 2024-09-14T11:29:00.613 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:29:00.618 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 261/354 kB Progress (1): 278/354 kB Progress (1): 294/354 kB Progress (1): 310/354 kB Progress (1): 314/354 kB Progress (1): 327/354 kB Progress (1): 343/354 kB Progress (1): 354 kB Progress (2): 354 kB | 16/41 kB Progress (2): 354 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-14T11:29:00.618 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:29:00.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 276 kB/s) 2024-09-14T11:29:00.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:29:00.627 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/586 kB Progress (2): 16/586 kB | 6.4 kB Progress (2): 33/586 kB | 6.4 kB Progress (2): 49/586 kB | 6.4 kB Progress (2): 62/586 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 41 kB/s) 2024-09-14T11:29:00.627 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 62/586 kB | 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:29:00.630 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 78/586 kB | 16/211 kB Progress (2): 78/586 kB | 33/211 kB Progress (2): 95/586 kB | 33/211 kB Progress (2): 95/586 kB | 49/211 kB Progress (2): 111/586 kB | 49/211 kB Progress (2): 111/586 kB | 65/211 kB Progress (2): 111/586 kB | 81/211 kB Progress (2): 127/586 kB | 81/211 kB Progress (2): 127/586 kB | 98/211 kB Progress (2): 144/586 kB | 98/211 kB Progress (2): 144/586 kB | 114/211 kB Progress (2): 160/586 kB | 114/211 kB Progress (2): 160/586 kB | 131/211 kB Progress (2): 176/586 kB | 131/211 kB Progress (2): 176/586 kB | 147/211 kB Progress (2): 193/586 kB | 147/211 kB Progress (2): 193/586 kB | 163/211 kB Progress (2): 209/586 kB | 163/211 kB Progress (2): 209/586 kB | 180/211 kB Progress (2): 226/586 kB | 180/211 kB Progress (2): 226/586 kB | 196/211 kB Progress (2): 242/586 kB | 196/211 kB Progress (2): 242/586 kB | 211 kB Progress (2): 258/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.3 MB/s) 2024-09-14T11:29:00.630 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:29:00.648 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (2): 340/586 kB | 14 kB Progress (2): 357/586 kB | 14 kB Progress (2): 373/586 kB | 14 kB Progress (3): 373/586 kB | 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 82 kB/s) 2024-09-14T11:29:00.648 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 373/586 kB | 16/106 kB | 16/245 kB Progress (3): 389/586 kB | 16/106 kB | 16/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:29:00.648 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 389/586 kB | 32/106 kB | 16/245 kB Progress (4): 389/586 kB | 32/106 kB | 16/245 kB | 6.8 kB Progress (4): 389/586 kB | 32/106 kB | 33/245 kB | 6.8 kB Progress (4): 406/586 kB | 32/106 kB | 33/245 kB | 6.8 kB Progress (4): 406/586 kB | 49/106 kB | 33/245 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-14T11:29:00.648 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 406/586 kB | 49/106 kB | 49/245 kB Progress (3): 422/586 kB | 49/106 kB | 49/245 kB Progress (3): 422/586 kB | 65/106 kB | 49/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:29:00.649 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 422/586 kB | 65/106 kB | 66/245 kB Progress (3): 422/586 kB | 81/106 kB | 66/245 kB Progress (3): 439/586 kB | 81/106 kB | 66/245 kB Progress (3): 439/586 kB | 81/106 kB | 79/245 kB Progress (3): 439/586 kB | 98/106 kB | 79/245 kB Progress (3): 455/586 kB | 98/106 kB | 79/245 kB Progress (3): 455/586 kB | 98/106 kB | 95/245 kB Progress (3): 455/586 kB | 106 kB | 95/245 kB Progress (3): 455/586 kB | 106 kB | 112/245 kB Progress (3): 471/586 kB | 106 kB | 112/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 600 kB/s) 2024-09-14T11:29:00.649 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:29:00.650 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 471/586 kB | 128/245 kB Progress (2): 488/586 kB | 128/245 kB Progress (2): 488/586 kB | 145/245 kB Progress (2): 504/586 kB | 145/245 kB Progress (2): 504/586 kB | 161/245 kB Progress (2): 504/586 kB | 177/245 kB Progress (2): 521/586 kB | 177/245 kB Progress (2): 521/586 kB | 194/245 kB Progress (2): 537/586 kB | 194/245 kB Progress (2): 537/586 kB | 210/245 kB Progress (2): 553/586 kB | 210/245 kB Progress (2): 553/586 kB | 226/245 kB Progress (2): 553/586 kB | 243/245 kB Progress (2): 553/586 kB | 245 kB Progress (2): 570/586 kB | 245 kB Progress (2): 586 kB | 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.4 MB/s) 2024-09-14T11:29:00.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:29:00.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:29:00.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:29:00.660 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Progress (2): 15 kB | 16/205 kB Progress (2): 15 kB | 28/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 80 kB/s) 2024-09-14T11:29:00.660 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:29:00.662 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 44/205 kB Progress (1): 61/205 kB Progress (1): 65/205 kB Progress (2): 65/205 kB | 16/16 kB Progress (2): 65/205 kB | 16 kB Progress (2): 81/205 kB | 16 kB Progress (2): 98/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 86 kB/s) 2024-09-14T11:29:00.662 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:29:00.663 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 114/205 kB Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Progress (2): 205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:29:00.663 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:29:00.663 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-14T11:29:00.666 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 115 kB/s) 2024-09-14T11:29:00.675 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 118 kB/s) 2024-09-14T11:29:00.675 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-14T11:29:00.681 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 62/184 kB Progress (1): 79/184 kB Progress (1): 95/184 kB Progress (1): 112/184 kB Progress (1): 120/184 kB Progress (1): 128/184 kB Progress (1): 144/184 kB Progress (1): 161/184 kB Progress (1): 173/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 871 kB/s) 2024-09-14T11:29:00.706 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:00.706 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:29:00.714 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:29:00.729 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:29:00.732 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:29:00.747 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-14T11:29:00.749 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:29:00.764 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:29:00.769 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:29:00.784 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-14T11:29:00.790 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:29:00.808 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 78/153 kB Progress (1): 94/153 kB Progress (1): 111/153 kB Progress (1): 127/153 kB Progress (1): 143/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-14T11:29:00.809 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:29:00.826 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15/215 kB Progress (1): 31/215 kB Progress (1): 48/215 kB Progress (1): 64/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-14T11:29:00.865 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:00.865 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:29:00.868 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:29:00.882 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:29:00.884 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:29:00.898 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:29:00.901 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:29:00.916 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-14T11:29:00.918 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:29:00.933 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-14T11:29:00.936 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:29:00.951 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:29:00.953 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:29:00.967 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:29:00.970 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:29:00.984 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:29:00.986 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:29:00.999 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:29:01.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:29:01.014 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T11:29:01.017 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:29:01.031 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:29:01.033 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:29:01.046 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:29:01.048 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:29:01.063 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-14T11:29:01.065 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:29:01.079 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:29:01.082 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:29:01.096 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:29:01.102 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:29:01.115 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-14T11:29:01.118 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:29:01.133 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:29:01.137 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:29:01.151 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 392 kB/s) 2024-09-14T11:29:01.154 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:29:01.170 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:29:01.185 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 16/269 kB Progress (3): 2.5 kB | 33/41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 192 kB/s) 2024-09-14T11:29:01.185 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 41 kB | 16/269 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:29:01.185 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 41 kB | 33/269 kB Progress (2): 41 kB | 49/269 kB Progress (3): 41 kB | 49/269 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-14T11:29:01.185 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/269 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:29:01.185 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 66/269 kB | 16/55 kB | 8.5 kB Progress (3): 66/269 kB | 33/55 kB | 8.5 kB Progress (3): 82/269 kB | 33/55 kB | 8.5 kB Progress (3): 98/269 kB | 33/55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-14T11:29:01.186 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 98/269 kB | 49/55 kB Progress (2): 112/269 kB | 49/55 kB Progress (2): 112/269 kB | 55 kB Progress (2): 129/269 kB | 55 kB Progress (2): 145/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-14T11:29:01.187 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-14T11:29:01.203 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 66/327 kB Progress (1): 82/327 kB Progress (2): 82/327 kB | 16/587 kB Progress (2): 98/327 kB | 16/587 kB Progress (2): 98/327 kB | 33/587 kB Progress (2): 115/327 kB | 33/587 kB Progress (2): 115/327 kB | 49/587 kB Progress (2): 131/327 kB | 49/587 kB Progress (2): 131/327 kB | 66/587 kB Progress (2): 147/327 kB | 66/587 kB Progress (2): 147/327 kB | 82/587 kB Progress (2): 164/327 kB | 82/587 kB Progress (2): 164/327 kB | 98/587 kB Progress (2): 180/327 kB | 98/587 kB Progress (2): 180/327 kB | 115/587 kB Progress (2): 197/327 kB | 115/587 kB Progress (2): 197/327 kB | 131/587 kB Progress (2): 213/327 kB | 131/587 kB Progress (2): 213/327 kB | 147/587 kB Progress (2): 213/327 kB | 164/587 kB Progress (2): 229/327 kB | 164/587 kB Progress (2): 229/327 kB | 180/587 kB Progress (2): 246/327 kB | 180/587 kB Progress (2): 246/327 kB | 197/587 kB Progress (2): 256/327 kB | 197/587 kB Progress (2): 256/327 kB | 213/587 kB Progress (2): 272/327 kB | 213/587 kB Progress (2): 272/327 kB | 229/587 kB Progress (2): 289/327 kB | 229/587 kB Progress (2): 289/327 kB | 246/587 kB Progress (2): 305/327 kB | 246/587 kB Progress (2): 305/327 kB | 256/587 kB Progress (2): 321/327 kB | 256/587 kB Progress (2): 321/327 kB | 272/587 kB Progress (2): 327 kB | 272/587 kB Progress (2): 327 kB | 289/587 kB Progress (2): 327 kB | 305/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.9 MB/s) 2024-09-14T11:29:01.213 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 321/587 kB Progress (1): 338/587 kB Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-14T11:29:01.248 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:29:01.249 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:01.249 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:29:01.254 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:29:01.269 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:29:01.271 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:29:01.285 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:29:01.287 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:29:01.301 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:29:01.303 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:29:01.317 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:29:01.321 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:29:01.335 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:29:01.337 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:29:01.352 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-14T11:29:01.354 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:29:01.369 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:29:01.373 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:29:01.388 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T11:29:01.391 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:29:01.406 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-09-14T11:29:01.409 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:29:01.426 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-09-14T11:29:01.428 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:29:01.443 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:29:01.446 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:29:01.462 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:29:01.465 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:29:01.480 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-14T11:29:01.483 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:29:01.498 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:29:01.500 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:29:01.516 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-14T11:29:01.518 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:29:01.533 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-14T11:29:01.537 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:29:01.551 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T11:29:01.554 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:29:01.569 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:29:01.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:29:01.587 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-14T11:29:01.589 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:29:01.603 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:29:01.605 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:29:01.620 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-14T11:29:01.624 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:29:01.639 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-14T11:29:01.641 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:29:01.656 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T11:29:01.663 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:29:01.678 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-14T11:29:01.678 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:29:01.678 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:29:01.679 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:29:01.679 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:29:01.679 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 16/122 kB | 16/55 kB Progress (2): 33/122 kB | 16/55 kB Progress (3): 33/122 kB | 16/55 kB | 16/27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 33/122 kB | 33/55 kB | 16/27 kB Progress (3): 33/122 kB | 33/55 kB | 27 kB Progress (3): 49/122 kB | 33/55 kB | 27 kB Progress (3): 49/122 kB | 49/55 kB | 27 kB Progress (3): 49/122 kB | 55 kB | 27 kB Progress (3): 66/122 kB | 55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 82/122 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:29:01.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 82/122 kB | 16/334 kB Progress (2): 98/122 kB | 16/334 kB Progress (2): 115/122 kB | 16/334 kB Progress (2): 115/122 kB | 32/334 kB Progress (2): 122 kB | 32/334 kB Progress (2): 122 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-14T11:29:01.698 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 65/334 kB Progress (1): 81/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-14T11:29:01.707 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15/267 kB Progress (1): 31/267 kB Progress (2): 31/267 kB | 4.7 kB Progress (2): 48/267 kB | 4.7 kB Progress (2): 64/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-14T11:29:01.707 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 64/267 kB | 16/23 kB Progress (2): 81/267 kB | 16/23 kB Progress (2): 81/267 kB | 23 kB Progress (2): 96/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-14T11:29:01.709 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-14T11:29:01.758 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:29:01.759 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:29:02.366 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:29:02.366 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:02.366 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:29:02.369 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:29:02.369 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:02.369 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:29:02.373 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:29:02.374 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:29:02.533 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:29:02.534 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:02.534 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:29:02.538 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:29:02.552 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:29:02.555 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:29:02.570 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-14T11:29:02.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:29:02.587 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:29:02.590 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:29:02.604 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:29:02.608 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:29:02.622 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:29:02.625 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:29:02.639 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:29:02.643 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:29:02.656 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:29:02.659 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:29:02.673 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:29:02.674 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:29:02.688 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-14T11:29:02.691 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:29:02.705 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:29:02.707 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:29:02.721 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:29:02.725 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:29:02.739 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:29:02.740 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:29:02.754 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-14T11:29:02.756 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:29:02.770 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:29:02.771 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:29:02.785 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:29:02.787 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:29:02.800 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 666 kB/s) 2024-09-14T11:29:02.802 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:29:02.815 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.1 MB/s) 2024-09-14T11:29:02.818 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:29:02.832 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-14T11:29:02.835 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:29:02.849 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:29:02.851 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:29:02.865 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:29:02.868 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:29:02.881 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-14T11:29:02.882 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:29:02.896 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:29:02.897 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:29:02.910 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-14T11:29:02.911 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:29:02.925 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-14T11:29:02.926 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:29:02.939 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-14T11:29:02.942 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:29:02.955 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-14T11:29:02.956 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:29:02.969 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:29:02.971 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:29:02.984 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:29:02.986 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:29:02.999 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-14T11:29:03.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:29:03.015 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:29:03.018 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:29:03.035 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-09-14T11:29:03.038 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:29:03.053 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:29:03.054 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:29:03.068 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:29:03.071 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:29:03.086 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:29:03.087 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:29:03.100 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-14T11:29:03.102 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:29:03.116 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:29:03.118 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:29:03.132 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-14T11:29:03.135 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:29:03.149 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:29:03.150 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:29:03.164 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:29:03.167 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:29:03.180 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:29:03.182 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:29:03.196 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:29:03.197 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:29:03.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:29:03.213 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:29:03.227 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:29:03.230 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:29:03.244 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:29:03.247 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:29:03.261 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:29:03.263 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:29:03.277 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:29:03.280 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:29:03.293 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:29:03.295 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:29:03.309 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:29:03.311 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:29:03.325 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.4 MB/s) 2024-09-14T11:29:03.327 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:29:03.340 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-14T11:29:03.342 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:29:03.355 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-14T11:29:03.356 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:29:03.370 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-14T11:29:03.371 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:29:03.384 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-14T11:29:03.386 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:29:03.399 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-14T11:29:03.402 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:29:03.416 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:29:03.418 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:29:03.432 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T11:29:03.435 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:29:03.449 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:29:03.452 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:29:03.465 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 435 kB/s) 2024-09-14T11:29:03.467 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:29:03.481 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-14T11:29:03.482 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:29:03.496 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-14T11:29:03.498 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:29:03.513 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:29:03.516 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:29:03.530 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-14T11:29:03.537 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:29:03.555 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:29:03.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:29:03.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:29:03.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:29:03.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:29:03.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:29:03.570 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 14 kB Progress (3): 8.2 kB | 14 kB | 16/26 kB Progress (4): 8.2 kB | 14 kB | 16/26 kB | 16/171 kB Progress (5): 8.2 kB | 14 kB | 16/26 kB | 16/171 kB | 16/118 kB Progress (5): 8.2 kB | 14 kB | 26 kB | 16/171 kB | 16/118 kB Progress (5): 8.2 kB | 14 kB | 26 kB | 33/171 kB | 16/118 kB Progress (5): 8.2 kB | 14 kB | 26 kB | 33/171 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.8 MB/s) 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/171 kB | 33/118 kB Progress (2): 49/171 kB | 49/118 kB Progress (2): 64/171 kB | 49/118 kB Progress (2): 64/171 kB | 64/118 kB Progress (2): 81/171 kB | 64/118 kB Progress (2): 81/171 kB | 80/118 kB Progress (2): 97/171 kB | 80/118 kB Progress (2): 97/171 kB | 97/118 kB Progress (2): 113/171 kB | 97/118 kB Progress (2): 113/171 kB | 113/118 kB Progress (2): 113/171 kB | 118 kB Progress (2): 130/171 kB | 118 kB Progress (2): 146/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 7.3 MB/s) 2024-09-14T11:29:03.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:29:03.574 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T11:29:03.574 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:29:03.585 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/61 kB Progress (2): 16/61 kB | 16/136 kB Progress (2): 33/61 kB | 16/136 kB Progress (2): 33/61 kB | 33/136 kB Progress (2): 49/61 kB | 33/136 kB Progress (2): 61 kB | 33/136 kB Progress (2): 61 kB | 49/136 kB Progress (3): 61 kB | 49/136 kB | 16/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.1 MB/s) 2024-09-14T11:29:03.585 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/136 kB | 16/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:29:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/136 kB | 33/146 kB Progress (2): 82/136 kB | 33/146 kB Progress (2): 82/136 kB | 49/146 kB Progress (2): 98/136 kB | 49/146 kB Progress (2): 98/136 kB | 66/146 kB Progress (3): 98/136 kB | 66/146 kB | 16/501 kB Progress (3): 115/136 kB | 66/146 kB | 16/501 kB Progress (3): 115/136 kB | 82/146 kB | 16/501 kB Progress (3): 115/136 kB | 82/146 kB | 33/501 kB Progress (3): 131/136 kB | 82/146 kB | 33/501 kB Progress (3): 131/136 kB | 98/146 kB | 33/501 kB Progress (3): 136 kB | 98/146 kB | 33/501 kB Progress (3): 136 kB | 98/146 kB | 49/501 kB Progress (4): 136 kB | 98/146 kB | 49/501 kB | 16/58 kB Progress (4): 136 kB | 115/146 kB | 49/501 kB | 16/58 kB Progress (4): 136 kB | 115/146 kB | 65/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-14T11:29:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:29:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 115/146 kB | 65/501 kB | 33/58 kB Progress (3): 131/146 kB | 65/501 kB | 33/58 kB Progress (3): 131/146 kB | 81/501 kB | 33/58 kB Progress (3): 146 kB | 81/501 kB | 33/58 kB Progress (3): 146 kB | 81/501 kB | 49/58 kB Progress (3): 146 kB | 97/501 kB | 49/58 kB Progress (3): 146 kB | 97/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-14T11:29:03.588 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 114/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-14T11:29:03.593 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 14 MB/s) 2024-09-14T11:29:03.600 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.9 MB/s) 2024-09-14T11:29:03.633 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 33 MB/s) 2024-09-14T11:29:03.700 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:03.700 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:29:03.703 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:29:03.717 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:29:03.719 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:29:03.733 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:29:03.734 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:29:03.748 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-14T11:29:03.750 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:29:03.764 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:29:03.766 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:29:03.780 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T11:29:03.782 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:29:03.797 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-14T11:29:03.800 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:29:03.814 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:29:03.816 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:29:03.831 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:29:03.833 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:29:03.848 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-14T11:29:03.852 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:29:03.865 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:29:03.867 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:29:03.881 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:29:03.883 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:29:03.897 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:29:03.899 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:29:03.913 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-14T11:29:03.917 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:29:03.931 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:29:03.932 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:29:03.932 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:29:03.932 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:29:03.933 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:29:03.933 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:29:03.950 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (3): 16/58 kB | 16/26 kB | 0/1.0 MB Progress (4): 16/58 kB | 16/26 kB | 0/1.0 MB | 16/79 kB Progress (5): 16/58 kB | 16/26 kB | 0/1.0 MB | 16/79 kB | 16/211 kB Progress (5): 16/58 kB | 26 kB | 0/1.0 MB | 16/79 kB | 16/211 kB Progress (5): 16/58 kB | 26 kB | 0/1.0 MB | 16/79 kB | 16/211 kB Progress (5): 33/58 kB | 26 kB | 0/1.0 MB | 16/79 kB | 16/211 kB Progress (5): 33/58 kB | 26 kB | 0/1.0 MB | 33/79 kB | 16/211 kB Progress (5): 33/58 kB | 26 kB | 0/1.0 MB | 33/79 kB | 33/211 kB Progress (5): 33/58 kB | 26 kB | 0/1.0 MB | 33/79 kB | 33/211 kB Progress (5): 49/58 kB | 26 kB | 0/1.0 MB | 33/79 kB | 33/211 kB Progress (5): 49/58 kB | 26 kB | 0/1.0 MB | 49/79 kB | 33/211 kB Progress (5): 49/58 kB | 26 kB | 0/1.0 MB | 49/79 kB | 49/211 kB Progress (5): 58 kB | 26 kB | 0/1.0 MB | 49/79 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-14T11:29:03.950 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 58 kB | 0.1/1.0 MB | 49/79 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:29:03.950 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 58 kB | 0.1/1.0 MB | 63/79 kB | 49/211 kB Progress (4): 58 kB | 0.1/1.0 MB | 63/79 kB | 63/211 kB Progress (4): 58 kB | 0.1/1.0 MB | 63/79 kB | 63/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-14T11:29:03.950 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 0.1/1.0 MB | 79 kB | 63/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:29:03.950 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 0.1/1.0 MB | 79 kB | 79/211 kB Progress (3): 0.1/1.0 MB | 79 kB | 79/211 kB Progress (3): 0.1/1.0 MB | 79 kB | 95/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-14T11:29:03.952 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 0.1/1.0 MB | 95/211 kB Progress (2): 0.1/1.0 MB | 112/211 kB Progress (2): 0.1/1.0 MB | 112/211 kB Progress (2): 0.1/1.0 MB | 128/211 kB Progress (2): 0.1/1.0 MB | 128/211 kB Progress (2): 0.1/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 210/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-14T11:29:03.963 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 79/267 kB Progress (3): 1.0/1.0 MB | 82/116 kB | 79/267 kB Progress (3): 1.0/1.0 MB | 82/116 kB | 79/267 kB Progress (3): 1.0 MB | 82/116 kB | 79/267 kB Progress (3): 1.0 MB | 82/116 kB | 96/267 kB Progress (3): 1.0 MB | 98/116 kB | 96/267 kB Progress (3): 1.0 MB | 98/116 kB | 112/267 kB Progress (3): 1.0 MB | 98/116 kB | 128/267 kB Progress (3): 1.0 MB | 115/116 kB | 128/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 34 MB/s) 2024-09-14T11:29:03.963 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 116 kB | 128/267 kB Progress (2): 116 kB | 145/267 kB Progress (2): 116 kB | 161/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-14T11:29:03.964 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.4 MB/s) 2024-09-14T11:29:04.146 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:29:04.179 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:04.180 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:29:04.180 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 5.611 s 2024-09-14T11:29:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-14T11:29:04Z 2024-09-14T11:29:04.181 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:04.205 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:29:04.214 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:29:05.249 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-14T11:29:05.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:29:05.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:29:05.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-14T11:29:05.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:29:05.637 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.637 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:29:05.744 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:29:05.745 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.745 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:29:05.829 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:29:05.830 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.830 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:29:05.832 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:29:05.832 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.832 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:29:05.836 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:29:05.836 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:05.836 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:29:06.002 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:29:06.218 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:29:06.457 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 19 kB/s) 2024-09-14T11:29:06.469 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:29:06.487 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:29:06.494 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:29:06.511 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:29:06.517 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:29:06.534 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-14T11:29:06.538 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:29:06.555 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-14T11:29:06.557 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:29:06.573 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:29:06.575 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:29:06.591 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 189 kB/s) 2024-09-14T11:29:06.595 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:29:06.618 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-14T11:29:06.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:29:06.619 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:29:06.620 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:29:06.620 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:29:06.620 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:29:06.642 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 731 kB/s) 2024-09-14T11:29:06.679 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/169 kB Progress (2): 2.8/189 kB | 1.4/169 kB Progress (3): 2.8/189 kB | 1.4/169 kB | 1.4/103 kB Progress (4): 2.8/189 kB | 1.4/169 kB | 1.4/103 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 1.4/169 kB | 2.8/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 1.4/169 kB | 2.8/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 2.8/169 kB | 2.8/103 kB | 1.4/7.7 kB Progress (4): 5.5/189 kB | 2.8/169 kB | 2.8/103 kB | 1.4/7.7 kB Progress (4): 5.5/189 kB | 2.8/169 kB | 4.1/103 kB | 1.4/7.7 kB Progress (4): 5.5/189 kB | 2.8/169 kB | 4.1/103 kB | 2.8/7.7 kB Progress (4): 5.5/189 kB | 2.8/169 kB | 5.5/103 kB | 2.8/7.7 kB Progress (4): 6.9/189 kB | 2.8/169 kB | 5.5/103 kB | 2.8/7.7 kB Progress (4): 6.9/189 kB | 4.1/169 kB | 5.5/103 kB | 2.8/7.7 kB Progress (4): 6.9/189 kB | 4.1/169 kB | 6.9/103 kB | 2.8/7.7 kB Progress (4): 6.9/189 kB | 4.1/169 kB | 6.9/103 kB | 4.1/7.7 kB Progress (4): 6.9/189 kB | 4.1/169 kB | 8.3/103 kB | 4.1/7.7 kB Progress (4): 6.9/189 kB | 5.5/169 kB | 8.3/103 kB | 4.1/7.7 kB Progress (4): 8.3/189 kB | 5.5/169 kB | 8.3/103 kB | 4.1/7.7 kB Progress (4): 8.3/189 kB | 6.9/169 kB | 8.3/103 kB | 4.1/7.7 kB Progress (4): 9.7/189 kB | 6.9/169 kB | 8.3/103 kB | 4.1/7.7 kB Progress (4): 9.7/189 kB | 6.9/169 kB | 9.7/103 kB | 4.1/7.7 kB Progress (4): 9.7/189 kB | 6.9/169 kB | 9.7/103 kB | 5.5/7.7 kB Progress (4): 9.7/189 kB | 6.9/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 11/189 kB | 6.9/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 11/189 kB | 8.3/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 12/189 kB | 8.3/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 12/189 kB | 9.7/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 14/189 kB | 9.7/169 kB | 11/103 kB | 5.5/7.7 kB Progress (4): 14/189 kB | 9.7/169 kB | 12/103 kB | 5.5/7.7 kB Progress (4): 14/189 kB | 9.7/169 kB | 12/103 kB | 6.9/7.7 kB Progress (4): 14/189 kB | 9.7/169 kB | 14/103 kB | 6.9/7.7 kB Progress (4): 15/189 kB | 9.7/169 kB | 14/103 kB | 6.9/7.7 kB Progress (4): 15/189 kB | 11/169 kB | 14/103 kB | 6.9/7.7 kB Progress (4): 16/189 kB | 11/169 kB | 14/103 kB | 6.9/7.7 kB Progress (4): 16/189 kB | 11/169 kB | 15/103 kB | 6.9/7.7 kB Progress (4): 16/189 kB | 11/169 kB | 15/103 kB | 7.7 kB Progress (4): 16/189 kB | 11/169 kB | 17/103 kB | 7.7 kB Progress (4): 18/189 kB | 11/169 kB | 17/103 kB | 7.7 kB Progress (4): 18/189 kB | 12/169 kB | 17/103 kB | 7.7 kB Progress (4): 19/189 kB | 12/169 kB | 17/103 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 128 kB/s) 2024-09-14T11:29:06.703 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 19/189 kB | 12/169 kB | 18/103 kB Progress (3): 21/189 kB | 12/169 kB | 18/103 kB Progress (3): 21/189 kB | 14/169 kB | 18/103 kB Progress (3): 22/189 kB | 14/169 kB | 18/103 kB Progress (3): 22/189 kB | 14/169 kB | 19/103 kB Progress (3): 22/189 kB | 15/169 kB | 19/103 kB Progress (3): 22/189 kB | 15/169 kB | 21/103 kB Progress (3): 23/189 kB | 15/169 kB | 21/103 kB Progress (3): 23/189 kB | 15/169 kB | 22/103 kB Progress (3): 23/189 kB | 16/169 kB | 22/103 kB Progress (3): 23/189 kB | 16/169 kB | 23/103 kB Progress (3): 25/189 kB | 16/169 kB | 23/103 kB Progress (3): 25/189 kB | 16/169 kB | 25/103 kB Progress (3): 25/189 kB | 18/169 kB | 25/103 kB Progress (3): 25/189 kB | 18/169 kB | 26/103 kB Progress (3): 26/189 kB | 18/169 kB | 26/103 kB Progress (3): 26/189 kB | 18/169 kB | 28/103 kB Progress (3): 26/189 kB | 19/169 kB | 28/103 kB Progress (3): 26/189 kB | 19/169 kB | 29/103 kB Progress (3): 27/189 kB | 19/169 kB | 29/103 kB Progress (3): 27/189 kB | 19/169 kB | 30/103 kB Progress (3): 27/189 kB | 21/169 kB | 30/103 kB Progress (3): 27/189 kB | 21/169 kB | 32/103 kB Progress (3): 29/189 kB | 21/169 kB | 32/103 kB Progress (3): 29/189 kB | 21/169 kB | 33/103 kB Progress (3): 29/189 kB | 22/169 kB | 33/103 kB Progress (3): 29/189 kB | 22/169 kB | 34/103 kB Progress (3): 30/189 kB | 22/169 kB | 34/103 kB Progress (3): 30/189 kB | 22/169 kB | 36/103 kB Progress (3): 30/189 kB | 23/169 kB | 36/103 kB Progress (3): 30/189 kB | 23/169 kB | 37/103 kB Progress (3): 32/189 kB | 23/169 kB | 37/103 kB Progress (3): 32/189 kB | 23/169 kB | 39/103 kB Progress (3): 32/189 kB | 25/169 kB | 39/103 kB Progress (3): 32/189 kB | 25/169 kB | 40/103 kB Progress (3): 33/189 kB | 25/169 kB | 40/103 kB Progress (3): 33/189 kB | 25/169 kB | 41/103 kB Progress (3): 33/189 kB | 26/169 kB | 41/103 kB Progress (3): 33/189 kB | 26/169 kB | 43/103 kB Progress (3): 33/189 kB | 27/169 kB | 43/103 kB Progress (3): 33/189 kB | 27/169 kB | 44/103 kB Progress (3): 33/189 kB | 29/169 kB | 44/103 kB Progress (3): 33/189 kB | 29/169 kB | 46/103 kB Progress (3): 49/189 kB | 29/169 kB | 46/103 kB Progress (3): 49/189 kB | 29/169 kB | 47/103 kB Progress (3): 49/189 kB | 30/169 kB | 47/103 kB Progress (3): 49/189 kB | 30/169 kB | 48/103 kB Progress (3): 49/189 kB | 31/169 kB | 48/103 kB Progress (3): 49/189 kB | 31/169 kB | 49/103 kB Progress (3): 66/189 kB | 31/169 kB | 49/103 kB Progress (3): 66/189 kB | 31/169 kB | 66/103 kB Progress (3): 79/189 kB | 31/169 kB | 66/103 kB Progress (3): 79/189 kB | 48/169 kB | 66/103 kB Progress (3): 79/189 kB | 48/169 kB | 82/103 kB Progress (3): 96/189 kB | 48/169 kB | 82/103 kB Progress (3): 96/189 kB | 64/169 kB | 82/103 kB Progress (3): 112/189 kB | 64/169 kB | 82/103 kB Progress (3): 112/189 kB | 78/169 kB | 82/103 kB Progress (3): 112/189 kB | 78/169 kB | 98/103 kB Progress (3): 112/189 kB | 78/169 kB | 103 kB Progress (3): 112/189 kB | 94/169 kB | 103 kB Progress (3): 128/189 kB | 94/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:29:06.707 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 145/189 kB | 94/169 kB Progress (2): 145/189 kB | 111/169 kB Progress (2): 161/189 kB | 111/169 kB Progress (2): 178/189 kB | 111/169 kB Progress (2): 189 kB | 111/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-14T11:29:06.716 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 127/169 kB Progress (1): 143/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-14T11:29:06.729 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:06.729 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:29:06.729 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] T E S T S 2024-09-14T11:29:06.729 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:29:07.178 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:29:07.305 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjects.java: starting test run: 2024-09-14T11:29:07.305 INFO:tasks.workunit.client.0.smithi094.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:29:07.305 INFO:tasks.workunit.client.0.smithi094.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:29:07.305 INFO:tasks.workunit.client.0.smithi094.stdout: EndpointUrl=https://smithi094.front.sepia.ceph.com:443 2024-09-14T11:29:07.305 INFO:tasks.workunit.client.0.smithi094.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:29:07.402 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Environment Variables Read 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.703 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-14T11:29:07.803 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generated Big Files 2024-09-14T11:29:08.003 INFO:tasks.workunit.client.0.smithi094.stdout:HeadBucketResponse() 2024-09-14T11:29:08.003 INFO:tasks.workunit.client.0.smithi094.stdout:sheik is ready 2024-09-14T11:29:08.003 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Test Bucket Created 2024-09-14T11:29:08.103 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:29:08.198 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:29:08.203 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:29:08.289 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:29:08.303 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:29:08.404 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:29:08.492 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:29:08.504 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:29:08.604 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:29:08.704 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:29:10.708 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:29:11.108 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:29:12.931 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-0b 2024-09-14T11:29:12.932 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-8b 2024-09-14T11:29:12.933 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-200b 2024-09-14T11:29:12.934 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-21983b 2024-09-14T11:29:12.936 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-5519b 2024-09-14T11:29:12.937 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-204329b 2024-09-14T11:29:12.937 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-256k 2024-09-14T11:29:12.939 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1m 2024-09-14T11:29:12.940 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1038757b 2024-09-14T11:29:12.974 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:29:12.974 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.011 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:29:13.011 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.087 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:29:13.087 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.111 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:29:13.111 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.203 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:29:13.203 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.212 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:29:13.266 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.293 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:29:13.293 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.311 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:29:13.375 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.412 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:29:13.412 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-14T11:29:13.512 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:29:13.712 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:29:14.113 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:29:16.360 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.172 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:29:16.371 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:16.371 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Results: 2024-09-14T11:29:16.371 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:16.371 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:29:16.371 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-14T11:29:16.373 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:16.373 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:29:16.373 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:16.374 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 11.145 s 2024-09-14T11:29:16.374 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-14T11:29:16Z 2024-09-14T11:29:16.374 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:29:16.396 INFO:tasks.workunit.client.0.smithi094.stderr:+ exit 2024-09-14T11:29:16.396 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:29:16.396 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:29:16.475 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:29:16.475 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:29:16.846 DEBUG:teuthology.parallel:result is None 2024-09-14T11:29:16.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:16.886 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:16.887 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:16.955 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:16.956 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:29:16.965 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:29:16.965 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:29:16.965 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:17.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:29:17.025 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:29:17.025 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:17.094 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:17.094 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:29:17.163 INFO:tasks.workunit:timeout=3h 2024-09-14T11:29:17.163 INFO:tasks.workunit:cleanup=True 2024-09-14T11:29:17.163 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:29:17.234 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:30:13.686 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:30:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:30:13.688 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:30:13.760 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:30:13.761 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:30:13.761 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:30:13.808 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:30:13.857 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:30:13.896 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:30:13.898 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:30:13.898 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:30:13.936 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:30:13.940 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:30:13.940 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:30:14.010 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:30:14.011 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:30:14.011 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:30:14.085 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: fully qualified domain name: smithi094.front.sepia.ceph.com 2024-09-14T11:30:14.085 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:30:14.085 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-14T11:30:16.598 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:30:16.784 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-14T11:30:16.790 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:30:16.834 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-14T11:30:16.834 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-14T11:30:16.834 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:30:16.983 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:30:16.988 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:30:17.726 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-14T11:30:18.542 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-14T11:30:18.544 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:30:19.076 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:30:19.077 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:30:19.134 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:30:19.135 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:30:19.177 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:30:19.178 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:30:19.220 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:19.221 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:30:19.297 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:19.298 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:30:19.434 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:19.435 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:30:19.439 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:30:19.441 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:30:19.451 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:30:19.452 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:30:19.453 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:30:19.455 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:30:19.456 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:30:19.529 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:30:21.198 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: creating user 2024-09-14T11:30:21.511 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-14T11:30:21.511 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "testid", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "M. Tester", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "tester@ceph.com", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "testid", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:30:21.512 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:30:21.508298Z" 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-14T11:30:21.513 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:21.514 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-14T11:30:21.508263Z", 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-14T11:30:21.515 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-14T11:30:24.010 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.010 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.042 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records in 2024-09-14T11:30:24.042 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records out 2024-09-14T11:30:24.042 INFO:tasks.workunit.client.0.smithi094.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0153098 s, 342 MB/s 2024-09-14T11:30:24.045 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.045 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.102 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.102 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.159 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.159 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.213 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.213 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.267 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.319 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.379 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.431 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.431 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.487 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.487 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.539 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.539 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.595 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.648 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.648 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.701 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.758 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.758 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.805 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:30:24.814 INFO:tasks.workunit.client.0.smithi094.stdout:bucket nams is reupload-bkt-110594 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:endpoint is https://smithi094.front.sepia.ceph.com:443 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:start UploadId=2~Il1gXfEOWX_G4YeJ-TpBsczDO9FpGXM 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 2} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1} 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi094.stdout:aborting multipart upload, parts=[{'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 1}, {'ETag': '"3d5ab06ea2dc3e3e90c60fc6f4f5b3f2"', 'PartNumber': 2}] 2024-09-14T11:30:25.832 INFO:tasks.workunit.client.0.smithi094.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:30:25.891 INFO:tasks.workunit.client.0.smithi094.stdout:rados ls: 2024-09-14T11:30:25.896 INFO:tasks.workunit.client.0.smithi094.stdout:== PASSED == 2024-09-14T11:30:25.896 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:30:25.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:30:25.975 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:30:25.975 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:30:26.350 DEBUG:teuthology.parallel:result is None 2024-09-14T11:30:26.350 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:26.388 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:26.388 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:26.456 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:30:26.456 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:30:26.472 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:30:26.472 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:30:26.472 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:30:26.472 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:30:26.525 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:30:26.552 INFO:teuthology.orchestra.run.smithi094.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:30:26.553 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:30:26.554 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:30:26.554 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:30:26.623 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:30:26.758 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:30:26.759 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:30:26.759 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key UIVUMPNKIRDLHTJTCNHO --secret y7WgIHcxRHHuHFKGVue70ZMccHTDP+GAQW/codFUw3cXA+KI59b/EQ== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:30:26.866 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:26.866 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:26.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.900+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 realm 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.901+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.902+0000 7fdf266b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:26.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.902+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.903+0000 7fdf266b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:26.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.903+0000 7fdf266b9800 20 searching for the correct realm 2024-09-14T11:30:26.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.906+0000 7fdf249a4640 0 -- 172.21.15.94:0/2785369686 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55acb4b119f0 msgr2=0x55acb4b13e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:26.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.910+0000 7fdf1b9a2640 0 -- 172.21.15.94:0/2785369686 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fdf1400b040 msgr2=0x7fdf1406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:26.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.914+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:26.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 zone default found 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 4 Realm: () 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 zonegroup default 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.915+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.916+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.916+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.916+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.916+0000 7fdf266b9800 20 started sync module instance, tier type = 2024-09-14T11:30:26.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.916+0000 7fdf266b9800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=0 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=1 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=2 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=3 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=4 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=5 2024-09-14T11:30:26.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.925+0000 7fdf266b9800 20 add_watcher() i=6 2024-09-14T11:30:26.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.926+0000 7fdf266b9800 20 add_watcher() i=7 2024-09-14T11:30:26.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.926+0000 7fdf266b9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.927+0000 7fdddafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.927+0000 7fdf266b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.927+0000 7fdf266b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.927+0000 7fdf266b9800 5 note: GC not initialized 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.927+0000 7fddd9fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 20 Filter name: none 2024-09-14T11:30:26.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdd4b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:26.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:30:26.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.928+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:30:26.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 cache get: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO : miss 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 20 rados->read ofs=0 len=0 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO info.flags=0x0 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 adding default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO to cache LRU end 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 cache get: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO : hit (negative entry) 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.929+0000 7fdf266b9800 10 cache get: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO : hit (negative entry) 2024-09-14T11:30:26.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.930+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:30:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.930+0000 7fdf266b9800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:30:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.930+0000 7fdf266b9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:30:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.931+0000 7fddfb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758611 cookie 94200254299664 notifier 5633 bl.length()=675 2024-09-14T11:30:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.931+0000 7fddfb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:30:26.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.931+0000 7fddfb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.932+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.932+0000 7fdf266b9800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.932+0000 7fdf266b9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.933+0000 7fddfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758603 cookie 94200254293056 notifier 5633 bl.length()=202 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.933+0000 7fddfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:30:26.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.933+0000 7fddfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:30:26.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.934+0000 7fdf266b9800 10 cache put: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO info.flags=0x7 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.934+0000 7fdf266b9800 10 moving default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO to cache LRU end 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.934+0000 7fdf266b9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:UIVUMPNKIRDLHTJTCNHO, ofs0, ns] 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.934+0000 7fddfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758650 cookie 94200254311808 notifier 5633 bl.length()=190 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.935+0000 7fddfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO info.flags=0x7 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.935+0000 7fddfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UIVUMPNKIRDLHTJTCNHO to cache LRU end 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:30:26.934 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "ragweed.client.0", 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "UIVUMPNKIRDLHTJTCNHO", 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "y7WgIHcxRHHuHFKGVue70ZMccHTDP+GAQW/codFUw3cXA+KI59b/EQ==", 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:30:26.931193Z" 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:30:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:30:26.936 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:30:26.931182Z", 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:30:26.938 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:30:26.938 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:30:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.936+0000 7fdddafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.938+0000 7fdf266b9800 20 remove_watcher() i=0 2024-09-14T11:30:26.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.938+0000 7fdf266b9800 2 removed watcher, disabling cache 2024-09-14T11:30:26.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.939+0000 7fdf266b9800 20 remove_watcher() i=1 2024-09-14T11:30:26.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.940+0000 7fdf266b9800 20 remove_watcher() i=2 2024-09-14T11:30:26.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.941+0000 7fdf266b9800 20 remove_watcher() i=3 2024-09-14T11:30:26.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.942+0000 7fdf266b9800 20 remove_watcher() i=4 2024-09-14T11:30:26.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.943+0000 7fdf266b9800 20 remove_watcher() i=5 2024-09-14T11:30:26.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.944+0000 7fdf266b9800 20 remove_watcher() i=6 2024-09-14T11:30:26.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:26.945+0000 7fdf266b9800 20 remove_watcher() i=7 2024-09-14T11:30:26.955 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:30:26.955 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ABTSURDPUHMWVFCLLGEZ --secret q2XpEqR7xDHqGFHcoFxAIkEYkJnh6zbXJSsQ7bBPS2ag/c6mVzEDGA== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:30:27.021 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:27.021 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:27.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.055+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 realm 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.057+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.058+0000 7fc29e533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:27.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.058+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.058+0000 7fc29e533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:27.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.058+0000 7fc29e533800 20 searching for the correct realm 2024-09-14T11:30:27.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.062+0000 7fc29aa77640 0 -- 172.21.15.94:0/4040602296 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55a11e112700 msgr2=0x55a11e114b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:27.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.065+0000 7fc29a276640 0 -- 172.21.15.94:0/4040602296 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fc28406a910 msgr2=0x7fc28408d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:27.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:30:27.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:30:27.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.069+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 zone default found 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 4 Realm: () 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:30:27.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 zonegroup default 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.070+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.071+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.071+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.071+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.071+0000 7fc29e533800 20 started sync module instance, tier type = 2024-09-14T11:30:27.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.071+0000 7fc29e533800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=0 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=1 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=2 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=3 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=4 2024-09-14T11:30:27.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=5 2024-09-14T11:30:27.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.079+0000 7fc29e533800 20 add_watcher() i=6 2024-09-14T11:30:27.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.080+0000 7fc29e533800 20 add_watcher() i=7 2024-09-14T11:30:27.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.080+0000 7fc29e533800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 5 note: GC not initialized 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc0cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 20 Filter name: none 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc0c97fa640 20 reqs_thread_entry: start 2024-09-14T11:30:27.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.082+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache get: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ : miss 2024-09-14T11:30:27.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 20 rados->read ofs=0 len=0 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ info.flags=0x0 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 adding default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ to cache LRU end 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache get: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ : hit (negative entry) 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.083+0000 7fc29e533800 10 cache get: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ : hit (negative entry) 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:30:27.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc29e533800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc29e533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc17dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758604 cookie 94150482586736 notifier 5651 bl.length()=675 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc17dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.085+0000 7fc17dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.086+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.086+0000 7fc29e533800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:30:27.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.086+0000 7fc29e533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:30:27.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.087+0000 7fc17d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758612 cookie 94150482601456 notifier 5651 bl.length()=202 2024-09-14T11:30:27.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.087+0000 7fc17d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:30:27.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.087+0000 7fc17d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:30:27.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.088+0000 7fc29e533800 10 cache put: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ info.flags=0x7 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.088+0000 7fc29e533800 10 moving default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ to cache LRU end 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.088+0000 7fc29e533800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ABTSURDPUHMWVFCLLGEZ, ofs0, ns] 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.089+0000 7fc17d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758613 cookie 94150482589248 notifier 5651 bl.length()=190 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.089+0000 7fc17d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ info.flags=0x7 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.089+0000 7fc17d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ABTSURDPUHMWVFCLLGEZ to cache LRU end 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:30:27.088 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "sysuser.client.0", 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "ABTSURDPUHMWVFCLLGEZ", 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "q2XpEqR7xDHqGFHcoFxAIkEYkJnh6zbXJSsQ7bBPS2ag/c6mVzEDGA==", 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:30:27.085622Z" 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:30:27.089 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "system": true, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:30:27.090 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:30:27.085610Z", 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:30:27.091 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:30:27.092 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:30:27.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.090+0000 7fc150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:27.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.092+0000 7fc29e533800 20 remove_watcher() i=0 2024-09-14T11:30:27.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.092+0000 7fc29e533800 2 removed watcher, disabling cache 2024-09-14T11:30:27.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.093+0000 7fc29e533800 20 remove_watcher() i=1 2024-09-14T11:30:27.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.094+0000 7fc29e533800 20 remove_watcher() i=2 2024-09-14T11:30:27.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.095+0000 7fc29e533800 20 remove_watcher() i=3 2024-09-14T11:30:27.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.096+0000 7fc29e533800 20 remove_watcher() i=4 2024-09-14T11:30:27.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.096+0000 7fc29e533800 20 remove_watcher() i=5 2024-09-14T11:30:27.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.097+0000 7fc29e533800 20 remove_watcher() i=6 2024-09-14T11:30:27.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:27.098+0000 7fc29e533800 20 remove_watcher() i=7 2024-09-14T11:30:27.108 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:30:27.108 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:30:27.108 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:30:27.136 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:30:27.137 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:30:27.137 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:30:27.206 DEBUG:teuthology.orchestra.run.smithi094:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:30:27.398 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:30:27.561 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:30:28.132 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:30:34.457 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:30:37.836 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=e369ca6957137b3b47c44c8a555fb41ace7663c19c72e3c50f2941be22e1e171,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:30:37.837 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='3662140761' 2024-09-14T11:30:37.837 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:30:38.036 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-14T11:30:38.036 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:30:38.037 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:30:38.037 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:30:38.037 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-14T11:30:38.131 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 9 items 2024-09-14T11:30:38.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:30:40.009 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:30:40.738 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:30:41.435 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:30:42.168 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:30:42.899 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:30:49.631 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:30:51.201 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:30:53.178 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:30:56.201 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:30:56.202 INFO:teuthology.orchestra.run.smithi094.stdout:======================== 9 passed, 1 warning in 18.16s ========================= 2024-09-14T11:30:56.232 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:30:56.232 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-14T11:30:56.232 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-14T11:30:56.250 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:30:56.250 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:30:56.279 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:30:56.375 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:56.375 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:56.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.410+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.411+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.411+0000 7f463e725800 20 realm 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.411+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.412+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.412+0000 7f463e725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.412+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.412+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.412+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.413+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.413+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.413+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:56.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.413+0000 7f463e725800 20 searching for the correct realm 2024-09-14T11:30:56.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.416+0000 7f4633fff640 0 -- 172.21.15.94:0/1722088683 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f462c028020 msgr2=0x7f462c099410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.419+0000 7f463a333640 0 -- 172.21.15.94:0/1722088683 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f46240ae670 msgr2=0x7f46240ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:30:56.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:30:56.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.625+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 zone default found 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 4 Realm: () 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 zonegroup default 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.626+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.627+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.627+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.627+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.627+0000 7f463e725800 20 started sync module instance, tier type = 2024-09-14T11:30:56.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.627+0000 7f463e725800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=0 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=1 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=2 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=3 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=4 2024-09-14T11:30:56.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=5 2024-09-14T11:30:56.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.636+0000 7f463e725800 20 add_watcher() i=6 2024-09-14T11:30:56.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.637+0000 7f463e725800 20 add_watcher() i=7 2024-09-14T11:30:56.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.637+0000 7f463e725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.639+0000 7f44f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.639+0000 7f463e725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.639+0000 7f463e725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f446b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:56.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f463e725800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:56.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f463e725800 20 Filter name: none 2024-09-14T11:30:56.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f44697fa640 20 reqs_thread_entry: start 2024-09-14T11:30:56.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f463e725800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:30:56.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.675+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.676+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:30:56.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.676+0000 7f463e725800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:30:56.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.676+0000 7f463e725800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:30:56.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.676+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 : miss 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 info.flags=0x17 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 to cache LRU end 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.677+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 2024-09-14T11:30:56.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.678+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:30:56.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.678+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:30:56.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.678+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:30:56.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.679+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:30:56.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.679+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:30:56.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.679+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:30:56.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.680+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:30:56.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.680+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:30:56.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.681+0000 7f463e725800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:30:56.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.681+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559734e4c6c8 s->prefetch_data=0 2024-09-14T11:30:56.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.682+0000 7f463e725800 10 manifest: total_size = 15978 2024-09-14T11:30:56.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.682+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17517003949768275442 2024-09-14T11:30:56.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.682+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x559734e4c6c8 s->prefetch_data=0 2024-09-14T11:30:56.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.682+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4c6c8 2024-09-14T11:30:56.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.682+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.1 2024-09-14T11:30:56.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=15978 stripe_ofs=15978 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17517003949768275442 2024-09-14T11:30:56.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.iZEw4msvapaRtJgoNcrJAq6S0FWw8s__0 2024-09-14T11:30:56.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.684+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17517003949768275442 2024-09-14T11:30:56.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.685+0000 7f451dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559734dd4678 s->prefetch_data=0 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 10 manifest: total_size = 4891 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16622485588501179546 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x559734dd4678 s->prefetch_data=0 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4678 2024-09-14T11:30:56.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.686+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.2 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=4891 stripe_ofs=4891 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16622485588501179546 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.OlVsF8ml0nRlgVsPbsfwDnxA9Az4orS_0 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.688+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16622485588501179546 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559734dd4678 s->prefetch_data=0 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 10 manifest: total_size = 7695 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13996604251466789231 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x559734dd4678 s->prefetch_data=0 2024-09-14T11:30:56.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4678 2024-09-14T11:30:56.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.690+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.2 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=7695 stripe_ofs=7695 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13996604251466789231 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.BbZV9p0H_2iSWs6m3Xd_zDohFfJaDqz_0 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.693+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13996604251466789231 2024-09-14T11:30:56.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.694+0000 7f451dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:30:56.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.694+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.695+0000 7f463e725800 10 manifest: total_size = 7557 2024-09-14T11:30:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.695+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11306290942936981785 2024-09-14T11:30:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.695+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.695+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4648 2024-09-14T11:30:56.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.695+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.3 2024-09-14T11:30:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=7557 stripe_ofs=7557 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11306290942936981785 2024-09-14T11:30:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.corBMEnIZoCxhUAWK5AvvjwfekG1C4S_0 2024-09-14T11:30:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.697+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11306290942936981785 2024-09-14T11:30:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.698+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:30:56.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 20 get_obj_state: octx=0x559734dcc3f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 10 manifest: total_size = 7547 2024-09-14T11:30:56.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16707366916163987067 2024-09-14T11:30:56.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 20 get_obj_state: octx=0x559734dcc3f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4648 2024-09-14T11:30:56.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.699+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.4 2024-09-14T11:30:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=7547 stripe_ofs=7547 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16707366916163987067 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.9z6nXFSwc8zpUCdHgv7Ren50QAae1Vz_0 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.701+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16707366916163987067 2024-09-14T11:30:56.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.702+0000 7f451dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 20 get_obj_state: octx=0x7f462c05f2d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 10 manifest: total_size = 13592 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13339475860254945380 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 20 get_obj_state: octx=0x7f462c05f2d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x559734dd4648 s->prefetch_data=0 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4648 2024-09-14T11:30:56.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.703+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.4 2024-09-14T11:30:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=13592 stripe_ofs=13592 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13339475860254945380 2024-09-14T11:30:56.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.gdP6kQU1Mzrdd0cGrpww_5o0qcNwaCi_0 2024-09-14T11:30:56.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.705+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13339475860254945380 2024-09-14T11:30:56.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.706+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:30:56.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 20 get_obj_state: octx=0x559734e4dc40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 10 manifest: total_size = 7530 2024-09-14T11:30:56.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12332320204713420123 2024-09-14T11:30:56.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 20 get_obj_state: octx=0x559734e4dc40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4608 2024-09-14T11:30:56.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.707+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.5 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=7530 stripe_ofs=7530 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12332320204713420123 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.ArX_8Zb60aI3UKery6d15RqV7KIj5Fb_0 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.710+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12332320204713420123 2024-09-14T11:30:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.711+0000 7f451dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:30:56.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.711+0000 7f463e725800 20 get_obj_state: octx=0x559734dd1b30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.712+0000 7f463e725800 10 manifest: total_size = 5379 2024-09-14T11:30:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.712+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5744016537601411023 2024-09-14T11:30:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.712+0000 7f463e725800 20 get_obj_state: octx=0x559734dd1b30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.712+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4608 2024-09-14T11:30:56.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.712+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.7 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5379 stripe_ofs=5379 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5744016537601411023 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.qZDDMgT5I5KwlBSNaCWueM_9q9XOmdV_0 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.714+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5744016537601411023 2024-09-14T11:30:56.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.715+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:30:56.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.715+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4140 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.716+0000 7f463e725800 10 manifest: total_size = 38605 2024-09-14T11:30:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.716+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5664474445825196784 2024-09-14T11:30:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.716+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4140 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.716+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4608 2024-09-14T11:30:56.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.716+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5.8 2024-09-14T11:30:56.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=38605 stripe_ofs=38605 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5664474445825196784 2024-09-14T11:30:56.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.q7AkZchysgIBRhcZ6DK0XW7uOT4dGYX_0 2024-09-14T11:30:56.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:56.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.718+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5664474445825196784 2024-09-14T11:30:56.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.719+0000 7f451dffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:30:56.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.720+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.722+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:30:56.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.722+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.722+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:30:56.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.722+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:30:56.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.722+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:30:56.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.723+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:30:56.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.723+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:30:56.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.724+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94107915049312 notifier 5940 bl.length()=162 2024-09-14T11:30:56.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.725+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 from cache 2024-09-14T11:30:56.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.725+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5, ofs0, ns] 2024-09-14T11:30:56.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.725+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94107915066624 notifier 5940 bl.length()=219 2024-09-14T11:30:56.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.730+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 : miss 2024-09-14T11:30:56.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.730+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.730+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.730+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 info.flags=0x0 2024-09-14T11:30:56.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.730+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5 to cache LRU end 2024-09-14T11:30:56.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.732+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 : miss 2024-09-14T11:30:56.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.732+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:30:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 info.flags=0x17 2024-09-14T11:30:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 to cache LRU end 2024-09-14T11:30:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.733+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 2024-09-14T11:30:56.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 10 manifest: total_size = 886297 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17168079802733822422 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4608 2024-09-14T11:30:56.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.737+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12.10 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:30:56.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17168079802733822422 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.1 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.2 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:30:56.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.3 2024-09-14T11:30:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:30:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.4 2024-09-14T11:30:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:30:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.740+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17168079802733822422 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.741+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.741+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.741+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.742+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.742+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.742+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.742+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.742+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.744+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:30:56.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.744+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.744+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:30:56.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.744+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:30:56.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.744+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:30:56.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.745+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:30:56.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.745+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:30:56.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.746+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562420 cookie 94107915047104 notifier 5940 bl.length()=191 2024-09-14T11:30:56.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.747+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 from cache 2024-09-14T11:30:56.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.747+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12, ofs0, ns] 2024-09-14T11:30:56.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.748+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94107915047104 notifier 5940 bl.length()=249 2024-09-14T11:30:56.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.750+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 : miss 2024-09-14T11:30:56.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.750+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.750+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.750+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 info.flags=0x0 2024-09-14T11:30:56.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.750+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12 to cache LRU end 2024-09-14T11:30:56.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.752+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 : miss 2024-09-14T11:30:56.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.752+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 info.flags=0x17 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 to cache LRU end 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.753+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 20 get_obj_state: octx=0x559734e4e150 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 10 manifest: total_size = 74198 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11820451183711918061 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 20 get_obj_state: octx=0x559734e4e150 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x559734dd4608 s->prefetch_data=0 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd4608 2024-09-14T11:30:56.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.757+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13.10 2024-09-14T11:30:56.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:30:56.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-14T11:30:56.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11820451183711918061 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.1 2024-09-14T11:30:56.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.2 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.3 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.4 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.759+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11820451183711918061 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.760+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.761+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.761+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.762+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.762+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.762+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.762+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.762+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.763+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:30:56.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.763+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.764+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:30:56.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.764+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:30:56.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.764+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:30:56.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.765+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:30:56.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.765+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:30:56.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.766+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94107915057792 notifier 5940 bl.length()=198 2024-09-14T11:30:56.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.767+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 from cache 2024-09-14T11:30:56.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.767+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13, ofs0, ns] 2024-09-14T11:30:56.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.767+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562434 cookie 94107915071520 notifier 5940 bl.length()=256 2024-09-14T11:30:56.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.770+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 : miss 2024-09-14T11:30:56.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.770+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.771+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.771+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 info.flags=0x0 2024-09-14T11:30:56.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.771+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13 to cache LRU end 2024-09-14T11:30:56.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 : miss 2024-09-14T11:30:56.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:30:56.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 info.flags=0x17 2024-09-14T11:30:56.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 to cache LRU end 2024-09-14T11:30:56.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.773+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 10 cls_bucket_list_unordered: got foo[51vn8Na2D3V2yZS8MOIfkndanGVMu5C] 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 20 get_obj_state: octx=0x559734e4de20 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559734dd2848 s->prefetch_data=0 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 77torb3h70i7n4i92pj0zboyfm9hqzpk 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 20 get_obj_state_impl: setting s->olh_tag to al6y89fm9xcf3rr9do63jlobx445nucd 2024-09-14T11:30:56.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.778+0000 7f463e725800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=al6y89fm9xcf3rr9do63jlobx445nucd 2024-09-14T11:30:56.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.779+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:30:56.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 olh_log_entry: epoch=3 op=3 key=foo[51vn8Na2D3V2yZS8MOIfkndanGVMu5C] 2024-09-14T11:30:56.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 get_obj_state: octx=0x559734e4de20 obj=test-client.0-r-test-multipart-index-versioning.1:_:51vn8Na2D3V2yZS8MOIfkndanGVMu5C_foo state=0x559734dddbf8 s->prefetch_data=0 2024-09-14T11:30:56.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 10 manifest: total_size = 886297 2024-09-14T11:30:56.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11604008661079158838 2024-09-14T11:30:56.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 get_obj_state: octx=0x559734e4de20 obj=test-client.0-r-test-multipart-index-versioning.1:_:51vn8Na2D3V2yZS8MOIfkndanGVMu5C_foo state=0x559734dddbf8 s->prefetch_data=0 2024-09-14T11:30:56.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dddbf8 2024-09-14T11:30:56.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.781+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:30:56.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11604008661079158838 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.1 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.2 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.3 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.4 2024-09-14T11:30:56.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:30:56.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.784+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11604008661079158838 2024-09-14T11:30:56.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.785+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo[51vn8Na2D3V2yZS8MOIfkndanGVMu5C] 2024-09-14T11:30:56.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.786+0000 7f463e725800 20 get_obj_state: octx=0x559734e4de20 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x559734dd2848 s->prefetch_data=0 2024-09-14T11:30:56.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.788+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.789+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11.10 2024-09-14T11:30:56.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.789+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.789+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.790+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.790+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.790+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.790+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.790+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.791+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:30:56.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.791+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.792+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:30:56.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.792+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:30:56.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.792+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:30:56.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.793+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:30:56.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.793+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:30:56.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.793+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94107915057792 notifier 5940 bl.length()=193 2024-09-14T11:30:56.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.794+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 from cache 2024-09-14T11:30:56.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.794+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11, ofs0, ns] 2024-09-14T11:30:56.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.795+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94107915063920 notifier 5940 bl.length()=251 2024-09-14T11:30:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.797+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 : miss 2024-09-14T11:30:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.797+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.797+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.797+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 info.flags=0x0 2024-09-14T11:30:56.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.797+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11 to cache LRU end 2024-09-14T11:30:56.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.799+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 : miss 2024-09-14T11:30:56.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.799+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 info.flags=0x17 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 to cache LRU end 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.800+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 2024-09-14T11:30:56.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.804+0000 7f463e725800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:30:56.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.804+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0cb0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559734de8d38 s->prefetch_data=0 2024-09-14T11:30:56.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.805+0000 7f463e725800 10 manifest: total_size = 1667 2024-09-14T11:30:56.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.805+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14207390513458564241 2024-09-14T11:30:56.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.805+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0cb0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x559734de8d38 s->prefetch_data=0 2024-09-14T11:30:56.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.805+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734de8d38 2024-09-14T11:30:56.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.805+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10.10 2024-09-14T11:30:56.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14207390513458564241 2024-09-14T11:30:56.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.1 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.2 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.3 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.4 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.807+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14207390513458564241 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.808+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.809+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.811+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:30:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.811+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.812+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:30:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.812+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:30:56.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.812+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:30:56.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.812+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:30:56.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.812+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:30:56.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.813+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94107915063920 notifier 5940 bl.length()=183 2024-09-14T11:30:56.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.814+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 from cache 2024-09-14T11:30:56.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.814+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10, ofs0, ns] 2024-09-14T11:30:56.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.814+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94107915057792 notifier 5940 bl.length()=241 2024-09-14T11:30:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.817+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 : miss 2024-09-14T11:30:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.817+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.817+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.817+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 info.flags=0x0 2024-09-14T11:30:56.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.817+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10 to cache LRU end 2024-09-14T11:30:56.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 : miss 2024-09-14T11:30:56.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 info.flags=0x17 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 to cache LRU end 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.819+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 2024-09-14T11:30:56.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.820+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:30:56.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.821+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:30:56.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.821+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:30:56.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.822+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:30:56.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.822+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:30:56.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.822+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:30:56.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:30:56.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:30:56.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:30:56.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:30:56.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:30:56.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.823+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 20 get_obj_state: octx=0x559734d490f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 10 manifest: total_size = 22651 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _p5vDblHp041tuq1X2byOd6lnG_Q6lvb 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 20 get_obj_state: octx=0x559734d490f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.824+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.0 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _p5vDblHp041tuq1X2byOd6lnG_Q6lvb 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.lRstEWY9XrtRP8XuGHXi8LVyCbekqXu_0 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.827+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _p5vDblHp041tuq1X2byOd6lnG_Q6lvb 2024-09-14T11:30:56.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:30:56.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 20 get_obj_state: octx=0x559734d490f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _9689E98gPNhE6E1Ezy_sQMn09GJxoXS 2024-09-14T11:30:56.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 20 get_obj_state: octx=0x559734d490f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.828+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.2 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _9689E98gPNhE6E1Ezy_sQMn09GJxoXS 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.osf9N01oCBdOOZVioZDa5NF16a5W9pD_0 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.831+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _9689E98gPNhE6E1Ezy_sQMn09GJxoXS 2024-09-14T11:30:56.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.832+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:30:56.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.832+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4dd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.833+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.833+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1586181546938410619 2024-09-14T11:30:56.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.833+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4dd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.833+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.833+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.3 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1586181546938410619 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.YItx1ffB0gl8AY3DRD5mUdeTtpIHYA-_0 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.835+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1586181546938410619 2024-09-14T11:30:56.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.836+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:30:56.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.836+0000 7f463e725800 20 get_obj_state: octx=0x559734dde550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.837+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.837+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _4-7W-P5uNYXThhQQpPp9NbzqHYV-_lT 2024-09-14T11:30:56.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.837+0000 7f463e725800 20 get_obj_state: octx=0x559734dde550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.837+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.837+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.5 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _4-7W-P5uNYXThhQQpPp9NbzqHYV-_lT 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.1cNQPxYHlJNg-VS8H3uM4bbpQLDNNvR_0 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.839+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _4-7W-P5uNYXThhQQpPp9NbzqHYV-_lT 2024-09-14T11:30:56.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.840+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:30:56.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.840+0000 7f463e725800 20 get_obj_state: octx=0x559734d49090 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.841+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.841+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _GjVP5wtIP1cxIII5sIi5PzFCHnAYLoO 2024-09-14T11:30:56.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.841+0000 7f463e725800 20 get_obj_state: octx=0x559734d49090 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.841+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.841+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.5 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _GjVP5wtIP1cxIII5sIi5PzFCHnAYLoO 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.ha42TcDXZEN7-YsFKE7m0y98XeYcbZ5_0 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.843+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _GjVP5wtIP1cxIII5sIi5PzFCHnAYLoO 2024-09-14T11:30:56.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:30:56.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 10 manifest: total_size = 22651 2024-09-14T11:30:56.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8701808936812922717 2024-09-14T11:30:56.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 20 get_obj_state: octx=0x559734dd4d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.844+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.5 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8701808936812922717 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.7lazgQEBsMVODjIDiDmoi5fw3VcZ3LW_0 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.847+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8701808936812922717 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0f20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _C2tnharcgui9RTyWAJweyq602Zyml90 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0f20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.848+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.7 2024-09-14T11:30:56.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _C2tnharcgui9RTyWAJweyq602Zyml90 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pl8my19GPILagsKvz0x7VD4V80dzfZ1_0 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.850+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _C2tnharcgui9RTyWAJweyq602Zyml90 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 20 get_obj_state: octx=0x559734d489b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3421872134844261668 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 20 get_obj_state: octx=0x559734d489b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.852+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.7 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3421872134844261668 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pa6iv4RFgvPgheyRWwjhw2RbvrnD-zt_0 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.855+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3421872134844261668 2024-09-14T11:30:56.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:30:56.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 20 get_obj_state: octx=0x559734dd3580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 10 manifest: total_size = 22651 2024-09-14T11:30:56.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16337497076214911325 2024-09-14T11:30:56.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 20 get_obj_state: octx=0x559734dd3580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.856+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.7 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16337497076214911325 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.7lazgQEBsMVODjIDiDmoi5fw3VcZ3LW_0 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.859+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16337497076214911325 2024-09-14T11:30:56.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:30:56.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 20 get_obj_state: octx=0x7f4624072480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17968043484971997677 2024-09-14T11:30:56.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 20 get_obj_state: octx=0x7f4624072480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.860+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.8 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17968043484971997677 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pa6iv4RFgvPgheyRWwjhw2RbvrnD-zt_0 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.863+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17968043484971997677 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 20 get_obj_state: octx=0x7f46240e4a60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 10 manifest: total_size = 22651 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _U1Jr3Rpw1wm51xnuG7Y2L7qdWuh9DoJ 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 20 get_obj_state: octx=0x7f46240e4a60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.864+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.8 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _U1Jr3Rpw1wm51xnuG7Y2L7qdWuh9DoJ 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.tHtR2G_GdaUw3P-x-zLAOnGRT8hal8c_0 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.867+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _U1Jr3Rpw1wm51xnuG7Y2L7qdWuh9DoJ 2024-09-14T11:30:56.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:30:56.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 20 get_obj_state: octx=0x7f4624072480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 10 manifest: total_size = 5242880 2024-09-14T11:30:56.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4961232178230650945 2024-09-14T11:30:56.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 20 get_obj_state: octx=0x7f4624072480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x559734dcff68 s->prefetch_data=0 2024-09-14T11:30:56.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dcff68 2024-09-14T11:30:56.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.868+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16.9 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4961232178230650945 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.YItx1ffB0gl8AY3DRD5mUdeTtpIHYA-_0 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.871+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4961232178230650945 2024-09-14T11:30:56.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.872+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:30:56.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.872+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.872+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.873+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.873+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.873+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.873+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.873+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.874+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:30:56.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.874+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.875+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:30:56.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.875+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:30:56.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.875+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:30:56.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.876+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:30:56.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.876+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:30:56.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.876+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94107915057792 notifier 5940 bl.length()=189 2024-09-14T11:30:56.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.877+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 from cache 2024-09-14T11:30:56.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.877+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16, ofs0, ns] 2024-09-14T11:30:56.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.878+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94107915063920 notifier 5940 bl.length()=247 2024-09-14T11:30:56.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.881+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 : miss 2024-09-14T11:30:56.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.881+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.881+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.881+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 info.flags=0x0 2024-09-14T11:30:56.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.881+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16 to cache LRU end 2024-09-14T11:30:56.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 : miss 2024-09-14T11:30:56.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:30:56.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 info.flags=0x17 2024-09-14T11:30:56.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 to cache LRU end 2024-09-14T11:30:56.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 2024-09-14T11:30:56.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.883+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:30:56.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.885+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:30:56.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.885+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:30:56.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:30:56.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:30:56.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:30:56.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:30:56.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:30:56.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.886+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:30:56.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.887+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:30:56.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.887+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:30:56.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.887+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.887+0000 7f463e725800 20 get_obj_state: octx=0x559734dd08e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.888+0000 7f463e725800 10 manifest: total_size = 1087 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.888+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _31C-jMbRNbMx4kCBsXydRUxTowS3KEH 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.888+0000 7f463e725800 20 get_obj_state: octx=0x559734dd08e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.888+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.888+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.0 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _31C-jMbRNbMx4kCBsXydRUxTowS3KEH 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.yXwqsBWIpsNX06_qWYQQfn_0xjAwWLu_0 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.890+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _31C-jMbRNbMx4kCBsXydRUxTowS3KEH 2024-09-14T11:30:56.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.891+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:30:56.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.891+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.892+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.892+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _jd6si1HAM92cxTBY7S5rK_Nr3Jc-joi 2024-09-14T11:30:56.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.892+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.892+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.892+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.2 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _jd6si1HAM92cxTBY7S5rK_Nr3Jc-joi 2024-09-14T11:30:56.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_._yuZEGGNCIYg4h5OW5hgoyf_kevWuuJ_0 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_._yuZEGGNCIYg4h5OW5hgoyf_kevWuuJ_1 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.894+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _jd6si1HAM92cxTBY7S5rK_Nr3Jc-joi 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.895+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.895+0000 7f463e725800 20 get_obj_state: octx=0x559734dd41a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.896+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.896+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18022353528764144076 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.896+0000 7f463e725800 20 get_obj_state: octx=0x559734dd41a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.896+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.896+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.3 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18022353528764144076 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.1 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.2 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.3 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.898+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18022353528764144076 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.899+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.899+0000 7f463e725800 20 get_obj_state: octx=0x559734d48740 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.900+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.900+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _Uvg_f7fY4r18HGlH8N1wq6DXOhEZA7B 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.900+0000 7f463e725800 20 get_obj_state: octx=0x559734d48740 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.900+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.900+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.5 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _Uvg_f7fY4r18HGlH8N1wq6DXOhEZA7B 2024-09-14T11:30:56.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.58lMfxOpkKE-NNzNfn1HcKOcbPwOmqz_0 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.58lMfxOpkKE-NNzNfn1HcKOcbPwOmqz_1 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.902+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _Uvg_f7fY4r18HGlH8N1wq6DXOhEZA7B 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.903+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.903+0000 7f463e725800 20 get_obj_state: octx=0x559734d48740 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.904+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.904+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to __XJJnEQltXwyAVzQKdKmtM2d4_Kgbu6 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.904+0000 7f463e725800 20 get_obj_state: octx=0x559734d48740 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.904+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.904+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.5 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: __XJJnEQltXwyAVzQKdKmtM2d4_Kgbu6 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.KuANZ7qpa8E5IoKiE3iAYIflfenN989_0 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:30:56.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.KuANZ7qpa8E5IoKiE3iAYIflfenN989_1 2024-09-14T11:30:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:30:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.906+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: __XJJnEQltXwyAVzQKdKmtM2d4_Kgbu6 2024-09-14T11:30:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.907+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:30:56.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.907+0000 7f463e725800 20 get_obj_state: octx=0x559734dd08e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.908+0000 7f463e725800 10 manifest: total_size = 1087 2024-09-14T11:30:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.908+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.341665548257866098 2024-09-14T11:30:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.908+0000 7f463e725800 20 get_obj_state: octx=0x559734dd08e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.908+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.908+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.5 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.341665548257866098 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.1 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.2 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.3 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.910+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.341665548257866098 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.911+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.911+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.912+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.912+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _gZAgOUUK1ZxPsDXteoqOXc2AajI5xVF 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.912+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.912+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.912+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.7 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _gZAgOUUK1ZxPsDXteoqOXc2AajI5xVF 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.lBpOkJqi8rUt1lB1vkPL4DHGmjQTf68_0 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.lBpOkJqi8rUt1lB1vkPL4DHGmjQTf68_1 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:30:56.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.914+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _gZAgOUUK1ZxPsDXteoqOXc2AajI5xVF 2024-09-14T11:30:56.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.915+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:30:56.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.915+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.916+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.916+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15826512973577643744 2024-09-14T11:30:56.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.916+0000 7f463e725800 20 get_obj_state: octx=0x7f462400a270 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.916+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.916+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.7 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15826512973577643744 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.1 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.2 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.3 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.918+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15826512973577643744 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.919+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.919+0000 7f463e725800 20 get_obj_state: octx=0x7f46240b2f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.920+0000 7f463e725800 10 manifest: total_size = 1087 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.920+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10333258511245575886 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.920+0000 7f463e725800 20 get_obj_state: octx=0x7f46240b2f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.920+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.920+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.7 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10333258511245575886 2024-09-14T11:30:56.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.1 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.2 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.3 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.922+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10333258511245575886 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15307705166009533685 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.923+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.8 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15307705166009533685 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.1 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.2 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.3 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.926+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15307705166009533685 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.927+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.927+0000 7f463e725800 20 get_obj_state: octx=0x559734ddf6e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.928+0000 7f463e725800 10 manifest: total_size = 1087 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.928+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to _iJ9YZ5MpH-vpSVB-Q6WDOyo9HudASIM 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.928+0000 7f463e725800 20 get_obj_state: octx=0x559734ddf6e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.928+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.928+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.8 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: _iJ9YZ5MpH-vpSVB-Q6WDOyo9HudASIM 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.XA1hEmiMyw7X_NJ6F-g5dZf7AsZ3-0y_0 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.930+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _iJ9YZ5MpH-vpSVB-Q6WDOyo9HudASIM 2024-09-14T11:30:56.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 20 get_obj_state: octx=0x559734dd1170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:30:56.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13098424056179520117 2024-09-14T11:30:56.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 20 get_obj_state: octx=0x559734dd1170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.931+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17.9 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13098424056179520117 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.1 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.2 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.3 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.934+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13098424056179520117 2024-09-14T11:30:56.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.935+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:30:56.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.935+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.935+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.936+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.936+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.936+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.936+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.936+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.938+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:30:56.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.938+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.938+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:30:56.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.938+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:30:56.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.938+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:30:56.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.940+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:30:56.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.940+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:30:56.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.940+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94107915061824 notifier 5940 bl.length()=199 2024-09-14T11:30:56.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.941+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 from cache 2024-09-14T11:30:56.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.941+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17, ofs0, ns] 2024-09-14T11:30:56.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.941+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562381 cookie 94107915058848 notifier 5940 bl.length()=257 2024-09-14T11:30:56.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.946+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 : miss 2024-09-14T11:30:56.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.946+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.946+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.946+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 info.flags=0x0 2024-09-14T11:30:56.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.946+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17 to cache LRU end 2024-09-14T11:30:56.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.948+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 : miss 2024-09-14T11:30:56.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.948+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.948+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.948+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 info.flags=0x17 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.949+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 to cache LRU end 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.949+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.949+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.949+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 2024-09-14T11:30:56.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.950+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:30:56.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.951+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:30:56.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.951+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:30:56.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.952+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbd90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.953+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.953+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10873774505386701718 2024-09-14T11:30:56.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.953+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbd90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.953+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:56.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.953+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15.3 2024-09-14T11:30:56.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10873774505386701718 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.1 2024-09-14T11:30:56.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.2 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.3 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.955+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10873774505386701718 2024-09-14T11:30:56.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.956+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 10 manifest: total_size = 45360 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14727069055150399910 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:56.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.957+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15.5 2024-09-14T11:30:56.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:30:56.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-14T11:30:56.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:30:56.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:30:56.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14727069055150399910 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.1 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.2 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.3 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:30:56.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.959+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14727069055150399910 2024-09-14T11:30:56.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.960+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:30:56.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.960+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbd90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.961+0000 7f463e725800 10 manifest: total_size = 11534336 2024-09-14T11:30:56.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.961+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.384935773260551923 2024-09-14T11:30:56.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.961+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbd90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.961+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:56.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.961+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15.7 2024-09-14T11:30:56.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:30:56.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.384935773260551923 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.1 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.2 2024-09-14T11:30:56.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.3 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.963+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.384935773260551923 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.964+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:30:56.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.965+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.967+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:30:56.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.967+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.967+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:30:56.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.967+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:30:56.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.967+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:30:56.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.968+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:30:56.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.968+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:30:56.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.968+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94107915066624 notifier 5940 bl.length()=194 2024-09-14T11:30:56.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.970+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 from cache 2024-09-14T11:30:56.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.970+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15, ofs0, ns] 2024-09-14T11:30:56.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.970+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562382 cookie 94107915058848 notifier 5940 bl.length()=252 2024-09-14T11:30:56.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.973+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 : miss 2024-09-14T11:30:56.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.973+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.973+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.973+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 info.flags=0x0 2024-09-14T11:30:56.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.973+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15 to cache LRU end 2024-09-14T11:30:56.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 : miss 2024-09-14T11:30:56.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:30:56.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 info.flags=0x17 2024-09-14T11:30:56.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 to cache LRU end 2024-09-14T11:30:56.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:56.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.975+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 2024-09-14T11:30:56.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.977+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:30:56.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.978+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:30:56.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.978+0000 7f463e725800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:30:56.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.979+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.980+0000 7f463e725800 10 manifest: total_size = 10485760 2024-09-14T11:30:56.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.980+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11235599325450750161 2024-09-14T11:30:56.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.980+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:56.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.980+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:56.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.980+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14.3 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11235599325450750161 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.H8RyccuXPRKa6ODNlqvSsA103ZSLqKA_0 2024-09-14T11:30:56.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:30:56.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.H8RyccuXPRKa6ODNlqvSsA103ZSLqKA_1 2024-09-14T11:30:56.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:30:56.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.982+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11235599325450750161 2024-09-14T11:30:56.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.983+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0e90 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.983+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.984+0000 7f463e725800 10 manifest: total_size = 10485760 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.984+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8894746188658483153 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.984+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0e90 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.984+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.984+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14.5 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8894746188658483153 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.WdBVM0Gx9tgcLZxVTdrAhAggJvpFrfS_0 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.WdBVM0Gx9tgcLZxVTdrAhAggJvpFrfS_1 2024-09-14T11:30:56.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-14T11:30:56.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.986+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8894746188658483153 2024-09-14T11:30:56.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f451dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:30:56.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 10 manifest: total_size = 10485760 2024-09-14T11:30:56.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12315890095361596645 2024-09-14T11:30:56.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x559734dd7398 s->prefetch_data=0 2024-09-14T11:30:56.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dd7398 2024-09-14T11:30:56.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.987+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14.7 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12315890095361596645 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.tO3r74v_f47xnqdE8dfFWnLdJORNOD-_0 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.tO3r74v_f47xnqdE8dfFWnLdJORNOD-_1 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:56.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.989+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12315890095361596645 2024-09-14T11:30:56.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.991+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:30:56.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.991+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:56.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.991+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:56.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.992+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:56.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.992+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:56.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.992+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:56.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.992+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:56.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.992+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:56.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.993+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:30:56.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.993+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.994+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:30:56.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.994+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:30:56.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.994+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:30:56.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.995+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:30:56.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.995+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:30:56.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.995+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 94107915057792 notifier 5940 bl.length()=184 2024-09-14T11:30:56.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.996+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 from cache 2024-09-14T11:30:56.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.996+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14, ofs0, ns] 2024-09-14T11:30:56.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.996+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94107915071520 notifier 5940 bl.length()=242 2024-09-14T11:30:56.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.999+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 : miss 2024-09-14T11:30:56.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.999+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.999+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.999+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 info.flags=0x0 2024-09-14T11:30:56.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:56.999+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14 to cache LRU end 2024-09-14T11:30:56.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.001+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 : miss 2024-09-14T11:30:56.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.001+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 info.flags=0x17 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 to cache LRU end 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:57.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.002+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 2024-09-14T11:30:57.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.003+0000 7f463e725800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:30:57.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.003+0000 7f463e725800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:30:57.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.004+0000 7f463e725800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:30:57.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.005+0000 7f463e725800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:30:57.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 10 manifest: total_size = 0 2024-09-14T11:30:57.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16276399122795500156 2024-09-14T11:30:57.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:57.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.006+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7.2 2024-09-14T11:30:57.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.008+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.009+0000 7f463e725800 10 manifest: total_size = 0 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.009+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16176191601946299672 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.009+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.009+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.009+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7.3 2024-09-14T11:30:57.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.010+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:30:57.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 10 manifest: total_size = 0 2024-09-14T11:30:57.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11727129805603220732 2024-09-14T11:30:57.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 20 get_obj_state: octx=0x559734dd9fb0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:57.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.011+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7.6 2024-09-14T11:30:57.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.012+0000 7f451dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 10 manifest: total_size = 0 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6430414045719149073 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 20 get_obj_state: octx=0x7f462c062b10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x559734e4bf88 s->prefetch_data=0 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734e4bf88 2024-09-14T11:30:57.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.014+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7.8 2024-09-14T11:30:57.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.015+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:30:57.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.017+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:57.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.017+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:57.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:30:57.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:57.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:57.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:57.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:57.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.018+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:57.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.020+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:30:57.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.020+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.020+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:30:57.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.020+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:30:57.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.020+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:30:57.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.021+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:30:57.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.021+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:30:57.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.022+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562422 cookie 94107915047104 notifier 5940 bl.length()=181 2024-09-14T11:30:57.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.023+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 from cache 2024-09-14T11:30:57.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.023+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7, ofs0, ns] 2024-09-14T11:30:57.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.023+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94107915049312 notifier 5940 bl.length()=238 2024-09-14T11:30:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.026+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 : miss 2024-09-14T11:30:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.026+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.026+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.026+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 info.flags=0x0 2024-09-14T11:30:57.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.026+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7 to cache LRU end 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 : miss 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 info.flags=0x17 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 to cache LRU end 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:57.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:57.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.028+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 2024-09-14T11:30:57.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.029+0000 7f463e725800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:30:57.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.030+0000 7f463e725800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:30:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.031+0000 7f463e725800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:30:57.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.032+0000 7f463e725800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:30:57.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.032+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbe90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559734ddd0f8 s->prefetch_data=0 2024-09-14T11:30:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.033+0000 7f463e725800 10 manifest: total_size = 2078 2024-09-14T11:30:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.033+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15698392873203768230 2024-09-14T11:30:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.033+0000 7f463e725800 20 get_obj_state: octx=0x559734ddbe90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x559734ddd0f8 s->prefetch_data=0 2024-09-14T11:30:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.033+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734ddd0f8 2024-09-14T11:30:57.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.033+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8.2 2024-09-14T11:30:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15698392873203768230 2024-09-14T11:30:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.8R3hP436MrZS1E-fqEOeLeSQLBsEmlX_0 2024-09-14T11:30:57.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:57.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.035+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15698392873203768230 2024-09-14T11:30:57.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.036+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:30:57.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.036+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.037+0000 7f463e725800 10 manifest: total_size = 38 2024-09-14T11:30:57.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.037+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14067540327519604463 2024-09-14T11:30:57.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.037+0000 7f463e725800 20 get_obj_state: octx=0x559734e4d860 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.037+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734ddcbe8 2024-09-14T11:30:57.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.037+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8.3 2024-09-14T11:30:57.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14067540327519604463 2024-09-14T11:30:57.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.OuDVyyI-T6739NAaDU41k5MB3my-cXa_0 2024-09-14T11:30:57.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:57.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.039+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14067540327519604463 2024-09-14T11:30:57.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.040+0000 7f451dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:30:57.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 20 get_obj_state: octx=0x7f46340608f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 10 manifest: total_size = 24595 2024-09-14T11:30:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2268494932251879820 2024-09-14T11:30:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 20 get_obj_state: octx=0x7f46340608f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734ddcbe8 2024-09-14T11:30:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.041+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8.6 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2268494932251879820 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.iJ542GiO9pV4fnhIOXBxZo6wTWHmglZ_0 2024-09-14T11:30:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.043+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2268494932251879820 2024-09-14T11:30:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.044+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:30:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.044+0000 7f463e725800 20 get_obj_state: octx=0x7f46340608f0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.045+0000 7f463e725800 10 manifest: total_size = 527 2024-09-14T11:30:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.045+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4899973486549816373 2024-09-14T11:30:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.045+0000 7f463e725800 20 get_obj_state: octx=0x7f46340608f0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x559734ddcbe8 s->prefetch_data=0 2024-09-14T11:30:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.045+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734ddcbe8 2024-09-14T11:30:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.045+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8.8 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4899973486549816373 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.1zsbjc0eYm9Rx8AWY3yXB7Gz1uup-kL_0 2024-09-14T11:30:57.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:57.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.047+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4899973486549816373 2024-09-14T11:30:57.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.048+0000 7f451dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:30:57.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.048+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:57.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.048+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:57.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.049+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:57.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.049+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:57.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.049+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:57.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.049+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:57.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.049+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:57.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.051+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:30:57.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.051+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.051+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:30:57.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.051+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:30:57.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.051+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:30:57.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.052+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:30:57.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.052+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:30:57.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.053+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562423 cookie 94107915047104 notifier 5940 bl.length()=181 2024-09-14T11:30:57.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.054+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 from cache 2024-09-14T11:30:57.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.054+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8, ofs0, ns] 2024-09-14T11:30:57.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.054+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94107915049312 notifier 5940 bl.length()=238 2024-09-14T11:30:57.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.057+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 : miss 2024-09-14T11:30:57.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.057+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.057+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.057+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 info.flags=0x0 2024-09-14T11:30:57.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.057+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8 to cache LRU end 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 : miss 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 info.flags=0x17 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 to cache LRU end 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:57.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:30:57.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.059+0000 7f463e725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 2024-09-14T11:30:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.061+0000 7f463e725800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:30:57.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.061+0000 7f463e725800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:30:57.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.062+0000 7f463e725800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:30:57.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.063+0000 7f463e725800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 10 manifest: total_size = 55 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8743978898548448580 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dda8a8 2024-09-14T11:30:57.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.064+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9.2 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8743978898548448580 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.9vT-ymdVTOh1THSxqWkkHEwelh1243p_0 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:57.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.067+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8743978898548448580 2024-09-14T11:30:57.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.068+0000 7f451dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:30:57.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 10 manifest: total_size = 1048576 2024-09-14T11:30:57.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13041919771586879725 2024-09-14T11:30:57.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dda8a8 2024-09-14T11:30:57.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.069+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9.3 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13041919771586879725 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.yCVGriHZDf0cUqlUQjP0ix2oM43fpvi_0 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.072+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13041919771586879725 2024-09-14T11:30:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.073+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:30:57.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.073+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.074+0000 7f463e725800 10 manifest: total_size = 1035 2024-09-14T11:30:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.074+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7455521943901181873 2024-09-14T11:30:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.074+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.074+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dda8a8 2024-09-14T11:30:57.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.074+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9.6 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7455521943901181873 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.3L_uUDGZBy2oEWWmsWcza9XR09TuDSV_0 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.076+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7455521943901181873 2024-09-14T11:30:57.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.077+0000 7f451dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:30:57.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.077+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.078+0000 7f463e725800 10 manifest: total_size = 1035 2024-09-14T11:30:57.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.078+0000 7f463e725800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3803479202944945158 2024-09-14T11:30:57.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.078+0000 7f463e725800 20 get_obj_state: octx=0x559734dd0df0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x559734dda8a8 s->prefetch_data=0 2024-09-14T11:30:57.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.078+0000 7f463e725800 20 prepare_atomic_modification: state is not atomic. state=0x559734dda8a8 2024-09-14T11:30:57.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.078+0000 7f463e725800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9.8 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3803479202944945158 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.gGqbSn0Agi-8aN8mjd8_DW2JfHFNMuy_0 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:30:57.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.080+0000 7f463e725800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3803479202944945158 2024-09-14T11:30:57.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.081+0000 7f463e725800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:30:57.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.081+0000 7f463e725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:30:57.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.081+0000 7f451d7fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:30:57.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.082+0000 7f463e725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:30:57.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.082+0000 7f463e725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:30:57.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.082+0000 7f463e725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:30:57.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.082+0000 7f463e725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:30:57.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.082+0000 7f463e725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:30:57.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.084+0000 7f463e725800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:30:57.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.084+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.084+0000 7f463e725800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:30:57.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.084+0000 7f463e725800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:30:57.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.084+0000 7f463e725800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:30:57.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.085+0000 7f463e725800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:30:57.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.085+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:30:57.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.085+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562424 cookie 94107915047104 notifier 5940 bl.length()=181 2024-09-14T11:30:57.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.087+0000 7f463e725800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 from cache 2024-09-14T11:30:57.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.087+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9, ofs0, ns] 2024-09-14T11:30:57.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.087+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94107915049312 notifier 5940 bl.length()=238 2024-09-14T11:30:57.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.090+0000 7f463e725800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 : miss 2024-09-14T11:30:57.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.090+0000 7f463e725800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.090+0000 7f463e725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.090+0000 7f463e725800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 info.flags=0x0 2024-09-14T11:30:57.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.090+0000 7f463e725800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9 to cache LRU end 2024-09-14T11:30:57.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.092+0000 7f463e725800 10 removing key index: UIVUMPNKIRDLHTJTCNHO 2024-09-14T11:30:57.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.093+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:UIVUMPNKIRDLHTJTCNHO, ofs0, ns] 2024-09-14T11:30:57.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.093+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94107915071520 notifier 5940 bl.length()=170 2024-09-14T11:30:57.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.093+0000 7f463e725800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:30:57.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.094+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:30:57.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.095+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94107915057792 notifier 5940 bl.length()=182 2024-09-14T11:30:57.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.095+0000 7f463e725800 10 removing user buckets index 2024-09-14T11:30:57.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.096+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:30:57.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.096+0000 7f451d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94107915066624 notifier 5940 bl.length()=173 2024-09-14T11:30:57.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.097+0000 7f463e725800 10 removing user index: ragweed.client.0 2024-09-14T11:30:57.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.098+0000 7f463e725800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:30:57.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.098+0000 7f463e725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:30:57.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.098+0000 7f451dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 94107915063920 notifier 5940 bl.length()=165 2024-09-14T11:30:57.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.099+0000 7f44f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:57.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.101+0000 7f463e725800 20 remove_watcher() i=0 2024-09-14T11:30:57.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.101+0000 7f463e725800 2 removed watcher, disabling cache 2024-09-14T11:30:57.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.102+0000 7f463e725800 20 remove_watcher() i=1 2024-09-14T11:30:57.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.103+0000 7f463e725800 20 remove_watcher() i=2 2024-09-14T11:30:57.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.104+0000 7f463e725800 20 remove_watcher() i=3 2024-09-14T11:30:57.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.105+0000 7f463e725800 20 remove_watcher() i=4 2024-09-14T11:30:57.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.106+0000 7f463e725800 20 remove_watcher() i=5 2024-09-14T11:30:57.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.107+0000 7f463e725800 20 remove_watcher() i=6 2024-09-14T11:30:57.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.108+0000 7f463e725800 20 remove_watcher() i=7 2024-09-14T11:30:57.116 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:30:57.173 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:57.173 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:57.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.208+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.209+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.209+0000 7f752ab0c800 20 realm 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.209+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.210+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.210+0000 7f752ab0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.210+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.210+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.210+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.211+0000 7f752ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:57.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.211+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.211+0000 7f752ab0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:57.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.211+0000 7f752ab0c800 20 searching for the correct realm 2024-09-14T11:30:57.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.213+0000 7f7527df5640 0 -- 172.21.15.94:0/4293374199 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f7518075070 msgr2=0x7f75180833c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:57.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.217+0000 7f75285f6640 0 -- 172.21.15.94:0/4293374199 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f751008bc10 msgr2=0x7f751006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.423+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 zone default found 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 4 Realm: () 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 zonegroup default 2024-09-14T11:30:57.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.424+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.425+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.425+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.425+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.425+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.426+0000 7f752ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.426+0000 7f752ab0c800 20 started sync module instance, tier type = 2024-09-14T11:30:57.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.426+0000 7f752ab0c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:30:57.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=0 2024-09-14T11:30:57.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=1 2024-09-14T11:30:57.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=2 2024-09-14T11:30:57.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=3 2024-09-14T11:30:57.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=4 2024-09-14T11:30:57.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=5 2024-09-14T11:30:57.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.434+0000 7f752ab0c800 20 add_watcher() i=6 2024-09-14T11:30:57.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.435+0000 7f752ab0c800 20 add_watcher() i=7 2024-09-14T11:30:57.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.435+0000 7f752ab0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:57.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.437+0000 7f73defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:57.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.437+0000 7f752ab0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:57.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.437+0000 7f752ab0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:57.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f73ddfdb640 20 reqs_thread_entry: start 2024-09-14T11:30:57.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f752ab0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:57.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f752ab0c800 20 Filter name: none 2024-09-14T11:30:57.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f734f7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f752ab0c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.470+0000 7f752ab0c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.471+0000 7f752ab0c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.471+0000 7f752ab0c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.471+0000 7f752ab0c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.471+0000 7f752ab0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:57.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.471+0000 7f752ab0c800 10 removing key index: ABTSURDPUHMWVFCLLGEZ 2024-09-14T11:30:57.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.472+0000 7f752ab0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:ABTSURDPUHMWVFCLLGEZ, ofs0, ns] 2024-09-14T11:30:57.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.472+0000 7f73ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 93949198679808 notifier 5696 bl.length()=170 2024-09-14T11:30:57.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.473+0000 7f752ab0c800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:30:57.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.474+0000 7f752ab0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:30:57.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.474+0000 7f73feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 93949198692576 notifier 5696 bl.length()=182 2024-09-14T11:30:57.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.474+0000 7f752ab0c800 10 removing user buckets index 2024-09-14T11:30:57.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.475+0000 7f752ab0c800 10 removing user index: sysuser.client.0 2024-09-14T11:30:57.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.476+0000 7f752ab0c800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:30:57.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.476+0000 7f752ab0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:30:57.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.476+0000 7f73ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 93949198687024 notifier 5696 bl.length()=165 2024-09-14T11:30:57.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.477+0000 7f73defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:57.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.480+0000 7f752ab0c800 20 remove_watcher() i=0 2024-09-14T11:30:57.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.480+0000 7f752ab0c800 2 removed watcher, disabling cache 2024-09-14T11:30:57.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.481+0000 7f752ab0c800 20 remove_watcher() i=1 2024-09-14T11:30:57.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.481+0000 7f752ab0c800 20 remove_watcher() i=2 2024-09-14T11:30:57.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.482+0000 7f752ab0c800 20 remove_watcher() i=3 2024-09-14T11:30:57.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.483+0000 7f752ab0c800 20 remove_watcher() i=4 2024-09-14T11:30:57.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.484+0000 7f752ab0c800 20 remove_watcher() i=5 2024-09-14T11:30:57.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.485+0000 7f752ab0c800 20 remove_watcher() i=6 2024-09-14T11:30:57.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:30:57.486+0000 7f752ab0c800 20 remove_watcher() i=7 2024-09-14T11:30:57.495 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:30:57.495 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:30:57.569 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:30:57.579 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:30:57.579 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:30:57.580 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:57.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:30:57.608 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:30:57.608 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:57.676 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:30:57.676 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:30:57.745 INFO:tasks.workunit:timeout=3h 2024-09-14T11:30:57.745 INFO:tasks.workunit:cleanup=True 2024-09-14T11:30:57.746 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:30:57.816 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:31:54.054 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:31:54.054 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.054 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:31:54.054 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:31:54.054 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:31:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:31:54.057 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:31:54.125 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:31:54.127 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:31:54.127 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:31:54.175 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:31:54.225 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:31:54.263 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:31:54.265 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:31:54.265 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:31:54.303 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:31:54.306 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:31:54.306 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:31:54.375 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:31:54.376 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:31:54.376 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:31:54.448 INFO:tasks.workunit.client.0.smithi094.stderr:+ ulimit -c 0 2024-09-14T11:31:54.448 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:31:54.449 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:31:54.449 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:31:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:31:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-14T11:31:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:31:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:31:56.810 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-14T11:31:56.811 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:31:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-14T11:31:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-14T11:31:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:31:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:31:56.812 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-14T11:31:57.038 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:31:57.219 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-14T11:31:57.225 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:31:57.268 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-14T11:31:57.268 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-14T11:31:57.268 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:31:57.417 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:31:57.422 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:31:58.145 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-14T11:31:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-14T11:31:58.970 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-14T11:31:58.971 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:31:59.513 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:31:59.514 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:31:59.564 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:31:59.565 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:31:59.611 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:31:59.612 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:31:59.670 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:59.671 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:31:59.749 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:59.750 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:31:59.950 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:31:59.951 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:31:59.956 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:31:59.957 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:31:59.967 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:31:59.968 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:31:59.969 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:31:59.971 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:31:59.972 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:32:00.045 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:32:01.071 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:32:01.188 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:32:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:32:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:01.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.586+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:01.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 20 realm 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.587+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.588+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.588+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:01.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.589+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:01.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.589+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:01.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.589+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:01.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.589+0000 7fd87833d800 20 searching for the correct realm 2024-09-14T11:32:01.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.592+0000 7fd873829640 0 -- 172.21.15.94:0/2782901968 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fd86408c030 msgr2=0x7fd86408c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:01.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:01.799+0000 7fd87402a640 0 -- 172.21.15.94:0/2782901968 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd868020940 msgr2=0x7fd868008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:02.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.006+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:02.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 zone default found 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 4 Realm: () 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 zonegroup default 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.007+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.008+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.008+0000 7fd87833d800 20 started sync module instance, tier type = 2024-09-14T11:32:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.008+0000 7fd87833d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:02.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=0 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=1 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=2 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=3 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=4 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=5 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.018+0000 7fd87833d800 20 add_watcher() i=6 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.019+0000 7fd87833d800 20 add_watcher() i=7 2024-09-14T11:32:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.019+0000 7fd87833d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd72afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd87833d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd87833d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd87833d800 5 note: GC not initialized 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd729fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd87833d800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd87833d800 20 Filter name: none 2024-09-14T11:32:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.022+0000 7fd69b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:32:02.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:32:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:32:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:32:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.023+0000 7fd87833d800 20 rados->read ofs=0 len=0 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.024+0000 7fd87833d800 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:32:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.025+0000 7fd72afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:02.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.027+0000 7fd87833d800 20 remove_watcher() i=0 2024-09-14T11:32:02.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.027+0000 7fd87833d800 2 removed watcher, disabling cache 2024-09-14T11:32:02.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.028+0000 7fd87833d800 20 remove_watcher() i=1 2024-09-14T11:32:02.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.029+0000 7fd87833d800 20 remove_watcher() i=2 2024-09-14T11:32:02.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.031+0000 7fd87833d800 20 remove_watcher() i=3 2024-09-14T11:32:02.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.032+0000 7fd87833d800 20 remove_watcher() i=4 2024-09-14T11:32:02.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.033+0000 7fd87833d800 20 remove_watcher() i=5 2024-09-14T11:32:02.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.034+0000 7fd87833d800 20 remove_watcher() i=6 2024-09-14T11:32:02.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:02.035+0000 7fd87833d800 20 remove_watcher() i=7 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:32:12.965 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.965 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.005+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.006+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.006+0000 7f8e9a220800 20 realm 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.006+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.007+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.007+0000 7f8e9a220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.007+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.007+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.007+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.008+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.008+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.008+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.008+0000 7f8e9a220800 20 searching for the correct realm 2024-09-14T11:32:13.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.012+0000 7f8e97509640 0 -- 172.21.15.94:0/1353790852 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f8e8802e070 msgr2=0x7f8e88053920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.016+0000 7f8e9850b640 0 -- 172.21.15.94:0/1353790852 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f8e800bdb20 msgr2=0x7f8e800c83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 zone default found 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 4 Realm: () 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:13.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 zonegroup default 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.021+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 started sync module instance, tier type = 2024-09-14T11:32:13.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.022+0000 7f8e9a220800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=0 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=1 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=2 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=3 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=4 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=5 2024-09-14T11:32:13.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.032+0000 7f8e9a220800 20 add_watcher() i=6 2024-09-14T11:32:13.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.033+0000 7f8e9a220800 20 add_watcher() i=7 2024-09-14T11:32:13.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.033+0000 7f8e9a220800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.034+0000 7f8d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 5 note: GC not initialized 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8d4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 20 Filter name: none 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8cc67fc640 20 reqs_thread_entry: start 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.035+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.036+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:13.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.036+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:13.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:13.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:13.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.037+0000 7f8e9a220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.040+0000 7f8d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.042+0000 7f8e9a220800 20 remove_watcher() i=0 2024-09-14T11:32:13.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.042+0000 7f8e9a220800 2 removed watcher, disabling cache 2024-09-14T11:32:13.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.043+0000 7f8e9a220800 20 remove_watcher() i=1 2024-09-14T11:32:13.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.044+0000 7f8e9a220800 20 remove_watcher() i=2 2024-09-14T11:32:13.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.045+0000 7f8e9a220800 20 remove_watcher() i=3 2024-09-14T11:32:13.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.046+0000 7f8e9a220800 20 remove_watcher() i=4 2024-09-14T11:32:13.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.047+0000 7f8e9a220800 20 remove_watcher() i=5 2024-09-14T11:32:13.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.048+0000 7f8e9a220800 20 remove_watcher() i=6 2024-09-14T11:32:13.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.049+0000 7f8e9a220800 20 remove_watcher() i=7 2024-09-14T11:32:13.057 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:13.057 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:13.057 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:32:13.057 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:13.059 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:32:13.089 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.089 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.128+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 realm 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.130+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.131+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.131+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.131+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.131+0000 7f469b62f800 20 searching for the correct realm 2024-09-14T11:32:13.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.134+0000 7f4698918640 0 -- 172.21.15.94:0/4267133845 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f468c06a420 msgr2=0x7f468c087960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.138+0000 7f4699119640 0 -- 172.21.15.94:0/4267133845 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f468406d420 msgr2=0x7f468406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.344+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 zone default found 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 4 Realm: () 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 zonegroup default 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.345+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.346+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.346+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.346+0000 7f469b62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.346+0000 7f469b62f800 20 started sync module instance, tier type = 2024-09-14T11:32:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.346+0000 7f469b62f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=0 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=1 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=2 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=3 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=4 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=5 2024-09-14T11:32:13.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=6 2024-09-14T11:32:13.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 20 add_watcher() i=7 2024-09-14T11:32:13.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.558+0000 7f469b62f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.561+0000 7f454ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 5 note: GC not initialized 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f454efe5640 20 reqs_thread_entry: start 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 20 Filter name: none 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f454cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:32:13.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.562+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:13.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:13.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:13.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:13.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.563+0000 7f469b62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:13.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.565+0000 7f454ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.568+0000 7f469b62f800 20 remove_watcher() i=0 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.568+0000 7f469b62f800 2 removed watcher, disabling cache 2024-09-14T11:32:13.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.569+0000 7f469b62f800 20 remove_watcher() i=1 2024-09-14T11:32:13.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.570+0000 7f469b62f800 20 remove_watcher() i=2 2024-09-14T11:32:13.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.571+0000 7f469b62f800 20 remove_watcher() i=3 2024-09-14T11:32:13.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.572+0000 7f469b62f800 20 remove_watcher() i=4 2024-09-14T11:32:13.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.573+0000 7f469b62f800 20 remove_watcher() i=5 2024-09-14T11:32:13.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.574+0000 7f469b62f800 20 remove_watcher() i=6 2024-09-14T11:32:13.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.575+0000 7f469b62f800 20 remove_watcher() i=7 2024-09-14T11:32:13.585 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-14T11:32:13.612 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.612 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.650+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 realm 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.652+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.653+0000 7f054ee20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.653+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.653+0000 7f054ee20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.653+0000 7f054ee20800 20 searching for the correct realm 2024-09-14T11:32:13.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.657+0000 7f054d10b640 0 -- 172.21.15.94:0/692658280 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x555f8f568880 msgr2=0x555f8f56ac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.661+0000 7f054c109640 0 -- 172.21.15.94:0/692658280 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f05440ac260 msgr2=0x7f0544004040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 zone default found 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 4 Realm: () 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 zonegroup default 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.665+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 started sync module instance, tier type = 2024-09-14T11:32:13.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.666+0000 7f054ee20800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=0 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=1 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=2 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=3 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=4 2024-09-14T11:32:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=5 2024-09-14T11:32:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.675+0000 7f054ee20800 20 add_watcher() i=6 2024-09-14T11:32:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.676+0000 7f054ee20800 20 add_watcher() i=7 2024-09-14T11:32:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.676+0000 7f054ee20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.677+0000 7f0402fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f054ee20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f054ee20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f054ee20800 5 note: GC not initialized 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f0401fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f054ee20800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f054ee20800 20 Filter name: none 2024-09-14T11:32:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.678+0000 7f03737fe640 20 reqs_thread_entry: start 2024-09-14T11:32:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.685+0000 7f0402fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.687+0000 7f054ee20800 20 remove_watcher() i=0 2024-09-14T11:32:13.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.687+0000 7f054ee20800 2 removed watcher, disabling cache 2024-09-14T11:32:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.688+0000 7f054ee20800 20 remove_watcher() i=1 2024-09-14T11:32:13.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.689+0000 7f054ee20800 20 remove_watcher() i=2 2024-09-14T11:32:13.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.690+0000 7f054ee20800 20 remove_watcher() i=3 2024-09-14T11:32:13.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.692+0000 7f054ee20800 20 remove_watcher() i=4 2024-09-14T11:32:13.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.693+0000 7f054ee20800 20 remove_watcher() i=5 2024-09-14T11:32:13.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.693+0000 7f054ee20800 20 remove_watcher() i=6 2024-09-14T11:32:13.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.694+0000 7f054ee20800 20 remove_watcher() i=7 2024-09-14T11:32:13.703 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-14T11:32:13.703 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process 2024-09-14T11:32:13.703 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:13.704 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-14T11:32:13.730 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.730 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.769+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 realm 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.771+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.772+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.772+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.772+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.772+0000 7f395032c800 20 searching for the correct realm 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.976+0000 7f394c73f640 0 -- 172.21.15.94:0/3482915681 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f39400bdc20 msgr2=0x7f39400ca130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:13.979+0000 7f394c73f640 0 -- 172.21.15.94:0/3482915681 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f3940068020 msgr2=0x7f39400aa0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.190+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 zone default found 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 4 Realm: () 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:14.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 zonegroup default 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.191+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.192+0000 7f395032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.192+0000 7f395032c800 20 started sync module instance, tier type = 2024-09-14T11:32:14.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.192+0000 7f395032c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:14.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=0 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=1 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=2 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=3 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=4 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=5 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=6 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 20 add_watcher() i=7 2024-09-14T11:32:14.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.201+0000 7f395032c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.203+0000 7f38027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.203+0000 7f395032c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.203+0000 7f395032c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.203+0000 7f395032c800 5 note: GC not initialized 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.204+0000 7f38017e2640 20 reqs_thread_entry: start 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.204+0000 7f395032c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.204+0000 7f395032c800 20 Filter name: none 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.204+0000 7f37fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.204+0000 7f395032c800 20 processing logshard = reshard.0000000000 2024-09-14T11:32:14.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.206+0000 7f395032c800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:32:14.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.206+0000 7f395032c800 20 processing logshard = reshard.0000000001 2024-09-14T11:32:14.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.209+0000 7f395032c800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:32:14.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.209+0000 7f395032c800 20 processing logshard = reshard.0000000002 2024-09-14T11:32:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.211+0000 7f395032c800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:32:14.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.211+0000 7f395032c800 20 processing logshard = reshard.0000000003 2024-09-14T11:32:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.214+0000 7f395032c800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:32:14.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.214+0000 7f395032c800 20 processing logshard = reshard.0000000004 2024-09-14T11:32:14.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.218+0000 7f395032c800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:32:14.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.218+0000 7f395032c800 20 processing logshard = reshard.0000000005 2024-09-14T11:32:14.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.221+0000 7f395032c800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:32:14.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.221+0000 7f395032c800 20 processing logshard = reshard.0000000006 2024-09-14T11:32:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 20 process_entry resharding a-bucket 2024-09-14T11:32:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:32:14.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.222+0000 7f395032c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.223+0000 7f395032c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:14.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f395032c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f395032c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f395032c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f395032c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:14.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f382a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94341498313808 notifier 6045 bl.length()=911 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f382a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f382a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.229+0000 7f382a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.230+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.230+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.230+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:14.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.230+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:14.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:14.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:14.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:14.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.0 2024-09-14T11:32:14.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.234+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.235+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.235+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.235+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.4 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.236+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.5 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.237+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.6 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.237+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.7 2024-09-14T11:32:14.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.237+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.8 2024-09-14T11:32:14.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.238+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.9 2024-09-14T11:32:14.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.239+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.10 2024-09-14T11:32:14.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.240+0000 7f395032c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:14.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.240+0000 7f395032c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:14.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f395032c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f395032c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f395032c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f395032c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f382affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94341498313808 notifier 6045 bl.length()=911 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f382affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f382affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.241+0000 7f382affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.242+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.242+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.242+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:14.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.242+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:14.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.244+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.0 2024-09-14T11:32:14.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.244+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1 2024-09-14T11:32:14.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.245+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2 2024-09-14T11:32:14.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.245+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3 2024-09-14T11:32:14.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.246+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.4 2024-09-14T11:32:14.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.246+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.5 2024-09-14T11:32:14.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.246+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.6 2024-09-14T11:32:14.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.247+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.7 2024-09-14T11:32:14.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.247+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.8 2024-09-14T11:32:14.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.247+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.9 2024-09-14T11:32:14.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.248+0000 7f395032c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.10 2024-09-14T11:32:14.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.248+0000 7f395032c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:14.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.248+0000 7f395032c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:14.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.249+0000 7f395032c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.249+0000 7f395032c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.249+0000 7f395032c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.249+0000 7f395032c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f382affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94341498313808 notifier 6045 bl.length()=879 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f382affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f382affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f382affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:14.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:14.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.250+0000 7f395032c800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:14.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.252+0000 7f395032c800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:14.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.253+0000 7f395032c800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:32:14.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.255+0000 7f395032c800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:32:14.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.255+0000 7f395032c800 20 processing logshard = reshard.0000000007 2024-09-14T11:32:14.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.257+0000 7f395032c800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:32:14.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.257+0000 7f395032c800 20 processing logshard = reshard.0000000008 2024-09-14T11:32:14.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.260+0000 7f395032c800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:32:14.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.260+0000 7f395032c800 20 processing logshard = reshard.0000000009 2024-09-14T11:32:14.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.262+0000 7f395032c800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:32:14.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.262+0000 7f395032c800 20 processing logshard = reshard.0000000010 2024-09-14T11:32:14.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.264+0000 7f395032c800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:32:14.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.264+0000 7f395032c800 20 processing logshard = reshard.0000000011 2024-09-14T11:32:14.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.267+0000 7f395032c800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:32:14.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.267+0000 7f395032c800 20 processing logshard = reshard.0000000012 2024-09-14T11:32:14.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.269+0000 7f395032c800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:32:14.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.269+0000 7f395032c800 20 processing logshard = reshard.0000000013 2024-09-14T11:32:14.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.272+0000 7f395032c800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:32:14.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.272+0000 7f395032c800 20 processing logshard = reshard.0000000014 2024-09-14T11:32:14.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.274+0000 7f395032c800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:32:14.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.274+0000 7f395032c800 20 processing logshard = reshard.0000000015 2024-09-14T11:32:14.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.276+0000 7f395032c800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:32:14.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.277+0000 7f38027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.279+0000 7f395032c800 20 remove_watcher() i=0 2024-09-14T11:32:14.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.279+0000 7f395032c800 2 removed watcher, disabling cache 2024-09-14T11:32:14.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.280+0000 7f395032c800 20 remove_watcher() i=1 2024-09-14T11:32:14.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.281+0000 7f395032c800 20 remove_watcher() i=2 2024-09-14T11:32:14.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.282+0000 7f395032c800 20 remove_watcher() i=3 2024-09-14T11:32:14.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.283+0000 7f395032c800 20 remove_watcher() i=4 2024-09-14T11:32:14.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.284+0000 7f395032c800 20 remove_watcher() i=5 2024-09-14T11:32:14.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.285+0000 7f395032c800 20 remove_watcher() i=6 2024-09-14T11:32:14.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:14.286+0000 7f395032c800 20 remove_watcher() i=7 2024-09-14T11:32:19.301 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:32:19.333 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:19.333 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:19.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.378+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.380+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.380+0000 7f481cf2e800 20 realm 2024-09-14T11:32:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.380+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.381+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.381+0000 7f481cf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.381+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.381+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.381+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.382+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:19.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.382+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.382+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:19.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.382+0000 7f481cf2e800 20 searching for the correct realm 2024-09-14T11:32:19.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.384+0000 7f4818cdd640 0 -- 172.21.15.94:0/1737185781 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f4810020040 msgr2=0x7f4810010920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:19.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.589+0000 7f48194de640 0 -- 172.21.15.94:0/1737185781 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f480c0e5040 msgr2=0x7f480c0ab730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.595+0000 7f481cf2e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 zone default found 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 4 Realm: () 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 zonegroup default 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.596+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 started sync module instance, tier type = 2024-09-14T11:32:19.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.597+0000 7f481cf2e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:19.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=0 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=1 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=2 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=3 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=4 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=5 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.607+0000 7f481cf2e800 20 add_watcher() i=6 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.608+0000 7f481cf2e800 20 add_watcher() i=7 2024-09-14T11:32:19.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.608+0000 7f481cf2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:19.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.610+0000 7f46cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:19.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:19.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:19.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 5 note: GC not initialized 2024-09-14T11:32:19.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f46cdfe3640 20 reqs_thread_entry: start 2024-09-14T11:32:19.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:19.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 20 Filter name: none 2024-09-14T11:32:19.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f463f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:19.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.611+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.612+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:19.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.612+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.612+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:19.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.612+0000 7f481cf2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:19.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.612+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.613+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:19.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.613+0000 7f481cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.613+0000 7f481cf2e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:19.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.613+0000 7f481cf2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:19.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.615+0000 7f46cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:19.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.617+0000 7f481cf2e800 20 remove_watcher() i=0 2024-09-14T11:32:19.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.617+0000 7f481cf2e800 2 removed watcher, disabling cache 2024-09-14T11:32:19.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.618+0000 7f481cf2e800 20 remove_watcher() i=1 2024-09-14T11:32:19.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.619+0000 7f481cf2e800 20 remove_watcher() i=2 2024-09-14T11:32:19.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.621+0000 7f481cf2e800 20 remove_watcher() i=3 2024-09-14T11:32:19.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.622+0000 7f481cf2e800 20 remove_watcher() i=4 2024-09-14T11:32:19.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.623+0000 7f481cf2e800 20 remove_watcher() i=5 2024-09-14T11:32:19.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.623+0000 7f481cf2e800 20 remove_watcher() i=6 2024-09-14T11:32:19.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.624+0000 7f481cf2e800 20 remove_watcher() i=7 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add non empty bucket 2024-09-14T11:32:19.634 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:19.638 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.638 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.647 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.647 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.656 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.656 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.664 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.664 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.672 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.672 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.680 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.681 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.688 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.689 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.696 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:19.696 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:19.703 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:32:19.731 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:19.731 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:19.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.770+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 20 realm 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.771+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.772+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.772+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.772+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:19.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.772+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.773+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:19.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.773+0000 7f100fb40800 20 searching for the correct realm 2024-09-14T11:32:19.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.776+0000 7f100c0c1640 0 -- 172.21.15.94:0/4237659322 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x56170db4dd20 msgr2=0x56170db501e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:19.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.780+0000 7f100b0bf640 0 -- 172.21.15.94:0/4237659322 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f0ffc044040 msgr2=0x7f0ffc037420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:19.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:19.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:19.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.783+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 zone default found 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 4 Realm: () 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 zonegroup default 2024-09-14T11:32:19.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.784+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.785+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.785+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.785+0000 7f100fb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.785+0000 7f100fb40800 20 started sync module instance, tier type = 2024-09-14T11:32:19.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.785+0000 7f100fb40800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=0 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=1 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=2 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=3 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=4 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=5 2024-09-14T11:32:19.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.793+0000 7f100fb40800 20 add_watcher() i=6 2024-09-14T11:32:19.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.794+0000 7f100fb40800 20 add_watcher() i=7 2024-09-14T11:32:19.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.794+0000 7f100fb40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:19.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f0ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:19.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:19.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:19.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 5 note: GC not initialized 2024-09-14T11:32:19.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f0ec0fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:19.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:19.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 20 Filter name: none 2024-09-14T11:32:19.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f0e3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:19.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.796+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.797+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.797+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.797+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.797+0000 7f100fb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.797+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.798+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.798+0000 7f100fb40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.798+0000 7f100fb40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:19.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.798+0000 7f100fb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:19.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.799+0000 7f0ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:19.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.801+0000 7f100fb40800 20 remove_watcher() i=0 2024-09-14T11:32:19.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.801+0000 7f100fb40800 2 removed watcher, disabling cache 2024-09-14T11:32:19.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.802+0000 7f100fb40800 20 remove_watcher() i=1 2024-09-14T11:32:19.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.803+0000 7f100fb40800 20 remove_watcher() i=2 2024-09-14T11:32:19.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.804+0000 7f100fb40800 20 remove_watcher() i=3 2024-09-14T11:32:19.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.805+0000 7f100fb40800 20 remove_watcher() i=4 2024-09-14T11:32:19.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.806+0000 7f100fb40800 20 remove_watcher() i=5 2024-09-14T11:32:19.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.807+0000 7f100fb40800 20 remove_watcher() i=6 2024-09-14T11:32:19.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.808+0000 7f100fb40800 20 remove_watcher() i=7 2024-09-14T11:32:19.817 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:19.817 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:19.817 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:32:19.817 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:19.818 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:32:19.849 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:19.849 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:19.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.888+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 realm 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:19.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.890+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.891+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:19.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.891+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:19.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.892+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:19.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.892+0000 7f1705b28800 20 searching for the correct realm 2024-09-14T11:32:19.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.894+0000 7f1701f5e640 0 -- 172.21.15.94:0/3579745370 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f16f8036060 msgr2=0x7f16f8067fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:19.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:19.899+0000 7f170175d640 0 -- 172.21.15.94:0/3579745370 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f16f8072740 msgr2=0x7f16f801c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.105+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 zone default found 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 4 Realm: () 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 zonegroup default 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.106+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 started sync module instance, tier type = 2024-09-14T11:32:20.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.107+0000 7f1705b28800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=0 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=1 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=2 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=3 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=4 2024-09-14T11:32:20.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=5 2024-09-14T11:32:20.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.116+0000 7f1705b28800 20 add_watcher() i=6 2024-09-14T11:32:20.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.117+0000 7f1705b28800 20 add_watcher() i=7 2024-09-14T11:32:20.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.117+0000 7f1705b28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:20.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f15b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:20.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 5 note: GC not initialized 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f15b67e4640 20 reqs_thread_entry: start 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 20 Filter name: none 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1527fff640 20 reqs_thread_entry: start 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:32:20.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.119+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:20.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:20.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.120+0000 7f1705b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:20.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.122+0000 7f15b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:20.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.125+0000 7f1705b28800 20 remove_watcher() i=0 2024-09-14T11:32:20.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.125+0000 7f1705b28800 2 removed watcher, disabling cache 2024-09-14T11:32:20.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.126+0000 7f1705b28800 20 remove_watcher() i=1 2024-09-14T11:32:20.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.127+0000 7f1705b28800 20 remove_watcher() i=2 2024-09-14T11:32:20.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.128+0000 7f1705b28800 20 remove_watcher() i=3 2024-09-14T11:32:20.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.129+0000 7f1705b28800 20 remove_watcher() i=4 2024-09-14T11:32:20.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.130+0000 7f1705b28800 20 remove_watcher() i=5 2024-09-14T11:32:20.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.131+0000 7f1705b28800 20 remove_watcher() i=6 2024-09-14T11:32:20.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.132+0000 7f1705b28800 20 remove_watcher() i=7 2024-09-14T11:32:20.142 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-14T11:32:20.170 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:20.170 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:20.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.209+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 realm 2024-09-14T11:32:20.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.211+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.212+0000 7f4ab4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:20.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.212+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.212+0000 7f4ab4925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:20.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.212+0000 7f4ab4925800 20 searching for the correct realm 2024-09-14T11:32:20.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.415+0000 7f4aafd32640 0 -- 172.21.15.94:0/3913637681 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f4a98073030 msgr2=0x7f4a980a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:20.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.621+0000 7f4ab0533640 0 -- 172.21.15.94:0/3913637681 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4aa00717b0 msgr2=0x7f4aa0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:20.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.828+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 zone default found 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 4 Realm: () 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:20.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 zonegroup default 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.829+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 started sync module instance, tier type = 2024-09-14T11:32:20.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.830+0000 7f4ab4925800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:20.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=0 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=1 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=2 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=3 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=4 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=5 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.841+0000 7f4ab4925800 20 add_watcher() i=6 2024-09-14T11:32:20.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.842+0000 7f4ab4925800 20 add_watcher() i=7 2024-09-14T11:32:20.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.842+0000 7f4ab4925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:20.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f49667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:20.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f4ab4925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:20.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f4ab4925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:20.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f4ab4925800 5 note: GC not initialized 2024-09-14T11:32:20.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f49657e2640 20 reqs_thread_entry: start 2024-09-14T11:32:20.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f4ab4925800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:20.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.844+0000 7f4ab4925800 20 Filter name: none 2024-09-14T11:32:20.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.845+0000 7f48d6ffd640 20 reqs_thread_entry: start 2024-09-14T11:32:20.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.852+0000 7f49667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:20.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.855+0000 7f4ab4925800 20 remove_watcher() i=0 2024-09-14T11:32:20.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.855+0000 7f4ab4925800 2 removed watcher, disabling cache 2024-09-14T11:32:20.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.856+0000 7f4ab4925800 20 remove_watcher() i=1 2024-09-14T11:32:20.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.857+0000 7f4ab4925800 20 remove_watcher() i=2 2024-09-14T11:32:20.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.858+0000 7f4ab4925800 20 remove_watcher() i=3 2024-09-14T11:32:20.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.859+0000 7f4ab4925800 20 remove_watcher() i=4 2024-09-14T11:32:20.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.860+0000 7f4ab4925800 20 remove_watcher() i=5 2024-09-14T11:32:20.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.861+0000 7f4ab4925800 20 remove_watcher() i=6 2024-09-14T11:32:20.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.862+0000 7f4ab4925800 20 remove_watcher() i=7 2024-09-14T11:32:20.874 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-14T11:32:20.874 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process non empty bucket 2024-09-14T11:32:20.874 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:20.875 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-14T11:32:20.903 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:20.904 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:20.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.943+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 realm 2024-09-14T11:32:20.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.945+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.946+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:20.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.946+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.946+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:20.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.946+0000 7f0ab332f800 20 searching for the correct realm 2024-09-14T11:32:20.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.950+0000 7f0aa6875640 0 -- 172.21.15.94:0/3800493350 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5608c42a3480 msgr2=0x5608c42a5940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:20.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.953+0000 7f0aaf076640 0 -- 172.21.15.94:0/3800493350 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f0a980bb960 msgr2=0x7f0a980ad6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:20.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:20.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:20.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.958+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 zone default found 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 4 Realm: () 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:20.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 zonegroup default 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.959+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.960+0000 7f0ab332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.960+0000 7f0ab332f800 20 started sync module instance, tier type = 2024-09-14T11:32:20.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.960+0000 7f0ab332f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:20.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=0 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=1 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=2 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=3 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=4 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=5 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.968+0000 7f0ab332f800 20 add_watcher() i=6 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.969+0000 7f0ab332f800 20 add_watcher() i=7 2024-09-14T11:32:20.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.969+0000 7f0ab332f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0ab332f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0ab332f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0ab332f800 5 note: GC not initialized 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0964fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0ab332f800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.971+0000 7f0ab332f800 20 Filter name: none 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.972+0000 7f08de7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.972+0000 7f0ab332f800 20 processing logshard = reshard.0000000000 2024-09-14T11:32:20.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.974+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:32:20.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.974+0000 7f0ab332f800 20 processing logshard = reshard.0000000001 2024-09-14T11:32:20.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.976+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:32:20.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.976+0000 7f0ab332f800 20 processing logshard = reshard.0000000002 2024-09-14T11:32:20.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.979+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:32:20.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.979+0000 7f0ab332f800 20 processing logshard = reshard.0000000003 2024-09-14T11:32:20.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.982+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:32:20.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.982+0000 7f0ab332f800 20 processing logshard = reshard.0000000004 2024-09-14T11:32:20.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.985+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:32:20.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.985+0000 7f0ab332f800 20 processing logshard = reshard.0000000005 2024-09-14T11:32:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.987+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:32:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.987+0000 7f0ab332f800 20 processing logshard = reshard.0000000006 2024-09-14T11:32:20.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.988+0000 7f0ab332f800 20 process_entry resharding a-bucket 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.988+0000 7f0ab332f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.988+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:32:20.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:20.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.989+0000 7f0ab332f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f09927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94595650829520 notifier 5864 bl.length()=911 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f09927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f09927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f09927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:20.998+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:32:21.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:32:21.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:21.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.003+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:21.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:21.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.004+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.005+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.005+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.006+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.007+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.007+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.007+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.007+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.008+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.008+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:21.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.009+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:21.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.009+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:21.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.011+0000 7f0ab332f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:21.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.011+0000 7f0ab332f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0ab332f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0ab332f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0ab332f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0ab332f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0992ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94595650829520 notifier 5864 bl.length()=911 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.012+0000 7f0992ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0992ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0992ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:21.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.013+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.015+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.015+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.0 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.1 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.2 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.016+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.3 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.4 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.5 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.6 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.017+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.7 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.8 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.9 2024-09-14T11:32:21.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:21.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.018+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.10 2024-09-14T11:32:21.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.019+0000 7f0ab332f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:21.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.019+0000 7f0ab332f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.1.11 2024-09-14T11:32:21.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.019+0000 7f0ab332f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:21.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.019+0000 7f0ab332f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.020+0000 7f0ab332f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.020+0000 7f0ab332f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.020+0000 7f0ab332f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.020+0000 7f0ab332f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f09927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94595650829520 notifier 5864 bl.length()=879 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f09927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f09927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:32:21.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f09927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:32:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:32:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:32:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:32:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.021+0000 7f0ab332f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:32:21.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.023+0000 7f0ab332f800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:32:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.024+0000 7f0ab332f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:32:21.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.027+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:32:21.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.027+0000 7f0ab332f800 20 processing logshard = reshard.0000000007 2024-09-14T11:32:21.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.029+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:32:21.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.029+0000 7f0ab332f800 20 processing logshard = reshard.0000000008 2024-09-14T11:32:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.032+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:32:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.032+0000 7f0ab332f800 20 processing logshard = reshard.0000000009 2024-09-14T11:32:21.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.034+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:32:21.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.034+0000 7f0ab332f800 20 processing logshard = reshard.0000000010 2024-09-14T11:32:21.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.036+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:32:21.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.036+0000 7f0ab332f800 20 processing logshard = reshard.0000000011 2024-09-14T11:32:21.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.039+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:32:21.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.039+0000 7f0ab332f800 20 processing logshard = reshard.0000000012 2024-09-14T11:32:21.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.041+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:32:21.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.041+0000 7f0ab332f800 20 processing logshard = reshard.0000000013 2024-09-14T11:32:21.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.044+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:32:21.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.044+0000 7f0ab332f800 20 processing logshard = reshard.0000000014 2024-09-14T11:32:21.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.046+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:32:21.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.046+0000 7f0ab332f800 20 processing logshard = reshard.0000000015 2024-09-14T11:32:21.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.049+0000 7f0ab332f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:32:21.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.049+0000 7f0965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:21.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.051+0000 7f0ab332f800 20 remove_watcher() i=0 2024-09-14T11:32:21.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.051+0000 7f0ab332f800 2 removed watcher, disabling cache 2024-09-14T11:32:21.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.052+0000 7f0ab332f800 20 remove_watcher() i=1 2024-09-14T11:32:21.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.053+0000 7f0ab332f800 20 remove_watcher() i=2 2024-09-14T11:32:21.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.054+0000 7f0ab332f800 20 remove_watcher() i=3 2024-09-14T11:32:21.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.055+0000 7f0ab332f800 20 remove_watcher() i=4 2024-09-14T11:32:21.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.056+0000 7f0ab332f800 20 remove_watcher() i=5 2024-09-14T11:32:21.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.057+0000 7f0ab332f800 20 remove_watcher() i=6 2024-09-14T11:32:21.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.058+0000 7f0ab332f800 20 remove_watcher() i=7 2024-09-14T11:32:21.068 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:32:21.097 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:21.097 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:21.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.134+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.136+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.136+0000 7fe35ef2c800 20 realm 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.136+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.137+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.137+0000 7fe35ef2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.137+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.137+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.137+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.138+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.138+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.138+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:21.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.138+0000 7fe35ef2c800 20 searching for the correct realm 2024-09-14T11:32:21.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.141+0000 7fe35a4ac640 0 -- 172.21.15.94:0/4020207250 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55d1b9828700 msgr2=0x55d1b982ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:21.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.144+0000 7fe35a4ac640 0 -- 172.21.15.94:0/4020207250 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fe34c085040 msgr2=0x7fe34c06a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:21.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.148+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 zone default found 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 4 Realm: () 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 zonegroup default 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.149+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.150+0000 7fe35ef2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.150+0000 7fe35ef2c800 20 started sync module instance, tier type = 2024-09-14T11:32:21.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.150+0000 7fe35ef2c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:21.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=0 2024-09-14T11:32:21.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=1 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=2 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=3 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=4 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=5 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.158+0000 7fe35ef2c800 20 add_watcher() i=6 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.159+0000 7fe35ef2c800 20 add_watcher() i=7 2024-09-14T11:32:21.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.159+0000 7fe35ef2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:21.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe2117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 5 note: GC not initialized 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe18bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 20 Filter name: none 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe189ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:21.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.161+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.162+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:21.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.162+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.162+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:21.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.162+0000 7fe35ef2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.162+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.163+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.163+0000 7fe35ef2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.163+0000 7fe35ef2c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.163+0000 7fe35ef2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:21.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.165+0000 7fe2117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:21.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.166+0000 7fe35ef2c800 20 remove_watcher() i=0 2024-09-14T11:32:21.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.166+0000 7fe35ef2c800 2 removed watcher, disabling cache 2024-09-14T11:32:21.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.167+0000 7fe35ef2c800 20 remove_watcher() i=1 2024-09-14T11:32:21.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.168+0000 7fe35ef2c800 20 remove_watcher() i=2 2024-09-14T11:32:21.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.169+0000 7fe35ef2c800 20 remove_watcher() i=3 2024-09-14T11:32:21.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.170+0000 7fe35ef2c800 20 remove_watcher() i=4 2024-09-14T11:32:21.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.171+0000 7fe35ef2c800 20 remove_watcher() i=5 2024-09-14T11:32:21.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.172+0000 7fe35ef2c800 20 remove_watcher() i=6 2024-09-14T11:32:21.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.173+0000 7fe35ef2c800 20 remove_watcher() i=7 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:32:21.181 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:21.183 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.183 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.195 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.195 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.238 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.238 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.246 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.246 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.254 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.254 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.262 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.262 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.269 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.270 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.277 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.277 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.284 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.285 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.292 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.292 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.300 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.300 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.308 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.308 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.315 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.315 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.323 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.323 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.330 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.331 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.338 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.346 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.346 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.354 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.354 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.362 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.362 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.369 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.370 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.377 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.385 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:21.385 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:21.393 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:32:21.421 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:21.422 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:21.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.460+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 realm 2024-09-14T11:32:21.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.462+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.463+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.463+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.463+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:21.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.463+0000 7f922713a800 20 searching for the correct realm 2024-09-14T11:32:21.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.466+0000 7f92236bc640 0 -- 172.21.15.94:0/4037124743 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f920c078140 msgr2=0x7f920c0758c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:21.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.469+0000 7f9222ebb640 0 -- 172.21.15.94:0/4037124743 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f920c077c80 msgr2=0x7f920c03c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:21.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:21.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.674+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:21.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 zone default found 2024-09-14T11:32:21.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 4 Realm: () 2024-09-14T11:32:21.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 zonegroup default 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.675+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.676+0000 7f922713a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.676+0000 7f922713a800 20 started sync module instance, tier type = 2024-09-14T11:32:21.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.676+0000 7f922713a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:21.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=0 2024-09-14T11:32:21.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=1 2024-09-14T11:32:21.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=2 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=3 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=4 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=5 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.684+0000 7f922713a800 20 add_watcher() i=6 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.685+0000 7f922713a800 20 add_watcher() i=7 2024-09-14T11:32:21.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.685+0000 7f922713a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:21.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.687+0000 7f90d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.687+0000 7f922713a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.687+0000 7f922713a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.687+0000 7f922713a800 5 note: GC not initialized 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.687+0000 7f9053fff640 20 reqs_thread_entry: start 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f922713a800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f922713a800 20 Filter name: none 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f9051ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:21.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.688+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.689+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.689+0000 7f922713a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.689+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.689+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:21.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.689+0000 7f922713a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.690+0000 7f922713a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:21.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.690+0000 7f922713a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:21.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.691+0000 7f90d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:21.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.693+0000 7f922713a800 20 remove_watcher() i=0 2024-09-14T11:32:21.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.693+0000 7f922713a800 2 removed watcher, disabling cache 2024-09-14T11:32:21.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.694+0000 7f922713a800 20 remove_watcher() i=1 2024-09-14T11:32:21.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.695+0000 7f922713a800 20 remove_watcher() i=2 2024-09-14T11:32:21.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.696+0000 7f922713a800 20 remove_watcher() i=3 2024-09-14T11:32:21.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.697+0000 7f922713a800 20 remove_watcher() i=4 2024-09-14T11:32:21.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.698+0000 7f922713a800 20 remove_watcher() i=5 2024-09-14T11:32:21.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.699+0000 7f922713a800 20 remove_watcher() i=6 2024-09-14T11:32:21.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.700+0000 7f922713a800 20 remove_watcher() i=7 2024-09-14T11:32:21.708 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:21.708 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:21.708 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:21.708 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:21.709 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:32:21.744 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:21.744 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:21.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.782+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 realm 2024-09-14T11:32:21.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.784+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.785+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.785+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.785+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:21.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.785+0000 7f2eb6b26800 20 searching for the correct realm 2024-09-14T11:32:21.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.788+0000 7f2eb2fda640 0 -- 172.21.15.94:0/998301383 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f2e9c078070 msgr2=0x7f2e9c0aa960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:21.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.791+0000 7f2eb27d9640 0 -- 172.21.15.94:0/998301383 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f2e9c0cc970 msgr2=0x7f2e9c0b0050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:21.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:21.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:21.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:21.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.998+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 zone default found 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 4 Realm: () 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 zonegroup default 2024-09-14T11:32:21.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:21.999+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.000+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.000+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.000+0000 7f2eb6b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.000+0000 7f2eb6b26800 20 started sync module instance, tier type = 2024-09-14T11:32:21.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.000+0000 7f2eb6b26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=0 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=1 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=2 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=3 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=4 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=5 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.008+0000 7f2eb6b26800 20 add_watcher() i=6 2024-09-14T11:32:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.009+0000 7f2eb6b26800 20 add_watcher() i=7 2024-09-14T11:32:22.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.009+0000 7f2eb6b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.011+0000 7f2d68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.011+0000 7f2eb6b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.011+0000 7f2eb6b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.011+0000 7f2eb6b26800 5 note: GC not initialized 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2ce37fe640 20 reqs_thread_entry: start 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 20 Filter name: none 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2ce17fa640 20 reqs_thread_entry: start 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:32:22.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 : miss 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.012+0000 7f2eb6b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.013+0000 7f2eb6b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.014+0000 7f2eb6b26800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:32:22.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.014+0000 7f2eb6b26800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:32:22.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.016+0000 7f2d68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.018+0000 7f2eb6b26800 20 remove_watcher() i=0 2024-09-14T11:32:22.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.018+0000 7f2eb6b26800 2 removed watcher, disabling cache 2024-09-14T11:32:22.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.019+0000 7f2eb6b26800 20 remove_watcher() i=1 2024-09-14T11:32:22.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.020+0000 7f2eb6b26800 20 remove_watcher() i=2 2024-09-14T11:32:22.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.022+0000 7f2eb6b26800 20 remove_watcher() i=3 2024-09-14T11:32:22.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.022+0000 7f2eb6b26800 20 remove_watcher() i=4 2024-09-14T11:32:22.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.023+0000 7f2eb6b26800 20 remove_watcher() i=5 2024-09-14T11:32:22.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.024+0000 7f2eb6b26800 20 remove_watcher() i=6 2024-09-14T11:32:22.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.025+0000 7f2eb6b26800 20 remove_watcher() i=7 2024-09-14T11:32:22.035 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:32:22.063 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:22.063 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:22.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.101+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 realm 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.103+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.104+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.104+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.104+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.104+0000 7fc4a9420800 20 searching for the correct realm 2024-09-14T11:32:22.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.107+0000 7fc49e710640 0 -- 172.21.15.94:0/1553472785 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x562700961a00 msgr2=0x562700963df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.110+0000 7fc4a6f11640 0 -- 172.21.15.94:0/1553472785 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fc490028040 msgr2=0x7fc4900193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.114+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:22.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 zone default found 2024-09-14T11:32:22.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 4 Realm: () 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 zonegroup default 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.115+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.116+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.116+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.116+0000 7fc4a9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.116+0000 7fc4a9420800 20 started sync module instance, tier type = 2024-09-14T11:32:22.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.116+0000 7fc4a9420800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=0 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=1 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=2 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=3 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=4 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=5 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.125+0000 7fc4a9420800 20 add_watcher() i=6 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.126+0000 7fc4a9420800 20 add_watcher() i=7 2024-09-14T11:32:22.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.126+0000 7fc4a9420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.127+0000 7fc35d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.127+0000 7fc4a9420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.127+0000 7fc4a9420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 5 note: GC not initialized 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc2d7fff640 20 reqs_thread_entry: start 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 20 Filter name: none 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc2d5ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:22.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.128+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.129+0000 7fc4a9420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.131+0000 7fc35d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.133+0000 7fc4a9420800 20 remove_watcher() i=0 2024-09-14T11:32:22.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.133+0000 7fc4a9420800 2 removed watcher, disabling cache 2024-09-14T11:32:22.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.134+0000 7fc4a9420800 20 remove_watcher() i=1 2024-09-14T11:32:22.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.135+0000 7fc4a9420800 20 remove_watcher() i=2 2024-09-14T11:32:22.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.136+0000 7fc4a9420800 20 remove_watcher() i=3 2024-09-14T11:32:22.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.137+0000 7fc4a9420800 20 remove_watcher() i=4 2024-09-14T11:32:22.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.138+0000 7fc4a9420800 20 remove_watcher() i=5 2024-09-14T11:32:22.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.139+0000 7fc4a9420800 20 remove_watcher() i=6 2024-09-14T11:32:22.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.140+0000 7fc4a9420800 20 remove_watcher() i=7 2024-09-14T11:32:22.149 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:22.149 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:22.149 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:22.149 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:22.151 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.151 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.159 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.159 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:22.235 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:22.235 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:22.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.466+0000 7fe0c87a5640 0 --2- 172.21.15.94:0/2558775367 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55a2328bc9a0 0x55a2328c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:32:22.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.474+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.475+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.475+0000 7fe0cacbb800 20 realm 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.475+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.476+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.476+0000 7fe0cacbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.476+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.476+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.476+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.477+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.477+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.477+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:22.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.477+0000 7fe0cacbb800 20 searching for the correct realm 2024-09-14T11:32:22.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.478+0000 7fe0c87a5640 0 -- 172.21.15.94:0/1828225383 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fe0c0017020 msgr2=0x7fe0c0034940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.683+0000 7fe0c8fa6640 0 -- 172.21.15.94:0/1828225383 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fe0b0090ff0 msgr2=0x7fe0b008fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:22.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.688+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:22.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 zone default found 2024-09-14T11:32:22.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 4 Realm: () 2024-09-14T11:32:22.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:22.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 zonegroup default 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.689+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.690+0000 7fe0cacbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.690+0000 7fe0cacbb800 20 started sync module instance, tier type = 2024-09-14T11:32:22.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.690+0000 7fe0cacbb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:22.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=0 2024-09-14T11:32:22.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=1 2024-09-14T11:32:22.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=2 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=3 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=4 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=5 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.698+0000 7fe0cacbb800 20 add_watcher() i=6 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.699+0000 7fe0cacbb800 20 add_watcher() i=7 2024-09-14T11:32:22.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.699+0000 7fe0cacbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fdf7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fe0cacbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fe0cacbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fe0cacbb800 5 note: GC not initialized 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fdf7dfe3640 20 reqs_thread_entry: start 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.701+0000 7fe0cacbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 20 Filter name: none 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fdf777fe640 20 reqs_thread_entry: start 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:32:22.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:32:22.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:32:22.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 : miss 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.702+0000 7fe0cacbb800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.703+0000 7fe0cacbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20, ofs0, ns] 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fdfa77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94155121576144 notifier 5948 bl.length()=995 2024-09-14T11:32:22.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fdfa77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fdfa77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fdfa77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_sources= new_sources= 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential sources added=[] removed=[] 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_dests= new_dests= 2024-09-14T11:32:22.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.708+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential dests added=[] removed=[] 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.0 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.0 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.1 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.1 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.2 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.2 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.3 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.3 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.4 2024-09-14T11:32:22.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.4 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.5 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.5 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.6 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.6 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.7 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.7 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.8 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.8 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.9 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.9 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.10 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.10 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.11 2024-09-14T11:32:22.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1.11 2024-09-14T11:32:22.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.0 2024-09-14T11:32:22.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.713+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1 2024-09-14T11:32:22.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.714+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.2 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.714+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.3 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.714+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.4 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.715+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.5 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.715+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.6 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.716+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.7 2024-09-14T11:32:22.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.717+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.8 2024-09-14T11:32:22.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.717+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.9 2024-09-14T11:32:22.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.717+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.10 2024-09-14T11:32:22.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.722+0000 7fe0cacbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:22.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.722+0000 7fe0cacbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 2024-09-14T11:32:22.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.723+0000 7fe0cacbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.723+0000 7fe0cacbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.723+0000 7fe0cacbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.723+0000 7fe0cacbb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20, ofs0, ns] 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fdfa77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94155121576144 notifier 5948 bl.length()=995 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fdfa77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fdfa77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fdfa77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_sources= new_sources= 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential sources added=[] removed=[] 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_dests= new_dests= 2024-09-14T11:32:22.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.724+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential dests added=[] removed=[] 2024-09-14T11:32:22.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.726+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.0 2024-09-14T11:32:22.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.726+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.1 2024-09-14T11:32:22.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.727+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.2 2024-09-14T11:32:22.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.727+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.3 2024-09-14T11:32:22.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.727+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.4 2024-09-14T11:32:22.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.728+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.5 2024-09-14T11:32:22.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.728+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.6 2024-09-14T11:32:22.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.728+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.7 2024-09-14T11:32:22.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.728+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.8 2024-09-14T11:32:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.729+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.9 2024-09-14T11:32:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.729+0000 7fe0cacbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20.10 2024-09-14T11:32:22.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.729+0000 7fe0cacbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:22.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.729+0000 7fe0cacbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20, ofs0, ns] 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fdfa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94155121576144 notifier 5948 bl.length()=963 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fdfa6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 info.flags=0x17 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fdfa6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 to cache LRU end 2024-09-14T11:32:22.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fdfa6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_sources= new_sources= 2024-09-14T11:32:22.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential sources added=[] removed=[] 2024-09-14T11:32:22.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): orig_dests= new_dests= 2024-09-14T11:32:22.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.731+0000 7fe0cacbb800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20]): potential dests added=[] removed=[] 2024-09-14T11:32:22.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.734+0000 7fe0cacbb800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.736+0000 7fdf7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.738+0000 7fe0cacbb800 20 remove_watcher() i=0 2024-09-14T11:32:22.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.738+0000 7fe0cacbb800 2 removed watcher, disabling cache 2024-09-14T11:32:22.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.739+0000 7fe0cacbb800 20 remove_watcher() i=1 2024-09-14T11:32:22.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.740+0000 7fe0cacbb800 20 remove_watcher() i=2 2024-09-14T11:32:22.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.741+0000 7fe0cacbb800 20 remove_watcher() i=3 2024-09-14T11:32:22.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.742+0000 7fe0cacbb800 20 remove_watcher() i=4 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.744+0000 7fe0cacbb800 20 remove_watcher() i=5 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.746+0000 7fe0cacbb800 20 remove_watcher() i=6 2024-09-14T11:32:22.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.747+0000 7fe0cacbb800 20 remove_watcher() i=7 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:32:22.786 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:22.786 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:22.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.825+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.826+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.826+0000 7f89c461b800 20 realm 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.826+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.827+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.827+0000 7f89c461b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.827+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.827+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.827+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.828+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.828+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.828+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.828+0000 7f89c461b800 20 searching for the correct realm 2024-09-14T11:32:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.831+0000 7f89bf5ea640 0 -- 172.21.15.94:0/3998164567 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55e4d31af780 msgr2=0x55e4d31b1b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:22.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.835+0000 7f89bfdeb640 0 -- 172.21.15.94:0/3998164567 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f89b404c8c0 msgr2=0x7f89b4001790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:22.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:22.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:22.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:22.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:22.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:22.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.839+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 zone default found 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 4 Realm: () 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:22.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 zonegroup default 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.840+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.841+0000 7f89c461b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.841+0000 7f89c461b800 20 started sync module instance, tier type = 2024-09-14T11:32:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.841+0000 7f89c461b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:22.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=0 2024-09-14T11:32:22.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=1 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=2 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=3 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=4 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=5 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.849+0000 7f89c461b800 20 add_watcher() i=6 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.850+0000 7f89c461b800 20 add_watcher() i=7 2024-09-14T11:32:22.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.850+0000 7f89c461b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f8875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f89c461b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f89c461b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f89c461b800 5 note: GC not initialized 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f8874fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f89c461b800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f89c461b800 20 Filter name: none 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.852+0000 7f87ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.853+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.854+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.854+0000 7f89c461b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.854+0000 7f89c461b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:22.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.854+0000 7f89c461b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.856+0000 7f8875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.858+0000 7f89c461b800 20 remove_watcher() i=0 2024-09-14T11:32:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.858+0000 7f89c461b800 2 removed watcher, disabling cache 2024-09-14T11:32:22.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.859+0000 7f89c461b800 20 remove_watcher() i=1 2024-09-14T11:32:22.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.860+0000 7f89c461b800 20 remove_watcher() i=2 2024-09-14T11:32:22.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.861+0000 7f89c461b800 20 remove_watcher() i=3 2024-09-14T11:32:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.862+0000 7f89c461b800 20 remove_watcher() i=4 2024-09-14T11:32:22.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.863+0000 7f89c461b800 20 remove_watcher() i=5 2024-09-14T11:32:22.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.864+0000 7f89c461b800 20 remove_watcher() i=6 2024-09-14T11:32:22.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:22.866+0000 7f89c461b800 20 remove_watcher() i=7 2024-09-14T11:32:22.875 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:22.875 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:22.875 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:22.875 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:22.877 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.877 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.881 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.881 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.925 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.951 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:32:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:22.952 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.963 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.006 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.014 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.020 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.028 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.036 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.036 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.044 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.044 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.051 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.051 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.058 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.058 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.066 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.066 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.073 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.073 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.080 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.080 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.087 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.087 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.095 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.096 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.102 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.103 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.110 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.110 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.117 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.117 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.124 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.124 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.131 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.131 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.138 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.138 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.146 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.146 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:23.153 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:32:23.182 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.182 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.220+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 realm 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.222+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.223+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.223+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.223+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.223+0000 7f5c17640800 20 searching for the correct realm 2024-09-14T11:32:23.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.226+0000 7f5c14929640 0 -- 172.21.15.94:0/3932138010 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5c0803f020 msgr2=0x7f5c0806bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:23.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.229+0000 7f5c1512a640 0 -- 172.21.15.94:0/3932138010 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f5c0c071290 msgr2=0x7f5c0c0093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.434+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.435+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.435+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.435+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.435+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 zone default found 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 4 Realm: () 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 zonegroup default 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 started sync module instance, tier type = 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.436+0000 7f5c17640800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=0 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=1 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=2 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=3 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=4 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=5 2024-09-14T11:32:23.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.447+0000 7f5c17640800 20 add_watcher() i=6 2024-09-14T11:32:23.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.448+0000 7f5c17640800 20 add_watcher() i=7 2024-09-14T11:32:23.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.448+0000 7f5c17640800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:23.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5acb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5c17640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5c17640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5c17640800 5 note: GC not initialized 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5aca7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5c17640800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.450+0000 7f5c17640800 20 Filter name: none 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.451+0000 7f5a3bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:23.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.451+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.451+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.451+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.452+0000 7f5c17640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:23.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.454+0000 7f5acb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.456+0000 7f5c17640800 20 remove_watcher() i=0 2024-09-14T11:32:23.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.456+0000 7f5c17640800 2 removed watcher, disabling cache 2024-09-14T11:32:23.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.457+0000 7f5c17640800 20 remove_watcher() i=1 2024-09-14T11:32:23.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.458+0000 7f5c17640800 20 remove_watcher() i=2 2024-09-14T11:32:23.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.459+0000 7f5c17640800 20 remove_watcher() i=3 2024-09-14T11:32:23.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.460+0000 7f5c17640800 20 remove_watcher() i=4 2024-09-14T11:32:23.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.461+0000 7f5c17640800 20 remove_watcher() i=5 2024-09-14T11:32:23.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.462+0000 7f5c17640800 20 remove_watcher() i=6 2024-09-14T11:32:23.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.463+0000 7f5c17640800 20 remove_watcher() i=7 2024-09-14T11:32:23.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:23.471 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:23.471 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:23.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:23.472 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:32:23.508 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.508 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.547+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 20 realm 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.548+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.549+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.549+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.549+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.549+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.550+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.550+0000 7fba9e610800 20 searching for the correct realm 2024-09-14T11:32:23.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.552+0000 7fba994ca640 0 -- 172.21.15.94:0/2388084531 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fba8c017070 msgr2=0x7fba8c082740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:23.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.556+0000 7fba99ccb640 0 -- 172.21.15.94:0/2388084531 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fba900a3040 msgr2=0x7fba90068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.762+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 zone default found 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 4 Realm: () 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 zonegroup default 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 started sync module instance, tier type = 2024-09-14T11:32:23.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.763+0000 7fba9e610800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=0 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=1 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=2 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=3 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=4 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=5 2024-09-14T11:32:23.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.772+0000 7fba9e610800 20 add_watcher() i=6 2024-09-14T11:32:23.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.773+0000 7fba9e610800 20 add_watcher() i=7 2024-09-14T11:32:23.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.773+0000 7fba9e610800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:23.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fb94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fba9e610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fba9e610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fba9e610800 5 note: GC not initialized 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fb94a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fba9e610800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fba9e610800 20 Filter name: none 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.775+0000 7fb8bbfff640 20 reqs_thread_entry: start 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:32:23.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 : miss 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 info.flags=0x17 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 to cache LRU end 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.776+0000 7fba9e610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.778+0000 7fba9e610800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:32:23.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.778+0000 7fba9e610800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:32:23.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.781+0000 7fba9e610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 info.flags=0x17 2024-09-14T11:32:23.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.781+0000 7fba9e610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 to cache LRU end 2024-09-14T11:32:23.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.781+0000 7fba9e610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.781+0000 7fba9e610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21, ofs0, ns] 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fb97d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94599659926768 notifier 5999 bl.length()=995 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fb97d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 info.flags=0x17 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fb97d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 to cache LRU end 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fb97d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): orig_sources= new_sources= 2024-09-14T11:32:23.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): potential sources added=[] removed=[] 2024-09-14T11:32:23.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): orig_dests= new_dests= 2024-09-14T11:32:23.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.782+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): potential dests added=[] removed=[] 2024-09-14T11:32:23.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.0 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.0 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.1 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.1 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.2 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.2 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.3 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.3 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.4 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.4 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.5 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.5 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.6 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.6 2024-09-14T11:32:23.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.7 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.7 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.8 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.8 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.9 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.9 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.10 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.10 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.11 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1.11 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.784+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.0 2024-09-14T11:32:23.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.785+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.1 2024-09-14T11:32:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.785+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.2 2024-09-14T11:32:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.785+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.3 2024-09-14T11:32:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.786+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.4 2024-09-14T11:32:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.787+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.5 2024-09-14T11:32:23.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.787+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.6 2024-09-14T11:32:23.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.788+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.7 2024-09-14T11:32:23.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.788+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.8 2024-09-14T11:32:23.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.788+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.9 2024-09-14T11:32:23.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.789+0000 7fba9e610800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21.10 2024-09-14T11:32:23.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.792+0000 7fba9e610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:23.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.792+0000 7fba9e610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 info.flags=0x17 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 to cache LRU end 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21, ofs0, ns] 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fb97cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94599659926768 notifier 5999 bl.length()=963 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fb97cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 info.flags=0x17 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fb97cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 to cache LRU end 2024-09-14T11:32:23.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fb97cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): orig_sources= new_sources= 2024-09-14T11:32:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): potential sources added=[] removed=[] 2024-09-14T11:32:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): orig_dests= new_dests= 2024-09-14T11:32:23.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.794+0000 7fba9e610800 20 handle_bi_update(): bucket=:error-at-init-index[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21]): potential dests added=[] removed=[] 2024-09-14T11:32:23.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.797+0000 7fba9e610800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:23.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.798+0000 7fb94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.800+0000 7fba9e610800 20 remove_watcher() i=0 2024-09-14T11:32:23.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.800+0000 7fba9e610800 2 removed watcher, disabling cache 2024-09-14T11:32:23.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.801+0000 7fba9e610800 20 remove_watcher() i=1 2024-09-14T11:32:23.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.802+0000 7fba9e610800 20 remove_watcher() i=2 2024-09-14T11:32:23.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.803+0000 7fba9e610800 20 remove_watcher() i=3 2024-09-14T11:32:23.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.804+0000 7fba9e610800 20 remove_watcher() i=4 2024-09-14T11:32:23.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.805+0000 7fba9e610800 20 remove_watcher() i=5 2024-09-14T11:32:23.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.806+0000 7fba9e610800 20 remove_watcher() i=6 2024-09-14T11:32:23.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.807+0000 7fba9e610800 20 remove_watcher() i=7 2024-09-14T11:32:23.816 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:32:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.845 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.884+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 realm 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.885+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.886+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.886+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.886+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.887+0000 7f4a0ac98800 20 searching for the correct realm 2024-09-14T11:32:23.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:23.890+0000 7f4a08f83640 0 -- 172.21.15.94:0/3602497280 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f49fc059040 msgr2=0x7f49fc0719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:24.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.096+0000 7f4a08782640 0 -- 172.21.15.94:0/3602497280 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x563be6bea190 msgr2=0x563be6bec650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:24.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.098+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 zone default found 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 4 Realm: () 2024-09-14T11:32:24.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 zonegroup default 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.099+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.100+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.100+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.100+0000 7f4a0ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.100+0000 7f4a0ac98800 20 started sync module instance, tier type = 2024-09-14T11:32:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.100+0000 7f4a0ac98800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=0 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=1 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=2 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=3 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=4 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=5 2024-09-14T11:32:24.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.109+0000 7f4a0ac98800 20 add_watcher() i=6 2024-09-14T11:32:24.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.110+0000 7f4a0ac98800 20 add_watcher() i=7 2024-09-14T11:32:24.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.110+0000 7f4a0ac98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:24.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.111+0000 7f48be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:24.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:24.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 5 note: GC not initialized 2024-09-14T11:32:24.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f48bd7e2640 20 reqs_thread_entry: start 2024-09-14T11:32:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 20 Filter name: none 2024-09-14T11:32:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f482effd640 20 reqs_thread_entry: start 2024-09-14T11:32:24.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.112+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.113+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.113+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.113+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.113+0000 7f4a0ac98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.113+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.114+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.114+0000 7f4a0ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.114+0000 7f4a0ac98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:24.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.114+0000 7f4a0ac98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.116+0000 7f48be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.118+0000 7f4a0ac98800 20 remove_watcher() i=0 2024-09-14T11:32:24.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.118+0000 7f4a0ac98800 2 removed watcher, disabling cache 2024-09-14T11:32:24.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.119+0000 7f4a0ac98800 20 remove_watcher() i=1 2024-09-14T11:32:24.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.120+0000 7f4a0ac98800 20 remove_watcher() i=2 2024-09-14T11:32:24.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.121+0000 7f4a0ac98800 20 remove_watcher() i=3 2024-09-14T11:32:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.122+0000 7f4a0ac98800 20 remove_watcher() i=4 2024-09-14T11:32:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.123+0000 7f4a0ac98800 20 remove_watcher() i=5 2024-09-14T11:32:24.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.124+0000 7f4a0ac98800 20 remove_watcher() i=6 2024-09-14T11:32:24.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.124+0000 7f4a0ac98800 20 remove_watcher() i=7 2024-09-14T11:32:24.133 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:24.133 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:24.133 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:32:24.133 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.135 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.138 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.180 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.180 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.206 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:32:24.206 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:24.208 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.208 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.219 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.219 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.262 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.262 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.269 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.270 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.277 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.278 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.284 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.285 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.292 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.292 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.300 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.300 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.308 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.309 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.316 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.324 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.332 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.340 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.347 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.355 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.363 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.371 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.379 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.387 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.394 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.402 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.409 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:24.418 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:32:24.446 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:24.446 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:24.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.483+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 realm 2024-09-14T11:32:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:24.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.485+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.486+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.486+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.487+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:24.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.487+0000 7fd788b26800 20 searching for the correct realm 2024-09-14T11:32:24.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.490+0000 7fd77c04a640 0 -- 172.21.15.94:0/612563192 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5556a54776d0 msgr2=0x5556a5479ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.493+0000 7fd78484b640 0 -- 172.21.15.94:0/612563192 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd76c062a60 msgr2=0x7fd76c07ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:24.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:24.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:24.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.699+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 zone default found 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 4 Realm: () 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 zonegroup default 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.700+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.701+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.701+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.701+0000 7fd788b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.701+0000 7fd788b26800 20 started sync module instance, tier type = 2024-09-14T11:32:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.701+0000 7fd788b26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:24.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=0 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=1 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=2 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=3 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=4 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=5 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.709+0000 7fd788b26800 20 add_watcher() i=6 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.710+0000 7fd788b26800 20 add_watcher() i=7 2024-09-14T11:32:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.710+0000 7fd788b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.712+0000 7fd63afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.712+0000 7fd788b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.712+0000 7fd788b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.712+0000 7fd788b26800 5 note: GC not initialized 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.712+0000 7fd639fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd788b26800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd788b26800 20 Filter name: none 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd5ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:24.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:24.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.713+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:24.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.714+0000 7fd788b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.716+0000 7fd63afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.718+0000 7fd788b26800 20 remove_watcher() i=0 2024-09-14T11:32:24.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.718+0000 7fd788b26800 2 removed watcher, disabling cache 2024-09-14T11:32:24.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.719+0000 7fd788b26800 20 remove_watcher() i=1 2024-09-14T11:32:24.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.720+0000 7fd788b26800 20 remove_watcher() i=2 2024-09-14T11:32:24.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.721+0000 7fd788b26800 20 remove_watcher() i=3 2024-09-14T11:32:24.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.722+0000 7fd788b26800 20 remove_watcher() i=4 2024-09-14T11:32:24.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.723+0000 7fd788b26800 20 remove_watcher() i=5 2024-09-14T11:32:24.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.724+0000 7fd788b26800 20 remove_watcher() i=6 2024-09-14T11:32:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.725+0000 7fd788b26800 20 remove_watcher() i=7 2024-09-14T11:32:24.733 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:24.733 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:24.735 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:32:24.768 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:24.768 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:24.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.806+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 realm 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:24.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.809+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:24.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.809+0000 7f267e240800 20 searching for the correct realm 2024-09-14T11:32:24.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.812+0000 7f267c52b640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f266c07e040 msgr2=0x7f266c057480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:24.815+0000 7f267bd2a640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f266c064430 msgr2=0x7f266c064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 zone default found 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 4 Realm: () 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 zonegroup default 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.023+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.023+0000 7f267e240800 20 started sync module instance, tier type = 2024-09-14T11:32:25.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.023+0000 7f267e240800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=0 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=1 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=2 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=3 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=4 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=5 2024-09-14T11:32:25.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=6 2024-09-14T11:32:25.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.033+0000 7f267e240800 20 add_watcher() i=7 2024-09-14T11:32:25.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.033+0000 7f267e240800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.034+0000 7f2531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 5 note: GC not initialized 2024-09-14T11:32:25.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f2530fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 20 Filter name: none 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f24aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.035+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : miss 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.036+0000 7f267e240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f267e240800 time 2024-09-14T11:32:25.038393+0000 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f268178c76a] 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.036 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f267e240800 thread_name:radosgw-admin 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.038+0000 7f267e240800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f267e240800 time 2024-09-14T11:32:25.038393+0000 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f268178c76a] 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.037 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:32:25.038 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f268043e6f0] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f268048b99c] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f268178c7c4] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.051 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.039+0000 7f267e240800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f267e240800 thread_name:radosgw-admin 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f268043e6f0] 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f268048b99c] 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f268178c7c4] 2024-09-14T11:32:25.052 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:32:24.790+0000 7f267bd2a640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:32:24.790+0000 7f267bd2a640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:32:24.790+0000 7f267bd2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.053 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: dump: 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.054 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: dump: 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:32:24.790+0000 7f267e240800 5 monclient: authenticate success, global_id 6324 2024-09-14T11:32:25.055 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:32:24.790+0000 7f267e240800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:32:24.790+0000 7f267e240800 4 set_mon_vals no callback set 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: shutdown 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:32:24.791+0000 7f267e240800 5 asok(0x556ba2399270) unregister_commands rotate-key 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:32:24.791+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.056 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.057 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:32:24.791+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: starting msgr at 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: starting objecter 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:32:24.791+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests hook 0x556ba25bf230 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: setting wanted keys 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: calling monclient init 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.058 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:32:24.791+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:32:24.792+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:32:24.792+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key hook 0x556ba25b9d28 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:25.059 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2465d50 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2466c30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba25e8fa0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.283244s 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba2465d50 auth_method 0 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2466c30 auth_method 0 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.060 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba25e8fa0 auth_method 0 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_done global_id 6327 payload 824 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.061 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:32:24.792+0000 7f267bd2a640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: dump: 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.062 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: dump: 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.063 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:32:24.792+0000 7f267e240800 5 monclient: authenticate success, global_id 6327 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:32:24.792+0000 7f2569e0b640 4 set_mon_vals no callback set 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:32:24.792+0000 7f267e240800 1 librados: init done 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:32:24.795+0000 7f267b529640 10 monclient: get_auth_request con 0x7f2564077230 auth_method 0 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:32:24.795+0000 7f267c52b640 10 monclient: get_auth_request con 0x556ba25e2cd0 auth_method 0 2024-09-14T11:32:25.064 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:32:24.795+0000 7f267bd2a640 10 monclient: get_auth_request con 0x556ba2605d80 auth_method 0 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:32:24.797+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba260ae10 auth_method 0 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:32:24.797+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:32:24.797+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:32:24.797+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.065 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.066 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:32:24.798+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests cmddesc objecter_requests hook 0x556ba2612310 EEXIST 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.067 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:32:24.798+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x556ba260dee0 EEXIST 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2636630 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba2636a10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2635340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.068 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.289803s 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba2635340 auth_method 0 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba2636630 auth_method 0 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.069 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2636a10 auth_method 0 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:32:24.799+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.070 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: dump: 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.071 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: dump: 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.072 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:32:24.799+0000 7f267e240800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:32:24.799+0000 7f267cd2c640 4 set_mon_vals no callback set 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:32:24.801+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f2554077140 auth_method 0 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: get_monmap_and_config 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.073 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:32:24.801+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.074 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.075 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.076 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:32:24.802+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x7ffc8ea1c688 EEXIST 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba268aac0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba265ba10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2686360 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.293774s 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba268aac0 auth_method 0 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.077 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba2686360 auth_method 0 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba265ba10 auth_method 0 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.078 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:32:24.803+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: dump: 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.079 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:32:24.803+0000 7f267e240800 5 monclient: authenticate success, global_id 6047 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: dump: 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.080 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:32:24.803+0000 7f267e240800 4 set_mon_vals no callback set 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: shutdown 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:32:24.803+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.082 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: starting msgr at 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: starting objecter 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:32:24.804+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests cmddesc objecter_requests hook 0x556ba2658510 EEXIST 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: setting wanted keys 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: calling monclient init 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.083 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.084 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:32:24.804+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x556ba264b038 EEXIST 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba265ba10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2686360 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba268aac0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.295950s 2024-09-14T11:32:25.085 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba268aac0 auth_method 0 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2686360 auth_method 0 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba265ba10 auth_method 0 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.086 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:32:24.805+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: dump: 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.087 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: dump: 2024-09-14T11:32:25.088 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:32:24.805+0000 7f267e240800 5 monclient: authenticate success, global_id 6050 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:32:24.805+0000 7f255affd640 4 set_mon_vals no callback set 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.089 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:32:24.805+0000 7f267e240800 1 librados: init done 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:32:24.805+0000 7f267e240800 5 asok(0x556ba2399270) register_command cr dump hook 0x556ba265ac58 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:32:24.806+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:32:24.807+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f2544077230 auth_method 0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:32:24.807+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba26a4e60 auth_method 0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:32:24.808+0000 7f267e240800 20 realm 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.090 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:32:24.808+0000 7f267e240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:32:24.808+0000 7f267bd2a640 10 monclient: get_auth_request con 0x556ba26a90d0 auth_method 0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:32:24.809+0000 7f267e240800 20 searching for the correct realm 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:32:24.809+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba26ae330 auth_method 0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:32:24.810+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c07e040 auth_method 0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:32:24.811+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f26740a6250 auth_method 0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:32:24.811+0000 7f267b529640 10 monclient: get_auth_request con 0x7f26700625f0 auth_method 0 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:32:24.812+0000 7f267c52b640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f266c07e040 msgr2=0x7f266c057480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.091 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:32:24.812+0000 7f25597fa640 1 client.6050.objecter ms_handle_reset 0x7f266c07e040 session 0x7f266c005040 osd.7 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:32:24.812+0000 7f25597fa640 10 monclient: _renew_subs 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:32:24.812+0000 7f25597fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:32:24.812+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f2544087860 auth_method 0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:32:24.813+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c057990 auth_method 0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:32:24.815+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f266c064430 auth_method 0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:32:24.815+0000 7f267bd2a640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f266c064430 msgr2=0x7f266c064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:32:25.016+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f266c064430 auth_method 0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.092 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:32:25.022+0000 7f267e240800 20 zone default found 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:32:25.022+0000 7f267e240800 4 Realm: () 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:32:25.022+0000 7f267e240800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:32:25.022+0000 7f267e240800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:32:25.022+0000 7f267e240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:32:25.022+0000 7f267e240800 20 zonegroup default 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.093 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:32:25.023+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:32:25.023+0000 7f267e240800 20 started sync module instance, tier type = 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:32:25.023+0000 7f267e240800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:32:25.024+0000 7f25597fa640 1 client.6050.objecter ms_handle_reset 0x7f266c057990 session 0x7f266c066840 osd.6 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:32:25.024+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c07e040 auth_method 0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=0 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=1 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=2 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=3 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=4 2024-09-14T11:32:25.094 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=5 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=6 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:32:25.033+0000 7f267e240800 20 add_watcher() i=7 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:32:25.033+0000 7f267e240800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:32:25.034+0000 7f2531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.095 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:32:25.035+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache list hook 0x556ba26815a0 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache inspect hook 0x556ba26815a0 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache erase hook 0x556ba26815a0 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache zap hook 0x556ba26815a0 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:32:25.035+0000 7f267e240800 5 note: GC not initialized 2024-09-14T11:32:25.096 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:32:25.035+0000 7f2530fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace show hook 0x7f267402a020 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace history hook 0x7f267402a020 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace active hook 0x7f267402a020 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace active_short hook 0x7f267402a020 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:32:25.035+0000 7f267e240800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:32:25.035+0000 7f267e240800 20 Filter name: none 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:32:25.035+0000 7f24aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:32:25.035+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : miss 2024-09-14T11:32:25.097 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:32:25.036+0000 7f267e240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:32:25.038+0000 7f267e240800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f267e240800 time 2024-09-14T11:32:25.038393+0000 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f268178c76a] 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.098 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:32:25.039+0000 7f267e240800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f267e240800 thread_name:radosgw-admin 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f268043e6f0] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f268048b99c] 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:32:25.099 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f268178c7c4] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:32:25.100 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:32:25.101 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:32:25.102 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:32:25.103 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:32:25.104 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:25.105 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 7f24aa7fc640 / http_manager 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2530fe1640 / http_manager 2024-09-14T11:32:25.106 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2531fe3640 / rgw_dt_lg_renew 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f25597fa640 / ms_dispatch 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f255affd640 / io_context_pool 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f25617fa640 / ms_dispatch 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2563fff640 / ms_dispatch 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2569e0b640 / io_context_pool 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267b529640 / msgr-worker-2 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267bd2a640 / msgr-worker-1 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267c52b640 / msgr-worker-0 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267cd2c640 / io_context_pool 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267e240800 / radosgw-admin 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:32:25.107 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.91185.log 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:32:24.790+0000 7f267bd2a640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:32:24.790+0000 7f267bd2a640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:32:24.790+0000 7f267bd2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: dump: 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.108 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:32:24.790+0000 7f2569e0b640 10 monclient: dump: 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.109 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:32:24.790+0000 7f267e240800 5 monclient: authenticate success, global_id 6324 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:32:24.790+0000 7f267e240800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:32:24.790+0000 7f267e240800 4 set_mon_vals no callback set 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: shutdown 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:32:24.791+0000 7f267e240800 5 asok(0x556ba2399270) unregister_commands rotate-key 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:32:24.791+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.110 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding auth protocol: cephx 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.111 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: crc 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25bf900) adding con mode: secure 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:32:24.791+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: starting msgr at 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: starting objecter 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:32:24.791+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests hook 0x556ba25bf230 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: setting wanted keys 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:32:24.791+0000 7f267e240800 1 librados: calling monclient init 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:32:24.791+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.112 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding auth protocol: cephx 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: crc 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:32:24.791+0000 7f267e240800 5 AuthRegistry(0x556ba25b9be0) adding con mode: secure 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:32:24.791+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:32:24.792+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.113 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:32:24.792+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key hook 0x556ba25b9d28 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2465d50 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2466c30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba25e8fa0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.283244s 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba2465d50 auth_method 0 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2466c30 auth_method 0 2024-09-14T11:32:25.114 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:32:24.792+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba25e8fa0 auth_method 0 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:32:24.792+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient(hunting): handle_auth_done global_id 6327 payload 824 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:32:24.792+0000 7f267bd2a640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.115 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:32:24.792+0000 7f267bd2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: dump: 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.116 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:32:24.792+0000 7f2563fff640 10 monclient: dump: 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.117 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:32:24.792+0000 7f267e240800 5 monclient: authenticate success, global_id 6327 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:32:24.792+0000 7f2569e0b640 4 set_mon_vals no callback set 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:32:24.792+0000 7f267e240800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:32:24.792+0000 7f267e240800 1 librados: init done 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:32:24.794+0000 7f2563fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:32:24.795+0000 7f267b529640 10 monclient: get_auth_request con 0x7f2564077230 auth_method 0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:32:24.795+0000 7f267c52b640 10 monclient: get_auth_request con 0x556ba25e2cd0 auth_method 0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:32:24.795+0000 7f267bd2a640 10 monclient: get_auth_request con 0x556ba2605d80 auth_method 0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:32:24.797+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba260ae10 auth_method 0 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:32:24.797+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.118 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:32:24.797+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:32:24.797+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding auth protocol: cephx 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.119 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: crc 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:32:24.797+0000 7f267e240800 5 AuthRegistry(0x556ba260ede0) adding con mode: secure 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:32:24.798+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests cmddesc objecter_requests hook 0x556ba2612310 EEXIST 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.120 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding auth protocol: cephx 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: crc 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:32:24.798+0000 7f267e240800 5 AuthRegistry(0x556ba260dd98) adding con mode: secure 2024-09-14T11:32:25.121 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:32:24.798+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:32:24.798+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x556ba260dee0 EEXIST 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2636630 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba2636a10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2635340 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:32:24.798+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.289803s 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba2635340 auth_method 0 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.122 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba2636630 auth_method 0 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:32:24.798+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:32:24.798+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2636a10 auth_method 0 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:32:24.799+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.123 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:32:24.799+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:32:24.799+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: dump: 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.124 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:32:24.799+0000 7f25617fa640 10 monclient: dump: 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.125 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:32:24.799+0000 7f267e240800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:32:24.799+0000 7f267cd2c640 4 set_mon_vals no callback set 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:32:24.799+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:32:24.801+0000 7f25617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:32:24.801+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f2554077140 auth_method 0 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: get_monmap_and_config 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:32:24.801+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.126 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:32:24.801+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding auth protocol: cephx 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.127 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: crc 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:32:24.801+0000 7f267e240800 5 AuthRegistry(0x556ba2656430) adding con mode: secure 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding auth protocol: cephx 2024-09-14T11:32:25.128 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: crc 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:32:24.802+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1c540) adding con mode: secure 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:32:24.802+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:32:24.802+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x7ffc8ea1c688 EEXIST 2024-09-14T11:32:25.129 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba268aac0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba265ba10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba2686360 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:32:24.802+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.293774s 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba268aac0 auth_method 0 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.130 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba2686360 auth_method 0 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:32:24.802+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:32:24.802+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba265ba10 auth_method 0 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:32:24.803+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.131 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:32:24.803+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:32:24.803+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: dump: 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.132 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:32:24.803+0000 7f267e240800 5 monclient: authenticate success, global_id 6047 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:32:24.803+0000 7f255affd640 10 monclient: dump: 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.133 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:32:24.803+0000 7f267e240800 4 set_mon_vals no callback set 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: shutdown 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:32:24.803+0000 7f267e240800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:32:24.803+0000 7f267e240800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: monmap: 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:32:25.134 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding auth protocol: cephx 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.135 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: crc 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba267cfb0) adding con mode: secure 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: starting msgr at 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: starting objecter 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:32:24.804+0000 7f267e240800 5 asok(0x556ba2399270) register_command objecter_requests cmddesc objecter_requests hook 0x556ba2658510 EEXIST 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: setting wanted keys 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:32:24.804+0000 7f267e240800 1 librados: calling monclient init 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: init 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding auth protocol: cephx 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.136 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: crc 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:32:24.804+0000 7f267e240800 5 AuthRegistry(0x556ba264aef0) adding con mode: secure 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:32:24.804+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:32:24.804+0000 7f267e240800 5 asok(0x556ba2399270) register_command rotate-key cmddesc rotate-key hook 0x556ba264b038 EEXIST 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:25.137 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-b con 0x556ba265ba10 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-a con 0x556ba2686360 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): picked mon.noname-c con 0x556ba268aac0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:32:24.804+0000 7f267e240800 10 monclient(hunting): authenticate will time out at 1858.295950s 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): get_auth_request con 0x556ba268aac0 auth_method 0 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): get_auth_request con 0x556ba2686360 auth_method 0 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.138 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): get_auth_request con 0x556ba265ba10 auth_method 0 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:32:24.805+0000 7f267b529640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:32:24.805+0000 7f267bd2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:32:25.139 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:32:24.805+0000 7f267c52b640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:32:24.805+0000 7f267c52b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: dump: 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.140 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:32:24.805+0000 7f25597fa640 10 monclient: dump: 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:32:25.141 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:32:24.805+0000 7f267e240800 5 monclient: authenticate success, global_id 6050 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:32:24.805+0000 7f255affd640 4 set_mon_vals no callback set 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _renew_subs 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:32:24.805+0000 7f267e240800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:32:24.805+0000 7f267e240800 1 librados: init done 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:32:24.805+0000 7f267e240800 5 asok(0x556ba2399270) register_command cr dump hook 0x556ba265ac58 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:32:24.806+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:32:24.807+0000 7f25597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:32:24.807+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f2544077230 auth_method 0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:32:24.807+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba26a4e60 auth_method 0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.142 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:32:24.808+0000 7f267e240800 20 realm 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:32:24.808+0000 7f267e240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:32:24.808+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:32:24.808+0000 7f267bd2a640 10 monclient: get_auth_request con 0x556ba26a90d0 auth_method 0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:32:24.809+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:32:24.809+0000 7f267e240800 20 searching for the correct realm 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:32:24.809+0000 7f267b529640 10 monclient: get_auth_request con 0x556ba26ae330 auth_method 0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:32:24.810+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c07e040 auth_method 0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:32:24.811+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f26740a6250 auth_method 0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:32:24.811+0000 7f267b529640 10 monclient: get_auth_request con 0x7f26700625f0 auth_method 0 2024-09-14T11:32:25.143 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:32:24.812+0000 7f267c52b640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f266c07e040 msgr2=0x7f266c057480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:32:24.812+0000 7f25597fa640 1 client.6050.objecter ms_handle_reset 0x7f266c07e040 session 0x7f266c005040 osd.7 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:32:24.812+0000 7f25597fa640 10 monclient: _renew_subs 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:32:24.812+0000 7f25597fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:32:24.812+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f2544087860 auth_method 0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:32:24.813+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c057990 auth_method 0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:32:24.815+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f266c064430 auth_method 0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:32:24.815+0000 7f267bd2a640 0 -- 172.21.15.94:0/3296074835 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f266c064430 msgr2=0x7f266c064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:32:25.016+0000 7f267bd2a640 10 monclient: get_auth_request con 0x7f266c064430 auth_method 0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:32:25.021+0000 7f267e240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.144 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:32:25.021+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:32:25.022+0000 7f267e240800 20 zone default found 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:32:25.022+0000 7f267e240800 4 Realm: () 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:32:25.022+0000 7f267e240800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:32:25.022+0000 7f267e240800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:32:25.022+0000 7f267e240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:32:25.022+0000 7f267e240800 20 zonegroup default 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.145 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:32:25.022+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:32:25.023+0000 7f267e240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:32:25.023+0000 7f267e240800 20 started sync module instance, tier type = 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:32:25.023+0000 7f267e240800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:32:25.024+0000 7f25597fa640 1 client.6050.objecter ms_handle_reset 0x7f266c057990 session 0x7f266c066840 osd.6 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:32:25.024+0000 7f267c52b640 10 monclient: get_auth_request con 0x7f266c07e040 auth_method 0 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=0 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=1 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=2 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=3 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=4 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=5 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:32:25.032+0000 7f267e240800 20 add_watcher() i=6 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:32:25.033+0000 7f267e240800 20 add_watcher() i=7 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:32:25.033+0000 7f267e240800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.146 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding auth protocol: cephx 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:32:25.034+0000 7f2531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: crc 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:32:25.034+0000 7f267e240800 5 AuthRegistry(0x7ffc8ea1ca20) adding con mode: secure 2024-09-14T11:32:25.147 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:32:25.035+0000 7f267e240800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache list hook 0x556ba26815a0 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache inspect hook 0x556ba26815a0 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache erase hook 0x556ba26815a0 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command cache zap hook 0x556ba26815a0 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:32:25.035+0000 7f267e240800 5 note: GC not initialized 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:32:25.035+0000 7f2530fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace show hook 0x7f267402a020 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace history hook 0x7f267402a020 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace active hook 0x7f267402a020 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:32:25.035+0000 7f267e240800 5 asok(0x556ba2399270) register_command sync trace active_short hook 0x7f267402a020 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:32:25.035+0000 7f267e240800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:32:25.035+0000 7f267e240800 20 Filter name: none 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:32:25.035+0000 7f24aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:32:25.035+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:32:25.035+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : miss 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:32:25.036+0000 7f267e240800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:32:25.036+0000 7f267e240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:32:25.036+0000 7f267e240800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:32:25.036+0000 7f267e240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:32:25.036+0000 7f267e240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:32:25.038+0000 7f267e240800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f267e240800 time 2024-09-14T11:32:25.038393+0000 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.149 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f268178c76a] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:32:25.039+0000 7f267e240800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f267e240800 thread_name:radosgw-admin 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.150 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f268043e6f0] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f268048b99c] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f268178c7c4] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f268178c928] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ba00de0b1] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd882d4) [0x556ba05f12d4] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ba00edefd] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2680429590] 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.151 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:32:25.152 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:32:25.153 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:25.154 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi094.stderr: 7f24aa7fc640 / http_manager 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2530fe1640 / http_manager 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2531fe3640 / rgw_dt_lg_renew 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f25597fa640 / ms_dispatch 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f255affd640 / io_context_pool 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f25617fa640 / ms_dispatch 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2563fff640 / ms_dispatch 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2569e0b640 / io_context_pool 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267b529640 / msgr-worker-2 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267bd2a640 / msgr-worker-1 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267c52b640 / msgr-worker-0 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267cd2c640 / io_context_pool 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: 7f267e240800 / radosgw-admin 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:25.040063Z_a01f8390-e288-4c30-a3ff-2cdebde40bf1/log 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:32:25.159 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:32:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.114+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.116+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.116+0000 7f4e65a98800 20 realm 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.116+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.117+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.118+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.118+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.118+0000 7f4e65a98800 20 searching for the correct realm 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.121+0000 7f4e62d81640 0 -- 172.21.15.94:0/1418273885 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f4e54091020 msgr2=0x7f4e54092950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.124+0000 7f4e63582640 0 -- 172.21.15.94:0/1418273885 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4e58067130 msgr2=0x7f4e58068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.330+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 zone default found 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 4 Realm: () 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:25.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 zonegroup default 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.331+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.332+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.332+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.332+0000 7f4e65a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.332+0000 7f4e65a98800 20 started sync module instance, tier type = 2024-09-14T11:32:25.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.332+0000 7f4e65a98800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=0 2024-09-14T11:32:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=1 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=2 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=3 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=4 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=5 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.340+0000 7f4e65a98800 20 add_watcher() i=6 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.341+0000 7f4e65a98800 20 add_watcher() i=7 2024-09-14T11:32:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.341+0000 7f4e65a98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 5 note: GC not initialized 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4d18fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 20 Filter name: none 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4c927fc640 20 reqs_thread_entry: start 2024-09-14T11:32:25.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.343+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.344+0000 7f4e65a98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.345+0000 7f4e65a98800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.345+0000 7f4e65a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.346+0000 7f4d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.348+0000 7f4e65a98800 20 remove_watcher() i=0 2024-09-14T11:32:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.348+0000 7f4e65a98800 2 removed watcher, disabling cache 2024-09-14T11:32:25.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.349+0000 7f4e65a98800 20 remove_watcher() i=1 2024-09-14T11:32:25.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.351+0000 7f4e65a98800 20 remove_watcher() i=2 2024-09-14T11:32:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.351+0000 7f4e65a98800 20 remove_watcher() i=3 2024-09-14T11:32:25.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.352+0000 7f4e65a98800 20 remove_watcher() i=4 2024-09-14T11:32:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.353+0000 7f4e65a98800 20 remove_watcher() i=5 2024-09-14T11:32:25.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.354+0000 7f4e65a98800 20 remove_watcher() i=6 2024-09-14T11:32:25.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.355+0000 7f4e65a98800 20 remove_watcher() i=7 2024-09-14T11:32:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.363 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:25.363 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:25.363 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:25.365 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.365 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:25.416 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:25.449 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:25.449 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:25.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.487+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 realm 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.489+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.490+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.490+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.490+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.490+0000 7fbd00d31800 20 searching for the correct realm 2024-09-14T11:32:25.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.493+0000 7fbcfc275640 0 -- 172.21.15.94:0/1902138530 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbcec069660 msgr2=0x7fbcec06b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.496+0000 7fbcfca76640 0 -- 172.21.15.94:0/1902138530 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbcf0023660 msgr2=0x7fbcf0071dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.702+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 zone default found 2024-09-14T11:32:25.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 4 Realm: () 2024-09-14T11:32:25.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 zonegroup default 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.703+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.704+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.704+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.704+0000 7fbd00d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.704+0000 7fbd00d31800 20 started sync module instance, tier type = 2024-09-14T11:32:25.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.704+0000 7fbd00d31800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:25.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=0 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=1 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=2 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=3 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=4 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=5 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.712+0000 7fbd00d31800 20 add_watcher() i=6 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.713+0000 7fbd00d31800 20 add_watcher() i=7 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.713+0000 7fbd00d31800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbbb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbd00d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbd00d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbd00d31800 5 note: GC not initialized 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbbb1fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbd00d31800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.715+0000 7fbd00d31800 20 Filter name: none 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbb237fe640 20 reqs_thread_entry: start 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : miss 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.716+0000 7fbd00d31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.717+0000 7fbd00d31800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to be held by another RGW process; skipping for now 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.719+0000 7fbbb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.720+0000 7fbd00d31800 20 remove_watcher() i=0 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.720+0000 7fbd00d31800 2 removed watcher, disabling cache 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.721+0000 7fbd00d31800 20 remove_watcher() i=1 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.722+0000 7fbd00d31800 20 remove_watcher() i=2 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.723+0000 7fbd00d31800 20 remove_watcher() i=3 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.725+0000 7fbd00d31800 20 remove_watcher() i=4 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.726+0000 7fbd00d31800 20 remove_watcher() i=5 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.726+0000 7fbd00d31800 20 remove_watcher() i=6 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:25.727+0000 7fbd00d31800 20 remove_watcher() i=7 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:32:55.767 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:55.802 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:55.802 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:55.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.845+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.847+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.847+0000 7f46e0b2a800 20 realm 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.847+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.848+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.848+0000 7f46e0b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.848+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.848+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:55.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.848+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:55.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.849+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:55.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.849+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:55.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.849+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:55.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.849+0000 7f46e0b2a800 20 searching for the correct realm 2024-09-14T11:32:55.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.853+0000 7f46dc0d9640 0 -- 172.21.15.94:0/1959635025 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f46cc01a040 msgr2=0x7f46cc02a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:55.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:55.857+0000 7f46dc8da640 0 -- 172.21.15.94:0/1959635025 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f46d0083c00 msgr2=0x7f46d00b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:56.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.065+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 zone default found 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 4 Realm: () 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 zonegroup default 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.066+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.067+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.067+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.067+0000 7f46e0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.067+0000 7f46e0b2a800 20 started sync module instance, tier type = 2024-09-14T11:32:56.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.067+0000 7f46e0b2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=0 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=1 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=2 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=3 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=4 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=5 2024-09-14T11:32:56.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.077+0000 7f46e0b2a800 20 add_watcher() i=6 2024-09-14T11:32:56.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.078+0000 7f46e0b2a800 20 add_watcher() i=7 2024-09-14T11:32:56.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.078+0000 7f46e0b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:56.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f45937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f46e0b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f46e0b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f46e0b2a800 5 note: GC not initialized 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f45927e4640 20 reqs_thread_entry: start 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.080+0000 7f46e0b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 20 Filter name: none 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f458bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:32:56.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:32:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:32:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : miss 2024-09-14T11:32:56.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.081+0000 7f46e0b2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.082+0000 7f46e0b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22, ofs0, ns] 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f45b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94476018214320 notifier 6390 bl.length()=997 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f45b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f45b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f45b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_sources= new_sources= 2024-09-14T11:32:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential sources added=[] removed=[] 2024-09-14T11:32:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_dests= new_dests= 2024-09-14T11:32:56.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.088+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential dests added=[] removed=[] 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.0 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.0 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.1 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.1 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.2 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.2 2024-09-14T11:32:56.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.3 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.3 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.4 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.4 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.5 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.5 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.6 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.6 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.7 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.7 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.8 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.8 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.9 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.9 2024-09-14T11:32:56.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.10 2024-09-14T11:32:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.10 2024-09-14T11:32:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.11 2024-09-14T11:32:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1.11 2024-09-14T11:32:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.0 2024-09-14T11:32:56.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.094+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.095+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.2 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.095+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.3 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.096+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.4 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.096+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.5 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.097+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.6 2024-09-14T11:32:56.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.097+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.7 2024-09-14T11:32:56.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.098+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.8 2024-09-14T11:32:56.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.099+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.9 2024-09-14T11:32:56.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.099+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.10 2024-09-14T11:32:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.103+0000 7f46e0b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:56.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.103+0000 7f46e0b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f46e0b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f46e0b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f46e0b2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f46e0b2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22, ofs0, ns] 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f45b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94476018214320 notifier 6390 bl.length()=997 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f45b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f45b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.104+0000 7f45b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.105+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_sources= new_sources= 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.105+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential sources added=[] removed=[] 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.105+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_dests= new_dests= 2024-09-14T11:32:56.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.105+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential dests added=[] removed=[] 2024-09-14T11:32:56.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.108+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.0 2024-09-14T11:32:56.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.108+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.1 2024-09-14T11:32:56.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.108+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.2 2024-09-14T11:32:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.109+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.3 2024-09-14T11:32:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.109+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.4 2024-09-14T11:32:56.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.110+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.5 2024-09-14T11:32:56.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.110+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.6 2024-09-14T11:32:56.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.110+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.7 2024-09-14T11:32:56.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.110+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.8 2024-09-14T11:32:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.111+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.9 2024-09-14T11:32:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.111+0000 7f46e0b2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22.10 2024-09-14T11:32:56.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.111+0000 7f46e0b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:56.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.111+0000 7f46e0b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22, ofs0, ns] 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f45b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94476018214320 notifier 6390 bl.length()=965 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f45b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 info.flags=0x17 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f45b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 to cache LRU end 2024-09-14T11:32:56.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f45b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_sources= new_sources= 2024-09-14T11:32:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential sources added=[] removed=[] 2024-09-14T11:32:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): orig_dests= new_dests= 2024-09-14T11:32:56.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.113+0000 7f46e0b2a800 20 handle_bi_update(): bucket=:abort-at-init-indext[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22]): potential dests added=[] removed=[] 2024-09-14T11:32:56.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.116+0000 7f46e0b2a800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:56.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.118+0000 7f45937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.120+0000 7f46e0b2a800 20 remove_watcher() i=0 2024-09-14T11:32:56.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.120+0000 7f46e0b2a800 2 removed watcher, disabling cache 2024-09-14T11:32:56.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.122+0000 7f46e0b2a800 20 remove_watcher() i=1 2024-09-14T11:32:56.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.123+0000 7f46e0b2a800 20 remove_watcher() i=2 2024-09-14T11:32:56.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.124+0000 7f46e0b2a800 20 remove_watcher() i=3 2024-09-14T11:32:56.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.125+0000 7f46e0b2a800 20 remove_watcher() i=4 2024-09-14T11:32:56.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.126+0000 7f46e0b2a800 20 remove_watcher() i=5 2024-09-14T11:32:56.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.127+0000 7f46e0b2a800 20 remove_watcher() i=6 2024-09-14T11:32:56.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.128+0000 7f46e0b2a800 20 remove_watcher() i=7 2024-09-14T11:32:56.138 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:32:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:56.168 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:56.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.206+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 realm 2024-09-14T11:32:56.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.208+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.209+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.209+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.209+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:56.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.209+0000 7f4de1728800 20 searching for the correct realm 2024-09-14T11:32:56.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.213+0000 7f4dd4b5c640 0 -- 172.21.15.94:0/912188277 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55920a4e86c0 msgr2=0x55920a4eaad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:56.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.216+0000 7f4ddd35d640 0 -- 172.21.15.94:0/912188277 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4dc8048f30 msgr2=0x7f4dc8048900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:56.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.221+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 zone default found 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 4 Realm: () 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 zonegroup default 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.222+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.223+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.223+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.223+0000 7f4de1728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.223+0000 7f4de1728800 20 started sync module instance, tier type = 2024-09-14T11:32:56.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.223+0000 7f4de1728800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=0 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=1 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=2 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=3 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=4 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=5 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=6 2024-09-14T11:32:56.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 20 add_watcher() i=7 2024-09-14T11:32:56.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.232+0000 7f4de1728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:56.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4c93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4de1728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:56.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4de1728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:56.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4de1728800 5 note: GC not initialized 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4c92fe5640 20 reqs_thread_entry: start 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.234+0000 7f4de1728800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 Filter name: none 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4c90fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:56.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.235+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.236+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:32:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.236+0000 7f4de1728800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.236+0000 7f4de1728800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:32:56.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.236+0000 7f4de1728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.238+0000 7f4c93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.240+0000 7f4de1728800 20 remove_watcher() i=0 2024-09-14T11:32:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.240+0000 7f4de1728800 2 removed watcher, disabling cache 2024-09-14T11:32:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.241+0000 7f4de1728800 20 remove_watcher() i=1 2024-09-14T11:32:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.242+0000 7f4de1728800 20 remove_watcher() i=2 2024-09-14T11:32:56.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.243+0000 7f4de1728800 20 remove_watcher() i=3 2024-09-14T11:32:56.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.244+0000 7f4de1728800 20 remove_watcher() i=4 2024-09-14T11:32:56.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.245+0000 7f4de1728800 20 remove_watcher() i=5 2024-09-14T11:32:56.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.245+0000 7f4de1728800 20 remove_watcher() i=6 2024-09-14T11:32:56.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.246+0000 7f4de1728800 20 remove_watcher() i=7 2024-09-14T11:32:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:56.255 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:56.256 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.256 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.260 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.303 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.303 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.333 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:32:56.333 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:56.334 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.334 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.345 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.345 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.388 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.389 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.396 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.397 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.404 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.404 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.411 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.412 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.419 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.428 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.428 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.436 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.443 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.452 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.452 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.459 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.459 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.467 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.467 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.475 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.475 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.482 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.482 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.489 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.489 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.497 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.497 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.504 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.505 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.512 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.513 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.519 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.520 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.527 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.535 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:56.535 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:56.544 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:32:56.571 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:56.571 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:56.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.610+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.611+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.611+0000 7fd7cd342800 20 realm 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.611+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.612+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.612+0000 7fd7cd342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.612+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.612+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.612+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.613+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.613+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.613+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:56.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.613+0000 7fd7cd342800 20 searching for the correct realm 2024-09-14T11:32:56.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.616+0000 7fd7c8885640 0 -- 172.21.15.94:0/2027697597 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fd7bc0d1040 msgr2=0x7fd7bc090eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:56.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:56.822+0000 7fd7c9086640 0 -- 172.21.15.94:0/2027697597 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd7c0090330 msgr2=0x7fd7c004f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.028+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.029+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.029+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.029+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.029+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 zone default found 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 4 Realm: () 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 zonegroup default 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.030+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.031+0000 7fd7cd342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.031+0000 7fd7cd342800 20 started sync module instance, tier type = 2024-09-14T11:32:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.031+0000 7fd7cd342800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=0 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=1 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=2 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=3 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=4 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=5 2024-09-14T11:32:57.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.040+0000 7fd7cd342800 20 add_watcher() i=6 2024-09-14T11:32:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.041+0000 7fd7cd342800 20 add_watcher() i=7 2024-09-14T11:32:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.041+0000 7fd7cd342800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd67f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd7cd342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd7cd342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd7cd342800 5 note: GC not initialized 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd67e7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd7cd342800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.043+0000 7fd7cd342800 20 Filter name: none 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.044+0000 7fd5effff640 20 reqs_thread_entry: start 2024-09-14T11:32:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.044+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.044+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.044+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:57.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.045+0000 7fd7cd342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.047+0000 7fd67f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.049+0000 7fd7cd342800 20 remove_watcher() i=0 2024-09-14T11:32:57.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.049+0000 7fd7cd342800 2 removed watcher, disabling cache 2024-09-14T11:32:57.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.050+0000 7fd7cd342800 20 remove_watcher() i=1 2024-09-14T11:32:57.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.051+0000 7fd7cd342800 20 remove_watcher() i=2 2024-09-14T11:32:57.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.052+0000 7fd7cd342800 20 remove_watcher() i=3 2024-09-14T11:32:57.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.053+0000 7fd7cd342800 20 remove_watcher() i=4 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.054+0000 7fd7cd342800 20 remove_watcher() i=5 2024-09-14T11:32:57.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.055+0000 7fd7cd342800 20 remove_watcher() i=6 2024-09-14T11:32:57.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.056+0000 7fd7cd342800 20 remove_watcher() i=7 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:32:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.138+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 realm 2024-09-14T11:32:57.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.139+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.140+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.140+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.141+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.141+0000 7fd1d4539800 20 searching for the correct realm 2024-09-14T11:32:57.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.144+0000 7fd1d09c8640 0 -- 172.21.15.94:0/1752432374 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7fd1b800b040 msgr2=0x7fd1b8074da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.350+0000 7fd1d01c7640 0 -- 172.21.15.94:0/1752432374 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x5579a7b7eeb0 msgr2=0x5579a7b812a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.352+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 zone default found 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 4 Realm: () 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 zonegroup default 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.353+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.354+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.354+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.354+0000 7fd1d4539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.354+0000 7fd1d4539800 20 started sync module instance, tier type = 2024-09-14T11:32:57.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.354+0000 7fd1d4539800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:57.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=0 2024-09-14T11:32:57.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=1 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=2 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=3 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=4 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=5 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.362+0000 7fd1d4539800 20 add_watcher() i=6 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.363+0000 7fd1d4539800 20 add_watcher() i=7 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.363+0000 7fd1d4539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd1d4539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd1d4539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd1d4539800 5 note: GC not initialized 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd085fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd1d4539800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.365+0000 7fd1d4539800 20 Filter name: none 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd07effd640 20 reqs_thread_entry: start 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:32:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 : miss 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:57.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:57.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:57.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.366+0000 7fd1d4539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 2024-09-14T11:32:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.370+0000 7fd1d4539800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:32:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.370+0000 7fd1d4539800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:32:57.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.377+0000 7fd086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.379+0000 7fd1d4539800 20 remove_watcher() i=0 2024-09-14T11:32:57.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.379+0000 7fd1d4539800 2 removed watcher, disabling cache 2024-09-14T11:32:57.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.380+0000 7fd1d4539800 20 remove_watcher() i=1 2024-09-14T11:32:57.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.381+0000 7fd1d4539800 20 remove_watcher() i=2 2024-09-14T11:32:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.382+0000 7fd1d4539800 20 remove_watcher() i=3 2024-09-14T11:32:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.383+0000 7fd1d4539800 20 remove_watcher() i=4 2024-09-14T11:32:57.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.384+0000 7fd1d4539800 20 remove_watcher() i=5 2024-09-14T11:32:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.385+0000 7fd1d4539800 20 remove_watcher() i=6 2024-09-14T11:32:57.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.386+0000 7fd1d4539800 20 remove_watcher() i=7 2024-09-14T11:32:57.397 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:32:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.463+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.464+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.464+0000 7f9313a12800 20 realm 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.464+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.465+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.466+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.466+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.466+0000 7f9313a12800 20 searching for the correct realm 2024-09-14T11:32:57.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.468+0000 7f93069df640 0 -- 172.21.15.94:0/3021329664 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f9300018070 msgr2=0x7f930009aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.472+0000 7f930f1e0640 0 -- 172.21.15.94:0/3021329664 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f92f80d0b90 msgr2=0x7f92f80b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.678+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 zone default found 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 4 Realm: () 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 zonegroup default 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.679+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.680+0000 7f9313a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.680+0000 7f9313a12800 20 started sync module instance, tier type = 2024-09-14T11:32:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.680+0000 7f9313a12800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=0 2024-09-14T11:32:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=1 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=2 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=3 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=4 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=5 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.688+0000 7f9313a12800 20 add_watcher() i=6 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.689+0000 7f9313a12800 20 add_watcher() i=7 2024-09-14T11:32:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.689+0000 7f9313a12800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.691+0000 7f91c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 5 note: GC not initialized 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f91c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 Filter name: none 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f913e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:57.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.692+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.693+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.693+0000 7f9313a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.693+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.693+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.693+0000 7f9313a12800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.694+0000 7f9313a12800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.694+0000 7f9313a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.695+0000 7f91c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.697+0000 7f9313a12800 20 remove_watcher() i=0 2024-09-14T11:32:57.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.697+0000 7f9313a12800 2 removed watcher, disabling cache 2024-09-14T11:32:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.698+0000 7f9313a12800 20 remove_watcher() i=1 2024-09-14T11:32:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.699+0000 7f9313a12800 20 remove_watcher() i=2 2024-09-14T11:32:57.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.700+0000 7f9313a12800 20 remove_watcher() i=3 2024-09-14T11:32:57.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.701+0000 7f9313a12800 20 remove_watcher() i=4 2024-09-14T11:32:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.702+0000 7f9313a12800 20 remove_watcher() i=5 2024-09-14T11:32:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.703+0000 7f9313a12800 20 remove_watcher() i=6 2024-09-14T11:32:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.704+0000 7f9313a12800 20 remove_watcher() i=7 2024-09-14T11:32:57.712 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:57.712 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:57.712 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:57.712 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:57.714 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.714 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:57.722 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.723 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.835+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 realm 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.837+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.838+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.838+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.838+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.838+0000 7f51cd946800 20 searching for the correct realm 2024-09-14T11:32:57.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:57.840+0000 7f51c3fff640 0 -- 172.21.15.94:0/2162267623 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f51bc011040 msgr2=0x7f51bc03b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.045+0000 7f51cb437640 0 -- 172.21.15.94:0/2162267623 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x55b0f22d7ff0 msgr2=0x55b0f22da420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.050+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 zone default found 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 4 Realm: () 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:58.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 zonegroup default 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.051+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.052+0000 7f51cd946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.052+0000 7f51cd946800 20 started sync module instance, tier type = 2024-09-14T11:32:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.052+0000 7f51cd946800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=0 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=1 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=2 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=3 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=4 2024-09-14T11:32:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=5 2024-09-14T11:32:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.060+0000 7f51cd946800 20 add_watcher() i=6 2024-09-14T11:32:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.061+0000 7f51cd946800 20 add_watcher() i=7 2024-09-14T11:32:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.061+0000 7f51cd946800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:58.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f5081fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f51cd946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f51cd946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f51cd946800 5 note: GC not initialized 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f5080fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.063+0000 7f51cd946800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 20 Filter name: none 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f4ffa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:32:58.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 : miss 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.064+0000 7f51cd946800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.065+0000 7f51cd946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.065+0000 7f51cd946800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.065+0000 7f51cd946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:58.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.065+0000 7f51cd946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.065+0000 7f51cd946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23, ofs0, ns] 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f50aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94218465708912 notifier 6480 bl.length()=1009 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f50aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f50aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f50aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_sources= new_sources= 2024-09-14T11:32:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential sources added=[] removed=[] 2024-09-14T11:32:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_dests= new_dests= 2024-09-14T11:32:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.070+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential dests added=[] removed=[] 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.0 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.0 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.1 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.1 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.2 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.2 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.3 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.3 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.4 2024-09-14T11:32:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.4 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.5 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.5 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.6 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.6 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.7 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.074+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.7 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.8 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.8 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.9 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.9 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.10 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.10 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.11 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1.11 2024-09-14T11:32:58.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.0 2024-09-14T11:32:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.075+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1 2024-09-14T11:32:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.076+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.2 2024-09-14T11:32:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.076+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.3 2024-09-14T11:32:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.076+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.4 2024-09-14T11:32:58.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.077+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.5 2024-09-14T11:32:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.077+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.6 2024-09-14T11:32:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.078+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.7 2024-09-14T11:32:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.078+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.8 2024-09-14T11:32:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.079+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.9 2024-09-14T11:32:58.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.079+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.10 2024-09-14T11:32:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.082+0000 7f51cd946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.082+0000 7f51cd946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 2024-09-14T11:32:58.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.083+0000 7f51cd946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.083+0000 7f51cd946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.083+0000 7f51cd946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.083+0000 7f51cd946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23, ofs0, ns] 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f50ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94218465708912 notifier 6480 bl.length()=1009 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f50ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f50ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f50ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_sources= new_sources= 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential sources added=[] removed=[] 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_dests= new_dests= 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.084+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential dests added=[] removed=[] 2024-09-14T11:32:58.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.086+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.0 2024-09-14T11:32:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.087+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.1 2024-09-14T11:32:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.087+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.2 2024-09-14T11:32:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.087+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.3 2024-09-14T11:32:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.087+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.4 2024-09-14T11:32:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.088+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.5 2024-09-14T11:32:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.088+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.6 2024-09-14T11:32:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.088+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.7 2024-09-14T11:32:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.089+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.8 2024-09-14T11:32:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.089+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.9 2024-09-14T11:32:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.089+0000 7f51cd946800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23.10 2024-09-14T11:32:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.089+0000 7f51cd946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.089+0000 7f51cd946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23, ofs0, ns] 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f50aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94218465708912 notifier 6480 bl.length()=977 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f50aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 info.flags=0x17 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f50aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 to cache LRU end 2024-09-14T11:32:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f50aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_sources= new_sources= 2024-09-14T11:32:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential sources added=[] removed=[] 2024-09-14T11:32:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): orig_dests= new_dests= 2024-09-14T11:32:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.091+0000 7f51cd946800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23]): potential dests added=[] removed=[] 2024-09-14T11:32:58.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.093+0000 7f51cd946800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:58.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.095+0000 7f5081fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.097+0000 7f51cd946800 20 remove_watcher() i=0 2024-09-14T11:32:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.097+0000 7f51cd946800 2 removed watcher, disabling cache 2024-09-14T11:32:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.099+0000 7f51cd946800 20 remove_watcher() i=1 2024-09-14T11:32:58.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.100+0000 7f51cd946800 20 remove_watcher() i=2 2024-09-14T11:32:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.101+0000 7f51cd946800 20 remove_watcher() i=3 2024-09-14T11:32:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.102+0000 7f51cd946800 20 remove_watcher() i=4 2024-09-14T11:32:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.103+0000 7f51cd946800 20 remove_watcher() i=5 2024-09-14T11:32:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.104+0000 7f51cd946800 20 remove_watcher() i=6 2024-09-14T11:32:58.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.105+0000 7f51cd946800 20 remove_watcher() i=7 2024-09-14T11:32:58.114 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:32:58.143 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.143 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.181+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 20 realm 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:58.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.183+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.184+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.184+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.185+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.185+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.185+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.185+0000 7fa2f352c800 20 searching for the correct realm 2024-09-14T11:32:58.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.189+0000 7fa2ef946640 0 -- 172.21.15.94:0/2894264158 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55bf379b9a10 msgr2=0x55bf379bbeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.192+0000 7fa2ee944640 0 -- 172.21.15.94:0/2894264158 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fa2e0046060 msgr2=0x7fa2e00193e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.195+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 zone default found 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 4 Realm: () 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 zonegroup default 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.196+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 started sync module instance, tier type = 2024-09-14T11:32:58.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.197+0000 7fa2f352c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=0 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=1 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=2 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=3 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=4 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=5 2024-09-14T11:32:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.206+0000 7fa2f352c800 20 add_watcher() i=6 2024-09-14T11:32:58.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.207+0000 7fa2f352c800 20 add_watcher() i=7 2024-09-14T11:32:58.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.207+0000 7fa2f352c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:58.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.208+0000 7fa1a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.208+0000 7fa2f352c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.208+0000 7fa2f352c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.208+0000 7fa2f352c800 5 note: GC not initialized 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa1a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa2f352c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa2f352c800 20 Filter name: none 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa11e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:58.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.209+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.210+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.210+0000 7fa2f352c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.210+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.210+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.210+0000 7fa2f352c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.211+0000 7fa2f352c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.211+0000 7fa2f352c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.213+0000 7fa1a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.215+0000 7fa2f352c800 20 remove_watcher() i=0 2024-09-14T11:32:58.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.215+0000 7fa2f352c800 2 removed watcher, disabling cache 2024-09-14T11:32:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.216+0000 7fa2f352c800 20 remove_watcher() i=1 2024-09-14T11:32:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.217+0000 7fa2f352c800 20 remove_watcher() i=2 2024-09-14T11:32:58.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.218+0000 7fa2f352c800 20 remove_watcher() i=3 2024-09-14T11:32:58.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.219+0000 7fa2f352c800 20 remove_watcher() i=4 2024-09-14T11:32:58.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.219+0000 7fa2f352c800 20 remove_watcher() i=5 2024-09-14T11:32:58.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.220+0000 7fa2f352c800 20 remove_watcher() i=6 2024-09-14T11:32:58.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.221+0000 7fa2f352c800 20 remove_watcher() i=7 2024-09-14T11:32:58.230 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:58.230 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:58.230 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:58.230 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:58.232 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.232 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.235 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.235 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.278 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.279 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:32:58.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:58.307 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.308 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.318 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.318 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.361 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.361 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.368 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.368 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.376 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.376 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.384 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.392 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.392 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.400 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.400 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.407 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.407 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.415 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.415 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.422 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.423 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.430 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.430 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.438 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.438 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.445 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.445 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.460 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.460 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.468 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.468 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.475 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.475 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.482 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.482 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.489 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.489 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.497 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.497 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.505 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.505 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:58.513 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:32:58.541 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.541 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.579+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 20 realm 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.581+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.582+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.582+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.582+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.582+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.583+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.583+0000 7f6465323800 20 searching for the correct realm 2024-09-14T11:32:58.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.585+0000 7f645bfff640 0 -- 172.21.15.94:0/3316421734 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f6454095070 msgr2=0x7f64540cc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.589+0000 7f646100c640 0 -- 172.21.15.94:0/3316421734 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f644c06a5a0 msgr2=0x7f644c049a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.796+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 zone default found 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 4 Realm: () 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 zonegroup default 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.797+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.798+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.798+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.798+0000 7f6465323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.798+0000 7f6465323800 20 started sync module instance, tier type = 2024-09-14T11:32:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.798+0000 7f6465323800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=0 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=1 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=2 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=3 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=4 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=5 2024-09-14T11:32:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.807+0000 7f6465323800 20 add_watcher() i=6 2024-09-14T11:32:58.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.808+0000 7f6465323800 20 add_watcher() i=7 2024-09-14T11:32:58.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.808+0000 7f6465323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:58.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.809+0000 7f63177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 5 note: GC not initialized 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f63167e4640 20 reqs_thread_entry: start 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:58.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 20 Filter name: none 2024-09-14T11:32:58.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6287fff640 20 reqs_thread_entry: start 2024-09-14T11:32:58.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.810+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.811+0000 7f6465323800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.812+0000 7f6465323800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:58.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.812+0000 7f6465323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.814+0000 7f63177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.816+0000 7f6465323800 20 remove_watcher() i=0 2024-09-14T11:32:58.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.816+0000 7f6465323800 2 removed watcher, disabling cache 2024-09-14T11:32:58.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.817+0000 7f6465323800 20 remove_watcher() i=1 2024-09-14T11:32:58.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.818+0000 7f6465323800 20 remove_watcher() i=2 2024-09-14T11:32:58.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.819+0000 7f6465323800 20 remove_watcher() i=3 2024-09-14T11:32:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.821+0000 7f6465323800 20 remove_watcher() i=4 2024-09-14T11:32:58.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.822+0000 7f6465323800 20 remove_watcher() i=5 2024-09-14T11:32:58.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.823+0000 7f6465323800 20 remove_watcher() i=6 2024-09-14T11:32:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.824+0000 7f6465323800 20 remove_watcher() i=7 2024-09-14T11:32:58.832 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:58.832 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:58.832 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:58.832 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:58.834 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:32:58.869 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.869 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.908+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 realm 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.910+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.911+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.911+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.911+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.911+0000 7f0ba3f2a800 20 searching for the correct realm 2024-09-14T11:32:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.914+0000 7f0b9f416640 0 -- 172.21.15.94:0/2112582402 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f0b90033040 msgr2=0x7f0b90040410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:58.917+0000 7f0b9fc17640 0 -- 172.21.15.94:0/2112582402 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f0b880c28c0 msgr2=0x7f0b880ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.122+0000 7f0ba3f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 zone default found 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 4 Realm: () 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 zonegroup default 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.123+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 started sync module instance, tier type = 2024-09-14T11:32:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.124+0000 7f0ba3f2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=0 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=1 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=2 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=3 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=4 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=5 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.133+0000 7f0ba3f2a800 20 add_watcher() i=6 2024-09-14T11:32:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.134+0000 7f0ba3f2a800 20 add_watcher() i=7 2024-09-14T11:32:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.134+0000 7f0ba3f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.135+0000 7f0a55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.135+0000 7f0ba3f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.135+0000 7f0ba3f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.135+0000 7f0ba3f2a800 5 note: GC not initialized 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0a54fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 20 Filter name: none 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f09ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:32:59.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 : miss 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.136+0000 7f0ba3f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.137+0000 7f0ba3f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 2024-09-14T11:32:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.140+0000 7f0ba3f2a800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.141+0000 7f0ba3f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.141+0000 7f0ba3f2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.141+0000 7f0ba3f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.141+0000 7f0ba3f2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24, ofs0, ns] 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0a7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94220027849200 notifier 6236 bl.length()=1009 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0a7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0a7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0a7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_sources= new_sources= 2024-09-14T11:32:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential sources added=[] removed=[] 2024-09-14T11:32:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_dests= new_dests= 2024-09-14T11:32:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.142+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential dests added=[] removed=[] 2024-09-14T11:32:59.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.0 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.0 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.1 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.1 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.2 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.2 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.3 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.3 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.4 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.4 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.5 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.5 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.6 2024-09-14T11:32:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.6 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.7 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.7 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.8 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.8 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.9 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.9 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.10 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.10 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.11 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.146+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1.11 2024-09-14T11:32:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.147+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.0 2024-09-14T11:32:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.147+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1 2024-09-14T11:32:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.148+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.2 2024-09-14T11:32:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.148+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.3 2024-09-14T11:32:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.148+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.4 2024-09-14T11:32:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.149+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.5 2024-09-14T11:32:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.149+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.6 2024-09-14T11:32:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.150+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.7 2024-09-14T11:32:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.150+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.8 2024-09-14T11:32:59.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.151+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.9 2024-09-14T11:32:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.151+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.10 2024-09-14T11:32:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.154+0000 7f0ba3f2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:59.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.154+0000 7f0ba3f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 2024-09-14T11:32:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0ba3f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0ba3f2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0ba3f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0ba3f2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24, ofs0, ns] 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0a7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94220027849200 notifier 6236 bl.length()=1009 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0a7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0a7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.155+0000 7f0a7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.156+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_sources= new_sources= 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.156+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential sources added=[] removed=[] 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.156+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_dests= new_dests= 2024-09-14T11:32:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.156+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential dests added=[] removed=[] 2024-09-14T11:32:59.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.158+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.0 2024-09-14T11:32:59.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.158+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.1 2024-09-14T11:32:59.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.159+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.2 2024-09-14T11:32:59.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.159+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.3 2024-09-14T11:32:59.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.159+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.4 2024-09-14T11:32:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.159+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.5 2024-09-14T11:32:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.160+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.6 2024-09-14T11:32:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.160+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.7 2024-09-14T11:32:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.160+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.8 2024-09-14T11:32:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.160+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.9 2024-09-14T11:32:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.161+0000 7f0ba3f2a800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24.10 2024-09-14T11:32:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.161+0000 7f0ba3f2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.161+0000 7f0ba3f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.162+0000 7f0ba3f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.162+0000 7f0ba3f2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.162+0000 7f0ba3f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.162+0000 7f0ba3f2a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24, ofs0, ns] 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0a7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94220027849200 notifier 6236 bl.length()=977 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0a7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 info.flags=0x17 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0a7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 to cache LRU end 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0a7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_sources= new_sources= 2024-09-14T11:32:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential sources added=[] removed=[] 2024-09-14T11:32:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): orig_dests= new_dests= 2024-09-14T11:32:59.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.163+0000 7f0ba3f2a800 20 handle_bi_update(): bucket=:error-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24]): potential dests added=[] removed=[] 2024-09-14T11:32:59.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.166+0000 7f0ba3f2a800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.168+0000 7f0a55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.170+0000 7f0ba3f2a800 20 remove_watcher() i=0 2024-09-14T11:32:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.170+0000 7f0ba3f2a800 2 removed watcher, disabling cache 2024-09-14T11:32:59.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.171+0000 7f0ba3f2a800 20 remove_watcher() i=1 2024-09-14T11:32:59.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.172+0000 7f0ba3f2a800 20 remove_watcher() i=2 2024-09-14T11:32:59.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.173+0000 7f0ba3f2a800 20 remove_watcher() i=3 2024-09-14T11:32:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.174+0000 7f0ba3f2a800 20 remove_watcher() i=4 2024-09-14T11:32:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.175+0000 7f0ba3f2a800 20 remove_watcher() i=5 2024-09-14T11:32:59.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.176+0000 7f0ba3f2a800 20 remove_watcher() i=6 2024-09-14T11:32:59.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.177+0000 7f0ba3f2a800 20 remove_watcher() i=7 2024-09-14T11:32:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:32:59.215 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:59.215 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:59.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.252+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 realm 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.254+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.255+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.255+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.255+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.255+0000 7f684bd40800 20 searching for the correct realm 2024-09-14T11:32:59.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.259+0000 7f68482c1640 0 -- 172.21.15.94:0/2364632873 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x562e8b4f0520 msgr2=0x562e8b4f29b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:59.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.262+0000 7f6847ac0640 0 -- 172.21.15.94:0/2364632873 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f683005f040 msgr2=0x7f683005f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:32:59.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.266+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 zone default found 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 4 Realm: () 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:32:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 zonegroup default 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.267+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.268+0000 7f684bd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.268+0000 7f684bd40800 20 started sync module instance, tier type = 2024-09-14T11:32:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.268+0000 7f684bd40800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=0 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=1 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=2 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=3 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=4 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=5 2024-09-14T11:32:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.276+0000 7f684bd40800 20 add_watcher() i=6 2024-09-14T11:32:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.277+0000 7f684bd40800 20 add_watcher() i=7 2024-09-14T11:32:59.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.277+0000 7f684bd40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.278+0000 7f66fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:59.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 5 note: GC not initialized 2024-09-14T11:32:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f66fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 20 Filter name: none 2024-09-14T11:32:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f66767fc640 20 reqs_thread_entry: start 2024-09-14T11:32:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.279+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.280+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.280+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.280+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.280+0000 7f684bd40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.280+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.281+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.281+0000 7f684bd40800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.281+0000 7f684bd40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:32:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.281+0000 7f684bd40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.282+0000 7f66fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.284+0000 7f684bd40800 20 remove_watcher() i=0 2024-09-14T11:32:59.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.284+0000 7f684bd40800 2 removed watcher, disabling cache 2024-09-14T11:32:59.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.285+0000 7f684bd40800 20 remove_watcher() i=1 2024-09-14T11:32:59.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.286+0000 7f684bd40800 20 remove_watcher() i=2 2024-09-14T11:32:59.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.287+0000 7f684bd40800 20 remove_watcher() i=3 2024-09-14T11:32:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.288+0000 7f684bd40800 20 remove_watcher() i=4 2024-09-14T11:32:59.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.289+0000 7f684bd40800 20 remove_watcher() i=5 2024-09-14T11:32:59.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.290+0000 7f684bd40800 20 remove_watcher() i=6 2024-09-14T11:32:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.291+0000 7f684bd40800 20 remove_watcher() i=7 2024-09-14T11:32:59.299 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:59.299 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:32:59.299 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:32:59.299 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.301 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.304 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.304 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.347 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.348 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.374 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:32:59.374 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:32:59.375 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.375 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.386 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.386 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.429 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.429 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.437 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.437 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.445 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.445 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.453 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.453 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.460 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.460 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.469 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.469 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.477 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.477 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.485 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.485 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.492 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.492 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.499 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.499 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.507 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.507 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.515 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.523 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.523 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.531 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.538 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.538 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.546 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.553 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.554 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.561 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.561 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.569 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.569 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.576 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.576 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:32:59.584 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:32:59.612 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:59.612 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.650+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 realm 2024-09-14T11:32:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.652+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.653+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.653+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.653+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:59.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.653+0000 7f0c9700f800 20 searching for the correct realm 2024-09-14T11:32:59.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.656+0000 7f0c8c2f8640 0 -- 172.21.15.94:0/778337253 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f0b600878e0 msgr2=0x7f0b60089d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:59.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:32:59.862+0000 7f0c94af9640 0 -- 172.21.15.94:0/778337253 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f0c7c0a68b0 msgr2=0x7f0c7c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.069+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 zone default found 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 4 Realm: () 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 zonegroup default 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.070+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.071+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.071+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.071+0000 7f0c9700f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.071+0000 7f0c9700f800 20 started sync module instance, tier type = 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.071+0000 7f0c9700f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=0 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=1 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=2 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=3 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=4 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=5 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.080+0000 7f0c9700f800 20 add_watcher() i=6 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.082+0000 7f0c9700f800 20 add_watcher() i=7 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.082+0000 7f0c9700f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.083+0000 7f0b4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 5 note: GC not initialized 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0b4a7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 20 Filter name: none 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0b43fff640 20 reqs_thread_entry: start 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.084+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.085+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.085+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.085+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.085+0000 7f0c9700f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.085+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.086+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.086+0000 7f0c9700f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.086+0000 7f0c9700f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.086+0000 7f0c9700f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.088+0000 7f0b4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.090+0000 7f0c9700f800 20 remove_watcher() i=0 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.090+0000 7f0c9700f800 2 removed watcher, disabling cache 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.091+0000 7f0c9700f800 20 remove_watcher() i=1 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.092+0000 7f0c9700f800 20 remove_watcher() i=2 2024-09-14T11:33:00.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.093+0000 7f0c9700f800 20 remove_watcher() i=3 2024-09-14T11:33:00.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.094+0000 7f0c9700f800 20 remove_watcher() i=4 2024-09-14T11:33:00.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.095+0000 7f0c9700f800 20 remove_watcher() i=5 2024-09-14T11:33:00.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.096+0000 7f0c9700f800 20 remove_watcher() i=6 2024-09-14T11:33:00.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.097+0000 7f0c9700f800 20 remove_watcher() i=7 2024-09-14T11:33:00.107 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.107 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:00.107 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:00.107 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.109 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:33:00.144 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:00.144 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:00.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.187+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 realm 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.189+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.189+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.190+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.190+0000 7f090b528800 20 searching for the correct realm 2024-09-14T11:33:00.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.193+0000 7f0907a4c640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5621fe633470 msgr2=0x5621fe635910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.196+0000 7f0906a4a640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f08f8078070 msgr2=0x7f08f8043ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 zone default found 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 4 Realm: () 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 zonegroup default 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.202+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.202+0000 7f090b528800 20 started sync module instance, tier type = 2024-09-14T11:33:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.202+0000 7f090b528800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=0 2024-09-14T11:33:00.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=1 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=2 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=3 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=4 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=5 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=6 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.211+0000 7f090b528800 20 add_watcher() i=7 2024-09-14T11:33:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.211+0000 7f090b528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f07bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f090b528800 5 note: GC not initialized 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f07bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.213+0000 7f090b528800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 20 Filter name: none 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f07367fc640 20 reqs_thread_entry: start 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:33:00.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : miss 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.215+0000 7f090b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:00.216 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f090b528800 time 2024-09-14T11:33:00.219316+0000 2024-09-14T11:33:00.216 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f090cd8c76a] 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:00.217 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.219+0000 7f090b528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f090b528800 time 2024-09-14T11:33:00.219316+0000 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f090cd8c76a] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.218 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.219 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:00.219 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.219 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:00.219 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f090b528800 thread_name:radosgw-admin 2024-09-14T11:33:00.236 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.236 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f090ba3e6f0] 2024-09-14T11:33:00.236 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f090ba8b99c] 2024-09-14T11:33:00.236 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f090cd8c7c4] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.220+0000 7f090b528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f090b528800 thread_name:radosgw-admin 2024-09-14T11:33:00.237 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f090ba3e6f0] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f090ba8b99c] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f090cd8c7c4] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.238 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6275 payload 274 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:33:00.168+0000 7f0907a4c640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.239 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: dump: 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.240 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:33:00.169+0000 7f090b528800 5 monclient: authenticate success, global_id 6275 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:33:00.169+0000 7f090b528800 4 set_mon_vals no callback set 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: dump: 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: shutdown 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:33:00.169+0000 7f090b528800 5 asok(0x5621fe328270) unregister_commands rotate-key 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:33:00.169+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.243 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: starting msgr at 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: starting objecter 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:33:00.170+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests hook 0x5621fe54cbc0 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: setting wanted keys 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: calling monclient init 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.244 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.245 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:33:00.170+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key hook 0x5621fe547878 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe3f4c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe3f5020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe48a800 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.661934s 2024-09-14T11:33:00.246 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe3f4c40 auth_method 0 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe3f5020 auth_method 0 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe48a800 auth_method 0 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.247 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_done global_id 6585 payload 824 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:33:00.171+0000 7f090724b640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: dump: 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.249 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: dump: 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:33:00.171+0000 7f090b528800 5 monclient: authenticate success, global_id 6585 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:33:00.171+0000 7f07f560a640 4 set_mon_vals no callback set 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.250 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:33:00.171+0000 7f090b528800 1 librados: init done 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:33:00.174+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f07ec077230 auth_method 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:33:00.174+0000 7f0907a4c640 10 monclient: get_auth_request con 0x5621fe574b10 auth_method 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:33:00.174+0000 7f090724b640 10 monclient: get_auth_request con 0x5621fe594230 auth_method 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:33:00.176+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe5992c0 auth_method 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:33:00.176+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:33:00.176+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:33:00.176+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.252 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:33:00.177+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests cmddesc objecter_requests hook 0x5621fe5a0730 EEXIST 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.253 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.254 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:33:00.177+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x5621fe59c320 EEXIST 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe5c4a50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe5c4e30 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe5c3760 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.669090s 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe5c3760 auth_method 0 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.255 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe5c4a50 auth_method 0 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe5c4e30 auth_method 0 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6588 payload 824 2024-09-14T11:33:00.256 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:33:00.178+0000 7f0907a4c640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: dump: 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: dump: 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:33:00.179+0000 7f090b528800 5 monclient: authenticate success, global_id 6588 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:33:00.179+0000 7f090824d640 4 set_mon_vals no callback set 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.259 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:33:00.181+0000 7f090724b640 10 monclient: get_auth_request con 0x7f07e0077140 auth_method 0 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: get_monmap_and_config 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:33:00.181+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.260 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.261 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.262 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:33:00.182+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x7ffe3540a208 EEXIST 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe618fc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe613560 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe60a190 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.263 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.673768s 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe60a190 auth_method 0 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe613560 auth_method 0 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.264 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe618fc0 auth_method 0 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:33:00.183+0000 7f0907a4c640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: dump: 2024-09-14T11:33:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.266 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: dump: 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:33:00.183+0000 7f090b528800 5 monclient: authenticate success, global_id 6591 2024-09-14T11:33:00.267 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:33:00.183+0000 7f090b528800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:33:00.183+0000 7f090b528800 4 set_mon_vals no callback set 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:33:00.183+0000 7f090b528800 10 monclient: shutdown 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:33:00.184+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.268 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.269 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: starting msgr at 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: starting objecter 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:33:00.184+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests cmddesc objecter_requests hook 0x5621fe5c9bb0 EEXIST 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: setting wanted keys 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: calling monclient init 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.270 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:33:00.184+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x5621fe5d9458 EEXIST 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe60a190 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.271 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe613560 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe618fc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.676097s 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe60a190 auth_method 0 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe618fc0 auth_method 0 2024-09-14T11:33:00.272 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe613560 auth_method 0 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:33:00.185+0000 7f090724b640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.273 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: dump: 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:33:00.185+0000 7f090b528800 5 monclient: authenticate success, global_id 6287 2024-09-14T11:33:00.274 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: dump: 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.275 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:33:00.185+0000 7f07eaffd640 4 set_mon_vals no callback set 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:33:00.185+0000 7f090b528800 1 librados: init done 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:33:00.185+0000 7f090b528800 5 asok(0x5621fe328270) register_command cr dump hook 0x5621fe609728 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:33:00.187+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:33:00.187+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f07d0077230 auth_method 0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:33:00.187+0000 7f0907a4c640 10 monclient: get_auth_request con 0x5621fe633470 auth_method 0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:33:00.188+0000 7f090b528800 20 realm 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.276 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:33:00.188+0000 7f090b528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:33:00.189+0000 7f090724b640 10 monclient: get_auth_request con 0x5621fe637350 auth_method 0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:33:00.189+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:33:00.189+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:33:00.190+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:33:00.190+0000 7f090b528800 20 searching for the correct realm 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:33:00.190+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe63c1c0 auth_method 0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:33:00.190+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f08f0066bb0 auth_method 0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:33:00.191+0000 7f090724b640 10 monclient: get_auth_request con 0x7f090001f050 auth_method 0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:33:00.192+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f08f8078070 auth_method 0 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:33:00.193+0000 7f0907a4c640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5621fe633470 msgr2=0x5621fe635910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.277 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:33:00.193+0000 7f07e97fa640 1 client.6287.objecter ms_handle_reset 0x5621fe633470 session 0x5621fe632da0 osd.1 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:33:00.193+0000 7f07e97fa640 10 monclient: _renew_subs 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:33:00.193+0000 7f07e97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:33:00.193+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f07d00878e0 auth_method 0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:33:00.193+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f08f007d940 auth_method 0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:33:00.196+0000 7f090724b640 10 monclient: get_auth_request con 0x7f08f008e410 auth_method 0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:33:00.196+0000 7f0906a4a640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f08f8078070 msgr2=0x7f08f8043ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:33:00.196+0000 7f07e97fa640 1 client.6287.objecter ms_handle_reset 0x7f08f8078070 session 0x7f08f8011040 osd.4 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:33:00.196+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe633470 auth_method 0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.278 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:33:00.201+0000 7f090b528800 20 zone default found 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:33:00.201+0000 7f090b528800 4 Realm: () 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:33:00.201+0000 7f090b528800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:33:00.201+0000 7f090b528800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:33:00.201+0000 7f090b528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:33:00.201+0000 7f090b528800 20 zonegroup default 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.279 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:33:00.202+0000 7f090b528800 20 started sync module instance, tier type = 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:33:00.202+0000 7f090b528800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=0 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=1 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=2 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=3 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=4 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=5 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=6 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:33:00.211+0000 7f090b528800 20 add_watcher() i=7 2024-09-14T11:33:00.280 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:33:00.211+0000 7f090b528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:33:00.213+0000 7f07bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.281 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:33:00.213+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache list hook 0x5621fe60a590 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache inspect hook 0x5621fe60a590 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache erase hook 0x5621fe60a590 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache zap hook 0x5621fe60a590 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:33:00.213+0000 7f090b528800 5 note: GC not initialized 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:33:00.213+0000 7f07bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace show hook 0x7f08f004e9b0 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace history hook 0x7f08f004e9b0 2024-09-14T11:33:00.282 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace active hook 0x7f08f004e9b0 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace active_short hook 0x7f08f004e9b0 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:33:00.213+0000 7f090b528800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:33:00.214+0000 7f090b528800 20 Filter name: none 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:33:00.214+0000 7f07367fc640 20 reqs_thread_entry: start 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:33:00.214+0000 7f090b528800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : miss 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:33:00.215+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:33:00.215+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:33:00.215+0000 7f090b528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.283 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:33:00.215+0000 7f090b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:33:00.219+0000 7f090b528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f090b528800 time 2024-09-14T11:33:00.219316+0000 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f090cd8c76a] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.284 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:33:00.220+0000 7f090b528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f090b528800 thread_name:radosgw-admin 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f090ba3e6f0] 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f090ba8b99c] 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f090cd8c7c4] 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.285 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:00.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:00.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:33:00.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:33:00.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:33:00.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:00.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:00.292 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07367fc640 / http_manager 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07bcfe1640 / http_manager 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07bdfe3640 / rgw_dt_lg_renew 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07e97fa640 / ms_dispatch 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07eaffd640 / io_context_pool 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f1602640 / ms_dispatch 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f3e07640 / ms_dispatch 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f560a640 / io_context_pool 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f0906a4a640 / msgr-worker-2 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090724b640 / msgr-worker-1 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f0907a4c640 / msgr-worker-0 2024-09-14T11:33:00.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090824d640 / io_context_pool 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090b528800 / radosgw-admin 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.99431.log 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:33:00.168+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6275 payload 274 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:33:00.168+0000 7f0907a4c640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.294 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:33:00.168+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: dump: 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.295 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:33:00.169+0000 7f090b528800 5 monclient: authenticate success, global_id 6275 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:33:00.169+0000 7f090b528800 4 set_mon_vals no callback set 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:33:00.169+0000 7f07f560a640 10 monclient: dump: 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: shutdown 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:33:00.169+0000 7f090b528800 5 asok(0x5621fe328270) unregister_commands rotate-key 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:33:00.169+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:33:00.169+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding auth protocol: cephx 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.298 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: crc 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:33:00.169+0000 7f090b528800 5 AuthRegistry(0x5621fe54d140) adding con mode: secure 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: starting msgr at 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: starting objecter 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:33:00.170+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests hook 0x5621fe54cbc0 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: setting wanted keys 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:33:00.170+0000 7f090b528800 1 librados: calling monclient init 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding auth protocol: cephx 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.299 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: crc 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:33:00.170+0000 7f090b528800 5 AuthRegistry(0x5621fe547730) adding con mode: secure 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:33:00.170+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:33:00.170+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key hook 0x5621fe547878 2024-09-14T11:33:00.300 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe3f4c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe3f5020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe48a800 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:33:00.170+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.661934s 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe3f4c40 auth_method 0 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.301 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:33:00.170+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe3f5020 auth_method 0 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe48a800 auth_method 0 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.302 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:33:00.171+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:33:00.171+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient(hunting): handle_auth_done global_id 6585 payload 824 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:33:00.171+0000 7f090724b640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:33:00.171+0000 7f090724b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: dump: 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:33:00.171+0000 7f07f3e07640 10 monclient: dump: 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.304 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:33:00.171+0000 7f090b528800 5 monclient: authenticate success, global_id 6585 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:33:00.171+0000 7f07f560a640 4 set_mon_vals no callback set 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.305 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:33:00.171+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:33:00.171+0000 7f090b528800 1 librados: init done 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:33:00.173+0000 7f07f3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:33:00.174+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f07ec077230 auth_method 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:33:00.174+0000 7f0907a4c640 10 monclient: get_auth_request con 0x5621fe574b10 auth_method 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:33:00.174+0000 7f090724b640 10 monclient: get_auth_request con 0x5621fe594230 auth_method 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:33:00.176+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe5992c0 auth_method 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:33:00.176+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:33:00.176+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:33:00.176+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding auth protocol: cephx 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.307 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: crc 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:33:00.176+0000 7f090b528800 5 AuthRegistry(0x5621fe59d240) adding con mode: secure 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:33:00.177+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests cmddesc objecter_requests hook 0x5621fe5a0730 EEXIST 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding auth protocol: cephx 2024-09-14T11:33:00.308 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: crc 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:33:00.177+0000 7f090b528800 5 AuthRegistry(0x5621fe59c1d8) adding con mode: secure 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:33:00.177+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.309 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:33:00.177+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x5621fe59c320 EEXIST 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:33:00.177+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe5c4a50 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe5c4e30 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe5c3760 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:33:00.178+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.669090s 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe5c3760 auth_method 0 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.310 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe5c4a50 auth_method 0 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:33:00.178+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe5c4e30 auth_method 0 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:33:00.178+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6588 payload 824 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.311 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:33:00.178+0000 7f0907a4c640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:33:00.178+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: dump: 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.312 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:33:00.179+0000 7f07f1602640 10 monclient: dump: 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:33:00.179+0000 7f090b528800 5 monclient: authenticate success, global_id 6588 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:33:00.179+0000 7f090824d640 4 set_mon_vals no callback set 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:33:00.179+0000 7f090b528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:33:00.181+0000 7f07f1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:33:00.181+0000 7f090724b640 10 monclient: get_auth_request con 0x7f07e0077140 auth_method 0 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: get_monmap_and_config 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.314 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:33:00.181+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:33:00.181+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding auth protocol: cephx 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.315 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: crc 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:33:00.181+0000 7f090b528800 5 AuthRegistry(0x5621fe5e4a20) adding con mode: secure 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.316 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding auth protocol: cephx 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: crc 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:33:00.182+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a0c0) adding con mode: secure 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.317 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:33:00.182+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:33:00.182+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x7ffe3540a208 EEXIST 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe618fc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe613560 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe60a190 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:33:00.182+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.673768s 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe60a190 auth_method 0 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.318 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe613560 auth_method 0 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:33:00.182+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:33:00.182+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe618fc0 auth_method 0 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:33:00.182+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.319 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:33:00.183+0000 7f0906a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:33:00.183+0000 7f0907a4c640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:33:00.183+0000 7f0907a4c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: dump: 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.320 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:33:00.183+0000 7f07eaffd640 10 monclient: dump: 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:33:00.183+0000 7f090b528800 5 monclient: authenticate success, global_id 6591 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:33:00.183+0000 7f090b528800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:33:00.183+0000 7f090b528800 4 set_mon_vals no callback set 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:33:00.183+0000 7f090b528800 10 monclient: shutdown 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:33:00.184+0000 7f090b528800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: monmap: 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding auth protocol: cephx 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.323 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: crc 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe60ad10) adding con mode: secure 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: starting msgr at 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: starting objecter 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:33:00.184+0000 7f090b528800 5 asok(0x5621fe328270) register_command objecter_requests cmddesc objecter_requests hook 0x5621fe5c9bb0 EEXIST 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: setting wanted keys 2024-09-14T11:33:00.324 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:33:00.184+0000 7f090b528800 1 librados: calling monclient init 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: init 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding auth protocol: cephx 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.325 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: crc 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:33:00.184+0000 7f090b528800 5 AuthRegistry(0x5621fe5d9310) adding con mode: secure 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:33:00.184+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:33:00.184+0000 7f090b528800 5 asok(0x5621fe328270) register_command rotate-key cmddesc rotate-key hook 0x5621fe5d9458 EEXIST 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:33:00.184+0000 7f090b528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-c con 0x5621fe60a190 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-b con 0x5621fe613560 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): picked mon.noname-a con 0x5621fe618fc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.326 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient(hunting): authenticate will time out at 1893.676097s 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): get_auth_request con 0x5621fe60a190 auth_method 0 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): get_auth_request con 0x5621fe618fc0 auth_method 0 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): get_auth_request con 0x5621fe613560 auth_method 0 2024-09-14T11:33:00.327 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:33:00.185+0000 7f0906a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:33:00.185+0000 7f0907a4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:33:00.185+0000 7f090724b640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:33:00.185+0000 7f090724b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: dump: 2024-09-14T11:33:00.328 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:33:00.185+0000 7f090b528800 5 monclient: authenticate success, global_id 6287 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.329 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:33:00.185+0000 7f07e97fa640 10 monclient: dump: 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:33:00.185+0000 7f07eaffd640 4 set_mon_vals no callback set 2024-09-14T11:33:00.330 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _renew_subs 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:33:00.185+0000 7f090b528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:33:00.185+0000 7f090b528800 1 librados: init done 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:33:00.185+0000 7f090b528800 5 asok(0x5621fe328270) register_command cr dump hook 0x5621fe609728 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:33:00.187+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:33:00.187+0000 7f07e97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:33:00.187+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f07d0077230 auth_method 0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:33:00.187+0000 7f0907a4c640 10 monclient: get_auth_request con 0x5621fe633470 auth_method 0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:33:00.188+0000 7f090b528800 20 realm 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:33:00.188+0000 7f090b528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.331 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:33:00.188+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:33:00.189+0000 7f090724b640 10 monclient: get_auth_request con 0x5621fe637350 auth_method 0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:33:00.189+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:33:00.189+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:33:00.190+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:33:00.190+0000 7f090b528800 20 searching for the correct realm 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:33:00.190+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe63c1c0 auth_method 0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:33:00.190+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f08f0066bb0 auth_method 0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:33:00.191+0000 7f090724b640 10 monclient: get_auth_request con 0x7f090001f050 auth_method 0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:33:00.192+0000 7f0906a4a640 10 monclient: get_auth_request con 0x7f08f8078070 auth_method 0 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:33:00.193+0000 7f0907a4c640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5621fe633470 msgr2=0x5621fe635910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:33:00.193+0000 7f07e97fa640 1 client.6287.objecter ms_handle_reset 0x5621fe633470 session 0x5621fe632da0 osd.1 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:33:00.193+0000 7f07e97fa640 10 monclient: _renew_subs 2024-09-14T11:33:00.332 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:33:00.193+0000 7f07e97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:33:00.193+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f07d00878e0 auth_method 0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:33:00.193+0000 7f0907a4c640 10 monclient: get_auth_request con 0x7f08f007d940 auth_method 0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:33:00.196+0000 7f090724b640 10 monclient: get_auth_request con 0x7f08f008e410 auth_method 0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:33:00.196+0000 7f0906a4a640 0 -- 172.21.15.94:0/1583118949 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f08f8078070 msgr2=0x7f08f8043ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:33:00.196+0000 7f07e97fa640 1 client.6287.objecter ms_handle_reset 0x7f08f8078070 session 0x7f08f8011040 osd.4 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:33:00.196+0000 7f0906a4a640 10 monclient: get_auth_request con 0x5621fe633470 auth_method 0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:33:00.200+0000 7f090b528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:33:00.200+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.333 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:33:00.201+0000 7f090b528800 20 zone default found 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:33:00.201+0000 7f090b528800 4 Realm: () 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:33:00.201+0000 7f090b528800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:33:00.201+0000 7f090b528800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:33:00.201+0000 7f090b528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:33:00.201+0000 7f090b528800 20 zonegroup default 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:33:00.201+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:33:00.202+0000 7f090b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.334 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:33:00.202+0000 7f090b528800 20 started sync module instance, tier type = 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:33:00.202+0000 7f090b528800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=0 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=1 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=2 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=3 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=4 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=5 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:33:00.210+0000 7f090b528800 20 add_watcher() i=6 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:33:00.211+0000 7f090b528800 20 add_watcher() i=7 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:33:00.211+0000 7f090b528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding auth protocol: cephx 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.335 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:33:00.213+0000 7f07bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: crc 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:33:00.213+0000 7f090b528800 5 AuthRegistry(0x7ffe3540a5a0) adding con mode: secure 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:33:00.213+0000 7f090b528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.336 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:33:00.213+0000 7f090b528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache list hook 0x5621fe60a590 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache inspect hook 0x5621fe60a590 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache erase hook 0x5621fe60a590 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command cache zap hook 0x5621fe60a590 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:33:00.213+0000 7f090b528800 5 note: GC not initialized 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:33:00.213+0000 7f07bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace show hook 0x7f08f004e9b0 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace history hook 0x7f08f004e9b0 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace active hook 0x7f08f004e9b0 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:33:00.213+0000 7f090b528800 5 asok(0x5621fe328270) register_command sync trace active_short hook 0x7f08f004e9b0 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:33:00.213+0000 7f090b528800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:33:00.214+0000 7f090b528800 20 Filter name: none 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:33:00.214+0000 7f07367fc640 20 reqs_thread_entry: start 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:33:00.337 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:33:00.214+0000 7f090b528800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:33:00.214+0000 7f090b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : miss 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:33:00.214+0000 7f090b528800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:33:00.215+0000 7f090b528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:33:00.215+0000 7f090b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:33:00.215+0000 7f090b528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:33:00.215+0000 7f090b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:33:00.215+0000 7f090b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:33:00.219+0000 7f090b528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f090b528800 time 2024-09-14T11:33:00.219316+0000 2024-09-14T11:33:00.338 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f090cd8c76a] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:33:00.220+0000 7f090b528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:00.339 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f090b528800 thread_name:radosgw-admin 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f090ba3e6f0] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f090ba8b99c] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f090cd8c7c4] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f090cd8c928] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621fd2f70b1] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd88418) [0x5621fd80a418] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621fd306efd] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f090ba29590] 2024-09-14T11:33:00.340 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:00.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:00.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:33:00.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:33:00.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:00.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:00.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:00.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:33:00.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:00.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:00.349 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07367fc640 / http_manager 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07bcfe1640 / http_manager 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07bdfe3640 / rgw_dt_lg_renew 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07e97fa640 / ms_dispatch 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07eaffd640 / io_context_pool 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f1602640 / ms_dispatch 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f3e07640 / ms_dispatch 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f07f560a640 / io_context_pool 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f0906a4a640 / msgr-worker-2 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090724b640 / msgr-worker-1 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f0907a4c640 / msgr-worker-0 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090824d640 / io_context_pool 2024-09-14T11:33:00.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7f090b528800 / radosgw-admin 2024-09-14T11:33:00.351 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:33:00.351 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:33:00.351 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:00.220975Z_fb5481a6-ee3f-4d85-86f7-fd5e1bf6c79c/log 2024-09-14T11:33:00.351 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:33:00.351 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.293+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 realm 2024-09-14T11:33:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.295+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.296+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.296+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.296+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.297+0000 7f7b58faf800 20 searching for the correct realm 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.300+0000 7f7b4e29f640 0 -- 172.21.15.94:0/3371189912 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f7b4808f070 msgr2=0x7f7b4806c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.303+0000 7f7b572a1640 0 -- 172.21.15.94:0/3371189912 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f7b400b5ee0 msgr2=0x7f7b400649b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.306+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 zone default found 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 4 Realm: () 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 zonegroup default 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.307+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.308+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.308+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.308+0000 7f7b58faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.308+0000 7f7b58faf800 20 started sync module instance, tier type = 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.308+0000 7f7b58faf800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=0 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=1 2024-09-14T11:33:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=2 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=3 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=4 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=5 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.316+0000 7f7b58faf800 20 add_watcher() i=6 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.317+0000 7f7b58faf800 20 add_watcher() i=7 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.317+0000 7f7b58faf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7a0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7b58faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7b58faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7b58faf800 5 note: GC not initialized 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7987fff640 20 reqs_thread_entry: start 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7b58faf800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.319+0000 7f7b58faf800 20 Filter name: none 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7985ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.320+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.321+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.321+0000 7f7b58faf800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.321+0000 7f7b58faf800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.321+0000 7f7b58faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.323+0000 7f7a0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.325+0000 7f7b58faf800 20 remove_watcher() i=0 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.325+0000 7f7b58faf800 2 removed watcher, disabling cache 2024-09-14T11:33:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.326+0000 7f7b58faf800 20 remove_watcher() i=1 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.327+0000 7f7b58faf800 20 remove_watcher() i=2 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.328+0000 7f7b58faf800 20 remove_watcher() i=3 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.329+0000 7f7b58faf800 20 remove_watcher() i=4 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.330+0000 7f7b58faf800 20 remove_watcher() i=5 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.331+0000 7f7b58faf800 20 remove_watcher() i=6 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.332+0000 7f7b58faf800 20 remove_watcher() i=7 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:00.362 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:00.392 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:00.423 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:00.424 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:00.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.462+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 realm 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.464+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.465+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.465+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.465+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.465+0000 7f5c25322800 20 searching for the correct realm 2024-09-14T11:33:00.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.469+0000 7f5c207ad640 0 -- 172.21.15.94:0/1207095988 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5c100adc20 msgr2=0x7f5c100b38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.472+0000 7f5c217af640 0 -- 172.21.15.94:0/1207095988 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f5c08009040 msgr2=0x7f5c0804e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 zone default found 2024-09-14T11:33:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 4 Realm: () 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 zonegroup default 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.476+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 started sync module instance, tier type = 2024-09-14T11:33:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.477+0000 7f5c25322800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=0 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=1 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=2 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=3 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=4 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=5 2024-09-14T11:33:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.486+0000 7f5c25322800 20 add_watcher() i=6 2024-09-14T11:33:00.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.487+0000 7f5c25322800 20 add_watcher() i=7 2024-09-14T11:33:00.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.487+0000 7f5c25322800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.488+0000 7f5ad77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.488+0000 7f5c25322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.488+0000 7f5c25322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5c25322800 5 note: GC not initialized 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5ad67e4640 20 reqs_thread_entry: start 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5c25322800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5c25322800 20 Filter name: none 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5acf7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5c25322800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:33:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.489+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:00.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : miss 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.490+0000 7f5c25322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.491+0000 7f5c25322800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to be held by another RGW process; skipping for now 2024-09-14T11:33:00.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.492+0000 7f5ad77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.494+0000 7f5c25322800 20 remove_watcher() i=0 2024-09-14T11:33:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.494+0000 7f5c25322800 2 removed watcher, disabling cache 2024-09-14T11:33:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.494+0000 7f5c25322800 20 remove_watcher() i=1 2024-09-14T11:33:00.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.495+0000 7f5c25322800 20 remove_watcher() i=2 2024-09-14T11:33:00.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.496+0000 7f5c25322800 20 remove_watcher() i=3 2024-09-14T11:33:00.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.497+0000 7f5c25322800 20 remove_watcher() i=4 2024-09-14T11:33:00.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.498+0000 7f5c25322800 20 remove_watcher() i=5 2024-09-14T11:33:00.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.499+0000 7f5c25322800 20 remove_watcher() i=6 2024-09-14T11:33:00.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:00.500+0000 7f5c25322800 20 remove_watcher() i=7 2024-09-14T11:33:00.508 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:33:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:30.577 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:30.577 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:30.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.620+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.621+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.621+0000 7f4e27f23800 20 realm 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.621+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.622+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.622+0000 7f4e27f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.622+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.622+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.622+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.623+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.623+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.623+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:30.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.623+0000 7f4e27f23800 20 searching for the correct realm 2024-09-14T11:33:30.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.627+0000 7f4e2440d640 0 -- 172.21.15.94:0/3514604944 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f4e0c0a9300 msgr2=0x7f4e0c074a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:30.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.631+0000 7f4e23c0c640 0 -- 172.21.15.94:0/3514604944 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4e0c08b3f0 msgr2=0x7f4e0c071cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:30.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:30.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:30.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.837+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 zone default found 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 4 Realm: () 2024-09-14T11:33:30.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 zonegroup default 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.838+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.839+0000 7f4e27f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.839+0000 7f4e27f23800 20 started sync module instance, tier type = 2024-09-14T11:33:30.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.839+0000 7f4e27f23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=0 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=1 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=2 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=3 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=4 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=5 2024-09-14T11:33:30.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.849+0000 7f4e27f23800 20 add_watcher() i=6 2024-09-14T11:33:30.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.850+0000 7f4e27f23800 20 add_watcher() i=7 2024-09-14T11:33:30.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.850+0000 7f4e27f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:30.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.851+0000 7f4cd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:30.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:30.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 5 note: GC not initialized 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4cd8fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 20 Filter name: none 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4c527fc640 20 reqs_thread_entry: start 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:33:30.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.852+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : miss 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:30.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.853+0000 7f4e27f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:30.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4e27f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4e27f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4e27f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4e27f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25, ofs0, ns] 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 93933723654560 notifier 6648 bl.length()=1009 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4d027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.858+0000 7f4d027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.859+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_sources= new_sources= 2024-09-14T11:33:30.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.859+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential sources added=[] removed=[] 2024-09-14T11:33:30.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.859+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_dests= new_dests= 2024-09-14T11:33:30.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.859+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential dests added=[] removed=[] 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.0 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.0 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.1 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.1 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.2 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.2 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.3 2024-09-14T11:33:30.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.3 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.4 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.4 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.5 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.5 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.6 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.6 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.7 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.7 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.8 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.8 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.9 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.9 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.10 2024-09-14T11:33:30.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.10 2024-09-14T11:33:30.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.11 2024-09-14T11:33:30.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1.11 2024-09-14T11:33:30.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.0 2024-09-14T11:33:30.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.864+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1 2024-09-14T11:33:30.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.865+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.2 2024-09-14T11:33:30.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.865+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.3 2024-09-14T11:33:30.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.866+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.4 2024-09-14T11:33:30.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.866+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.5 2024-09-14T11:33:30.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.867+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.6 2024-09-14T11:33:30.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.867+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.7 2024-09-14T11:33:30.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.868+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.8 2024-09-14T11:33:30.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.868+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.9 2024-09-14T11:33:30.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.869+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.10 2024-09-14T11:33:30.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.872+0000 7f4e27f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:30.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.872+0000 7f4e27f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4e27f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4e27f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4e27f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4e27f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25, ofs0, ns] 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 93933723654560 notifier 6648 bl.length()=1009 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4d027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.873+0000 7f4d027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.874+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_sources= new_sources= 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.874+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential sources added=[] removed=[] 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.874+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_dests= new_dests= 2024-09-14T11:33:30.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.874+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential dests added=[] removed=[] 2024-09-14T11:33:30.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.876+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.0 2024-09-14T11:33:30.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.876+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.1 2024-09-14T11:33:30.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.877+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.2 2024-09-14T11:33:30.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.877+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.3 2024-09-14T11:33:30.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.877+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.4 2024-09-14T11:33:30.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.878+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.5 2024-09-14T11:33:30.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.878+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.6 2024-09-14T11:33:30.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.878+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.7 2024-09-14T11:33:30.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.879+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.8 2024-09-14T11:33:30.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.879+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.9 2024-09-14T11:33:30.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.879+0000 7f4e27f23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25.10 2024-09-14T11:33:30.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.880+0000 7f4e27f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:30.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.880+0000 7f4e27f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25, ofs0, ns] 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 93933723654560 notifier 6648 bl.length()=977 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 info.flags=0x17 2024-09-14T11:33:30.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4d027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 to cache LRU end 2024-09-14T11:33:30.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4d027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_sources= new_sources= 2024-09-14T11:33:30.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential sources added=[] removed=[] 2024-09-14T11:33:30.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): orig_dests= new_dests= 2024-09-14T11:33:30.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.881+0000 7f4e27f23800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25]): potential dests added=[] removed=[] 2024-09-14T11:33:30.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.884+0000 7f4e27f23800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:30.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.886+0000 7f4cd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.888+0000 7f4e27f23800 20 remove_watcher() i=0 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.888+0000 7f4e27f23800 2 removed watcher, disabling cache 2024-09-14T11:33:30.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.889+0000 7f4e27f23800 20 remove_watcher() i=1 2024-09-14T11:33:30.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.890+0000 7f4e27f23800 20 remove_watcher() i=2 2024-09-14T11:33:30.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.891+0000 7f4e27f23800 20 remove_watcher() i=3 2024-09-14T11:33:30.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.892+0000 7f4e27f23800 20 remove_watcher() i=4 2024-09-14T11:33:30.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.893+0000 7f4e27f23800 20 remove_watcher() i=5 2024-09-14T11:33:30.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.894+0000 7f4e27f23800 20 remove_watcher() i=6 2024-09-14T11:33:30.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.895+0000 7f4e27f23800 20 remove_watcher() i=7 2024-09-14T11:33:30.906 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:33:30.935 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:30.935 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:30.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.972+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 20 realm 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.974+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.975+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.975+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.975+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.975+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.976+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:30.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.976+0000 7fabe2c16800 20 searching for the correct realm 2024-09-14T11:33:30.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.979+0000 7fabdebe8640 0 -- 172.21.15.94:0/1943196349 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x563aec17e6e0 msgr2=0x563aec180ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:30.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.983+0000 7fabd5be6640 0 -- 172.21.15.94:0/1943196349 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fabd0001000 msgr2=0x7fabd0074980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:30.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:30.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.987+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:30.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 zone default found 2024-09-14T11:33:30.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 4 Realm: () 2024-09-14T11:33:30.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 zonegroup default 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.988+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.989+0000 7fabe2c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.989+0000 7fabe2c16800 20 started sync module instance, tier type = 2024-09-14T11:33:30.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.989+0000 7fabe2c16800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:30.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=0 2024-09-14T11:33:30.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=1 2024-09-14T11:33:30.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=2 2024-09-14T11:33:30.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=3 2024-09-14T11:33:30.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=4 2024-09-14T11:33:30.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=5 2024-09-14T11:33:30.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.997+0000 7fabe2c16800 20 add_watcher() i=6 2024-09-14T11:33:30.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.998+0000 7fabe2c16800 20 add_watcher() i=7 2024-09-14T11:33:30.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:30.998+0000 7fabe2c16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:30.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7faa94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:30.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 5 note: GC not initialized 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7faa0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 20 Filter name: none 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7faa0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:33:31.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.000+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.001+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.001+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.002+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.002+0000 7fabe2c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.002+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.002+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:33:31.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.002+0000 7fabe2c16800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.003+0000 7fabe2c16800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:33:31.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.003+0000 7fabe2c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.004+0000 7faa94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.006+0000 7fabe2c16800 20 remove_watcher() i=0 2024-09-14T11:33:31.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.006+0000 7fabe2c16800 2 removed watcher, disabling cache 2024-09-14T11:33:31.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.007+0000 7fabe2c16800 20 remove_watcher() i=1 2024-09-14T11:33:31.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.008+0000 7fabe2c16800 20 remove_watcher() i=2 2024-09-14T11:33:31.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.009+0000 7fabe2c16800 20 remove_watcher() i=3 2024-09-14T11:33:31.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.010+0000 7fabe2c16800 20 remove_watcher() i=4 2024-09-14T11:33:31.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.011+0000 7fabe2c16800 20 remove_watcher() i=5 2024-09-14T11:33:31.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.012+0000 7fabe2c16800 20 remove_watcher() i=6 2024-09-14T11:33:31.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.013+0000 7fabe2c16800 20 remove_watcher() i=7 2024-09-14T11:33:31.022 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:31.022 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:31.022 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:31.022 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:31.024 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.024 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.027 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.027 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.070 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.071 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.098 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:33:31.099 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:31.100 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.100 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.154 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.154 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.162 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.162 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.170 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.170 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.178 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.178 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.186 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.186 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.193 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.194 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.201 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.201 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.209 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.209 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.217 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.217 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.225 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.225 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.232 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.232 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.240 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.240 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.248 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.248 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.256 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.256 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.264 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.264 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.305 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.305 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.313 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.313 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.322 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.322 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.329 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.329 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.337 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.337 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:31.345 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:33:31.373 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.373 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.410+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 realm 2024-09-14T11:33:31.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.412+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.413+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.413+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.413+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.413+0000 7fb0ce440800 20 searching for the correct realm 2024-09-14T11:33:31.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.416+0000 7fb0cc72b640 0 -- 172.21.15.94:0/3668566745 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fb0b4072d70 msgr2=0x7fb0b40685f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.420+0000 7fb0cbf2a640 0 -- 172.21.15.94:0/3668566745 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb0b4083b90 msgr2=0x7fb0b402c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:31.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.625+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 zone default found 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 4 Realm: () 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 zonegroup default 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.626+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.627+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.627+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.627+0000 7fb0ce440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.627+0000 7fb0ce440800 20 started sync module instance, tier type = 2024-09-14T11:33:31.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.627+0000 7fb0ce440800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=0 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=1 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=2 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=3 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=4 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=5 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=6 2024-09-14T11:33:31.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 20 add_watcher() i=7 2024-09-14T11:33:31.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.636+0000 7fb0ce440800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.638+0000 7faf81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.638+0000 7fb0ce440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.638+0000 7fb0ce440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.638+0000 7fb0ce440800 5 note: GC not initialized 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.638+0000 7faf80fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.639+0000 7fb0ce440800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.639+0000 7fb0ce440800 20 Filter name: none 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.639+0000 7faefa7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:31.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.639+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.639+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.640+0000 7fb0ce440800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.641+0000 7fb0ce440800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:31.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.641+0000 7fb0ce440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.642+0000 7faf81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.645+0000 7fb0ce440800 20 remove_watcher() i=0 2024-09-14T11:33:31.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.645+0000 7fb0ce440800 2 removed watcher, disabling cache 2024-09-14T11:33:31.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.646+0000 7fb0ce440800 20 remove_watcher() i=1 2024-09-14T11:33:31.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.647+0000 7fb0ce440800 20 remove_watcher() i=2 2024-09-14T11:33:31.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.648+0000 7fb0ce440800 20 remove_watcher() i=3 2024-09-14T11:33:31.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.649+0000 7fb0ce440800 20 remove_watcher() i=4 2024-09-14T11:33:31.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.650+0000 7fb0ce440800 20 remove_watcher() i=5 2024-09-14T11:33:31.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.651+0000 7fb0ce440800 20 remove_watcher() i=6 2024-09-14T11:33:31.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.652+0000 7fb0ce440800 20 remove_watcher() i=7 2024-09-14T11:33:31.661 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:31.661 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:31.661 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:31.661 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:31.662 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:33:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.696 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.733+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 realm 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.735+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.736+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.736+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.736+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.736+0000 7f1d3b30c800 20 searching for the correct realm 2024-09-14T11:33:31.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.739+0000 7f1d395f7640 0 -- 172.21.15.94:0/2038603056 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55759c264340 msgr2=0x55759c2667b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.742+0000 7f1d38df6640 0 -- 172.21.15.94:0/2038603056 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f1d2c049040 msgr2=0x7f1d2c049420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.746+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 zone default found 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 4 Realm: () 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 zonegroup default 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 started sync module instance, tier type = 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.747+0000 7f1d3b30c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=0 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=1 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=2 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=3 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=4 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=5 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.756+0000 7f1d3b30c800 20 add_watcher() i=6 2024-09-14T11:33:31.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.757+0000 7f1d3b30c800 20 add_watcher() i=7 2024-09-14T11:33:31.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.757+0000 7f1d3b30c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.758+0000 7f1bef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 5 note: GC not initialized 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1bee7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 20 Filter name: none 2024-09-14T11:33:31.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1be77fe640 20 reqs_thread_entry: start 2024-09-14T11:33:31.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:33:31.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.759+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 : miss 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:31.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.760+0000 7f1d3b30c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 2024-09-14T11:33:31.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1d3b30c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:31.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1d3b30c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:31.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1d3b30c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:31.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1d3b30c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26, ofs0, ns] 2024-09-14T11:33:31.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1c0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 93963619357120 notifier 6389 bl.length()=1023 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1c0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1c0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.765+0000 7f1c0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_sources= new_sources= 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential sources added=[] removed=[] 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_dests= new_dests= 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential dests added=[] removed=[] 2024-09-14T11:33:31.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:33:31.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.766+0000 7f1d3b30c800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:33:31.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.767+0000 7f1bef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.769+0000 7f1d3b30c800 20 remove_watcher() i=0 2024-09-14T11:33:31.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.769+0000 7f1d3b30c800 2 removed watcher, disabling cache 2024-09-14T11:33:31.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.770+0000 7f1d3b30c800 20 remove_watcher() i=1 2024-09-14T11:33:31.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.771+0000 7f1d3b30c800 20 remove_watcher() i=2 2024-09-14T11:33:31.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.772+0000 7f1d3b30c800 20 remove_watcher() i=3 2024-09-14T11:33:31.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.773+0000 7f1d3b30c800 20 remove_watcher() i=4 2024-09-14T11:33:31.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.774+0000 7f1d3b30c800 20 remove_watcher() i=5 2024-09-14T11:33:31.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.775+0000 7f1d3b30c800 20 remove_watcher() i=6 2024-09-14T11:33:31.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.776+0000 7f1d3b30c800 20 remove_watcher() i=7 2024-09-14T11:33:31.787 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:33:31.815 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.816 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.853+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 realm 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.855+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.856+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.856+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.856+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.856+0000 7fa525813800 20 searching for the correct realm 2024-09-14T11:33:31.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.859+0000 7fa521749640 0 -- 172.21.15.94:0/2061706366 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fa51407fc20 msgr2=0x7fa514068970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:31.862+0000 7fa520f48640 0 -- 172.21.15.94:0/2061706366 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa51405a5a0 msgr2=0x7fa514084950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 zone default found 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 4 Realm: () 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.069+0000 7fa525813800 20 zonegroup default 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.070+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.070+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.070+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.070+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.070+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.071+0000 7fa525813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.071+0000 7fa525813800 20 started sync module instance, tier type = 2024-09-14T11:33:32.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.071+0000 7fa525813800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:32.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=0 2024-09-14T11:33:32.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=1 2024-09-14T11:33:32.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=2 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=3 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=4 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=5 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.079+0000 7fa525813800 20 add_watcher() i=6 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.080+0000 7fa525813800 20 add_watcher() i=7 2024-09-14T11:33:32.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.080+0000 7fa525813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa3d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa525813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa525813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa525813800 5 note: GC not initialized 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa3d5fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa525813800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa525813800 20 Filter name: none 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.082+0000 7fa3477fe640 20 reqs_thread_entry: start 2024-09-14T11:33:32.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.083+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.084+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:32.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.084+0000 7fa525813800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.084+0000 7fa525813800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:32.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.084+0000 7fa525813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.086+0000 7fa3d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.088+0000 7fa525813800 20 remove_watcher() i=0 2024-09-14T11:33:32.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.088+0000 7fa525813800 2 removed watcher, disabling cache 2024-09-14T11:33:32.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.089+0000 7fa525813800 20 remove_watcher() i=1 2024-09-14T11:33:32.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.090+0000 7fa525813800 20 remove_watcher() i=2 2024-09-14T11:33:32.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.091+0000 7fa525813800 20 remove_watcher() i=3 2024-09-14T11:33:32.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.092+0000 7fa525813800 20 remove_watcher() i=4 2024-09-14T11:33:32.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.093+0000 7fa525813800 20 remove_watcher() i=5 2024-09-14T11:33:32.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.094+0000 7fa525813800 20 remove_watcher() i=6 2024-09-14T11:33:32.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.095+0000 7fa525813800 20 remove_watcher() i=7 2024-09-14T11:33:32.104 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:32.104 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:32.104 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:32.104 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:32.106 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.106 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.113 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.113 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.157 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:32.189 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:32.189 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.227+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 realm 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.229+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.230+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.230+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.230+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.230+0000 7f3c2bc11800 20 searching for the correct realm 2024-09-14T11:33:32.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.234+0000 7f3c27b49640 0 -- 172.21.15.94:0/1361207781 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f3c1c043040 msgr2=0x7f3c1c013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:32.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.440+0000 7f3c27348640 0 -- 172.21.15.94:0/1361207781 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x560d76f45580 msgr2=0x560d76f479b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.442+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 zone default found 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 4 Realm: () 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 zonegroup default 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.443+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 started sync module instance, tier type = 2024-09-14T11:33:32.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.444+0000 7f3c2bc11800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=0 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=1 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=2 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=3 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=4 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=5 2024-09-14T11:33:32.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.453+0000 7f3c2bc11800 20 add_watcher() i=6 2024-09-14T11:33:32.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.454+0000 7f3c2bc11800 20 add_watcher() i=7 2024-09-14T11:33:32.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.454+0000 7f3c2bc11800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.455+0000 7f3addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 5 note: GC not initialized 2024-09-14T11:33:32.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3adcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 20 Filter name: none 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3a567fc640 20 reqs_thread_entry: start 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.456+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 : miss 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.457+0000 7f3c2bc11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 2024-09-14T11:33:32.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.458+0000 7f3c2bc11800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.463+0000 7f3c2bc11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26, ofs0, ns] 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94615830330064 notifier 6425 bl.length()=1023 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3b0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3b0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_sources= new_sources= 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential sources added=[] removed=[] 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_dests= new_dests= 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.464+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential dests added=[] removed=[] 2024-09-14T11:33:32.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.0 2024-09-14T11:33:32.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.0 2024-09-14T11:33:32.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.1 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.1 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.2 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.2 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.3 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.3 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.4 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.4 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.5 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.5 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.6 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.6 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.7 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.7 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.8 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.8 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.9 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.9 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.10 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.10 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.11 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2.11 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.0 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.469+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.1 2024-09-14T11:33:32.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.470+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2 2024-09-14T11:33:32.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.470+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.3 2024-09-14T11:33:32.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.471+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.4 2024-09-14T11:33:32.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.472+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.5 2024-09-14T11:33:32.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.472+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.6 2024-09-14T11:33:32.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.472+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.7 2024-09-14T11:33:32.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.473+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.8 2024-09-14T11:33:32.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.473+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.9 2024-09-14T11:33:32.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.474+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.10 2024-09-14T11:33:32.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.477+0000 7f3c2bc11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:32.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.477+0000 7f3c2bc11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 2024-09-14T11:33:32.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3c2bc11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3c2bc11800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3c2bc11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3c2bc11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26, ofs0, ns] 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94615830330064 notifier 6425 bl.length()=1023 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3b0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.478+0000 7f3b0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.479+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_sources= new_sources= 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.479+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential sources added=[] removed=[] 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.479+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_dests= new_dests= 2024-09-14T11:33:32.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.479+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential dests added=[] removed=[] 2024-09-14T11:33:32.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.481+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.0 2024-09-14T11:33:32.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.481+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.1 2024-09-14T11:33:32.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.482+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.2 2024-09-14T11:33:32.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.482+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.3 2024-09-14T11:33:32.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.482+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.4 2024-09-14T11:33:32.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.483+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.5 2024-09-14T11:33:32.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.483+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.6 2024-09-14T11:33:32.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.483+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.7 2024-09-14T11:33:32.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.483+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.8 2024-09-14T11:33:32.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.484+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.9 2024-09-14T11:33:32.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.484+0000 7f3c2bc11800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26.10 2024-09-14T11:33:32.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.484+0000 7f3c2bc11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:32.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.484+0000 7f3c2bc11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26, ofs0, ns] 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94615830330064 notifier 6425 bl.length()=991 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 info.flags=0x17 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3b0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 to cache LRU end 2024-09-14T11:33:32.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3b0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_sources= new_sources= 2024-09-14T11:33:32.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential sources added=[] removed=[] 2024-09-14T11:33:32.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): orig_dests= new_dests= 2024-09-14T11:33:32.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.486+0000 7f3c2bc11800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26]): potential dests added=[] removed=[] 2024-09-14T11:33:32.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.488+0000 7f3c2bc11800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:32.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.490+0000 7f3addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.492+0000 7f3c2bc11800 20 remove_watcher() i=0 2024-09-14T11:33:32.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.492+0000 7f3c2bc11800 2 removed watcher, disabling cache 2024-09-14T11:33:32.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.493+0000 7f3c2bc11800 20 remove_watcher() i=1 2024-09-14T11:33:32.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.494+0000 7f3c2bc11800 20 remove_watcher() i=2 2024-09-14T11:33:32.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.495+0000 7f3c2bc11800 20 remove_watcher() i=3 2024-09-14T11:33:32.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.496+0000 7f3c2bc11800 20 remove_watcher() i=4 2024-09-14T11:33:32.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.497+0000 7f3c2bc11800 20 remove_watcher() i=5 2024-09-14T11:33:32.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.498+0000 7f3c2bc11800 20 remove_watcher() i=6 2024-09-14T11:33:32.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.499+0000 7f3c2bc11800 20 remove_watcher() i=7 2024-09-14T11:33:32.509 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:33:32.539 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:32.539 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.575+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 realm 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.577+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.578+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.578+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.578+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.579+0000 7fb72f40e800 20 searching for the correct realm 2024-09-14T11:33:32.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.581+0000 7fb72236a640 0 -- 172.21.15.94:0/4283420563 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb71c027040 msgr2=0x7fb71c0523f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.585+0000 7fb72ab6b640 0 -- 172.21.15.94:0/4283420563 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb71400d000 msgr2=0x7fb714043ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 zone default found 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 4 Realm: () 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 zonegroup default 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.791+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 started sync module instance, tier type = 2024-09-14T11:33:32.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.792+0000 7fb72f40e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=0 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=1 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=2 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=3 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=4 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=5 2024-09-14T11:33:32.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.802+0000 7fb72f40e800 20 add_watcher() i=6 2024-09-14T11:33:32.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.803+0000 7fb72f40e800 20 add_watcher() i=7 2024-09-14T11:33:32.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.803+0000 7fb72f40e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.804+0000 7fb5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 5 note: GC not initialized 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb55bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 20 Filter name: none 2024-09-14T11:33:32.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb559ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:32.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.805+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.806+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.806+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.806+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.806+0000 7fb72f40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.806+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.807+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:32.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.807+0000 7fb72f40e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.807+0000 7fb72f40e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:32.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.807+0000 7fb72f40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.809+0000 7fb5e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.811+0000 7fb72f40e800 20 remove_watcher() i=0 2024-09-14T11:33:32.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.811+0000 7fb72f40e800 2 removed watcher, disabling cache 2024-09-14T11:33:32.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.812+0000 7fb72f40e800 20 remove_watcher() i=1 2024-09-14T11:33:32.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.813+0000 7fb72f40e800 20 remove_watcher() i=2 2024-09-14T11:33:32.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.814+0000 7fb72f40e800 20 remove_watcher() i=3 2024-09-14T11:33:32.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.815+0000 7fb72f40e800 20 remove_watcher() i=4 2024-09-14T11:33:32.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.816+0000 7fb72f40e800 20 remove_watcher() i=5 2024-09-14T11:33:32.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.817+0000 7fb72f40e800 20 remove_watcher() i=6 2024-09-14T11:33:32.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:32.818+0000 7fb72f40e800 20 remove_watcher() i=7 2024-09-14T11:33:32.827 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:32.827 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:32.827 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:32.827 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:32.829 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.830 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.833 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.833 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.876 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.876 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.904 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:33:32.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:32.905 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.905 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.915 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.915 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.958 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.958 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.965 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.965 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.972 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.972 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.979 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.979 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.986 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.986 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:32.994 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.994 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.001 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.001 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.008 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.008 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.017 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.017 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.024 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.024 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.031 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.031 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.038 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.038 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.046 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.046 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.053 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.053 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.061 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.061 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.068 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.068 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.075 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.075 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.082 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.082 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.089 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.089 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.097 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.097 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:33.104 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:33:33.133 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:33.133 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:33.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.169+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.171+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.171+0000 7ff5ab546800 20 realm 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.171+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.172+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.172+0000 7ff5ab546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.172+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.172+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.172+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.173+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.173+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.173+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:33.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.173+0000 7ff5ab546800 20 searching for the correct realm 2024-09-14T11:33:33.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.176+0000 7ff5a0836640 0 -- 172.21.15.94:0/3261855783 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55d9fc4bc360 msgr2=0x55d9fc4be750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.179+0000 7ff5a9037640 0 -- 172.21.15.94:0/3261855783 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7ff59403f040 msgr2=0x7ff594067930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.183+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:33.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 zone default found 2024-09-14T11:33:33.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 4 Realm: () 2024-09-14T11:33:33.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 zonegroup default 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.184+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.185+0000 7ff5ab546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.185+0000 7ff5ab546800 20 started sync module instance, tier type = 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.185+0000 7ff5ab546800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:33.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=0 2024-09-14T11:33:33.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=1 2024-09-14T11:33:33.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=2 2024-09-14T11:33:33.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=3 2024-09-14T11:33:33.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=4 2024-09-14T11:33:33.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=5 2024-09-14T11:33:33.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.193+0000 7ff5ab546800 20 add_watcher() i=6 2024-09-14T11:33:33.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.194+0000 7ff5ab546800 20 add_watcher() i=7 2024-09-14T11:33:33.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.194+0000 7ff5ab546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:33.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.195+0000 7ff45f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 5 note: GC not initialized 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff45e7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:33.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 20 Filter name: none 2024-09-14T11:33:33.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff3cffff640 20 reqs_thread_entry: start 2024-09-14T11:33:33.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.196+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.197+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.197+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.197+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.197+0000 7ff5ab546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.197+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.198+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.198+0000 7ff5ab546800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.198+0000 7ff5ab546800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:33.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.198+0000 7ff5ab546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:33.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.199+0000 7ff45f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.202+0000 7ff5ab546800 20 remove_watcher() i=0 2024-09-14T11:33:33.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.202+0000 7ff5ab546800 2 removed watcher, disabling cache 2024-09-14T11:33:33.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.202+0000 7ff5ab546800 20 remove_watcher() i=1 2024-09-14T11:33:33.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.203+0000 7ff5ab546800 20 remove_watcher() i=2 2024-09-14T11:33:33.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.204+0000 7ff5ab546800 20 remove_watcher() i=3 2024-09-14T11:33:33.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.205+0000 7ff5ab546800 20 remove_watcher() i=4 2024-09-14T11:33:33.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.206+0000 7ff5ab546800 20 remove_watcher() i=5 2024-09-14T11:33:33.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.207+0000 7ff5ab546800 20 remove_watcher() i=6 2024-09-14T11:33:33.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.208+0000 7ff5ab546800 20 remove_watcher() i=7 2024-09-14T11:33:33.217 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:33.217 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:33.217 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:33.217 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:33.218 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:33:33.254 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:33.254 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:33.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.292+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 realm 2024-09-14T11:33:33.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:33.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.294+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.295+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.295+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.295+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:33.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.295+0000 7f9acd3ad800 20 searching for the correct realm 2024-09-14T11:33:33.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.298+0000 7f9aca696640 0 -- 172.21.15.94:0/3238980938 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f9abc088040 msgr2=0x7f9abc067c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.504+0000 7f9acae97640 0 -- 172.21.15.94:0/3238980938 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f9ac0077160 msgr2=0x7f9ac0069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.710+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 zone default found 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 4 Realm: () 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 zonegroup default 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.711+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.712+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.712+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.712+0000 7f9acd3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.712+0000 7f9acd3ad800 20 started sync module instance, tier type = 2024-09-14T11:33:33.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.712+0000 7f9acd3ad800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:33.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=0 2024-09-14T11:33:33.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=1 2024-09-14T11:33:33.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=2 2024-09-14T11:33:33.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=3 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=4 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=5 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.721+0000 7f9acd3ad800 20 add_watcher() i=6 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.722+0000 7f9acd3ad800 20 add_watcher() i=7 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.722+0000 7f9acd3ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:33.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.724+0000 7f99817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.724+0000 7f9acd3ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.724+0000 7f9acd3ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.724+0000 7f9acd3ad800 5 note: GC not initialized 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f98fbfff640 20 reqs_thread_entry: start 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 20 Filter name: none 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f98f9ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:33.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:33:33.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:33.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:33.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 : miss 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.725+0000 7f9acd3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 info.flags=0x17 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 to cache LRU end 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.726+0000 7f9acd3ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 2024-09-14T11:33:33.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.731+0000 7f9acd3ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 info.flags=0x17 2024-09-14T11:33:33.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.731+0000 7f9acd3ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 to cache LRU end 2024-09-14T11:33:33.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.731+0000 7f9acd3ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27, ofs0, ns] 2024-09-14T11:33:33.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f99ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94343761837712 notifier 6795 bl.length()=1023 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f99ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 info.flags=0x17 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f99ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 to cache LRU end 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f99ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): orig_sources= new_sources= 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): potential sources added=[] removed=[] 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): orig_dests= new_dests= 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): potential dests added=[] removed=[] 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:33:33.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.732+0000 7f9acd3ad800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.0 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.0 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.1 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.1 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.2 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.2 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.3 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.3 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.4 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.4 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.5 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.5 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.6 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.6 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.7 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.7 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.8 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.8 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.9 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.9 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.10 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.10 2024-09-14T11:33:33.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.11 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1.11 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.0 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.735+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.1 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.736+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.2 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.736+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.3 2024-09-14T11:33:33.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.737+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.4 2024-09-14T11:33:33.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.737+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.5 2024-09-14T11:33:33.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.738+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.6 2024-09-14T11:33:33.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.739+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.7 2024-09-14T11:33:33.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.740+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.8 2024-09-14T11:33:33.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.741+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.9 2024-09-14T11:33:33.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.741+0000 7f9acd3ad800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27.10 2024-09-14T11:33:33.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.744+0000 7f9acd3ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:33.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.744+0000 7f9acd3ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.745+0000 7f9acd3ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 info.flags=0x17 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.745+0000 7f9acd3ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 to cache LRU end 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.745+0000 7f9acd3ad800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.745+0000 7f9acd3ad800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27, ofs0, ns] 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f99ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94343761837712 notifier 6795 bl.length()=991 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f99ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 info.flags=0x17 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f99ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 to cache LRU end 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f99ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): orig_sources= new_sources= 2024-09-14T11:33:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): potential sources added=[] removed=[] 2024-09-14T11:33:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): orig_dests= new_dests= 2024-09-14T11:33:33.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.746+0000 7f9acd3ad800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27]): potential dests added=[] removed=[] 2024-09-14T11:33:33.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.748+0000 7f9acd3ad800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:33.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.750+0000 7f99817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.752+0000 7f9acd3ad800 20 remove_watcher() i=0 2024-09-14T11:33:33.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.752+0000 7f9acd3ad800 2 removed watcher, disabling cache 2024-09-14T11:33:33.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.753+0000 7f9acd3ad800 20 remove_watcher() i=1 2024-09-14T11:33:33.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.754+0000 7f9acd3ad800 20 remove_watcher() i=2 2024-09-14T11:33:33.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.755+0000 7f9acd3ad800 20 remove_watcher() i=3 2024-09-14T11:33:33.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.756+0000 7f9acd3ad800 20 remove_watcher() i=4 2024-09-14T11:33:33.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.757+0000 7f9acd3ad800 20 remove_watcher() i=5 2024-09-14T11:33:33.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.758+0000 7f9acd3ad800 20 remove_watcher() i=6 2024-09-14T11:33:33.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.759+0000 7f9acd3ad800 20 remove_watcher() i=7 2024-09-14T11:33:33.770 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:33:33.798 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:33.799 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:33.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.836+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.837+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.837+0000 7fb645375800 20 realm 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.837+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.838+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.838+0000 7fb645375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.838+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.838+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.838+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.839+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.839+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.839+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:33.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.839+0000 7fb645375800 20 searching for the correct realm 2024-09-14T11:33:33.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.842+0000 7fb63a665640 0 -- 172.21.15.94:0/3370153571 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb63404f040 msgr2=0x7fb634050ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:33.846+0000 7fb642e66640 0 -- 172.21.15.94:0/3370153571 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb62c036040 msgr2=0x7fb62c044420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.051+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 zone default found 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 4 Realm: () 2024-09-14T11:33:34.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 zonegroup default 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.052+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.053+0000 7fb645375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.053+0000 7fb645375800 20 started sync module instance, tier type = 2024-09-14T11:33:34.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.053+0000 7fb645375800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=0 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=1 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=2 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=3 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=4 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.061+0000 7fb645375800 20 add_watcher() i=5 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.062+0000 7fb645375800 20 add_watcher() i=6 2024-09-14T11:33:34.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.062+0000 7fb645375800 20 add_watcher() i=7 2024-09-14T11:33:34.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.062+0000 7fb645375800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.064+0000 7fb4f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.064+0000 7fb645375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.064+0000 7fb645375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.064+0000 7fb645375800 5 note: GC not initialized 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.065+0000 7fb473fff640 20 reqs_thread_entry: start 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.065+0000 7fb645375800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.065+0000 7fb645375800 20 Filter name: none 2024-09-14T11:33:34.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.065+0000 7fb471ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:34.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.065+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.066+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.066+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.066+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.066+0000 7fb645375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.066+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.067+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.067+0000 7fb645375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.067+0000 7fb645375800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.067+0000 7fb645375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.069+0000 7fb4f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.071+0000 7fb645375800 20 remove_watcher() i=0 2024-09-14T11:33:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.071+0000 7fb645375800 2 removed watcher, disabling cache 2024-09-14T11:33:34.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.072+0000 7fb645375800 20 remove_watcher() i=1 2024-09-14T11:33:34.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.073+0000 7fb645375800 20 remove_watcher() i=2 2024-09-14T11:33:34.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.074+0000 7fb645375800 20 remove_watcher() i=3 2024-09-14T11:33:34.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.075+0000 7fb645375800 20 remove_watcher() i=4 2024-09-14T11:33:34.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.076+0000 7fb645375800 20 remove_watcher() i=5 2024-09-14T11:33:34.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.077+0000 7fb645375800 20 remove_watcher() i=6 2024-09-14T11:33:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.078+0000 7fb645375800 20 remove_watcher() i=7 2024-09-14T11:33:34.087 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.087 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:34.087 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:33:34.088 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.089 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.089 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.092 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.092 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.135 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.135 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.162 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:33:34.163 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.164 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.164 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.175 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.175 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.218 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.218 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.228 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.228 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.236 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.236 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.243 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.243 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.251 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.251 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.258 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.258 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.265 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.266 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.273 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.273 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.282 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.282 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.289 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.290 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.297 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.297 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.304 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.304 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.312 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.312 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.321 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.321 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.329 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.329 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.337 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.337 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.345 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.345 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.353 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.353 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.361 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.361 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.369 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.369 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:33:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:34.405 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.444+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 realm 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.446+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.447+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.447+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.447+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.447+0000 7fe48ea0e800 20 searching for the correct realm 2024-09-14T11:33:34.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.451+0000 7fe4818ca640 0 -- 172.21.15.94:0/2610657790 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x556bcb8d7e50 msgr2=0x556bcb8da2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.454+0000 7fe4818ca640 0 -- 172.21.15.94:0/2610657790 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fe47c06d070 msgr2=0x7fe47c079940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.457+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 zone default found 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 4 Realm: () 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 zonegroup default 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.458+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.459+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.459+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.459+0000 7fe48ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.459+0000 7fe48ea0e800 20 started sync module instance, tier type = 2024-09-14T11:33:34.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.459+0000 7fe48ea0e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.467+0000 7fe48ea0e800 20 add_watcher() i=0 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.467+0000 7fe48ea0e800 20 add_watcher() i=1 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.467+0000 7fe48ea0e800 20 add_watcher() i=2 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.467+0000 7fe48ea0e800 20 add_watcher() i=3 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.467+0000 7fe48ea0e800 20 add_watcher() i=4 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.468+0000 7fe48ea0e800 20 add_watcher() i=5 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.468+0000 7fe48ea0e800 20 add_watcher() i=6 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.469+0000 7fe48ea0e800 20 add_watcher() i=7 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.469+0000 7fe48ea0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.470+0000 7fe340fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.470+0000 7fe48ea0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.470+0000 7fe48ea0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.470+0000 7fe48ea0e800 5 note: GC not initialized 2024-09-14T11:33:34.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe2bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:34.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe48ea0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe48ea0e800 20 Filter name: none 2024-09-14T11:33:34.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe2b97fa640 20 reqs_thread_entry: start 2024-09-14T11:33:34.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.471+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.472+0000 7fe48ea0e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.473+0000 7fe48ea0e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.473+0000 7fe48ea0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.475+0000 7fe340fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.477+0000 7fe48ea0e800 20 remove_watcher() i=0 2024-09-14T11:33:34.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.477+0000 7fe48ea0e800 2 removed watcher, disabling cache 2024-09-14T11:33:34.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.477+0000 7fe48ea0e800 20 remove_watcher() i=1 2024-09-14T11:33:34.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.478+0000 7fe48ea0e800 20 remove_watcher() i=2 2024-09-14T11:33:34.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.480+0000 7fe48ea0e800 20 remove_watcher() i=3 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.481+0000 7fe48ea0e800 20 remove_watcher() i=4 2024-09-14T11:33:34.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.482+0000 7fe48ea0e800 20 remove_watcher() i=5 2024-09-14T11:33:34.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.482+0000 7fe48ea0e800 20 remove_watcher() i=6 2024-09-14T11:33:34.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.483+0000 7fe48ea0e800 20 remove_watcher() i=7 2024-09-14T11:33:34.492 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.493 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:34.493 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:34.493 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.494 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:33:34.528 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:34.528 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.565+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 realm 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 searching for the correct realm 2024-09-14T11:33:34.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.571+0000 7fbcec46e640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbce4071f20 msgr2=0x7fbce40677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:34.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.575+0000 7fbcf4c6f640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbcdc0ee440 msgr2=0x7fbcdc0c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zone default found 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Realm: () 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zonegroup default 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started sync module instance, tier type = 2024-09-14T11:33:34.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=0 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=1 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=2 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=3 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=4 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=5 2024-09-14T11:33:34.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=6 2024-09-14T11:33:34.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.792+0000 7fbcf8f26800 20 add_watcher() i=7 2024-09-14T11:33:34.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.792+0000 7fbcf8f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.794+0000 7fbbab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 note: GC not initialized 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbbaa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 Filter name: none 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbba3fff640 20 reqs_thread_entry: start 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : miss 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 93850475212288 notifier 6524 bl.length()=1023 2024-09-14T11:33:34.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbcf8f26800 time 2024-09-14T11:33:34.803916+0000 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:34.826 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.826 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbcfa78c76a] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.802+0000 7fbcf8f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbcf8f26800 time 2024-09-14T11:33:34.803916+0000 2024-09-14T11:33:34.827 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbcfa78c76a] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:34.828 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fbcf8f26800 thread_name:radosgw-admin 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbcf943e6f0] 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbcf948b99c] 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:34.829 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbcfa78c7c4] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.803+0000 7fbcf8f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:34.830 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fbcf8f26800 thread_name:radosgw-admin 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbcf943e6f0] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbcf948b99c] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbcfa78c7c4] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.831 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.832 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: dump: 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6512 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 4 set_mon_vals no callback set 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: shutdown 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 asok(0x555b440b1270) unregister_commands rotate-key 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 librados: starting msgr at 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 librados: starting objecter 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests hook 0x555b44302570 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 1 librados: setting wanted keys 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 1 librados: calling monclient init 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key hook 0x555b442d07a8 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4417dc40 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b4417e020 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b44216670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.042608s 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4417e020 auth_method 0 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b44216670 auth_method 0 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b4417dc40 auth_method 0 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6840 payload 824 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:33:34.550+0000 7fbcec46e640 1 monclient: found mon.noname-a 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: dump: 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: dump: 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6840 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:33:34.551+0000 7fbbe2e0d640 4 set_mon_vals no callback set 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 1 librados: init done 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:33:34.553+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbbdc077230 auth_method 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:33:34.553+0000 7fbcf5470640 10 monclient: get_auth_request con 0x555b442f9040 auth_method 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:33:34.554+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b4431be00 auth_method 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:33:34.555+0000 7fbcec46e640 10 monclient: get_auth_request con 0x555b4431f6f0 auth_method 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.848 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests cmddesc objecter_requests hook 0x555b44328620 EEXIST 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x555b44324230 EEXIST 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b4434c940 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b4434cd20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4434b650 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.049503s 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b4434c940 auth_method 0 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4434cd20 auth_method 0 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b4434b650 auth_method 0 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.856 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: dump: 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.857 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6518 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: dump: 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.858 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:33:34.558+0000 7fbcf5c71640 4 set_mon_vals no callback set 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.859 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:33:34.560+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbbcc077140 auth_method 0 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: get_monmap_and_config 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.860 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.862 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.863 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.864 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x7ffd8c59e2d8 EEXIST 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b443a0e90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b44370ca0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4439c250 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.865 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.053402s 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b44370ca0 auth_method 0 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b443a0e90 auth_method 0 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.866 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b4439c250 auth_method 0 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6521 payload 274 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:33:34.561+0000 7fbcec46e640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: dump: 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.868 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6521 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:34.869 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 4 set_mon_vals no callback set 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: dump: 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.870 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: shutdown 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.871 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.872 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.873 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: starting msgr at 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: starting objecter 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests cmddesc objecter_requests hook 0x555b4439cea0 EEXIST 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: setting wanted keys 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: calling monclient init 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.874 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.875 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x555b44361348 EEXIST 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b44370ca0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b4439c250 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b443a0e90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.876 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.055526s 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4439c250 auth_method 0 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b443a0e90 auth_method 0 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.877 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:33:34.563+0000 7fbcec46e640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.878 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:33:34.563+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b44370ca0 auth_method 0 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: dump: 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.879 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: dump: 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.880 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6524 2024-09-14T11:33:34.881 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:33:34.564+0000 7fbbcbfff640 4 set_mon_vals no callback set 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 1 librados: init done 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cr dump hook 0x555b44391d58 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:33:34.565+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.882 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:33:34.566+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbbc0077260 auth_method 0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:33:34.566+0000 7fbcf5470640 10 monclient: get_auth_request con 0x555b443baa30 auth_method 0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 realm 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:33:34.567+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b443bed10 auth_method 0 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.883 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 searching for the correct realm 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:33:34.568+0000 7fbcec46e640 10 monclient: get_auth_request con 0x555b443c3e40 auth_method 0 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:33:34.569+0000 7fbcf5470640 10 monclient: get_auth_request con 0x7fbcdc06b020 auth_method 0 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:33:34.570+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcf0025040 auth_method 0 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:33:34.570+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbce4071f20 auth_method 0 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:33:34.571+0000 7fbcec46e640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbce4071f20 msgr2=0x7fbce40677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 1 client.6524.objecter ms_handle_reset 0x7fbce4071f20 session 0x7fbce4089040 osd.4 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 10 monclient: _renew_subs 2024-09-14T11:33:34.884 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:33:34.571+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbbc0087910 auth_method 0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:33:34.573+0000 7fbcf5470640 10 monclient: get_auth_request con 0x7fbcdc04fc60 auth_method 0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:33:34.575+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcdc0ee440 auth_method 0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:33:34.575+0000 7fbcf4c6f640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbcdc0ee440 msgr2=0x7fbcdc0c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:33:34.776+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcdc0ee440 auth_method 0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.885 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zone default found 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Realm: () 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.886 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zonegroup default 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started sync module instance, tier type = 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=0 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=1 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=2 2024-09-14T11:33:34.887 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=3 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=4 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=5 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=6 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:33:34.792+0000 7fbcf8f26800 20 add_watcher() i=7 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:33:34.792+0000 7fbcf8f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.888 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:33:34.794+0000 7fbbab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.889 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache list hook 0x555b443992c0 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache inspect hook 0x555b443992c0 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache erase hook 0x555b443992c0 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache zap hook 0x555b443992c0 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 note: GC not initialized 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:33:34.795+0000 7fbbaa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace show hook 0x7fbce40014d0 2024-09-14T11:33:34.890 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace history hook 0x7fbce40014d0 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace active hook 0x7fbce40014d0 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace active_short hook 0x7fbce40014d0 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 Filter name: none 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:33:34.795+0000 7fbba3fff640 20 reqs_thread_entry: start 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:34.891 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : miss 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.892 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 93850475212288 notifier 6524 bl.length()=1023 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:33:34.893 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbcf8f26800 time 2024-09-14T11:33:34.803916+0000 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbcfa78c76a] 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:34.894 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:33:34.803+0000 7fbcf8f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fbcf8f26800 thread_name:radosgw-admin 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbcf943e6f0] 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbcf948b99c] 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:34.895 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbcfa78c7c4] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:34.897 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:34.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:33:34.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:34.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:33:34.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:33:34.902 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:34.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:33:34.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbba3fff640 / http_manager 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbaa7e4640 / http_manager 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbab7e6640 / rgw_dt_lg_renew 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbca7fc640 / ms_dispatch 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbcbfff640 / io_context_pool 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbda7fc640 / ms_dispatch 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbe160a640 / ms_dispatch 2024-09-14T11:33:34.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbe2e0d640 / io_context_pool 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcec46e640 / msgr-worker-2 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf4c6f640 / msgr-worker-1 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf5470640 / msgr-worker-0 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf5c71640 / io_context_pool 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf8f26800 / radosgw-admin 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.107677.log 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.906 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:33:34.548+0000 7fbbe2e0d640 10 monclient: dump: 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.907 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6512 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:33:34.548+0000 7fbcf8f26800 4 set_mon_vals no callback set 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: shutdown 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 asok(0x555b440b1270) unregister_commands rotate-key 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.908 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding auth protocol: cephx 2024-09-14T11:33:34.909 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: crc 2024-09-14T11:33:34.910 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d62d0) adding con mode: secure 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 librados: starting msgr at 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:33:34.549+0000 7fbcf8f26800 1 librados: starting objecter 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests hook 0x555b44302570 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 1 librados: setting wanted keys 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 1 librados: calling monclient init 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding auth protocol: cephx 2024-09-14T11:33:34.911 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: crc 2024-09-14T11:33:34.912 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 AuthRegistry(0x555b442d0660) adding con mode: secure 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key hook 0x555b442d07a8 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4417dc40 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b4417e020 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b44216670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.913 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:33:34.550+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.042608s 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4417e020 auth_method 0 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b44216670 auth_method 0 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b4417dc40 auth_method 0 2024-09-14T11:33:34.914 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:33:34.550+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.915 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:33:34.550+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6840 payload 824 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:33:34.550+0000 7fbcec46e640 1 monclient: found mon.noname-a 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:33:34.550+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: dump: 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.916 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:33:34.551+0000 7fbbe160a640 10 monclient: dump: 2024-09-14T11:33:34.917 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6840 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.918 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:33:34.551+0000 7fbbe2e0d640 4 set_mon_vals no callback set 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:33:34.551+0000 7fbcf8f26800 1 librados: init done 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:33:34.553+0000 7fbbe160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:33:34.553+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbbdc077230 auth_method 0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:33:34.553+0000 7fbcf5470640 10 monclient: get_auth_request con 0x555b442f9040 auth_method 0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:33:34.554+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b4431be00 auth_method 0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:33:34.555+0000 7fbcec46e640 10 monclient: get_auth_request con 0x555b4431f6f0 auth_method 0 2024-09-14T11:33:34.919 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.920 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding auth protocol: cephx 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.921 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: crc 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b44325130) adding con mode: secure 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests cmddesc objecter_requests hook 0x555b44328620 EEXIST 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding auth protocol: cephx 2024-09-14T11:33:34.922 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: crc 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:33:34.556+0000 7fbcf8f26800 5 AuthRegistry(0x555b443240e8) adding con mode: secure 2024-09-14T11:33:34.923 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x555b44324230 EEXIST 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b4434c940 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b4434cd20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4434b650 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.924 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:33:34.557+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.049503s 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b4434c940 auth_method 0 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4434cd20 auth_method 0 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.925 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:33:34.557+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b4434b650 auth_method 0 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:33:34.557+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:33:34.557+0000 7fbcf4c6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.926 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: dump: 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.927 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6518 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:33:34.558+0000 7fbbda7fc640 10 monclient: dump: 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.928 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:33:34.558+0000 7fbcf5c71640 4 set_mon_vals no callback set 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:33:34.558+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.929 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:33:34.560+0000 7fbbda7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:33:34.560+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbbcc077140 auth_method 0 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: get_monmap_and_config 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.930 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding auth protocol: cephx 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.931 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: crc 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x555b4436c820) adding con mode: secure 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding auth protocol: cephx 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.933 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: crc 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:33:34.560+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e190) adding con mode: secure 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x7ffd8c59e2d8 EEXIST 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b443a0e90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b44370ca0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b4439c250 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.053402s 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b44370ca0 auth_method 0 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request con 0x555b443a0e90 auth_method 0 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b4439c250 auth_method 0 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:33:34.561+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:33:34.561+0000 7fbcf4c6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6521 payload 274 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:33:34.561+0000 7fbcec46e640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:33:34.561+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: dump: 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.937 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6521 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:33:34.561+0000 7fbcf8f26800 4 set_mon_vals no callback set 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:33:34.561+0000 7fbbcbfff640 10 monclient: dump: 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: shutdown 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: build_initial_monmap 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 build_initial for_mkfs: 0 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: monmap: 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:33:34.940 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding auth protocol: cephx 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.941 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: crc 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44371ae0) adding con mode: secure 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: starting msgr at 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: starting objecter 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command objecter_requests cmddesc objecter_requests hook 0x555b4439cea0 EEXIST 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: setting wanted keys 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 1 librados: calling monclient init 2024-09-14T11:33:34.942 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 10 monclient: init 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:33:34.562+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding auth protocol: cephx 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.943 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: crc 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 AuthRegistry(0x555b44361200) adding con mode: secure 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command rotate-key cmddesc rotate-key hook 0x555b44361348 EEXIST 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-b con 0x555b44370ca0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-c con 0x555b4439c250 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): picked mon.noname-a con 0x555b443a0e90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.944 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:33:34.563+0000 7fbcf8f26800 10 monclient(hunting): authenticate will time out at 1928.055526s 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): get_auth_request con 0x555b4439c250 auth_method 0 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): get_auth_request con 0x555b443a0e90 auth_method 0 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.945 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:33:34.563+0000 7fbcf5470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:33:34.563+0000 7fbcec46e640 1 monclient: found mon.noname-c 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:33:34.563+0000 7fbcec46e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:33:34.563+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b44370ca0 auth_method 0 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:34.946 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: dump: 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:34.947 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:33:34.564+0000 7fbbca7fc640 10 monclient: dump: 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:33:34.948 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 5 monclient: authenticate success, global_id 6524 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:33:34.564+0000 7fbbcbfff640 4 set_mon_vals no callback set 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _renew_subs 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 1 librados: init done 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:33:34.564+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cr dump hook 0x555b44391d58 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:33:34.565+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:33:34.566+0000 7fbbca7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:33:34.949 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:33:34.566+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbbc0077260 auth_method 0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:33:34.566+0000 7fbcf5470640 10 monclient: get_auth_request con 0x555b443baa30 auth_method 0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 realm 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:33:34.567+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:33:34.567+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x555b443bed10 auth_method 0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.950 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:33:34.568+0000 7fbcf8f26800 20 searching for the correct realm 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:33:34.568+0000 7fbcec46e640 10 monclient: get_auth_request con 0x555b443c3e40 auth_method 0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:33:34.569+0000 7fbcf5470640 10 monclient: get_auth_request con 0x7fbcdc06b020 auth_method 0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:33:34.570+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcf0025040 auth_method 0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:33:34.570+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbce4071f20 auth_method 0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:33:34.571+0000 7fbcec46e640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbce4071f20 msgr2=0x7fbce40677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 1 client.6524.objecter ms_handle_reset 0x7fbce4071f20 session 0x7fbce4089040 osd.4 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 10 monclient: _renew_subs 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:33:34.571+0000 7fbbca7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:33:34.571+0000 7fbcec46e640 10 monclient: get_auth_request con 0x7fbbc0087910 auth_method 0 2024-09-14T11:33:34.951 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:33:34.573+0000 7fbcf5470640 10 monclient: get_auth_request con 0x7fbcdc04fc60 auth_method 0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:33:34.575+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcdc0ee440 auth_method 0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:33:34.575+0000 7fbcf4c6f640 0 -- 172.21.15.94:0/2130763557 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbcdc0ee440 msgr2=0x7fbcdc0c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:33:34.776+0000 7fbcf4c6f640 10 monclient: get_auth_request con 0x7fbcdc0ee440 auth_method 0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:33:34.780+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.952 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zone default found 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Realm: () 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 zonegroup default 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:33:34.781+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.953 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started sync module instance, tier type = 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:33:34.782+0000 7fbcf8f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=0 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=1 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=2 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=3 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=4 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=5 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:33:34.791+0000 7fbcf8f26800 20 add_watcher() i=6 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:33:34.792+0000 7fbcf8f26800 20 add_watcher() i=7 2024-09-14T11:33:34.954 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:33:34.792+0000 7fbcf8f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding auth protocol: cephx 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:33:34.794+0000 7fbbab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.955 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: crc 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 AuthRegistry(0x7ffd8c59e670) adding con mode: secure 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache list hook 0x555b443992c0 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache inspect hook 0x555b443992c0 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache erase hook 0x555b443992c0 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command cache zap hook 0x555b443992c0 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:33:34.794+0000 7fbcf8f26800 5 note: GC not initialized 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:33:34.795+0000 7fbbaa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:34.956 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace show hook 0x7fbce40014d0 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace history hook 0x7fbce40014d0 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace active hook 0x7fbce40014d0 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 5 asok(0x555b440b1270) register_command sync trace active_short hook 0x7fbce40014d0 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 Filter name: none 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:33:34.795+0000 7fbba3fff640 20 reqs_thread_entry: start 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : miss 2024-09-14T11:33:34.957 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:33:34.795+0000 7fbcf8f26800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:33:34.796+0000 7fbcf8f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:33:34.801+0000 7fbcf8f26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 93850475212288 notifier 6524 bl.length()=1023 2024-09-14T11:33:34.958 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:33:34.801+0000 7fbbcbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:33:34.802+0000 7fbcf8f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbcf8f26800 time 2024-09-14T11:33:34.803916+0000 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbcfa78c76a] 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.959 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:33:34.803+0000 7fbcf8f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fbcf8f26800 thread_name:radosgw-admin 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:34.960 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbcf943e6f0] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbcf948b99c] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbcfa78c7c4] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbcfa78c928] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b417230b1] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8900e) [0x555b41c3700e] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b41732efd] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbcf9429590] 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:33:34.961 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:33:34.962 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:34.963 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:33:34.964 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:34.965 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:33:34.966 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:33:34.967 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:33:34.968 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbba3fff640 / http_manager 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbaa7e4640 / http_manager 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbab7e6640 / rgw_dt_lg_renew 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbca7fc640 / ms_dispatch 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbcbfff640 / io_context_pool 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbda7fc640 / ms_dispatch 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbe160a640 / ms_dispatch 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbbe2e0d640 / io_context_pool 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcec46e640 / msgr-worker-2 2024-09-14T11:33:34.969 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf4c6f640 / msgr-worker-1 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf5470640 / msgr-worker-0 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf5c71640 / io_context_pool 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: 7fbcf8f26800 / radosgw-admin 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:34.805557Z_6b22b30c-62fc-4103-867b-135f312b2fdd/log 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:33:34.970 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.876+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 realm 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.878+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.879+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.879+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.879+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.879+0000 7f211c375800 20 searching for the correct realm 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.882+0000 7f211a660640 0 -- 172.21.15.94:0/198711704 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55560d3b81c0 msgr2=0x55560d3ba630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.885+0000 7f2119e5f640 0 -- 172.21.15.94:0/198711704 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f21040cfc20 msgr2=0x7f21040adad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:34.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.889+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 zone default found 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 4 Realm: () 2024-09-14T11:33:34.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 zonegroup default 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.890+0000 7f211c375800 20 started sync module instance, tier type = 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.891+0000 7f211c375800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=0 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=1 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=2 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=3 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=4 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=5 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.900+0000 7f211c375800 20 add_watcher() i=6 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.901+0000 7f211c375800 20 add_watcher() i=7 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.901+0000 7f211c375800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f1fcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f211c375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f211c375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f211c375800 5 note: GC not initialized 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f1fca7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f211c375800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.903+0000 7f211c375800 20 Filter name: none 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.904+0000 7f1f3bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.904+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.904+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.904+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.905+0000 7f211c375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.907+0000 7f1fcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.910+0000 7f211c375800 20 remove_watcher() i=0 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.910+0000 7f211c375800 2 removed watcher, disabling cache 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.911+0000 7f211c375800 20 remove_watcher() i=1 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.911+0000 7f211c375800 20 remove_watcher() i=2 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.912+0000 7f211c375800 20 remove_watcher() i=3 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.914+0000 7f211c375800 20 remove_watcher() i=4 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.915+0000 7f211c375800 20 remove_watcher() i=5 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.916+0000 7f211c375800 20 remove_watcher() i=6 2024-09-14T11:33:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:34.917+0000 7f211c375800 20 remove_watcher() i=7 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:33:34.982 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:35.009 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:35.009 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:35.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.046+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 realm 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.048+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.049+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.049+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.049+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:35.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.049+0000 7f2151410800 20 searching for the correct realm 2024-09-14T11:33:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.052+0000 7f214c3df640 0 -- 172.21.15.94:0/2660397293 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f213c03f070 msgr2=0x7f213c04d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.257+0000 7f214cbe0640 0 -- 172.21.15.94:0/2660397293 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f2140010920 msgr2=0x7f2140084990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.464+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 zone default found 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 4 Realm: () 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:33:35.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 zonegroup default 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.465+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.466+0000 7f2151410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.466+0000 7f2151410800 20 started sync module instance, tier type = 2024-09-14T11:33:35.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.466+0000 7f2151410800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:33:35.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=0 2024-09-14T11:33:35.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=1 2024-09-14T11:33:35.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=2 2024-09-14T11:33:35.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=3 2024-09-14T11:33:35.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=4 2024-09-14T11:33:35.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=5 2024-09-14T11:33:35.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.474+0000 7f2151410800 20 add_watcher() i=6 2024-09-14T11:33:35.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.475+0000 7f2151410800 20 add_watcher() i=7 2024-09-14T11:33:35.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.475+0000 7f2151410800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.476+0000 7f2002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 5 note: GC not initialized 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2001fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 20 Filter name: none 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f1f737fe640 20 reqs_thread_entry: start 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:33:35.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.477+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:33:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:33:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:33:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : miss 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.478+0000 7f2151410800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.479+0000 7f2151410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:33:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.480+0000 7f2151410800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to be held by another RGW process; skipping for now 2024-09-14T11:33:35.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.481+0000 7f2002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.483+0000 7f2151410800 20 remove_watcher() i=0 2024-09-14T11:33:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.483+0000 7f2151410800 2 removed watcher, disabling cache 2024-09-14T11:33:35.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.484+0000 7f2151410800 20 remove_watcher() i=1 2024-09-14T11:33:35.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.485+0000 7f2151410800 20 remove_watcher() i=2 2024-09-14T11:33:35.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.486+0000 7f2151410800 20 remove_watcher() i=3 2024-09-14T11:33:35.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.487+0000 7f2151410800 20 remove_watcher() i=4 2024-09-14T11:33:35.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.488+0000 7f2151410800 20 remove_watcher() i=5 2024-09-14T11:33:35.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.489+0000 7f2151410800 20 remove_watcher() i=6 2024-09-14T11:33:35.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:33:35.490+0000 7f2151410800 20 remove_watcher() i=7 2024-09-14T11:33:35.498 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:05.529 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:05.564 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:05.564 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:05.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.607+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 realm 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.609+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.610+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.610+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.610+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:05.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.610+0000 7fcc50d0c800 20 searching for the correct realm 2024-09-14T11:34:05.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.614+0000 7fcc4dff5640 0 -- 172.21.15.94:0/3789894158 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55af8a3c7de0 msgr2=0x55af8a3ca280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.618+0000 7fcc4e7f6640 0 -- 172.21.15.94:0/3789894158 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fcc3804f340 msgr2=0x7fcc380c61c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.622+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 zone default found 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 4 Realm: () 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 zonegroup default 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.623+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.624+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.624+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.624+0000 7fcc50d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.624+0000 7fcc50d0c800 20 started sync module instance, tier type = 2024-09-14T11:34:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.624+0000 7fcc50d0c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:05.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=0 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=1 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=2 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=3 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=4 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=5 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.633+0000 7fcc50d0c800 20 add_watcher() i=6 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.634+0000 7fcc50d0c800 20 add_watcher() i=7 2024-09-14T11:34:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.634+0000 7fcc50d0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:05.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcb04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:05.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcc50d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:05.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcc50d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:05.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcc50d0c800 5 note: GC not initialized 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fca7f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcc50d0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.636+0000 7fcc50d0c800 20 Filter name: none 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fca7d7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:34:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:34:05.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:34:05.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:34:05.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : miss 2024-09-14T11:34:05.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.637+0000 7fcc50d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.638+0000 7fcc50d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:34:05.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.639+0000 7fcc50d0c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcb31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94212426885024 notifier 6900 bl.length()=1023 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcb31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcb31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcb31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:34:05.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:34:05.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:34:05.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.648+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.0 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.0 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.1 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.1 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.2 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.2 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.3 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.3 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.4 2024-09-14T11:34:05.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.4 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.5 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.5 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.6 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.6 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.7 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.7 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.8 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.8 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.9 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.9 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.10 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.10 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.11 2024-09-14T11:34:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2.11 2024-09-14T11:34:05.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.653+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.0 2024-09-14T11:34:05.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.654+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.1 2024-09-14T11:34:05.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.654+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2 2024-09-14T11:34:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.654+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.3 2024-09-14T11:34:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.655+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.4 2024-09-14T11:34:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.656+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.5 2024-09-14T11:34:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.656+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.6 2024-09-14T11:34:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.657+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.7 2024-09-14T11:34:05.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.657+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.8 2024-09-14T11:34:05.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.658+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.9 2024-09-14T11:34:05.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.658+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.10 2024-09-14T11:34:05.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.661+0000 7fcc50d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:05.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.661+0000 7fcc50d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:34:05.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.662+0000 7fcc50d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.662+0000 7fcc50d0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.662+0000 7fcc50d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.662+0000 7fcc50d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcb317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94212426885024 notifier 6900 bl.length()=1023 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcb317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcb317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcb317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:34:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:34:05.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:34:05.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.663+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:34:05.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.665+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.0 2024-09-14T11:34:05.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.666+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.1 2024-09-14T11:34:05.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.666+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.2 2024-09-14T11:34:05.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.666+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.3 2024-09-14T11:34:05.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.667+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.4 2024-09-14T11:34:05.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.667+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.5 2024-09-14T11:34:05.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.667+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.6 2024-09-14T11:34:05.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.668+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.7 2024-09-14T11:34:05.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.668+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.8 2024-09-14T11:34:05.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.668+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.9 2024-09-14T11:34:05.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.669+0000 7fcc50d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28.10 2024-09-14T11:34:05.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.670+0000 7fcc50d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:05.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.670+0000 7fcc50d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 2024-09-14T11:34:05.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.671+0000 7fcc50d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.671+0000 7fcc50d0c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.671+0000 7fcc50d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.671+0000 7fcc50d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28, ofs0, ns] 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcb317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94212426885024 notifier 6900 bl.length()=991 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcb317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 info.flags=0x17 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcb317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 to cache LRU end 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcb317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_sources= new_sources= 2024-09-14T11:34:05.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential sources added=[] removed=[] 2024-09-14T11:34:05.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): orig_dests= new_dests= 2024-09-14T11:34:05.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.672+0000 7fcc50d0c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28]): potential dests added=[] removed=[] 2024-09-14T11:34:05.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.674+0000 7fcc50d0c800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:05.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.676+0000 7fcb04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:05.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.678+0000 7fcc50d0c800 20 remove_watcher() i=0 2024-09-14T11:34:05.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.678+0000 7fcc50d0c800 2 removed watcher, disabling cache 2024-09-14T11:34:05.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.679+0000 7fcc50d0c800 20 remove_watcher() i=1 2024-09-14T11:34:05.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.680+0000 7fcc50d0c800 20 remove_watcher() i=2 2024-09-14T11:34:05.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.681+0000 7fcc50d0c800 20 remove_watcher() i=3 2024-09-14T11:34:05.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.682+0000 7fcc50d0c800 20 remove_watcher() i=4 2024-09-14T11:34:05.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.683+0000 7fcc50d0c800 20 remove_watcher() i=5 2024-09-14T11:34:05.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.684+0000 7fcc50d0c800 20 remove_watcher() i=6 2024-09-14T11:34:05.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.685+0000 7fcc50d0c800 20 remove_watcher() i=7 2024-09-14T11:34:05.696 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:34:05.725 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:05.725 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:05.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.763+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 realm 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.765+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.766+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.766+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.767+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.767+0000 7fa73f92f800 20 searching for the correct realm 2024-09-14T11:34:05.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.769+0000 7fa73ae75640 0 -- 172.21.15.94:0/247915903 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fa734090200 msgr2=0x7fa734084170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:05.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:05.975+0000 7fa73b676640 0 -- 172.21.15.94:0/247915903 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa7240a88f0 msgr2=0x7fa724089410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:06.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.182+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:06.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 zone default found 2024-09-14T11:34:06.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 4 Realm: () 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 zonegroup default 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.183+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.184+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.184+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.184+0000 7fa73f92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.184+0000 7fa73f92f800 20 started sync module instance, tier type = 2024-09-14T11:34:06.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.184+0000 7fa73f92f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=0 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=1 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=2 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=3 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=4 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=5 2024-09-14T11:34:06.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.194+0000 7fa73f92f800 20 add_watcher() i=6 2024-09-14T11:34:06.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.195+0000 7fa73f92f800 20 add_watcher() i=7 2024-09-14T11:34:06.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.195+0000 7fa73f92f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:06.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.196+0000 7fa5f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:06.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:06.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 5 note: GC not initialized 2024-09-14T11:34:06.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa5f0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:06.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:06.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 20 Filter name: none 2024-09-14T11:34:06.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa56a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:06.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.197+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.198+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.198+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.198+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.198+0000 7fa73f92f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.198+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.199+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:34:06.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.199+0000 7fa73f92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.199+0000 7fa73f92f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:06.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.199+0000 7fa73f92f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:06.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.201+0000 7fa5f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.203+0000 7fa73f92f800 20 remove_watcher() i=0 2024-09-14T11:34:06.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.203+0000 7fa73f92f800 2 removed watcher, disabling cache 2024-09-14T11:34:06.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.204+0000 7fa73f92f800 20 remove_watcher() i=1 2024-09-14T11:34:06.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.205+0000 7fa73f92f800 20 remove_watcher() i=2 2024-09-14T11:34:06.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.206+0000 7fa73f92f800 20 remove_watcher() i=3 2024-09-14T11:34:06.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.207+0000 7fa73f92f800 20 remove_watcher() i=4 2024-09-14T11:34:06.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.208+0000 7fa73f92f800 20 remove_watcher() i=5 2024-09-14T11:34:06.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.209+0000 7fa73f92f800 20 remove_watcher() i=6 2024-09-14T11:34:06.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.210+0000 7fa73f92f800 20 remove_watcher() i=7 2024-09-14T11:34:06.218 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:06.218 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:06.218 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:06.218 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:06.220 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.220 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.224 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.224 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.266 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.267 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.294 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:34:06.294 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:06.295 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.295 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.307 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.307 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.349 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.349 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.357 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.357 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.364 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.365 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.373 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.373 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.381 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.381 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.389 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.396 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.404 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.404 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.412 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.413 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.420 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.420 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.429 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.429 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.437 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.438 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.446 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.446 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.453 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.454 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.461 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.461 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.469 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.469 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.477 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.477 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.485 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.485 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.492 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.492 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:06.500 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:06.508 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:34:06.536 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:06.536 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:06.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.575+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 realm 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.577+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.578+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.578+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.578+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:06.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.578+0000 7f3199536800 20 searching for the correct realm 2024-09-14T11:34:06.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.581+0000 7f3195ab8640 0 -- 172.21.15.94:0/2846553193 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x563d75c633a0 msgr2=0x563d75c657f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:06.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.585+0000 7f318cab6640 0 -- 172.21.15.94:0/2846553193 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f3188073040 msgr2=0x7f3188056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:06.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.588+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:06.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 zone default found 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 4 Realm: () 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 zonegroup default 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.589+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.590+0000 7f3199536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.590+0000 7f3199536800 20 started sync module instance, tier type = 2024-09-14T11:34:06.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.590+0000 7f3199536800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=0 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=1 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=2 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=3 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=4 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=5 2024-09-14T11:34:06.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=6 2024-09-14T11:34:06.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.598+0000 7f3199536800 20 add_watcher() i=7 2024-09-14T11:34:06.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.599+0000 7f3199536800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:06.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.600+0000 7f304b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 5 note: GC not initialized 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f304a7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:06.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 20 Filter name: none 2024-09-14T11:34:06.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f2fbbfff640 20 reqs_thread_entry: start 2024-09-14T11:34:06.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.601+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.602+0000 7f3199536800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.603+0000 7f3199536800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.603+0000 7f3199536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:06.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.604+0000 7f304b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.606+0000 7f3199536800 20 remove_watcher() i=0 2024-09-14T11:34:06.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.606+0000 7f3199536800 2 removed watcher, disabling cache 2024-09-14T11:34:06.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.607+0000 7f3199536800 20 remove_watcher() i=1 2024-09-14T11:34:06.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.608+0000 7f3199536800 20 remove_watcher() i=2 2024-09-14T11:34:06.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.609+0000 7f3199536800 20 remove_watcher() i=3 2024-09-14T11:34:06.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.610+0000 7f3199536800 20 remove_watcher() i=4 2024-09-14T11:34:06.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.611+0000 7f3199536800 20 remove_watcher() i=5 2024-09-14T11:34:06.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.612+0000 7f3199536800 20 remove_watcher() i=6 2024-09-14T11:34:06.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.613+0000 7f3199536800 20 remove_watcher() i=7 2024-09-14T11:34:06.620 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:06.621 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:06.621 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:06.621 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:06.622 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:34:06.656 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:06.656 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:06.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.696+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 20 realm 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.697+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.698+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.698+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.698+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.698+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.699+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:06.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.699+0000 7f6d98b28800 20 searching for the correct realm 2024-09-14T11:34:06.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.702+0000 7f6d95070640 0 -- 172.21.15.94:0/4180404701 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f6d7c039970 msgr2=0x7f6d7c02d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:06.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.705+0000 7f6d9486f640 0 -- 172.21.15.94:0/4180404701 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f6d7c021450 msgr2=0x7f6d7c0218d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.911+0000 7f6d98b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 zone default found 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 4 Realm: () 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 zonegroup default 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.912+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 started sync module instance, tier type = 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.913+0000 7f6d98b28800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=0 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=1 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=2 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=3 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=4 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=5 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.922+0000 7f6d98b28800 20 add_watcher() i=6 2024-09-14T11:34:06.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.923+0000 7f6d98b28800 20 add_watcher() i=7 2024-09-14T11:34:06.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.923+0000 7f6d98b28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.924+0000 7f6c4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.924+0000 7f6d98b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.924+0000 7f6d98b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6d98b28800 5 note: GC not initialized 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6c49fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6d98b28800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6d98b28800 20 Filter name: none 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6bbb7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6d98b28800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.925+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : miss 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.926+0000 7f6d98b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.930+0000 7f6d98b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.930+0000 7f6d98b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.930+0000 7f6d98b28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.930+0000 7f6d98b28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94345987178528 notifier 6632 bl.length()=999 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6c6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6c6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.931+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.0 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.0 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.1 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.1 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.2 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.2 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.3 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.3 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.4 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.4 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.5 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.5 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.6 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.6 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.7 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.7 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.8 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.8 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.9 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.9 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.10 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.10 2024-09-14T11:34:06.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.11 2024-09-14T11:34:06.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.11 2024-09-14T11:34:06.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.0 2024-09-14T11:34:06.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.936+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1 2024-09-14T11:34:06.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.937+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.2 2024-09-14T11:34:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.937+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.3 2024-09-14T11:34:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.938+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.4 2024-09-14T11:34:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.938+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.5 2024-09-14T11:34:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.939+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.6 2024-09-14T11:34:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.939+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.7 2024-09-14T11:34:06.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.940+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.8 2024-09-14T11:34:06.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.941+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.9 2024-09-14T11:34:06.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.941+0000 7f6d98b28800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.10 2024-09-14T11:34:06.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.945+0000 7f6d98b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:06.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.945+0000 7f6d98b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:06.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94345987178528 notifier 6632 bl.length()=999 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6c6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6c6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:34:06.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:06.946+0000 7f6d98b28800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:34:07.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.008+0000 7f6d98b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:07.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.008+0000 7f6d98b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:07.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6d98b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6d98b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6d98b28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6d98b28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94345987178528 notifier 6632 bl.length()=967 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6c6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.009+0000 7f6c6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.010+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.010+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.010+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.010+0000 7f6d98b28800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:07.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.012+0000 7f6d98b28800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:34:07.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.014+0000 7f6c4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.016+0000 7f6d98b28800 20 remove_watcher() i=0 2024-09-14T11:34:07.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.016+0000 7f6d98b28800 2 removed watcher, disabling cache 2024-09-14T11:34:07.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.017+0000 7f6d98b28800 20 remove_watcher() i=1 2024-09-14T11:34:07.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.018+0000 7f6d98b28800 20 remove_watcher() i=2 2024-09-14T11:34:07.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.019+0000 7f6d98b28800 20 remove_watcher() i=3 2024-09-14T11:34:07.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.021+0000 7f6d98b28800 20 remove_watcher() i=4 2024-09-14T11:34:07.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.022+0000 7f6d98b28800 20 remove_watcher() i=5 2024-09-14T11:34:07.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.023+0000 7f6d98b28800 20 remove_watcher() i=6 2024-09-14T11:34:07.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.023+0000 7f6d98b28800 20 remove_watcher() i=7 2024-09-14T11:34:07.033 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:34:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.100+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.101+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.101+0000 7f47d7abb800 20 realm 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.101+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.102+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.102+0000 7f47d7abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.102+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.102+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.102+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.103+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.103+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.103+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.103+0000 7f47d7abb800 20 searching for the correct realm 2024-09-14T11:34:07.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.106+0000 7f47d5da6640 0 -- 172.21.15.94:0/479655890 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f47cc07a070 msgr2=0x7f47cc07a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.109+0000 7f47d55a5640 0 -- 172.21.15.94:0/479655890 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f47cc0a48f0 msgr2=0x7f47cc0a3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 zone default found 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 4 Realm: () 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 zonegroup default 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.114+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.115+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.115+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.115+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.115+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.116+0000 7f47d7abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.116+0000 7f47d7abb800 20 started sync module instance, tier type = 2024-09-14T11:34:07.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.116+0000 7f47d7abb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=0 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=1 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=2 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=3 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=4 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=5 2024-09-14T11:34:07.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.124+0000 7f47d7abb800 20 add_watcher() i=6 2024-09-14T11:34:07.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.125+0000 7f47d7abb800 20 add_watcher() i=7 2024-09-14T11:34:07.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.125+0000 7f47d7abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.126+0000 7f468b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.126+0000 7f47d7abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.126+0000 7f47d7abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.126+0000 7f47d7abb800 5 note: GC not initialized 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f468a7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f47d7abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f47d7abb800 20 Filter name: none 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f45fbfff640 20 reqs_thread_entry: start 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:07.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.127+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:07.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.128+0000 7f47d7abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.131+0000 7f468b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.133+0000 7f47d7abb800 20 remove_watcher() i=0 2024-09-14T11:34:07.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.133+0000 7f47d7abb800 2 removed watcher, disabling cache 2024-09-14T11:34:07.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.133+0000 7f47d7abb800 20 remove_watcher() i=1 2024-09-14T11:34:07.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.134+0000 7f47d7abb800 20 remove_watcher() i=2 2024-09-14T11:34:07.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.135+0000 7f47d7abb800 20 remove_watcher() i=3 2024-09-14T11:34:07.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.136+0000 7f47d7abb800 20 remove_watcher() i=4 2024-09-14T11:34:07.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.137+0000 7f47d7abb800 20 remove_watcher() i=5 2024-09-14T11:34:07.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.138+0000 7f47d7abb800 20 remove_watcher() i=6 2024-09-14T11:34:07.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.139+0000 7f47d7abb800 20 remove_watcher() i=7 2024-09-14T11:34:07.147 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:07.147 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:07.147 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:07.147 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:07.149 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.149 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.156 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.156 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.269+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 realm 2024-09-14T11:34:07.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.270+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.271+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.271+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.271+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.271+0000 7f9eb25af800 20 searching for the correct realm 2024-09-14T11:34:07.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.275+0000 7f9ea7fff640 0 -- 172.21.15.94:0/2381047452 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55849c89bd10 msgr2=0x55849c89e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.278+0000 7f9eb00a0640 0 -- 172.21.15.94:0/2381047452 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f9e980b3120 msgr2=0x7f9e98059920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.485+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 zone default found 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 4 Realm: () 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 zonegroup default 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.486+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.487+0000 7f9eb25af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.487+0000 7f9eb25af800 20 started sync module instance, tier type = 2024-09-14T11:34:07.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.487+0000 7f9eb25af800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:07.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=0 2024-09-14T11:34:07.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=1 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=2 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=3 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=4 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=5 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.495+0000 7f9eb25af800 20 add_watcher() i=6 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.496+0000 7f9eb25af800 20 add_watcher() i=7 2024-09-14T11:34:07.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.496+0000 7f9eb25af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.497+0000 7f9d66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 5 note: GC not initialized 2024-09-14T11:34:07.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9d65fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:07.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 20 Filter name: none 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9cd77fe640 20 reqs_thread_entry: start 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.498+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : miss 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.499+0000 7f9eb25af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.503+0000 7f9eb25af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.503+0000 7f9eb25af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.503+0000 7f9eb25af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.503+0000 7f9eb25af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9d86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94028050336816 notifier 6665 bl.length()=999 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9d86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9d86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9d86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:07.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:07.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:07.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.504+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.0 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.0 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.1 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.1 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.2 2024-09-14T11:34:07.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.2 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.3 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.3 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.4 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.4 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.5 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.5 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.6 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.6 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.7 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.7 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.8 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.8 2024-09-14T11:34:07.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.9 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.9 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.10 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.10 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.11 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1.11 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.0 2024-09-14T11:34:07.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.509+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.510+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.2 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.510+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.3 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.511+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.4 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.511+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.5 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.512+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.6 2024-09-14T11:34:07.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.512+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.7 2024-09-14T11:34:07.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.513+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.8 2024-09-14T11:34:07.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.513+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.9 2024-09-14T11:34:07.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.514+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.10 2024-09-14T11:34:07.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.516+0000 7f9eb25af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:07.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.516+0000 7f9eb25af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9d86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94028050336816 notifier 6665 bl.length()=999 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9d86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9d86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9d86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:07.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:07.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:07.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.518+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:07.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.521+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.0 2024-09-14T11:34:07.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.521+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.1 2024-09-14T11:34:07.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.521+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.2 2024-09-14T11:34:07.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.522+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.3 2024-09-14T11:34:07.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.522+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.4 2024-09-14T11:34:07.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.522+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.5 2024-09-14T11:34:07.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.523+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.6 2024-09-14T11:34:07.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.523+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.7 2024-09-14T11:34:07.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.523+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.8 2024-09-14T11:34:07.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.523+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.9 2024-09-14T11:34:07.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.524+0000 7f9eb25af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29.10 2024-09-14T11:34:07.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.524+0000 7f9eb25af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:07.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.524+0000 7f9eb25af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 2024-09-14T11:34:07.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.525+0000 7f9eb25af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.525+0000 7f9eb25af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.525+0000 7f9eb25af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.525+0000 7f9eb25af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29, ofs0, ns] 2024-09-14T11:34:07.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9d86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94028050336816 notifier 6665 bl.length()=967 2024-09-14T11:34:07.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9d86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 info.flags=0x17 2024-09-14T11:34:07.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9d86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 to cache LRU end 2024-09-14T11:34:07.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9d86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:07.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_sources= new_sources= 2024-09-14T11:34:07.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential sources added=[] removed=[] 2024-09-14T11:34:07.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): orig_dests= new_dests= 2024-09-14T11:34:07.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.526+0000 7f9eb25af800 20 handle_bi_update(): bucket=:error-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29]): potential dests added=[] removed=[] 2024-09-14T11:34:07.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.528+0000 7f9eb25af800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:07.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.530+0000 7f9d66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.532+0000 7f9eb25af800 20 remove_watcher() i=0 2024-09-14T11:34:07.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.532+0000 7f9eb25af800 2 removed watcher, disabling cache 2024-09-14T11:34:07.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.533+0000 7f9eb25af800 20 remove_watcher() i=1 2024-09-14T11:34:07.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.534+0000 7f9eb25af800 20 remove_watcher() i=2 2024-09-14T11:34:07.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.535+0000 7f9eb25af800 20 remove_watcher() i=3 2024-09-14T11:34:07.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.536+0000 7f9eb25af800 20 remove_watcher() i=4 2024-09-14T11:34:07.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.537+0000 7f9eb25af800 20 remove_watcher() i=5 2024-09-14T11:34:07.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.538+0000 7f9eb25af800 20 remove_watcher() i=6 2024-09-14T11:34:07.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.539+0000 7f9eb25af800 20 remove_watcher() i=7 2024-09-14T11:34:07.549 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:34:07.577 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.577 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.617+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.618+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.618+0000 7f455c726800 20 realm 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.618+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.619+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.620+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.620+0000 7f455c726800 20 searching for the correct realm 2024-09-14T11:34:07.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.621+0000 7f455844b640 0 -- 172.21.15.94:0/1211538840 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f4550025040 msgr2=0x7f455000a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:07.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.826+0000 7f4558c4c640 0 -- 172.21.15.94:0/1211538840 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f454c029040 msgr2=0x7f454c069a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.831+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 zone default found 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 4 Realm: () 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:07.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 zonegroup default 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.832+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.833+0000 7f455c726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.833+0000 7f455c726800 20 started sync module instance, tier type = 2024-09-14T11:34:07.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.833+0000 7f455c726800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:07.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=0 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=1 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=2 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=3 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=4 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=5 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.841+0000 7f455c726800 20 add_watcher() i=6 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.842+0000 7f455c726800 20 add_watcher() i=7 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.842+0000 7f455c726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f440efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f455c726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f455c726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f455c726800 5 note: GC not initialized 2024-09-14T11:34:07.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f440dfdb640 20 reqs_thread_entry: start 2024-09-14T11:34:07.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.844+0000 7f455c726800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.845+0000 7f455c726800 20 Filter name: none 2024-09-14T11:34:07.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.845+0000 7f437f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:07.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.845+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.845+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:07.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.845+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:07.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:07.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:07.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.846+0000 7f455c726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.848+0000 7f440efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.850+0000 7f455c726800 20 remove_watcher() i=0 2024-09-14T11:34:07.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.850+0000 7f455c726800 2 removed watcher, disabling cache 2024-09-14T11:34:07.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.851+0000 7f455c726800 20 remove_watcher() i=1 2024-09-14T11:34:07.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.852+0000 7f455c726800 20 remove_watcher() i=2 2024-09-14T11:34:07.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.853+0000 7f455c726800 20 remove_watcher() i=3 2024-09-14T11:34:07.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.854+0000 7f455c726800 20 remove_watcher() i=4 2024-09-14T11:34:07.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.855+0000 7f455c726800 20 remove_watcher() i=5 2024-09-14T11:34:07.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.856+0000 7f455c726800 20 remove_watcher() i=6 2024-09-14T11:34:07.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:07.857+0000 7f455c726800 20 remove_watcher() i=7 2024-09-14T11:34:07.864 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:07.865 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:07.865 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:07.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:07.867 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.867 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.870 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.870 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.913 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.913 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.939 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:34:07.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.941 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.953 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:07.995 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.995 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.003 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.003 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.010 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.010 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.020 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.020 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.028 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.028 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.036 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.036 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.044 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.052 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.060 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.067 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.067 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.075 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.075 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.082 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.082 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.090 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.090 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.105 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.105 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.121 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.121 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.138 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.138 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.145 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.145 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.220+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 20 realm 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.221+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.222+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.222+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.222+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.222+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.223+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.223+0000 7f7232337800 20 searching for the correct realm 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.224+0000 7f722e07d640 0 -- 172.21.15.94:0/2368119645 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f722801f040 msgr2=0x7f72280651d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.429+0000 7f722e87e640 0 -- 172.21.15.94:0/2368119645 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f722406e070 msgr2=0x7f7224063aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.434+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 zone default found 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 4 Realm: () 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 zonegroup default 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.435+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.436+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.436+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.436+0000 7f7232337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.436+0000 7f7232337800 20 started sync module instance, tier type = 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.436+0000 7f7232337800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=0 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=1 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=2 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=3 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=4 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=5 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.445+0000 7f7232337800 20 add_watcher() i=6 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.446+0000 7f7232337800 20 add_watcher() i=7 2024-09-14T11:34:08.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.446+0000 7f7232337800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.447+0000 7f70e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 5 note: GC not initialized 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f705f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 Filter name: none 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f705d7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.448+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.449+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.449+0000 7f7232337800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.449+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.449+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.449+0000 7f7232337800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.450+0000 7f7232337800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.450+0000 7f7232337800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.451+0000 7f70e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.453+0000 7f7232337800 20 remove_watcher() i=0 2024-09-14T11:34:08.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.453+0000 7f7232337800 2 removed watcher, disabling cache 2024-09-14T11:34:08.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.454+0000 7f7232337800 20 remove_watcher() i=1 2024-09-14T11:34:08.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.455+0000 7f7232337800 20 remove_watcher() i=2 2024-09-14T11:34:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.456+0000 7f7232337800 20 remove_watcher() i=3 2024-09-14T11:34:08.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.457+0000 7f7232337800 20 remove_watcher() i=4 2024-09-14T11:34:08.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.458+0000 7f7232337800 20 remove_watcher() i=5 2024-09-14T11:34:08.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.458+0000 7f7232337800 20 remove_watcher() i=6 2024-09-14T11:34:08.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.459+0000 7f7232337800 20 remove_watcher() i=7 2024-09-14T11:34:08.468 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.468 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:08.468 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:08.468 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.469 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:34:08.503 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.503 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.543+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 realm 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.545+0000 7ff83001b800 20 searching for the correct realm 2024-09-14T11:34:08.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.549+0000 7ff82bfec640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x56116d962140 msgr2=0x56116d9645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.552+0000 7ff822fea640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff81c045020 msgr2=0x7ff81c077320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 zone default found 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 4 Realm: () 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 zonegroup default 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 started sync module instance, tier type = 2024-09-14T11:34:08.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.556+0000 7ff83001b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:08.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=0 2024-09-14T11:34:08.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=1 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=2 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=3 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=4 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=5 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=6 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.566+0000 7ff83001b800 20 add_watcher() i=7 2024-09-14T11:34:08.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.566+0000 7ff83001b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.568+0000 7ff6e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.568+0000 7ff83001b800 5 note: GC not initialized 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff6e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 20 Filter name: none 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff65a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:08.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : miss 2024-09-14T11:34:08.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.570+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.575+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.575+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.575+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.575+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.0 2024-09-14T11:34:08.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.3 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.4 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.5 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.6 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.7 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.8 2024-09-14T11:34:08.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.9 2024-09-14T11:34:08.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.585+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.10 2024-09-14T11:34:08.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.588+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:08.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.588+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff83001b800 time 2024-09-14T11:34:08.591125+0000 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff83118c76a] 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.589 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.591+0000 7ff83001b800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff83001b800 time 2024-09-14T11:34:08.591125+0000 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff83118c76a] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.590 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:08.591 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff83001b800 thread_name:radosgw-admin 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff82fe3e6f0] 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff82fe8b99c] 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff83118c7c4] 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.608 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.591+0000 7ff83001b800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff83001b800 thread_name:radosgw-admin 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff82fe3e6f0] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff82fe8b99c] 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:08.609 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff83118c7c4] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d725c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d726020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d7be670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.610 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.018482s 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d7be670 auth_method 0 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d725c40 auth_method 0 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.611 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d726020 auth_method 0 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:34:08.527+0000 7ff82bfec640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: dump: 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.612 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: dump: 2024-09-14T11:34:08.613 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:34:08.528+0000 7ff83001b800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:34:08.528+0000 7ff71960a640 4 set_mon_vals no callback set 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.614 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:34:08.528+0000 7ff83001b800 1 librados: init done 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:34:08.529+0000 7ff717e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:34:08.529+0000 7ff717e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:34:08.530+0000 7ff717e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:34:08.530+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff710077230 auth_method 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:34:08.530+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d8a1790 auth_method 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:34:08.531+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x56116d8c4240 auth_method 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:34:08.532+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d8c92d0 auth_method 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:34:08.533+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.615 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.616 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:34:08.533+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 asok(0x56116d659270) register_command objecter_requests cmddesc objecter_requests hook 0x56116d8d0bd0 EEXIST 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.617 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:34:08.534+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:34:08.534+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x56116d8cc330 EEXIST 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d8f48c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d8f6b90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d8f3090 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.618 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.025508s 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d8f6b90 auth_method 0 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d8f48c0 auth_method 0 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.619 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d8f3090 auth_method 0 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_done global_id 7038 payload 824 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:34:08.534+0000 7ff822fea640 1 monclient: found mon.noname-a 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: dump: 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.620 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: dump: 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.621 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:34:08.535+0000 7ff83001b800 5 monclient: authenticate success, global_id 7038 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:34:08.535+0000 7ff82c7ed640 4 set_mon_vals no callback set 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.622 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:34:08.537+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff704079350 auth_method 0 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: get_monmap_and_config 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:34:08.537+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.623 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.624 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:34:08.537+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.625 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:34:08.538+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:34:08.538+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:34:08.538+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x7fffadf38188 EEXIST 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d947ad0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d942070 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d917910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.626 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.029439s 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d917910 auth_method 0 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d942070 auth_method 0 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d947ad0 auth_method 0 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.627 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_done global_id 6710 payload 274 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:34:08.538+0000 7ff82bfec640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: dump: 2024-09-14T11:34:08.628 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: dump: 2024-09-14T11:34:08.629 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 monclient: authenticate success, global_id 6710 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:34:08.539+0000 7ff83001b800 4 set_mon_vals no callback set 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: shutdown 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.630 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.631 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:34:08.539+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 librados: starting msgr at 2024-09-14T11:34:08.632 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 librados: starting objecter 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 asok(0x56116d659270) register_command objecter_requests cmddesc objecter_requests hook 0x56116d915e80 EEXIST 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:34:08.540+0000 7ff83001b800 1 librados: setting wanted keys 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:34:08.540+0000 7ff83001b800 1 librados: calling monclient init 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.633 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:34:08.540+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:34:08.540+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x56116d90c7b8 EEXIST 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d917910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d942070 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d947ad0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.634 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.031652s 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d917910 auth_method 0 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d942070 auth_method 0 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.635 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d947ad0 auth_method 0 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_done global_id 6713 payload 824 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: dump: 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.636 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: dump: 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.637 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:34:08.541+0000 7ff83001b800 5 monclient: authenticate success, global_id 6713 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:34:08.541+0000 7ff70effd640 4 set_mon_vals no callback set 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.638 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:34:08.541+0000 7ff83001b800 1 librados: init done 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:34:08.541+0000 7ff83001b800 5 asok(0x56116d659270) register_command cr dump hook 0x56116d946b58 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:34:08.543+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:34:08.543+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff6f4077230 auth_method 0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:34:08.544+0000 7ff82bfec640 10 monclient: get_auth_request con 0x56116d962140 auth_method 0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 realm 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:34:08.544+0000 7ff83001b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.639 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:34:08.545+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x56116d966320 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 searching for the correct realm 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:34:08.546+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d96b5a0 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:34:08.546+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff814083060 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:34:08.547+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff82402d060 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:34:08.547+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff81c045020 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:34:08.549+0000 7ff82bfec640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x56116d962140 msgr2=0x56116d9645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x56116d962140 session 0x56116d961a70 osd.1 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 10 monclient: _renew_subs 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:34:08.549+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff6f40878e0 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:34:08.549+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff8140abdb0 auth_method 0 2024-09-14T11:34:08.640 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:34:08.551+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff8140b4fa0 auth_method 0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:34:08.552+0000 7ff822fea640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff81c045020 msgr2=0x7ff81c077320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:34:08.552+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x7ff81c045020 session 0x7ff81c036040 osd.4 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:34:08.552+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d962140 auth_method 0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.641 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 zone default found 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 Realm: () 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:34:08.556+0000 7ff83001b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 zonegroup default 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 started sync module instance, tier type = 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:08.642 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=0 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=1 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=2 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=3 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=4 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=5 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=6 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:34:08.566+0000 7ff83001b800 20 add_watcher() i=7 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:34:08.566+0000 7ff83001b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.643 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:34:08.568+0000 7ff6e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:34:08.568+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache list hook 0x56116d946930 2024-09-14T11:34:08.644 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache inspect hook 0x56116d946930 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache erase hook 0x56116d946930 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache zap hook 0x56116d946930 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 note: GC not initialized 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:34:08.569+0000 7ff6e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace show hook 0x7ff8140042f0 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace history hook 0x7ff8140042f0 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace active hook 0x7ff8140042f0 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace active_short hook 0x7ff8140042f0 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 Filter name: none 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:34:08.569+0000 7ff65a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:34:08.645 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : miss 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:34:08.570+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:34:08.575+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x56116d96b5a0 session 0x56116d96af20 osd.3 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:34:08.575+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff81c045020 auth_method 0 2024-09-14T11:34:08.646 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.647 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.648 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.0 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.3 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.4 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.5 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.6 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.7 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.8 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.9 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:34:08.585+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.10 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:34:08.588+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:34:08.588+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.649 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:34:08.591+0000 7ff83001b800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff83001b800 time 2024-09-14T11:34:08.591125+0000 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff83118c76a] 2024-09-14T11:34:08.650 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:34:08.591+0000 7ff83001b800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff83001b800 thread_name:radosgw-admin 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff82fe3e6f0] 2024-09-14T11:34:08.651 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff82fe8b99c] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff83118c7c4] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.652 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:34:08.653 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:34:08.654 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:08.655 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:34:08.656 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:08.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:34:08.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff65a7fc640 / http_manager 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff6e0fe1640 / http_manager 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff6e1fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70d7fa640 / ms_dispatch 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70e7fc640 / io_context_pool 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70effd640 / io_context_pool 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff715602640 / ms_dispatch 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff717e07640 / ms_dispatch 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff71960a640 / io_context_pool 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff822fea640 / msgr-worker-2 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82b7eb640 / msgr-worker-1 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82bfec640 / msgr-worker-0 2024-09-14T11:34:08.659 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82c7ed640 / io_context_pool 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff83001b800 / radosgw-admin 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.114157.log 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d725c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d726020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d7be670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:34:08.527+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.018482s 2024-09-14T11:34:08.660 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d7be670 auth_method 0 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d725c40 auth_method 0 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:34:08.527+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d726020 auth_method 0 2024-09-14T11:34:08.661 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:34:08.527+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:34:08.527+0000 7ff82bfec640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:34:08.527+0000 7ff82bfec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: dump: 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:34:08.528+0000 7ff717e07640 10 monclient: dump: 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:34:08.528+0000 7ff83001b800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:34:08.528+0000 7ff71960a640 4 set_mon_vals no callback set 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:34:08.528+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:34:08.528+0000 7ff83001b800 1 librados: init done 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:34:08.529+0000 7ff717e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:34:08.529+0000 7ff717e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:34:08.530+0000 7ff717e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.664 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:34:08.530+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff710077230 auth_method 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:34:08.530+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d8a1790 auth_method 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:34:08.531+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x56116d8c4240 auth_method 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:34:08.532+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d8c92d0 auth_method 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:34:08.533+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding auth protocol: cephx 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: crc 2024-09-14T11:34:08.666 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cd2f0) adding con mode: secure 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:34:08.533+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 asok(0x56116d659270) register_command objecter_requests cmddesc objecter_requests hook 0x56116d8d0bd0 EEXIST 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:34:08.533+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding auth protocol: cephx 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:34:08.533+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.667 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: crc 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 AuthRegistry(0x56116d8cc1e8) adding con mode: secure 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:34:08.534+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:34:08.534+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:34:08.534+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x56116d8cc330 EEXIST 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d8f48c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d8f6b90 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d8f3090 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.668 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:34:08.534+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.025508s 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d8f6b90 auth_method 0 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d8f48c0 auth_method 0 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.669 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:34:08.534+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d8f3090 auth_method 0 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:34:08.534+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient(hunting): handle_auth_done global_id 7038 payload 824 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:34:08.534+0000 7ff822fea640 1 monclient: found mon.noname-a 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:34:08.534+0000 7ff822fea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:08.670 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: dump: 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.671 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:34:08.535+0000 7ff715602640 10 monclient: dump: 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:34:08.535+0000 7ff83001b800 5 monclient: authenticate success, global_id 7038 2024-09-14T11:34:08.672 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:34:08.535+0000 7ff82c7ed640 4 set_mon_vals no callback set 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:34:08.535+0000 7ff83001b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:34:08.537+0000 7ff715602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:34:08.537+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff704079350 auth_method 0 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: get_monmap_and_config 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:34:08.537+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.673 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding auth protocol: cephx 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.674 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: crc 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x56116d9139f0) adding con mode: secure 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:34:08.537+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:34:08.537+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding auth protocol: cephx 2024-09-14T11:34:08.675 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: crc 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:34:08.537+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38040) adding con mode: secure 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:34:08.538+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:34:08.538+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.676 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:34:08.538+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x7fffadf38188 EEXIST 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d947ad0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d942070 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d917910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:34:08.538+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.029439s 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d917910 auth_method 0 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d942070 auth_method 0 2024-09-14T11:34:08.677 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d947ad0 auth_method 0 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:34:08.538+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.678 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:34:08.538+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient(hunting): handle_auth_done global_id 6710 payload 274 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:34:08.538+0000 7ff82bfec640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:34:08.538+0000 7ff82bfec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: dump: 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.679 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:34:08.539+0000 7ff70effd640 10 monclient: dump: 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 monclient: authenticate success, global_id 6710 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:34:08.539+0000 7ff83001b800 4 set_mon_vals no callback set 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: shutdown 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.681 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:34:08.539+0000 7ff83001b800 10 monclient: monmap: 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.682 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding auth protocol: cephx 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: crc 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:34:08.539+0000 7ff83001b800 5 AuthRegistry(0x56116d943030) adding con mode: secure 2024-09-14T11:34:08.683 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:34:08.539+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 librados: starting msgr at 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:34:08.539+0000 7ff83001b800 1 librados: starting objecter 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 asok(0x56116d659270) register_command objecter_requests cmddesc objecter_requests hook 0x56116d915e80 EEXIST 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:34:08.540+0000 7ff83001b800 1 librados: setting wanted keys 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:34:08.540+0000 7ff83001b800 1 librados: calling monclient init 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: init 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding auth protocol: cephx 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.684 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: crc 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 AuthRegistry(0x56116d90c670) adding con mode: secure 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:34:08.540+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:34:08.540+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:34:08.540+0000 7ff83001b800 5 asok(0x56116d659270) register_command rotate-key cmddesc rotate-key hook 0x56116d90c7b8 EEXIST 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-c con 0x56116d917910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-a con 0x56116d942070 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:08.685 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): picked mon.noname-b con 0x56116d947ad0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:34:08.540+0000 7ff83001b800 10 monclient(hunting): authenticate will time out at 1962.031652s 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request con 0x56116d917910 auth_method 0 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): get_auth_request con 0x56116d942070 auth_method 0 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.686 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:34:08.540+0000 7ff822fea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): get_auth_request con 0x56116d947ad0 auth_method 0 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:34:08.540+0000 7ff82bfec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient(hunting): handle_auth_done global_id 6713 payload 824 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:34:08.540+0000 7ff82b7eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.687 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: dump: 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.688 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:34:08.541+0000 7ff70d7fa640 10 monclient: dump: 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:34:08.541+0000 7ff83001b800 5 monclient: authenticate success, global_id 6713 2024-09-14T11:34:08.689 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:34:08.541+0000 7ff70effd640 4 set_mon_vals no callback set 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _renew_subs 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:34:08.541+0000 7ff83001b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:34:08.541+0000 7ff83001b800 1 librados: init done 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:34:08.541+0000 7ff83001b800 5 asok(0x56116d659270) register_command cr dump hook 0x56116d946b58 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:34:08.543+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:34:08.543+0000 7ff70d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:34:08.543+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff6f4077230 auth_method 0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:34:08.544+0000 7ff82bfec640 10 monclient: get_auth_request con 0x56116d962140 auth_method 0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.690 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 realm 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:34:08.544+0000 7ff83001b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:34:08.544+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:34:08.545+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x56116d966320 auth_method 0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:34:08.545+0000 7ff83001b800 20 searching for the correct realm 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:34:08.546+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d96b5a0 auth_method 0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:34:08.546+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff814083060 auth_method 0 2024-09-14T11:34:08.691 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:34:08.547+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff82402d060 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:34:08.547+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff81c045020 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:34:08.549+0000 7ff82bfec640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x56116d962140 msgr2=0x56116d9645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x56116d962140 session 0x56116d961a70 osd.1 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 10 monclient: _renew_subs 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:34:08.549+0000 7ff70d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:34:08.549+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff6f40878e0 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:34:08.549+0000 7ff82bfec640 10 monclient: get_auth_request con 0x7ff8140abdb0 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:34:08.551+0000 7ff82b7eb640 10 monclient: get_auth_request con 0x7ff8140b4fa0 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:34:08.552+0000 7ff822fea640 0 -- 172.21.15.94:0/2264799924 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff81c045020 msgr2=0x7ff81c077320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:34:08.552+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x7ff81c045020 session 0x7ff81c036040 osd.4 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:34:08.552+0000 7ff822fea640 10 monclient: get_auth_request con 0x56116d962140 auth_method 0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.692 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:34:08.555+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 zone default found 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 Realm: () 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:34:08.556+0000 7ff83001b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:34:08.556+0000 7ff83001b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.693 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 zonegroup default 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 started sync module instance, tier type = 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:34:08.556+0000 7ff83001b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=0 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=1 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=2 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=3 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=4 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=5 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:34:08.565+0000 7ff83001b800 20 add_watcher() i=6 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:34:08.566+0000 7ff83001b800 20 add_watcher() i=7 2024-09-14T11:34:08.694 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:34:08.566+0000 7ff83001b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding auth protocol: cephx 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: crc 2024-09-14T11:34:08.695 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 AuthRegistry(0x7fffadf38520) adding con mode: secure 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:34:08.568+0000 7ff6e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:34:08.568+0000 7ff83001b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:34:08.568+0000 7ff83001b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache list hook 0x56116d946930 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache inspect hook 0x56116d946930 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache erase hook 0x56116d946930 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 asok(0x56116d659270) register_command cache zap hook 0x56116d946930 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:34:08.568+0000 7ff83001b800 5 note: GC not initialized 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:34:08.569+0000 7ff6e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace show hook 0x7ff8140042f0 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace history hook 0x7ff8140042f0 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace active hook 0x7ff8140042f0 2024-09-14T11:34:08.696 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:34:08.569+0000 7ff83001b800 5 asok(0x56116d659270) register_command sync trace active_short hook 0x7ff8140042f0 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 Filter name: none 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:34:08.569+0000 7ff65a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:34:08.569+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : miss 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:34:08.569+0000 7ff83001b800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:34:08.570+0000 7ff83001b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.697 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:34:08.570+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:34:08.575+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:34:08.575+0000 7ff70d7fa640 1 client.6713.objecter ms_handle_reset 0x56116d96b5a0 session 0x56116d96af20 osd.3 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:34:08.575+0000 7ff822fea640 10 monclient: get_auth_request con 0x7ff81c045020 auth_method 0 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:34:08.576+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:34:08.576+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.698 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.0 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.1 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.2 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.3 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.4 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.5 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.6 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.7 2024-09-14T11:34:08.699 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.8 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.9 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.10 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:34:08.580+0000 7ff83001b800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1.11 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:34:08.580+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.0 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:34:08.581+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.3 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:34:08.582+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.4 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.5 2024-09-14T11:34:08.700 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.6 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:34:08.583+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.7 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.8 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:34:08.584+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.9 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:34:08.585+0000 7ff83001b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.10 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:34:08.588+0000 7ff83001b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:34:08.588+0000 7ff83001b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:34:08.589+0000 7ff83001b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94632853055312 notifier 6713 bl.length()=999 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:08.701 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:34:08.589+0000 7ff70e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:34:08.590+0000 7ff83001b800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:34:08.591+0000 7ff83001b800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff83001b800 time 2024-09-14T11:34:08.591125+0000 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff83118c76a] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.702 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:34:08.591+0000 7ff83001b800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff83001b800 thread_name:radosgw-admin 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff82fe3e6f0] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff82fe8b99c] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff83118c7c4] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff83118c928] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56116c3740b1] 2024-09-14T11:34:08.703 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56116c38318e] 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56116c383fc4] 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff82fe29590] 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:34:08.704 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:08.705 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:34:08.706 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:34:08.707 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:08.708 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:08.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff65a7fc640 / http_manager 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff6e0fe1640 / http_manager 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff6e1fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70d7fa640 / ms_dispatch 2024-09-14T11:34:08.710 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70e7fc640 / io_context_pool 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff70effd640 / io_context_pool 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff715602640 / ms_dispatch 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff717e07640 / ms_dispatch 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff71960a640 / io_context_pool 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff822fea640 / msgr-worker-2 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82b7eb640 / msgr-worker-1 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82bfec640 / msgr-worker-0 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff82c7ed640 / io_context_pool 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff83001b800 / radosgw-admin 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:08.592758Z_67868a2d-02b1-46f0-9720-f107ed0ada1f/log 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:34:08.711 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.666+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.667+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 realm 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.668+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.669+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.669+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.669+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.669+0000 7fdbbf926800 20 searching for the correct realm 2024-09-14T11:34:08.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.671+0000 7fdbbb5d9640 0 -- 172.21.15.94:0/4221184847 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fdbac02f060 msgr2=0x7fdbac0670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:08.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.877+0000 7fdbbbdda640 0 -- 172.21.15.94:0/4221184847 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fdba407d070 msgr2=0x7fdba4060410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.882+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 zone default found 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 4 Realm: () 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 zonegroup default 2024-09-14T11:34:08.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.883+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.884+0000 7fdbbf926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.884+0000 7fdbbf926800 20 started sync module instance, tier type = 2024-09-14T11:34:08.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.884+0000 7fdbbf926800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=0 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=1 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=2 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=3 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=4 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=5 2024-09-14T11:34:08.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.892+0000 7fdbbf926800 20 add_watcher() i=6 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.893+0000 7fdbbf926800 20 add_watcher() i=7 2024-09-14T11:34:08.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.893+0000 7fdbbf926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fda71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fdbbf926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fdbbf926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fdbbf926800 5 note: GC not initialized 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fda70fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.895+0000 7fdbbf926800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 Filter name: none 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fd9ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:08.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.896+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.897+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.897+0000 7fdbbf926800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.897+0000 7fdbbf926800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:34:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.897+0000 7fdbbf926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.898+0000 7fda71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.900+0000 7fdbbf926800 20 remove_watcher() i=0 2024-09-14T11:34:08.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.900+0000 7fdbbf926800 2 removed watcher, disabling cache 2024-09-14T11:34:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.901+0000 7fdbbf926800 20 remove_watcher() i=1 2024-09-14T11:34:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.902+0000 7fdbbf926800 20 remove_watcher() i=2 2024-09-14T11:34:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.903+0000 7fdbbf926800 20 remove_watcher() i=3 2024-09-14T11:34:08.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.904+0000 7fdbbf926800 20 remove_watcher() i=4 2024-09-14T11:34:08.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.905+0000 7fdbbf926800 20 remove_watcher() i=5 2024-09-14T11:34:08.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.906+0000 7fdbbf926800 20 remove_watcher() i=6 2024-09-14T11:34:08.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:08.907+0000 7fdbbf926800 20 remove_watcher() i=7 2024-09-14T11:34:08.915 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.915 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:08.915 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:08.915 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:08.917 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.917 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.925 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.925 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:08.968 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:08.999 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.999 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:09.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.038+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.039+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.039+0000 7f74a1214800 20 realm 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.039+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.040+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.040+0000 7f74a1214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.040+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.040+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.040+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.041+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.041+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.041+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:09.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.041+0000 7f74a1214800 20 searching for the correct realm 2024-09-14T11:34:09.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.043+0000 7f749c0ca640 0 -- 172.21.15.94:0/982258280 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f7494082040 msgr2=0x7f74940ba530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:09.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.248+0000 7f749c8cb640 0 -- 172.21.15.94:0/982258280 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f7484042b60 msgr2=0x7f7484069f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:09.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.455+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 zone default found 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 4 Realm: () 2024-09-14T11:34:09.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 zonegroup default 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.456+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.457+0000 7f74a1214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:09.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.457+0000 7f74a1214800 20 started sync module instance, tier type = 2024-09-14T11:34:09.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.457+0000 7f74a1214800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:09.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=0 2024-09-14T11:34:09.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=1 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=2 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=3 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=4 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=5 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.465+0000 7f74a1214800 20 add_watcher() i=6 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.466+0000 7f74a1214800 20 add_watcher() i=7 2024-09-14T11:34:09.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.466+0000 7f74a1214800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:09.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.468+0000 7f7352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.468+0000 7f74a1214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:09.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.468+0000 7f74a1214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:09.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.468+0000 7f74a1214800 5 note: GC not initialized 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f7351fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 20 Filter name: none 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f72c37fe640 20 reqs_thread_entry: start 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:34:09.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : miss 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.469+0000 7f74a1214800 20 rados->read ofs=0 len=0 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.470+0000 7f74a1214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:09.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.471+0000 7f74a1214800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to be held by another RGW process; skipping for now 2024-09-14T11:34:09.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.472+0000 7f7352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:09.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.473+0000 7f74a1214800 20 remove_watcher() i=0 2024-09-14T11:34:09.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.473+0000 7f74a1214800 2 removed watcher, disabling cache 2024-09-14T11:34:09.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.474+0000 7f74a1214800 20 remove_watcher() i=1 2024-09-14T11:34:09.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.475+0000 7f74a1214800 20 remove_watcher() i=2 2024-09-14T11:34:09.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.476+0000 7f74a1214800 20 remove_watcher() i=3 2024-09-14T11:34:09.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.477+0000 7f74a1214800 20 remove_watcher() i=4 2024-09-14T11:34:09.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.478+0000 7f74a1214800 20 remove_watcher() i=5 2024-09-14T11:34:09.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.479+0000 7f74a1214800 20 remove_watcher() i=6 2024-09-14T11:34:09.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:09.480+0000 7f74a1214800 20 remove_watcher() i=7 2024-09-14T11:34:09.488 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:39.520 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:39.558 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.558 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.600+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 realm 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.602+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.603+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.603+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.604+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.604+0000 7f3293a0f800 20 searching for the correct realm 2024-09-14T11:34:39.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.607+0000 7f3290cf8640 0 -- 172.21.15.94:0/3021018735 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55f2f3d97e00 msgr2=0x55f2f3d9a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.611+0000 7f32914f9640 0 -- 172.21.15.94:0/3021018735 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f328806e980 msgr2=0x7f32880728f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:39.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.616+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 zone default found 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 4 Realm: () 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 zonegroup default 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.617+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.618+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.618+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.618+0000 7f3293a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.618+0000 7f3293a0f800 20 started sync module instance, tier type = 2024-09-14T11:34:39.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.618+0000 7f3293a0f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:39.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=0 2024-09-14T11:34:39.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=1 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=2 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=3 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=4 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=5 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.627+0000 7f3293a0f800 20 add_watcher() i=6 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.628+0000 7f3293a0f800 20 add_watcher() i=7 2024-09-14T11:34:39.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.628+0000 7f3293a0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.630+0000 7f31477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.630+0000 7f3293a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.630+0000 7f3293a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 5 note: GC not initialized 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f31467e4640 20 reqs_thread_entry: start 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 20 Filter name: none 2024-09-14T11:34:39.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f30b7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:39.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:34:39.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : miss 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.631+0000 7f3293a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.632+0000 7f3293a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:39.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.633+0000 7f3293a0f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:39.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3293a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3293a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3293a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3293a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3163fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94501961592144 notifier 7098 bl.length()=999 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3163fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3163fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.645+0000 7f3163fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.646+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.646+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.646+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:39.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.646+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:39.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.0 2024-09-14T11:34:39.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.0 2024-09-14T11:34:39.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.1 2024-09-14T11:34:39.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.1 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.2 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.2 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.3 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.3 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.4 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.4 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.5 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.5 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.6 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.6 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.7 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.7 2024-09-14T11:34:39.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.8 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.8 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.9 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.9 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.10 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.10 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.11 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2.11 2024-09-14T11:34:39.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.653+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.0 2024-09-14T11:34:39.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.654+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1 2024-09-14T11:34:39.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.654+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2 2024-09-14T11:34:39.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.654+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.3 2024-09-14T11:34:39.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.655+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.4 2024-09-14T11:34:39.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.656+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.5 2024-09-14T11:34:39.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.657+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.6 2024-09-14T11:34:39.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.657+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.7 2024-09-14T11:34:39.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.657+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.8 2024-09-14T11:34:39.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.658+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.9 2024-09-14T11:34:39.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.659+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.10 2024-09-14T11:34:39.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.662+0000 7f3293a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:39.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.662+0000 7f3293a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.663+0000 7f3293a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.663+0000 7f3293a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.663+0000 7f3293a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.663+0000 7f3293a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3163fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94501961592144 notifier 7098 bl.length()=999 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3163fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3163fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3163fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:39.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:39.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:39.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.664+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:39.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.668+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.0 2024-09-14T11:34:39.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.669+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.1 2024-09-14T11:34:39.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.669+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.2 2024-09-14T11:34:39.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.670+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.3 2024-09-14T11:34:39.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.670+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.4 2024-09-14T11:34:39.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.670+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.5 2024-09-14T11:34:39.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.671+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.6 2024-09-14T11:34:39.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.671+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.7 2024-09-14T11:34:39.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.671+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.8 2024-09-14T11:34:39.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.672+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.9 2024-09-14T11:34:39.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.672+0000 7f3293a0f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30.10 2024-09-14T11:34:39.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.672+0000 7f3293a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:39.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.672+0000 7f3293a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30, ofs0, ns] 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3174ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94501961592144 notifier 7098 bl.length()=967 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3174ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 info.flags=0x17 2024-09-14T11:34:39.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3174ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 to cache LRU end 2024-09-14T11:34:39.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3174ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:39.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_sources= new_sources= 2024-09-14T11:34:39.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential sources added=[] removed=[] 2024-09-14T11:34:39.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): orig_dests= new_dests= 2024-09-14T11:34:39.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.674+0000 7f3293a0f800 20 handle_bi_update(): bucket=:abort-at-block-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30]): potential dests added=[] removed=[] 2024-09-14T11:34:39.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.678+0000 7f3293a0f800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:39.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.680+0000 7f31477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.682+0000 7f3293a0f800 20 remove_watcher() i=0 2024-09-14T11:34:39.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.682+0000 7f3293a0f800 2 removed watcher, disabling cache 2024-09-14T11:34:39.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.684+0000 7f3293a0f800 20 remove_watcher() i=1 2024-09-14T11:34:39.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.685+0000 7f3293a0f800 20 remove_watcher() i=2 2024-09-14T11:34:39.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.686+0000 7f3293a0f800 20 remove_watcher() i=3 2024-09-14T11:34:39.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.687+0000 7f3293a0f800 20 remove_watcher() i=4 2024-09-14T11:34:39.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.688+0000 7f3293a0f800 20 remove_watcher() i=5 2024-09-14T11:34:39.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.689+0000 7f3293a0f800 20 remove_watcher() i=6 2024-09-14T11:34:39.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.690+0000 7f3293a0f800 20 remove_watcher() i=7 2024-09-14T11:34:39.701 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:34:39.729 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.729 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.770+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 realm 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.772+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.773+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.773+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.773+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.773+0000 7f789d33d800 20 searching for the correct realm 2024-09-14T11:34:39.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.777+0000 7f7898829640 0 -- 172.21.15.94:0/3821997041 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x556609b926b0 msgr2=0x556609b94aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.780+0000 7f789902a640 0 -- 172.21.15.94:0/3821997041 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f789006b8a0 msgr2=0x7f7890017740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:39.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:39.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 zone default found 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 4 Realm: () 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.784+0000 7f789d33d800 20 zonegroup default 2024-09-14T11:34:39.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 started sync module instance, tier type = 2024-09-14T11:34:39.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.785+0000 7f789d33d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=0 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=1 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=2 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=3 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=4 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=5 2024-09-14T11:34:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.794+0000 7f789d33d800 20 add_watcher() i=6 2024-09-14T11:34:39.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.795+0000 7f789d33d800 20 add_watcher() i=7 2024-09-14T11:34:39.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.795+0000 7f789d33d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.796+0000 7f774f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.796+0000 7f789d33d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.796+0000 7f789d33d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 5 note: GC not initialized 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f774e7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 20 Filter name: none 2024-09-14T11:34:39.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f76bffff640 20 reqs_thread_entry: start 2024-09-14T11:34:39.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.797+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:34:39.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.798+0000 7f789d33d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.800+0000 7f774f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.802+0000 7f789d33d800 20 remove_watcher() i=0 2024-09-14T11:34:39.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.802+0000 7f789d33d800 2 removed watcher, disabling cache 2024-09-14T11:34:39.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.803+0000 7f789d33d800 20 remove_watcher() i=1 2024-09-14T11:34:39.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.804+0000 7f789d33d800 20 remove_watcher() i=2 2024-09-14T11:34:39.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.805+0000 7f789d33d800 20 remove_watcher() i=3 2024-09-14T11:34:39.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.806+0000 7f789d33d800 20 remove_watcher() i=4 2024-09-14T11:34:39.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.807+0000 7f789d33d800 20 remove_watcher() i=5 2024-09-14T11:34:39.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.808+0000 7f789d33d800 20 remove_watcher() i=6 2024-09-14T11:34:39.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:39.809+0000 7f789d33d800 20 remove_watcher() i=7 2024-09-14T11:34:39.818 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:39.818 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:39.818 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:39.818 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:39.820 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.820 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.824 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.824 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.867 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.867 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.894 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:34:39.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:39.895 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.895 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.908 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.908 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.951 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.951 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.959 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.960 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.968 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.968 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.976 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.976 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.984 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.984 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:39.991 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.991 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.000 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.000 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.008 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.008 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.016 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.016 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.024 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.024 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.032 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.032 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.040 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.041 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.048 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.048 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.056 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.056 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.065 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.065 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.073 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.073 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.080 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.080 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.088 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.088 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.095 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.095 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.102 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.103 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:40.111 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:34:40.139 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.139 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.176+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 realm 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.178+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.179+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.179+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.179+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.179+0000 7f6af4725800 20 searching for the correct realm 2024-09-14T11:34:40.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.182+0000 7f6aefca1640 0 -- 172.21.15.94:0/371119613 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x560a793442f0 msgr2=0x560a793466e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.186+0000 7f6af04a2640 0 -- 172.21.15.94:0/371119613 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f6ae4072b80 msgr2=0x7f6ae4001870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.189+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 zone default found 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 4 Realm: () 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 zonegroup default 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.190+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.191+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.191+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.191+0000 7f6af4725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.191+0000 7f6af4725800 20 started sync module instance, tier type = 2024-09-14T11:34:40.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.191+0000 7f6af4725800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=0 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=1 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=2 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=3 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=4 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=5 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.199+0000 7f6af4725800 20 add_watcher() i=6 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.200+0000 7f6af4725800 20 add_watcher() i=7 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.200+0000 7f6af4725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.202+0000 7f69a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.202+0000 7f6af4725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.202+0000 7f6af4725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.202+0000 7f6af4725800 5 note: GC not initialized 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.202+0000 7f69a5fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f6af4725800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f6af4725800 20 Filter name: none 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f69177fe640 20 reqs_thread_entry: start 2024-09-14T11:34:40.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.203+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.204+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.204+0000 7f6af4725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.204+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.204+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.204+0000 7f6af4725800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.205+0000 7f6af4725800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.205+0000 7f6af4725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.206+0000 7f69a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.208+0000 7f6af4725800 20 remove_watcher() i=0 2024-09-14T11:34:40.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.208+0000 7f6af4725800 2 removed watcher, disabling cache 2024-09-14T11:34:40.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.209+0000 7f6af4725800 20 remove_watcher() i=1 2024-09-14T11:34:40.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.210+0000 7f6af4725800 20 remove_watcher() i=2 2024-09-14T11:34:40.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.211+0000 7f6af4725800 20 remove_watcher() i=3 2024-09-14T11:34:40.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.212+0000 7f6af4725800 20 remove_watcher() i=4 2024-09-14T11:34:40.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.213+0000 7f6af4725800 20 remove_watcher() i=5 2024-09-14T11:34:40.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.214+0000 7f6af4725800 20 remove_watcher() i=6 2024-09-14T11:34:40.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.215+0000 7f6af4725800 20 remove_watcher() i=7 2024-09-14T11:34:40.224 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:40.224 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:40.224 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:40.224 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:40.225 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:34:40.258 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.258 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.296+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 20 realm 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.297+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.298+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.298+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.298+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.298+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.299+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.299+0000 7f9d3f320800 20 searching for the correct realm 2024-09-14T11:34:40.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.301+0000 7f9d32867640 0 -- 172.21.15.94:0/2785482151 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f9d2c092070 msgr2=0x7f9d2c095960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.507+0000 7f9d3b068640 0 -- 172.21.15.94:0/2785482151 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f9d24071be0 msgr2=0x7f9d240820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.712+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 zone default found 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 4 Realm: () 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 zonegroup default 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.713+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.714+0000 7f9d3f320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.714+0000 7f9d3f320800 20 started sync module instance, tier type = 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.714+0000 7f9d3f320800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=0 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=1 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=2 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=3 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=4 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=5 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.723+0000 7f9d3f320800 20 add_watcher() i=6 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.724+0000 7f9d3f320800 20 add_watcher() i=7 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.724+0000 7f9d3f320800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9bf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9d3f320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9d3f320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9d3f320800 5 note: GC not initialized 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9bf0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9d3f320800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.726+0000 7f9d3f320800 20 Filter name: none 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.727+0000 7f9b6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.727+0000 7f9d3f320800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.727+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.727+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 : miss 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.728+0000 7f9d3f320800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31, ofs0, ns] 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9c1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94792936786432 notifier 6809 bl.length()=1015 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9c1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9c1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9c1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_sources= new_sources= 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential sources added=[] removed=[] 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_dests= new_dests= 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.733+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential dests added=[] removed=[] 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.0 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.0 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.1 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.1 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.2 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.2 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.3 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.3 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.4 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.4 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.5 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.5 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.6 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.6 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.7 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.7 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.8 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.8 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.9 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.9 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.10 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.10 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.11 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1.11 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.739+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.0 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.740+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.740+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.741+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.3 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.741+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.4 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.742+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.5 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.742+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.6 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.743+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.7 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.743+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.8 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.744+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.9 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.744+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.10 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.747+0000 7f9d3f320800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.747+0000 7f9d3f320800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.748+0000 7f9d3f320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.748+0000 7f9d3f320800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.748+0000 7f9d3f320800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.748+0000 7f9d3f320800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31, ofs0, ns] 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9c1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94792936786432 notifier 6809 bl.length()=1015 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9c1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9c1effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9c1effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_sources= new_sources= 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential sources added=[] removed=[] 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_dests= new_dests= 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.749+0000 7f9d3f320800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential dests added=[] removed=[] 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.752+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.0 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.752+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.752+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.753+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.3 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.753+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.4 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.753+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.5 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.754+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.6 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.754+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.7 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.754+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.8 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.755+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.9 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.755+0000 7f9d3f320800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.10 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.755+0000 7f9d3f320800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.755+0000 7f9d3f320800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.759+0000 7f9bf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.761+0000 7f9d3f320800 20 remove_watcher() i=0 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.761+0000 7f9d3f320800 2 removed watcher, disabling cache 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.763+0000 7f9d3f320800 20 remove_watcher() i=1 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.764+0000 7f9d3f320800 20 remove_watcher() i=2 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.765+0000 7f9d3f320800 20 remove_watcher() i=3 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.766+0000 7f9d3f320800 20 remove_watcher() i=4 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.767+0000 7f9d3f320800 20 remove_watcher() i=5 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.767+0000 7f9d3f320800 20 remove_watcher() i=6 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.768+0000 7f9d3f320800 20 remove_watcher() i=7 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:34:40.808 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.808 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.845+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 realm 2024-09-14T11:34:40.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.847+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.848+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.848+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.848+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.848+0000 7f44d0887800 20 searching for the correct realm 2024-09-14T11:34:40.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.851+0000 7f44c7fff640 0 -- 172.21.15.94:0/2278603854 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f44c0024070 msgr2=0x7f44c0065930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:40.854+0000 7f44ce371640 0 -- 172.21.15.94:0/2278603854 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f44b807c440 msgr2=0x7f44b807c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.059+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 zone default found 2024-09-14T11:34:41.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 4 Realm: () 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 zonegroup default 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.060+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.061+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.061+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.061+0000 7f44d0887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.061+0000 7f44d0887800 20 started sync module instance, tier type = 2024-09-14T11:34:41.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.061+0000 7f44d0887800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=0 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=1 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=2 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=3 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=4 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=5 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.069+0000 7f44d0887800 20 add_watcher() i=6 2024-09-14T11:34:41.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.070+0000 7f44d0887800 20 add_watcher() i=7 2024-09-14T11:34:41.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.070+0000 7f44d0887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f4384fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f44d0887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f44d0887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f44d0887800 5 note: GC not initialized 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f42ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f44d0887800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.072+0000 7f44d0887800 20 Filter name: none 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.073+0000 7f42fd7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:41.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.073+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.073+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.073+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:41.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.074+0000 7f44d0887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.076+0000 7f4384fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.078+0000 7f44d0887800 20 remove_watcher() i=0 2024-09-14T11:34:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.078+0000 7f44d0887800 2 removed watcher, disabling cache 2024-09-14T11:34:41.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.079+0000 7f44d0887800 20 remove_watcher() i=1 2024-09-14T11:34:41.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.080+0000 7f44d0887800 20 remove_watcher() i=2 2024-09-14T11:34:41.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.081+0000 7f44d0887800 20 remove_watcher() i=3 2024-09-14T11:34:41.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.082+0000 7f44d0887800 20 remove_watcher() i=4 2024-09-14T11:34:41.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.083+0000 7f44d0887800 20 remove_watcher() i=5 2024-09-14T11:34:41.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.084+0000 7f44d0887800 20 remove_watcher() i=6 2024-09-14T11:34:41.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.085+0000 7f44d0887800 20 remove_watcher() i=7 2024-09-14T11:34:41.094 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:41.094 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:41.094 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:41.094 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:41.096 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.096 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.104 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.104 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.148 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:41.179 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.179 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.216+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 realm 2024-09-14T11:34:41.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.218+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.219+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.219+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.219+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.219+0000 7f9541215800 20 searching for the correct realm 2024-09-14T11:34:41.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.221+0000 7f953c992640 0 -- 172.21.15.94:0/479012434 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55d7d2381dc0 msgr2=0x7f95380b1fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:41.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.426+0000 7f953d193640 0 -- 172.21.15.94:0/479012434 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f9528009c20 msgr2=0x7f952801a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.431+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 zone default found 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 4 Realm: () 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 zonegroup default 2024-09-14T11:34:41.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 started sync module instance, tier type = 2024-09-14T11:34:41.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.432+0000 7f9541215800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=0 2024-09-14T11:34:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=1 2024-09-14T11:34:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=2 2024-09-14T11:34:41.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=3 2024-09-14T11:34:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=4 2024-09-14T11:34:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=5 2024-09-14T11:34:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.441+0000 7f9541215800 20 add_watcher() i=6 2024-09-14T11:34:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.442+0000 7f9541215800 20 add_watcher() i=7 2024-09-14T11:34:41.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.442+0000 7f9541215800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.443+0000 7f93f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 5 note: GC not initialized 2024-09-14T11:34:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f93f1fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:41.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:41.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 20 Filter name: none 2024-09-14T11:34:41.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f93637fe640 20 reqs_thread_entry: start 2024-09-14T11:34:41.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:34:41.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.444+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 : miss 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.445+0000 7f9541215800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 2024-09-14T11:34:41.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.446+0000 7f9541215800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:41.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31, ofs0, ns] 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f94137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94385435632096 notifier 7191 bl.length()=1015 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f94137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f94137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f94137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_sources= new_sources= 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential sources added=[] removed=[] 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_dests= new_dests= 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.453+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential dests added=[] removed=[] 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.0 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.0 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.1 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.1 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.2 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.2 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.3 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.3 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.4 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.4 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.5 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.5 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.6 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.6 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.7 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.7 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.8 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.8 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.9 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.9 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.10 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.10 2024-09-14T11:34:41.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.11 2024-09-14T11:34:41.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2.11 2024-09-14T11:34:41.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.0 2024-09-14T11:34:41.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1 2024-09-14T11:34:41.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.458+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.459+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.3 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.460+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.4 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.460+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.5 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.460+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.6 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.461+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.7 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.461+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.8 2024-09-14T11:34:41.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.462+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.9 2024-09-14T11:34:41.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.462+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.10 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.465+0000 7f9541215800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.465+0000 7f9541215800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f9541215800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f9541215800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f9541215800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f9541215800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31, ofs0, ns] 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f94137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94385435632096 notifier 7191 bl.length()=1015 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f94137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f94137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.467+0000 7f94137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.468+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_sources= new_sources= 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.468+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential sources added=[] removed=[] 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.468+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_dests= new_dests= 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.468+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential dests added=[] removed=[] 2024-09-14T11:34:41.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.470+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.0 2024-09-14T11:34:41.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.470+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.1 2024-09-14T11:34:41.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.471+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.2 2024-09-14T11:34:41.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.471+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.3 2024-09-14T11:34:41.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.471+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.4 2024-09-14T11:34:41.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.472+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.5 2024-09-14T11:34:41.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.472+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.6 2024-09-14T11:34:41.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.472+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.7 2024-09-14T11:34:41.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.473+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.8 2024-09-14T11:34:41.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.473+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.9 2024-09-14T11:34:41.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.473+0000 7f9541215800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31.10 2024-09-14T11:34:41.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.473+0000 7f9541215800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:41.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.473+0000 7f9541215800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31, ofs0, ns] 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9413fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94385435632096 notifier 7191 bl.length()=983 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9413fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 info.flags=0x17 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9413fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 to cache LRU end 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9413fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_sources= new_sources= 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential sources added=[] removed=[] 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): orig_dests= new_dests= 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.475+0000 7f9541215800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31]): potential dests added=[] removed=[] 2024-09-14T11:34:41.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.480+0000 7f9541215800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.481+0000 7f93f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.483+0000 7f9541215800 20 remove_watcher() i=0 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.483+0000 7f9541215800 2 removed watcher, disabling cache 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.485+0000 7f9541215800 20 remove_watcher() i=1 2024-09-14T11:34:41.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.486+0000 7f9541215800 20 remove_watcher() i=2 2024-09-14T11:34:41.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.486+0000 7f9541215800 20 remove_watcher() i=3 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.488+0000 7f9541215800 20 remove_watcher() i=4 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.489+0000 7f9541215800 20 remove_watcher() i=5 2024-09-14T11:34:41.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.489+0000 7f9541215800 20 remove_watcher() i=6 2024-09-14T11:34:41.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.490+0000 7f9541215800 20 remove_watcher() i=7 2024-09-14T11:34:41.501 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:34:41.530 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.530 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.566+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 realm 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.568+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.569+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.569+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.569+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.569+0000 7f0e5310c800 20 searching for the correct realm 2024-09-14T11:34:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.572+0000 7f0e4bfff640 0 -- 172.21.15.94:0/263690120 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x564b59b13b50 msgr2=0x564b59b15f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.576+0000 7f0e50bfd640 0 -- 172.21.15.94:0/263690120 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f0e3c0783d0 msgr2=0x7f0e3c078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 zone default found 2024-09-14T11:34:41.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 4 Realm: () 2024-09-14T11:34:41.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 zonegroup default 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.580+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 started sync module instance, tier type = 2024-09-14T11:34:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.581+0000 7f0e5310c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=0 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=1 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=2 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=3 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=4 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=5 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=6 2024-09-14T11:34:41.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 20 add_watcher() i=7 2024-09-14T11:34:41.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.590+0000 7f0e5310c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.592+0000 7f0d06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.592+0000 7f0e5310c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.592+0000 7f0e5310c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0e5310c800 5 note: GC not initialized 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0d05fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0e5310c800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0e5310c800 20 Filter name: none 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0c777fe640 20 reqs_thread_entry: start 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.593+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.594+0000 7f0e5310c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.595+0000 7f0e5310c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.595+0000 7f0e5310c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.597+0000 7f0d06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.599+0000 7f0e5310c800 20 remove_watcher() i=0 2024-09-14T11:34:41.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.599+0000 7f0e5310c800 2 removed watcher, disabling cache 2024-09-14T11:34:41.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.600+0000 7f0e5310c800 20 remove_watcher() i=1 2024-09-14T11:34:41.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.601+0000 7f0e5310c800 20 remove_watcher() i=2 2024-09-14T11:34:41.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.602+0000 7f0e5310c800 20 remove_watcher() i=3 2024-09-14T11:34:41.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.603+0000 7f0e5310c800 20 remove_watcher() i=4 2024-09-14T11:34:41.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.604+0000 7f0e5310c800 20 remove_watcher() i=5 2024-09-14T11:34:41.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.605+0000 7f0e5310c800 20 remove_watcher() i=6 2024-09-14T11:34:41.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.606+0000 7f0e5310c800 20 remove_watcher() i=7 2024-09-14T11:34:41.615 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:41.615 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:41.615 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:41.615 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:41.617 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.617 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.664 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.665 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:34:41.691 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.692 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.704 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.704 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.747 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.747 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.755 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.755 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.764 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.764 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.772 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.772 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.779 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.779 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.789 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.789 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.796 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.796 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.804 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.804 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.811 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.811 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.818 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.818 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.826 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.826 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.834 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.834 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.842 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.842 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.849 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.849 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.856 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.856 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.864 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.864 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.871 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.871 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.878 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.879 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.888 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.888 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.893 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:41.893 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:41.901 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:34:41.930 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.930 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.968+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 realm 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.970+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.971+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.971+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.971+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.971+0000 7f69d0d40800 20 searching for the correct realm 2024-09-14T11:34:41.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.974+0000 7f69cd287640 0 -- 172.21.15.94:0/2011262263 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x555b64f060f0 msgr2=0x555b64f08560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.978+0000 7f69c7fff640 0 -- 172.21.15.94:0/2011262263 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f69c000e070 msgr2=0x7f69c0083390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.981+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 zone default found 2024-09-14T11:34:41.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 4 Realm: () 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 zonegroup default 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.982+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.983+0000 7f69d0d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.983+0000 7f69d0d40800 20 started sync module instance, tier type = 2024-09-14T11:34:41.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.983+0000 7f69d0d40800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:41.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=0 2024-09-14T11:34:41.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=1 2024-09-14T11:34:41.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=2 2024-09-14T11:34:41.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=3 2024-09-14T11:34:41.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=4 2024-09-14T11:34:41.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=5 2024-09-14T11:34:41.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.991+0000 7f69d0d40800 20 add_watcher() i=6 2024-09-14T11:34:41.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.992+0000 7f69d0d40800 20 add_watcher() i=7 2024-09-14T11:34:41.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.992+0000 7f69d0d40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f68837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 5 note: GC not initialized 2024-09-14T11:34:41.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f68827e4640 20 reqs_thread_entry: start 2024-09-14T11:34:41.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:41.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 20 Filter name: none 2024-09-14T11:34:41.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f687b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:41.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.994+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.995+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.995+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.995+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:41.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:41.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.997+0000 7f69d0d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:41.998+0000 7f68837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.000+0000 7f69d0d40800 20 remove_watcher() i=0 2024-09-14T11:34:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.000+0000 7f69d0d40800 2 removed watcher, disabling cache 2024-09-14T11:34:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.002+0000 7f69d0d40800 20 remove_watcher() i=1 2024-09-14T11:34:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.003+0000 7f69d0d40800 20 remove_watcher() i=2 2024-09-14T11:34:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.003+0000 7f69d0d40800 20 remove_watcher() i=3 2024-09-14T11:34:42.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.004+0000 7f69d0d40800 20 remove_watcher() i=4 2024-09-14T11:34:42.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.005+0000 7f69d0d40800 20 remove_watcher() i=5 2024-09-14T11:34:42.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.007+0000 7f69d0d40800 20 remove_watcher() i=6 2024-09-14T11:34:42.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.007+0000 7f69d0d40800 20 remove_watcher() i=7 2024-09-14T11:34:42.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:42.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:42.018 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:34:42.054 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:42.054 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:42.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.092+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.093+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.093+0000 7f122ff20800 20 realm 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.093+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.094+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.094+0000 7f122ff20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.094+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.094+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.094+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.095+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.095+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.095+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:42.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.095+0000 7f122ff20800 20 searching for the correct realm 2024-09-14T11:34:42.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.098+0000 7f122c303640 0 -- 172.21.15.94:0/4108389843 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f121406c040 msgr2=0x7f12140ab8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.101+0000 7f122bb02640 0 -- 172.21.15.94:0/4108389843 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f12140b6030 msgr2=0x7f12140ab120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.307+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 zone default found 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 4 Realm: () 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 zonegroup default 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.308+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.309+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.309+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.309+0000 7f122ff20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.309+0000 7f122ff20800 20 started sync module instance, tier type = 2024-09-14T11:34:42.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.309+0000 7f122ff20800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=0 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=1 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=2 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=3 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=4 2024-09-14T11:34:42.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=5 2024-09-14T11:34:42.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.318+0000 7f122ff20800 20 add_watcher() i=6 2024-09-14T11:34:42.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.319+0000 7f122ff20800 20 add_watcher() i=7 2024-09-14T11:34:42.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.319+0000 7f122ff20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:42.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.320+0000 7f10e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:42.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 5 note: GC not initialized 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f10e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 20 Filter name: none 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f105a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:34:42.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.321+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:42.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:42.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:34:42.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 : miss 2024-09-14T11:34:42.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.322+0000 7f122ff20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 2024-09-14T11:34:42.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f122ff20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f122ff20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f122ff20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f122ff20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32, ofs0, ns] 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f110a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 93951662182352 notifier 6893 bl.length()=1015 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f110a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f110a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.327+0000 7f110a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.328+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_sources= new_sources= 2024-09-14T11:34:42.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.328+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential sources added=[] removed=[] 2024-09-14T11:34:42.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.328+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_dests= new_dests= 2024-09-14T11:34:42.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.328+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential dests added=[] removed=[] 2024-09-14T11:34:42.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.0 2024-09-14T11:34:42.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.0 2024-09-14T11:34:42.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.1 2024-09-14T11:34:42.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.1 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.2 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.2 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.3 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.3 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.4 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.4 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.5 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.5 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.6 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.6 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.7 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.7 2024-09-14T11:34:42.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.8 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.8 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.9 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.9 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.10 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.10 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.11 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1.11 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.0 2024-09-14T11:34:42.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.332+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.2 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.333+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.3 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.333+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.4 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.334+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.5 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.334+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.6 2024-09-14T11:34:42.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.335+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.7 2024-09-14T11:34:42.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.335+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.8 2024-09-14T11:34:42.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.336+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.9 2024-09-14T11:34:42.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.337+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.10 2024-09-14T11:34:42.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.339+0000 7f122ff20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:42.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.339+0000 7f122ff20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32, ofs0, ns] 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f110affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93951662182352 notifier 6893 bl.length()=1015 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f110affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f110affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f110affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_sources= new_sources= 2024-09-14T11:34:42.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential sources added=[] removed=[] 2024-09-14T11:34:42.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_dests= new_dests= 2024-09-14T11:34:42.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.341+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential dests added=[] removed=[] 2024-09-14T11:34:42.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.346+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.0 2024-09-14T11:34:42.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.346+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.1 2024-09-14T11:34:42.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.346+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.2 2024-09-14T11:34:42.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.347+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.3 2024-09-14T11:34:42.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.347+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.4 2024-09-14T11:34:42.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.347+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.5 2024-09-14T11:34:42.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.348+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.6 2024-09-14T11:34:42.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.348+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.7 2024-09-14T11:34:42.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.348+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.8 2024-09-14T11:34:42.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.348+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.9 2024-09-14T11:34:42.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.349+0000 7f122ff20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32.10 2024-09-14T11:34:42.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.349+0000 7f122ff20800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:34:42.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.349+0000 7f122ff20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:42.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.349+0000 7f122ff20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 2024-09-14T11:34:42.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.350+0000 7f122ff20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.350+0000 7f122ff20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.350+0000 7f122ff20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.350+0000 7f122ff20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32, ofs0, ns] 2024-09-14T11:34:42.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f110a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93951662182352 notifier 6893 bl.length()=983 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f110a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 info.flags=0x17 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f110a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 to cache LRU end 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f110a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_sources= new_sources= 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential sources added=[] removed=[] 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): orig_dests= new_dests= 2024-09-14T11:34:42.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.351+0000 7f122ff20800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32]): potential dests added=[] removed=[] 2024-09-14T11:34:42.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.358+0000 7f122ff20800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:42.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.359+0000 7f10e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.361+0000 7f122ff20800 20 remove_watcher() i=0 2024-09-14T11:34:42.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.361+0000 7f122ff20800 2 removed watcher, disabling cache 2024-09-14T11:34:42.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.362+0000 7f122ff20800 20 remove_watcher() i=1 2024-09-14T11:34:42.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.363+0000 7f122ff20800 20 remove_watcher() i=2 2024-09-14T11:34:42.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.364+0000 7f122ff20800 20 remove_watcher() i=3 2024-09-14T11:34:42.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.365+0000 7f122ff20800 20 remove_watcher() i=4 2024-09-14T11:34:42.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.366+0000 7f122ff20800 20 remove_watcher() i=5 2024-09-14T11:34:42.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.367+0000 7f122ff20800 20 remove_watcher() i=6 2024-09-14T11:34:42.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.368+0000 7f122ff20800 20 remove_watcher() i=7 2024-09-14T11:34:42.378 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:34:42.407 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:42.407 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:42.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.445+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 realm 2024-09-14T11:34:42.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:42.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.447+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.448+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.448+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.448+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:42.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.448+0000 7f28f0e0f800 20 searching for the correct realm 2024-09-14T11:34:42.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.451+0000 7f28ecd23640 0 -- 172.21.15.94:0/4095934424 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f28d4060fd0 msgr2=0x7f28d4060a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.454+0000 7f28ec522640 0 -- 172.21.15.94:0/4095934424 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f28d4098760 msgr2=0x7f28d4060140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:42.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:42.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:42.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 zone default found 2024-09-14T11:34:42.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 4 Realm: () 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 zonegroup default 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.661+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 started sync module instance, tier type = 2024-09-14T11:34:42.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.662+0000 7f28f0e0f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=0 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=1 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=2 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=3 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=4 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=5 2024-09-14T11:34:42.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.671+0000 7f28f0e0f800 20 add_watcher() i=6 2024-09-14T11:34:42.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.672+0000 7f28f0e0f800 20 add_watcher() i=7 2024-09-14T11:34:42.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.672+0000 7f28f0e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f27a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f28f0e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f28f0e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f28f0e0f800 5 note: GC not initialized 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f27a1fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.674+0000 7f28f0e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.675+0000 7f28f0e0f800 20 Filter name: none 2024-09-14T11:34:42.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.675+0000 7f27137fe640 20 reqs_thread_entry: start 2024-09-14T11:34:42.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.675+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.675+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.675+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:42.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.676+0000 7f28f0e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:42.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.678+0000 7f27a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.680+0000 7f28f0e0f800 20 remove_watcher() i=0 2024-09-14T11:34:42.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.680+0000 7f28f0e0f800 2 removed watcher, disabling cache 2024-09-14T11:34:42.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.681+0000 7f28f0e0f800 20 remove_watcher() i=1 2024-09-14T11:34:42.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.682+0000 7f28f0e0f800 20 remove_watcher() i=2 2024-09-14T11:34:42.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.684+0000 7f28f0e0f800 20 remove_watcher() i=3 2024-09-14T11:34:42.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.684+0000 7f28f0e0f800 20 remove_watcher() i=4 2024-09-14T11:34:42.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.685+0000 7f28f0e0f800 20 remove_watcher() i=5 2024-09-14T11:34:42.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.686+0000 7f28f0e0f800 20 remove_watcher() i=6 2024-09-14T11:34:42.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:42.687+0000 7f28f0e0f800 20 remove_watcher() i=7 2024-09-14T11:34:42.695 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:42.695 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:42.695 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:34:42.695 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:42.697 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.697 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.700 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.701 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.744 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.744 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.771 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:34:42.771 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:42.772 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.773 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.783 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.783 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.826 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.826 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.836 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.836 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.842 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.842 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.850 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.850 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.858 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.859 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.866 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.866 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.874 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.874 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.882 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.882 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.889 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.889 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.897 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.897 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.913 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.913 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.929 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.929 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.936 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.937 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.944 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.944 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.953 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.953 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.960 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.961 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.968 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.968 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.977 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:42.977 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:34:42.985 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:34:43.013 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:43.013 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.050+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 20 realm 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.052+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.053+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.053+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.053+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.053+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.054+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.054+0000 7f830ab1f800 20 searching for the correct realm 2024-09-14T11:34:43.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.057+0000 7f83060a1640 0 -- 172.21.15.94:0/722128153 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5613088ba390 msgr2=0x5613088bc780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.060+0000 7f83068a2640 0 -- 172.21.15.94:0/722128153 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f82f0069950 msgr2=0x7f82f001f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.064+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 zone default found 2024-09-14T11:34:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 4 Realm: () 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 zonegroup default 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.065+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.066+0000 7f830ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.066+0000 7f830ab1f800 20 started sync module instance, tier type = 2024-09-14T11:34:43.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.066+0000 7f830ab1f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=0 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=1 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=2 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=3 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=4 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=5 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.074+0000 7f830ab1f800 20 add_watcher() i=6 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.075+0000 7f830ab1f800 20 add_watcher() i=7 2024-09-14T11:34:43.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.075+0000 7f830ab1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f81bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 5 note: GC not initialized 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f8137fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 20 Filter name: none 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f8135ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.077+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.078+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.078+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.078+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.078+0000 7f830ab1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.078+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.079+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.079+0000 7f830ab1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.079+0000 7f830ab1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.079+0000 7f830ab1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.080+0000 7f81bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.082+0000 7f830ab1f800 20 remove_watcher() i=0 2024-09-14T11:34:43.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.082+0000 7f830ab1f800 2 removed watcher, disabling cache 2024-09-14T11:34:43.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.083+0000 7f830ab1f800 20 remove_watcher() i=1 2024-09-14T11:34:43.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.084+0000 7f830ab1f800 20 remove_watcher() i=2 2024-09-14T11:34:43.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.085+0000 7f830ab1f800 20 remove_watcher() i=3 2024-09-14T11:34:43.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.086+0000 7f830ab1f800 20 remove_watcher() i=4 2024-09-14T11:34:43.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.087+0000 7f830ab1f800 20 remove_watcher() i=5 2024-09-14T11:34:43.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.088+0000 7f830ab1f800 20 remove_watcher() i=6 2024-09-14T11:34:43.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.089+0000 7f830ab1f800 20 remove_watcher() i=7 2024-09-14T11:34:43.097 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.097 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:43.097 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:43.097 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.098 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:34:43.132 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:43.132 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.171+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 realm 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.173+0000 7ff865b23800 20 searching for the correct realm 2024-09-14T11:34:43.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.177+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55da42eb3160 msgr2=0x55da42eb55a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.179+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ff84c08c910 msgr2=0x7ff84c065440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.185+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 zone default found 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 4 Realm: () 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 zonegroup default 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.188+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.188+0000 7ff865b23800 20 started sync module instance, tier type = 2024-09-14T11:34:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.188+0000 7ff865b23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:43.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=0 2024-09-14T11:34:43.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=1 2024-09-14T11:34:43.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=2 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=3 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=4 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=5 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=6 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.197+0000 7ff865b23800 20 add_watcher() i=7 2024-09-14T11:34:43.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.197+0000 7ff865b23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 5 note: GC not initialized 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff7127fc640 20 reqs_thread_entry: start 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 20 Filter name: none 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff683fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:34:43.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.199+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : miss 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:43.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.200+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.214+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.216+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.219+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:43.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.219+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.222+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.226+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.224 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff865b23800 time 2024-09-14T11:34:43.227229+0000 2024-09-14T11:34:43.224 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff86718c76a] 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.227+0000 7ff865b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff865b23800 time 2024-09-14T11:34:43.227229+0000 2024-09-14T11:34:43.225 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff86718c76a] 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:43.226 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff865b23800 thread_name:radosgw-admin 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff865e3e6f0] 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff865e8b99c] 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff86718c7c4] 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.240 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.227+0000 7ff865b23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff865b23800 thread_name:radosgw-admin 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff865e3e6f0] 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff865e8b99c] 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:43.241 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff86718c7c4] 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:34:43.162+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.242 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.243 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:34:43.162+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command objecter_requests cmddesc objecter_requests hook 0x55da42e21700 EEXIST 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:34:43.163+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:34:43.163+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:34:43.163+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x55da42e1d1c0 EEXIST 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e45a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e45e00 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e44730 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.246 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.654438s 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e45a20 auth_method 0 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e44730 auth_method 0 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e45e00 auth_method 0 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:34:43.163+0000 7ff86180c640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:34:43.163+0000 7ff7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: dump: 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:34:43.164+0000 7ff865b23800 5 monclient: authenticate success, global_id 6938 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: dump: 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:34:43.164+0000 7ff86280e640 4 set_mon_vals no callback set 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:34:43.166+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff73c077140 auth_method 0 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: get_monmap_and_config 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:34:43.166+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.251 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.252 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:34:43.167+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x7ffc9fc22ca8 EEXIST 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.254 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e99ab0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e698c0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e94e70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.658076s 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.256 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7308 payload 274 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:34:43.167+0000 7ff86180c640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: dump: 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: dump: 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.258 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:34:43.167+0000 7ff865b23800 5 monclient: authenticate success, global_id 7308 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:34:43.167+0000 7ff865b23800 4 set_mon_vals no callback set 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: shutdown 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:34:43.168+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: starting msgr at 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: starting objecter 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command objecter_requests cmddesc objecter_requests hook 0x55da42e6af70 EEXIST 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: setting wanted keys 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: calling monclient init 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:34:43.168+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:34:43.169+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x55da42e5a428 EEXIST 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e698c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.263 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e94e70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e99ab0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.660230s 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.264 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7311 payload 824 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:34:43.169+0000 7ff86180c640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.265 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.266 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.267 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 monclient: authenticate success, global_id 7311 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:34:43.169+0000 7ff7457fa640 4 set_mon_vals no callback set 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:34:43.169+0000 7ff865b23800 1 librados: init done 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cr dump hook 0x7ff8540015f8 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:34:43.171+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:34:43.171+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff72c077230 auth_method 0 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:34:43.172+0000 7ff86200d640 10 monclient: get_auth_request con 0x55da42eb3160 auth_method 0 2024-09-14T11:34:43.268 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 realm 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:34:43.172+0000 7ff865b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:34:43.173+0000 7ff86180c640 10 monclient: get_auth_request con 0x55da42eb7350 auth_method 0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 searching for the correct realm 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:34:43.174+0000 7ff85900b640 10 monclient: get_auth_request con 0x55da42ebc5e0 auth_method 0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:34:43.174+0000 7ff86200d640 10 monclient: get_auth_request con 0x7ff84c08c910 auth_method 0 2024-09-14T11:34:43.269 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:34:43.175+0000 7ff86180c640 10 monclient: get_auth_request con 0x7ff85c022040 auth_method 0 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:34:43.176+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff854072050 auth_method 0 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:34:43.177+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55da42eb3160 msgr2=0x55da42eb55a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:34:43.177+0000 7ff7337fe640 1 client.7311.objecter ms_handle_reset 0x55da42eb3160 session 0x55da42eb2a90 osd.1 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _renew_subs 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.a con 0x55da42eb3160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.c con 0x55da42e99ab0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.b con 0x55da42e94e70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.270 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x7ff72c0878e0 auth_method 0 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42eb3160 auth_method 0 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.271 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:34:43.177+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x7ff84c09b910 auth_method 0 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7311 payload 293 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:34:43.177+0000 7ff86180c640 1 monclient: found mon.a 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.272 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.273 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:34:43.178+0000 7ff744ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:34:43.179+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ff84c08c910 msgr2=0x7ff84c065440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:34:43.179+0000 7ff7337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:34:43.179+0000 7ff7337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:34:43.179+0000 7ff7337fe640 1 client.7311.objecter ms_handle_reset 0x7ff84c08c910 session 0x7ff84c005040 osd.7 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:34:43.179+0000 7ff86200d640 10 monclient: get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:34:43.181+0000 7ff86200d640 10 monclient: get_auth_request con 0x7ff84c065950 auth_method 0 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.274 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 zone default found 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 Realm: () 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:34:43.187+0000 7ff865b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 zonegroup default 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.275 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 started sync module instance, tier type = 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=0 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=1 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=2 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=3 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=4 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=5 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=6 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:34:43.197+0000 7ff865b23800 20 add_watcher() i=7 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:34:43.197+0000 7ff865b23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.276 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:34:43.199+0000 7ff7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.277 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:34:43.199+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache list hook 0x55da42e93220 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache inspect hook 0x55da42e93220 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache erase hook 0x55da42e93220 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache zap hook 0x55da42e93220 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 note: GC not initialized 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:34:43.199+0000 7ff7127fc640 20 reqs_thread_entry: start 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace show hook 0x7ff85c0134b0 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace history hook 0x7ff85c0134b0 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace active hook 0x7ff85c0134b0 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace active_short hook 0x7ff85c0134b0 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 Filter name: none 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:34:43.199+0000 7ff683fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:34:43.199+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : miss 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:34:43.214+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:34:43.216+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:34:43.219+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:34:43.219+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:34:43.222+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:34:43.226+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:34:43.227+0000 7ff865b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff865b23800 time 2024-09-14T11:34:43.227229+0000 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff86718c76a] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:34:43.227+0000 7ff865b23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff865b23800 thread_name:radosgw-admin 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff865e3e6f0] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff865e8b99c] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff86718c7c4] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff683fff640 / http_manager 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7127fc640 / http_manager 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7137fe640 / rgw_dt_lg_renew 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7337fe640 / ms_dispatch 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff744ff9640 / io_context_pool 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7457fa640 / io_context_pool 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7477fe640 / ms_dispatch 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff85900b640 / msgr-worker-2 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86180c640 / msgr-worker-1 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86200d640 / msgr-worker-0 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86280e640 / io_context_pool 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff865b23800 / radosgw-admin 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.122403.log 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:34:43.162+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding auth protocol: cephx 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: crc 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1e1d0) adding con mode: secure 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:34:43.162+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command objecter_requests cmddesc objecter_requests hook 0x55da42e21700 EEXIST 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:34:43.162+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding auth protocol: cephx 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: crc 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:34:43.162+0000 7ff865b23800 5 AuthRegistry(0x55da42e1d078) adding con mode: secure 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:34:43.163+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:34:43.163+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:34:43.163+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x55da42e1d1c0 EEXIST 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e45a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e45e00 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e44730 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:34:43.163+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.654438s 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e45a20 auth_method 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e44730 auth_method 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:34:43.163+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e45e00 auth_method 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:34:43.163+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:34:43.163+0000 7ff86180c640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:34:43.163+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:34:43.163+0000 7ff7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: dump: 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:34:43.164+0000 7ff865b23800 5 monclient: authenticate success, global_id 6938 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:34:43.164+0000 7ff7477fe640 10 monclient: dump: 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:34:43.164+0000 7ff86280e640 4 set_mon_vals no callback set 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:34:43.164+0000 7ff865b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:34:43.165+0000 7ff7477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:34:43.166+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff73c077140 auth_method 0 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: get_monmap_and_config 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:34:43.166+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding auth protocol: cephx 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: crc 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x55da42e65430) adding con mode: secure 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:34:43.166+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding auth protocol: cephx 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: crc 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:34:43.166+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc22b60) adding con mode: secure 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:34:43.166+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:34:43.167+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x7ffc9fc22ca8 EEXIST 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e99ab0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e698c0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e94e70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.658076s 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:34:43.167+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:34:43.167+0000 7ff85900b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7308 payload 274 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:34:43.167+0000 7ff86180c640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:34:43.167+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: dump: 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:34:43.167+0000 7ff7457fa640 10 monclient: dump: 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:34:43.167+0000 7ff865b23800 5 monclient: authenticate success, global_id 7308 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:34:43.167+0000 7ff865b23800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:34:43.167+0000 7ff865b23800 4 set_mon_vals no callback set 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: shutdown 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: monmap: 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding auth protocol: cephx 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: crc 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e6a700) adding con mode: secure 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:34:43.168+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: starting msgr at 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: starting objecter 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command objecter_requests cmddesc objecter_requests hook 0x55da42e6af70 EEXIST 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: setting wanted keys 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:34:43.168+0000 7ff865b23800 1 librados: calling monclient init 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:34:43.168+0000 7ff865b23800 10 monclient: init 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding auth protocol: cephx 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: crc 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:34:43.168+0000 7ff865b23800 5 AuthRegistry(0x55da42e5a2e0) adding con mode: secure 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:34:43.168+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:34:43.169+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command rotate-key cmddesc rotate-key hook 0x55da42e5a428 EEXIST 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-a con 0x55da42e698c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-b con 0x55da42e94e70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): picked mon.noname-c con 0x55da42e99ab0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient(hunting): authenticate will time out at 1996.660230s 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:34:43.169+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:34:43.169+0000 7ff85900b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7311 payload 824 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:34:43.169+0000 7ff86180c640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:34:43.169+0000 7ff86180c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:34:43.169+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 monclient: authenticate success, global_id 7311 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:34:43.169+0000 7ff7457fa640 4 set_mon_vals no callback set 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _renew_subs 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:34:43.169+0000 7ff865b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:34:43.169+0000 7ff865b23800 1 librados: init done 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:34:43.169+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cr dump hook 0x7ff8540015f8 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:34:43.171+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:34:43.171+0000 7ff7337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:34:43.171+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff72c077230 auth_method 0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:34:43.172+0000 7ff86200d640 10 monclient: get_auth_request con 0x55da42eb3160 auth_method 0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 realm 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:34:43.172+0000 7ff865b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:34:43.172+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:34:43.173+0000 7ff86180c640 10 monclient: get_auth_request con 0x55da42eb7350 auth_method 0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:34:43.173+0000 7ff865b23800 20 searching for the correct realm 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:34:43.174+0000 7ff85900b640 10 monclient: get_auth_request con 0x55da42ebc5e0 auth_method 0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:34:43.174+0000 7ff86200d640 10 monclient: get_auth_request con 0x7ff84c08c910 auth_method 0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:34:43.175+0000 7ff86180c640 10 monclient: get_auth_request con 0x7ff85c022040 auth_method 0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:34:43.176+0000 7ff85900b640 10 monclient: get_auth_request con 0x7ff854072050 auth_method 0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:34:43.177+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55da42eb3160 msgr2=0x55da42eb55a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:34:43.177+0000 7ff7337fe640 1 client.7311.objecter ms_handle_reset 0x55da42eb3160 session 0x55da42eb2a90 osd.1 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _renew_subs 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.a con 0x55da42eb3160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.c con 0x55da42e99ab0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): picked mon.b con 0x55da42e94e70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:34:43.177+0000 7ff7337fe640 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x7ff72c0878e0 auth_method 0 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42eb3160 auth_method 0 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request con 0x55da42e99ab0 auth_method 0 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request con 0x55da42e94e70 auth_method 0 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:34:43.177+0000 7ff85900b640 10 monclient(hunting): get_auth_request con 0x7ff84c09b910 auth_method 0 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:34:43.177+0000 7ff86200d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient(hunting): handle_auth_done global_id 7311 payload 293 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:34:43.177+0000 7ff86180c640 1 monclient: found mon.a 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:34:43.177+0000 7ff86180c640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: dump: 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:34:43.178+0000 7ff7337fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:34:43.178+0000 7ff744ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:34:43.179+0000 7ff86200d640 0 -- 172.21.15.94:0/3543454951 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ff84c08c910 msgr2=0x7ff84c065440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:34:43.179+0000 7ff7337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:34:43.179+0000 7ff7337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:34:43.179+0000 7ff7337fe640 1 client.7311.objecter ms_handle_reset 0x7ff84c08c910 session 0x7ff84c005040 osd.7 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:34:43.179+0000 7ff86200d640 10 monclient: get_auth_request con 0x55da42e698c0 auth_method 0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:34:43.181+0000 7ff86200d640 10 monclient: get_auth_request con 0x7ff84c065950 auth_method 0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:34:43.185+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:34:43.186+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 zone default found 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 Realm: () 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:34:43.187+0000 7ff865b23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:34:43.187+0000 7ff865b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 zonegroup default 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:34:43.187+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 started sync module instance, tier type = 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:34:43.188+0000 7ff865b23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=0 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=1 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=2 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=3 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=4 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=5 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:34:43.196+0000 7ff865b23800 20 add_watcher() i=6 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:34:43.197+0000 7ff865b23800 20 add_watcher() i=7 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:34:43.197+0000 7ff865b23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding auth protocol: cephx 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:34:43.199+0000 7ff7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: crc 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 AuthRegistry(0x7ffc9fc23040) adding con mode: secure 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:34:43.199+0000 7ff865b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache list hook 0x55da42e93220 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache inspect hook 0x55da42e93220 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache erase hook 0x55da42e93220 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command cache zap hook 0x55da42e93220 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 note: GC not initialized 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:34:43.199+0000 7ff7127fc640 20 reqs_thread_entry: start 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace show hook 0x7ff85c0134b0 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace history hook 0x7ff85c0134b0 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace active hook 0x7ff85c0134b0 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:34:43.199+0000 7ff865b23800 5 asok(0x55da42ba9270) register_command sync trace active_short hook 0x7ff85c0134b0 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 Filter name: none 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:34:43.199+0000 7ff683fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:34:43.199+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:34:43.199+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : miss 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:34:43.200+0000 7ff865b23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:34:43.200+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:34:43.205+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:34:43.205+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:34:43.206+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:34:43.210+0000 7ff865b23800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:34:43.210+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:34:43.211+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:34:43.212+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:34:43.213+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:34:43.214+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:34:43.215+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:34:43.216+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:34:43.219+0000 7ff865b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:34:43.219+0000 7ff865b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:34:43.220+0000 7ff865b23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94395913944960 notifier 7311 bl.length()=1015 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:34:43.220+0000 7ff744ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:34:43.221+0000 7ff865b23800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:34:43.222+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:34:43.223+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:34:43.224+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:34:43.225+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:34:43.226+0000 7ff865b23800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:34:43.227+0000 7ff865b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff865b23800 time 2024-09-14T11:34:43.227229+0000 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff86718c76a] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:34:43.227+0000 7ff865b23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7ff865b23800 thread_name:radosgw-admin 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff865e3e6f0] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff865e8b99c] 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff86718c7c4] 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff86718c928] 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da409510b1] 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55da40961217] 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff865e29590] 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff683fff640 / http_manager 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7127fc640 / http_manager 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7137fe640 / rgw_dt_lg_renew 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7337fe640 / ms_dispatch 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff744ff9640 / io_context_pool 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7457fa640 / io_context_pool 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff7477fe640 / ms_dispatch 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff85900b640 / msgr-worker-2 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86180c640 / msgr-worker-1 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86200d640 / msgr-worker-0 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff86280e640 / io_context_pool 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: 7ff865b23800 / radosgw-admin 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:43.228619Z_29e182e9-a427-47d4-b600-78f039bf6d50/log 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.301+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 realm 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.303+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.304+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.304+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.304+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.304+0000 7fd95b52c800 20 searching for the correct realm 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.307+0000 7fd95793f640 0 -- 172.21.15.94:0/1903030037 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fd94c064430 msgr2=0x7fd94c064850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.310+0000 7fd95713e640 0 -- 172.21.15.94:0/1903030037 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd94c088920 msgr2=0x7fd94c0943f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.516+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 zone default found 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 4 Realm: () 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 zonegroup default 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 started sync module instance, tier type = 2024-09-14T11:34:43.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.517+0000 7fd95b52c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:34:43.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=0 2024-09-14T11:34:43.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=1 2024-09-14T11:34:43.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=2 2024-09-14T11:34:43.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=3 2024-09-14T11:34:43.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=4 2024-09-14T11:34:43.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=5 2024-09-14T11:34:43.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.526+0000 7fd95b52c800 20 add_watcher() i=6 2024-09-14T11:34:43.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.527+0000 7fd95b52c800 20 add_watcher() i=7 2024-09-14T11:34:43.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.527+0000 7fd95b52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd95b52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd95b52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd95b52c800 5 note: GC not initialized 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd80cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd95b52c800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.529+0000 7fd95b52c800 20 Filter name: none 2024-09-14T11:34:43.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.530+0000 7fd7867fc640 20 reqs_thread_entry: start 2024-09-14T11:34:43.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.530+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.530+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.530+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.531+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:43.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.531+0000 7fd95b52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.531+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.531+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:43.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.531+0000 7fd95b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.532+0000 7fd95b52c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:43.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.532+0000 7fd95b52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.534+0000 7fd80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.536+0000 7fd95b52c800 20 remove_watcher() i=0 2024-09-14T11:34:43.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.536+0000 7fd95b52c800 2 removed watcher, disabling cache 2024-09-14T11:34:43.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.536+0000 7fd95b52c800 20 remove_watcher() i=1 2024-09-14T11:34:43.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.537+0000 7fd95b52c800 20 remove_watcher() i=2 2024-09-14T11:34:43.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.539+0000 7fd95b52c800 20 remove_watcher() i=3 2024-09-14T11:34:43.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.540+0000 7fd95b52c800 20 remove_watcher() i=4 2024-09-14T11:34:43.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.541+0000 7fd95b52c800 20 remove_watcher() i=5 2024-09-14T11:34:43.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.542+0000 7fd95b52c800 20 remove_watcher() i=6 2024-09-14T11:34:43.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:34:43.543+0000 7fd95b52c800 20 remove_watcher() i=7 2024-09-14T11:34:43.551 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.551 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:34:43.551 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:43.551 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:34:43.553 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:43.553 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:13.595 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:13.596 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:13.639 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:13.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.716+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 20 realm 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.717+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.718+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.718+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.719+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:13.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.719+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.719+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:13.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.719+0000 7f58f4d32800 20 searching for the correct realm 2024-09-14T11:35:13.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.722+0000 7f58f11bd640 0 -- 172.21.15.94:0/2501368552 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f58dc01f040 msgr2=0x7f58dc01f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:13.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.726+0000 7f58f09bc640 0 -- 172.21.15.94:0/2501368552 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f58dc03f3d0 msgr2=0x7f58dc03f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.933+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.934+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.934+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.934+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.934+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.934+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 zone default found 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 4 Realm: () 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 zonegroup default 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.935+0000 7f58f4d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.936+0000 7f58f4d32800 20 started sync module instance, tier type = 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.936+0000 7f58f4d32800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:13.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=0 2024-09-14T11:35:13.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=1 2024-09-14T11:35:13.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=2 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=3 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=4 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=5 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.945+0000 7f58f4d32800 20 add_watcher() i=6 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.946+0000 7f58f4d32800 20 add_watcher() i=7 2024-09-14T11:35:13.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.946+0000 7f58f4d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.948+0000 7f57a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.948+0000 7f58f4d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.948+0000 7f58f4d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.948+0000 7f58f4d32800 5 note: GC not initialized 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.948+0000 7f57a5fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 20 Filter name: none 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f57177fe640 20 reqs_thread_entry: start 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:35:13.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : miss 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.949+0000 7f58f4d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.950+0000 7f58f4d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:35:13.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.955+0000 7f58f4d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.955+0000 7f58f4d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.955+0000 7f58f4d32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.955+0000 7f58f4d32800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f57c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94673836033488 notifier 6974 bl.length()=1015 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f57c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f57c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f57c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:35:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:35:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:35:13.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.956+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.0 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.1 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.2 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.3 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.4 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.5 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.6 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.7 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.8 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.9 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.960+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.10 2024-09-14T11:35:13.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.961+0000 7f58f4d32800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.961+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1.11 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.961+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.961+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.962+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.962+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.963+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:35:13.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.963+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.964+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.964+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:35:13.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.965+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:35:13.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.966+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:35:13.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.966+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.970+0000 7f58f4d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.970+0000 7f58f4d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:35:13.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.971+0000 7f58f4d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.971+0000 7f58f4d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.971+0000 7f58f4d32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.971+0000 7f58f4d32800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f57c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94673836033488 notifier 6974 bl.length()=1015 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f57c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f57c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f57c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:35:13.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.972+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.975+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.0 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.975+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.1 2024-09-14T11:35:13.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.976+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.2 2024-09-14T11:35:13.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.976+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.3 2024-09-14T11:35:13.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.976+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.4 2024-09-14T11:35:13.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.977+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.5 2024-09-14T11:35:13.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.977+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.6 2024-09-14T11:35:13.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.977+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.7 2024-09-14T11:35:13.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.978+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.8 2024-09-14T11:35:13.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.978+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.9 2024-09-14T11:35:13.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.978+0000 7f58f4d32800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33.10 2024-09-14T11:35:13.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.979+0000 7f58f4d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:13.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.979+0000 7f58f4d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.980+0000 7f58f4d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.980+0000 7f58f4d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.980+0000 7f58f4d32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.980+0000 7f58f4d32800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33, ofs0, ns] 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f57c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94673836033488 notifier 6974 bl.length()=983 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f57c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 info.flags=0x17 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f57c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 to cache LRU end 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f57c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:13.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_sources= new_sources= 2024-09-14T11:35:13.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential sources added=[] removed=[] 2024-09-14T11:35:13.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): orig_dests= new_dests= 2024-09-14T11:35:13.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.981+0000 7f58f4d32800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33]): potential dests added=[] removed=[] 2024-09-14T11:35:13.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.984+0000 7f58f4d32800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:13.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.986+0000 7f57a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:13.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.988+0000 7f58f4d32800 20 remove_watcher() i=0 2024-09-14T11:35:13.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.988+0000 7f58f4d32800 2 removed watcher, disabling cache 2024-09-14T11:35:13.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.989+0000 7f58f4d32800 20 remove_watcher() i=1 2024-09-14T11:35:13.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.991+0000 7f58f4d32800 20 remove_watcher() i=2 2024-09-14T11:35:13.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.992+0000 7f58f4d32800 20 remove_watcher() i=3 2024-09-14T11:35:13.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.993+0000 7f58f4d32800 20 remove_watcher() i=4 2024-09-14T11:35:13.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.994+0000 7f58f4d32800 20 remove_watcher() i=5 2024-09-14T11:35:13.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.995+0000 7f58f4d32800 20 remove_watcher() i=6 2024-09-14T11:35:13.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:13.996+0000 7f58f4d32800 20 remove_watcher() i=7 2024-09-14T11:35:14.006 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:35:14.035 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.035 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.073+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.074+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.074+0000 7f5a6d287800 20 realm 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.074+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.075+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.075+0000 7f5a6d287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.075+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.075+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.075+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.076+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.076+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.076+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.076+0000 7f5a6d287800 20 searching for the correct realm 2024-09-14T11:35:14.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.079+0000 7f5a6b572640 0 -- 172.21.15.94:0/2777514873 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f5a5c02d070 msgr2=0x7f5a5c02e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.082+0000 7f5a6ad71640 0 -- 172.21.15.94:0/2777514873 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f5a5c017910 msgr2=0x7f5a5c02d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:14.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:14.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.290+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 zone default found 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 4 Realm: () 2024-09-14T11:35:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 zonegroup default 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.291+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.292+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.292+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.292+0000 7f5a6d287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.292+0000 7f5a6d287800 20 started sync module instance, tier type = 2024-09-14T11:35:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.292+0000 7f5a6d287800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=0 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=1 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=2 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=3 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=4 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=5 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=6 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 20 add_watcher() i=7 2024-09-14T11:35:14.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.302+0000 7f5a6d287800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f59217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 5 note: GC not initialized 2024-09-14T11:35:14.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f589bfff640 20 reqs_thread_entry: start 2024-09-14T11:35:14.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:14.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 20 Filter name: none 2024-09-14T11:35:14.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5899ffb640 20 reqs_thread_entry: start 2024-09-14T11:35:14.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.305+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.306+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.306+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.306+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.306+0000 7f5a6d287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.306+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.307+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:35:14.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.307+0000 7f5a6d287800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.307+0000 7f5a6d287800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:35:14.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.307+0000 7f5a6d287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.309+0000 7f59217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.311+0000 7f5a6d287800 20 remove_watcher() i=0 2024-09-14T11:35:14.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.311+0000 7f5a6d287800 2 removed watcher, disabling cache 2024-09-14T11:35:14.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.312+0000 7f5a6d287800 20 remove_watcher() i=1 2024-09-14T11:35:14.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.313+0000 7f5a6d287800 20 remove_watcher() i=2 2024-09-14T11:35:14.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.314+0000 7f5a6d287800 20 remove_watcher() i=3 2024-09-14T11:35:14.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.315+0000 7f5a6d287800 20 remove_watcher() i=4 2024-09-14T11:35:14.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.316+0000 7f5a6d287800 20 remove_watcher() i=5 2024-09-14T11:35:14.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.317+0000 7f5a6d287800 20 remove_watcher() i=6 2024-09-14T11:35:14.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.318+0000 7f5a6d287800 20 remove_watcher() i=7 2024-09-14T11:35:14.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:14.327 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:14.327 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:14.328 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.329 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.332 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.332 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.374 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.374 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.404 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:35:14.404 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:14.406 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.406 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.416 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.416 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.459 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.459 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.467 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.467 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.475 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.476 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.483 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.483 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.491 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.491 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.499 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.499 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.508 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.508 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.516 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.516 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.558 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.558 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.567 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.567 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.574 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.575 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.582 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.582 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.590 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.590 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.598 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.598 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.605 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.606 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.613 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.614 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.621 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.621 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.629 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.629 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.638 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.645 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:14.645 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:35:14.681 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.682 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.720+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.721+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.721+0000 7f1680b46800 20 realm 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.721+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.721+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.721+0000 7f1680b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.722+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.722+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.722+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.723+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.723+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.723+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.723+0000 7f1680b46800 20 searching for the correct realm 2024-09-14T11:35:14.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.726+0000 7f1675e2f640 0 -- 172.21.15.94:0/962604871 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x561ed7a2e770 msgr2=0x561ed7a30b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.730+0000 7f167e630640 0 -- 172.21.15.94:0/962604871 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f1668061450 msgr2=0x7f16680618d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.733+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 zone default found 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 4 Realm: () 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 zonegroup default 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.734+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.735+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.735+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.735+0000 7f1680b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.735+0000 7f1680b46800 20 started sync module instance, tier type = 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.735+0000 7f1680b46800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:14.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=0 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=1 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=2 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=3 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=4 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=5 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.743+0000 7f1680b46800 20 add_watcher() i=6 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.744+0000 7f1680b46800 20 add_watcher() i=7 2024-09-14T11:35:14.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.744+0000 7f1680b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1680b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1680b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1680b46800 5 note: GC not initialized 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f14af7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1680b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f1680b46800 20 Filter name: none 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.746+0000 7f14ad7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:14.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.747+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.748+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.748+0000 7f1680b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.748+0000 7f1680b46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:14.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.748+0000 7f1680b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.749+0000 7f1534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.751+0000 7f1680b46800 20 remove_watcher() i=0 2024-09-14T11:35:14.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.751+0000 7f1680b46800 2 removed watcher, disabling cache 2024-09-14T11:35:14.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.752+0000 7f1680b46800 20 remove_watcher() i=1 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.754+0000 7f1680b46800 20 remove_watcher() i=2 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.755+0000 7f1680b46800 20 remove_watcher() i=3 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.756+0000 7f1680b46800 20 remove_watcher() i=4 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.757+0000 7f1680b46800 20 remove_watcher() i=5 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.757+0000 7f1680b46800 20 remove_watcher() i=6 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.758+0000 7f1680b46800 20 remove_watcher() i=7 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:14.794 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:14.795 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:14.795 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:14.795 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:35:14.803 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.803 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.841+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 realm 2024-09-14T11:35:14.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.843+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.844+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.844+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.844+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.844+0000 7f5db2525800 20 searching for the correct realm 2024-09-14T11:35:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:14.847+0000 7f5dad932640 0 -- 172.21.15.94:0/2721168115 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5da006a7b0 msgr2=0x7f5da0077040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.052+0000 7f5dae133640 0 -- 172.21.15.94:0/2721168115 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f5da8078060 msgr2=0x7f5da80029e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.057+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 zone default found 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 4 Realm: () 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 zonegroup default 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.058+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 started sync module instance, tier type = 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.059+0000 7f5db2525800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=0 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=1 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=2 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=3 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=4 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=5 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.068+0000 7f5db2525800 20 add_watcher() i=6 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.069+0000 7f5db2525800 20 add_watcher() i=7 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.069+0000 7f5db2525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5c64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5db2525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5db2525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5db2525800 5 note: GC not initialized 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5bdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.071+0000 7f5db2525800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 20 Filter name: none 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5bdd7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 : miss 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.072+0000 7f5db2525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.073+0000 7f5db2525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.077+0000 7f5db2525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.077+0000 7f5db2525800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.077+0000 7f5db2525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.077+0000 7f5db2525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34, ofs0, ns] 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5c91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 93858923393968 notifier 7404 bl.length()=995 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5c91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5c91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5c91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_sources= new_sources= 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential sources added=[] removed=[] 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_dests= new_dests= 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.078+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential dests added=[] removed=[] 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.082+0000 7f5db2525800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.088+0000 7f5db2525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.088+0000 7f5db2525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.089+0000 7f5db2525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.089+0000 7f5db2525800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.089+0000 7f5db2525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.089+0000 7f5db2525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34, ofs0, ns] 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5c91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 93858923393968 notifier 7404 bl.length()=963 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5c91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5c91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5c91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_sources= new_sources= 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential sources added=[] removed=[] 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_dests= new_dests= 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5db2525800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential dests added=[] removed=[] 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.090+0000 7f5db2525800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.092+0000 7f5c64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.095+0000 7f5db2525800 20 remove_watcher() i=0 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.095+0000 7f5db2525800 2 removed watcher, disabling cache 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.095+0000 7f5db2525800 20 remove_watcher() i=1 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.096+0000 7f5db2525800 20 remove_watcher() i=2 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.098+0000 7f5db2525800 20 remove_watcher() i=3 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.099+0000 7f5db2525800 20 remove_watcher() i=4 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.100+0000 7f5db2525800 20 remove_watcher() i=5 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.100+0000 7f5db2525800 20 remove_watcher() i=6 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.101+0000 7f5db2525800 20 remove_watcher() i=7 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.177+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 realm 2024-09-14T11:35:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.179+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.180+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.180+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.180+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.180+0000 7f187aa40800 20 searching for the correct realm 2024-09-14T11:35:15.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.183+0000 7f1877d29640 0 -- 172.21.15.94:0/2087232436 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f1868078040 msgr2=0x7f186808a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.186+0000 7f187852a640 0 -- 172.21.15.94:0/2087232436 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f186c06cad0 msgr2=0x7f186c0625f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.392+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 zone default found 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 4 Realm: () 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 zonegroup default 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.393+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.394+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.394+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.394+0000 7f187aa40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.394+0000 7f187aa40800 20 started sync module instance, tier type = 2024-09-14T11:35:15.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.394+0000 7f187aa40800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=0 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=1 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=2 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=3 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=4 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=5 2024-09-14T11:35:15.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.403+0000 7f187aa40800 20 add_watcher() i=6 2024-09-14T11:35:15.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.404+0000 7f187aa40800 20 add_watcher() i=7 2024-09-14T11:35:15.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.404+0000 7f187aa40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.405+0000 7f172efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 5 note: GC not initialized 2024-09-14T11:35:15.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f172dfdb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:15.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 20 Filter name: none 2024-09-14T11:35:15.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f169f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.406+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:15.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.407+0000 7f187aa40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.408+0000 7f187aa40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:15.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.408+0000 7f187aa40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.409+0000 7f172efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.411+0000 7f187aa40800 20 remove_watcher() i=0 2024-09-14T11:35:15.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.411+0000 7f187aa40800 2 removed watcher, disabling cache 2024-09-14T11:35:15.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.412+0000 7f187aa40800 20 remove_watcher() i=1 2024-09-14T11:35:15.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.413+0000 7f187aa40800 20 remove_watcher() i=2 2024-09-14T11:35:15.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.415+0000 7f187aa40800 20 remove_watcher() i=3 2024-09-14T11:35:15.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.416+0000 7f187aa40800 20 remove_watcher() i=4 2024-09-14T11:35:15.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.417+0000 7f187aa40800 20 remove_watcher() i=5 2024-09-14T11:35:15.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.419+0000 7f187aa40800 20 remove_watcher() i=6 2024-09-14T11:35:15.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.420+0000 7f187aa40800 20 remove_watcher() i=7 2024-09-14T11:35:15.428 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:15.428 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:15.428 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:15.428 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:15.429 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:15.429 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:15.437 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:15.437 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:15.481 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:15.512 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.512 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.550+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 realm 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.552+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.553+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.553+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.553+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.553+0000 7fb936d0c800 20 searching for the correct realm 2024-09-14T11:35:15.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.556+0000 7fb933ffc640 0 -- 172.21.15.94:0/1538518568 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb92409ab00 msgr2=0x7fb924061e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.560+0000 7fb9347fd640 0 -- 172.21.15.94:0/1538518568 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb92803f4d0 msgr2=0x7fb92804f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:15.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.766+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 zone default found 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 4 Realm: () 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 zonegroup default 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.767+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.768+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.768+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.768+0000 7fb936d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.768+0000 7fb936d0c800 20 started sync module instance, tier type = 2024-09-14T11:35:15.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.768+0000 7fb936d0c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=0 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=1 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=2 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=3 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=4 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=5 2024-09-14T11:35:15.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.777+0000 7fb936d0c800 20 add_watcher() i=6 2024-09-14T11:35:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.778+0000 7fb936d0c800 20 add_watcher() i=7 2024-09-14T11:35:15.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.778+0000 7fb936d0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.779+0000 7fb7eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 5 note: GC not initialized 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb7e9fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:15.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 Filter name: none 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb75b7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 : miss 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.780+0000 7fb936d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:15.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.781+0000 7fb936d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 2024-09-14T11:35:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb936d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb936d0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb936d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb936d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34, ofs0, ns] 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb80b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94343527614256 notifier 7440 bl.length()=995 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb80b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb80b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.786+0000 7fb80b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.787+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_sources= new_sources= 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.787+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential sources added=[] removed=[] 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.787+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_dests= new_dests= 2024-09-14T11:35:15.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.787+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential dests added=[] removed=[] 2024-09-14T11:35:15.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.0 2024-09-14T11:35:15.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.0 2024-09-14T11:35:15.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.1 2024-09-14T11:35:15.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.1 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.2 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.2 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.3 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.3 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.4 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.4 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.5 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.5 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.6 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.6 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.7 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.7 2024-09-14T11:35:15.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.8 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.8 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.9 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.9 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.10 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.10 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.11 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1.11 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.0 2024-09-14T11:35:15.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.792+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.793+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.2 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.793+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.3 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.794+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.4 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.794+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.5 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.794+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.6 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.795+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.7 2024-09-14T11:35:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.796+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.8 2024-09-14T11:35:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.796+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.9 2024-09-14T11:35:15.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.796+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.10 2024-09-14T11:35:15.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.799+0000 7fb936d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:15.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.799+0000 7fb936d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34, ofs0, ns] 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb80affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94343527614256 notifier 7440 bl.length()=995 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb80affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb80affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb80affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_sources= new_sources= 2024-09-14T11:35:15.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential sources added=[] removed=[] 2024-09-14T11:35:15.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_dests= new_dests= 2024-09-14T11:35:15.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.801+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential dests added=[] removed=[] 2024-09-14T11:35:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.803+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.0 2024-09-14T11:35:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.804+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.1 2024-09-14T11:35:15.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.804+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.2 2024-09-14T11:35:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.804+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.3 2024-09-14T11:35:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.805+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.4 2024-09-14T11:35:15.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.805+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.5 2024-09-14T11:35:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.805+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.6 2024-09-14T11:35:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.805+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.7 2024-09-14T11:35:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.806+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.8 2024-09-14T11:35:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.806+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.9 2024-09-14T11:35:15.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.806+0000 7fb936d0c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34.10 2024-09-14T11:35:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.807+0000 7fb936d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:15.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.807+0000 7fb936d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 2024-09-14T11:35:15.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb936d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb936d0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb936d0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb936d0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34, ofs0, ns] 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb80affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 94343527614256 notifier 7440 bl.length()=963 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb80affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 info.flags=0x17 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb80affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 to cache LRU end 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.808+0000 7fb80affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.809+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_sources= new_sources= 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.809+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential sources added=[] removed=[] 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.809+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): orig_dests= new_dests= 2024-09-14T11:35:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.809+0000 7fb936d0c800 20 handle_bi_update(): bucket=:error-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34]): potential dests added=[] removed=[] 2024-09-14T11:35:15.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.811+0000 7fb936d0c800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:15.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.812+0000 7fb7eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.815+0000 7fb936d0c800 20 remove_watcher() i=0 2024-09-14T11:35:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.815+0000 7fb936d0c800 2 removed watcher, disabling cache 2024-09-14T11:35:15.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.815+0000 7fb936d0c800 20 remove_watcher() i=1 2024-09-14T11:35:15.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.816+0000 7fb936d0c800 20 remove_watcher() i=2 2024-09-14T11:35:15.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.818+0000 7fb936d0c800 20 remove_watcher() i=3 2024-09-14T11:35:15.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.819+0000 7fb936d0c800 20 remove_watcher() i=4 2024-09-14T11:35:15.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.820+0000 7fb936d0c800 20 remove_watcher() i=5 2024-09-14T11:35:15.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.821+0000 7fb936d0c800 20 remove_watcher() i=6 2024-09-14T11:35:15.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.822+0000 7fb936d0c800 20 remove_watcher() i=7 2024-09-14T11:35:15.832 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:35:15.860 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.860 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.898+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 realm 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.900+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.901+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.901+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.901+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.902+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.902+0000 7fa99d20f800 20 searching for the correct realm 2024-09-14T11:35:15.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:15.904+0000 7fa998147640 0 -- 172.21.15.94:0/2281698823 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fa9880e0070 msgr2=0x7fa9880a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:16.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.109+0000 7fa998948640 0 -- 172.21.15.94:0/2281698823 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa9800030f0 msgr2=0x7fa98c027400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:16.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:16.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:16.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:16.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:16.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:16.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.315+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 zone default found 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 4 Realm: () 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 zonegroup default 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 started sync module instance, tier type = 2024-09-14T11:35:16.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.316+0000 7fa99d20f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=0 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=1 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=2 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=3 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=4 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=5 2024-09-14T11:35:16.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.326+0000 7fa99d20f800 20 add_watcher() i=6 2024-09-14T11:35:16.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.327+0000 7fa99d20f800 20 add_watcher() i=7 2024-09-14T11:35:16.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.327+0000 7fa99d20f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:16.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.328+0000 7fa84f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.328+0000 7fa99d20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.328+0000 7fa99d20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.328+0000 7fa99d20f800 5 note: GC not initialized 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa84e7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa99d20f800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa99d20f800 20 Filter name: none 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa847fff640 20 reqs_thread_entry: start 2024-09-14T11:35:16.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.329+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.330+0000 7fa99d20f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.332+0000 7fa84f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.334+0000 7fa99d20f800 20 remove_watcher() i=0 2024-09-14T11:35:16.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.334+0000 7fa99d20f800 2 removed watcher, disabling cache 2024-09-14T11:35:16.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.336+0000 7fa99d20f800 20 remove_watcher() i=1 2024-09-14T11:35:16.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.337+0000 7fa99d20f800 20 remove_watcher() i=2 2024-09-14T11:35:16.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.338+0000 7fa99d20f800 20 remove_watcher() i=3 2024-09-14T11:35:16.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.340+0000 7fa99d20f800 20 remove_watcher() i=4 2024-09-14T11:35:16.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.341+0000 7fa99d20f800 20 remove_watcher() i=5 2024-09-14T11:35:16.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.341+0000 7fa99d20f800 20 remove_watcher() i=6 2024-09-14T11:35:16.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.342+0000 7fa99d20f800 20 remove_watcher() i=7 2024-09-14T11:35:16.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:16.350 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:16.350 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:16.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:16.352 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.352 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.355 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.355 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.398 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.398 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.429 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:35:16.429 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.431 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.443 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.443 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.486 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.486 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.493 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.494 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.501 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.501 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.509 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.509 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.517 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.517 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.525 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.525 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.533 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.533 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.540 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.540 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.548 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.555 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.555 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.562 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.563 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.570 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.570 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.578 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.578 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.585 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.585 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.593 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.593 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.600 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.600 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.609 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.609 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.616 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.616 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.624 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.624 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.632 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:16.632 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:16.640 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:35:16.668 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:16.668 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:16.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.705+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 realm 2024-09-14T11:35:16.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.707+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.708+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.708+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.708+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:16.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.708+0000 7f3d59f28800 20 searching for the correct realm 2024-09-14T11:35:16.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.711+0000 7f3d4ffff640 0 -- 172.21.15.94:0/1673660267 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f3d4807bc20 msgr2=0x7f3d480633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:16.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.714+0000 7f3d55cd6640 0 -- 172.21.15.94:0/1673660267 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f3d40091400 msgr2=0x7f3d40091880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:16.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:16.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:16.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:16.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.920+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:16.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:16.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 zone default found 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 4 Realm: () 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 zonegroup default 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.921+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 started sync module instance, tier type = 2024-09-14T11:35:16.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.922+0000 7f3d59f28800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=0 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=1 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=2 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=3 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=4 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=5 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.932+0000 7f3d59f28800 20 add_watcher() i=6 2024-09-14T11:35:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.933+0000 7f3d59f28800 20 add_watcher() i=7 2024-09-14T11:35:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.933+0000 7f3d59f28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3d59f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3d59f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3d59f28800 5 note: GC not initialized 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3c067fc640 20 reqs_thread_entry: start 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3d59f28800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.935+0000 7f3d59f28800 20 Filter name: none 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.936+0000 7f3b77fff640 20 reqs_thread_entry: start 2024-09-14T11:35:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.936+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.936+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:16.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.936+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.937+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:16.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.937+0000 7f3d59f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.937+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.937+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:16.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.937+0000 7f3d59f28800 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.938+0000 7f3d59f28800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:16.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.938+0000 7f3d59f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.939+0000 7f3c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.942+0000 7f3d59f28800 20 remove_watcher() i=0 2024-09-14T11:35:16.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.942+0000 7f3d59f28800 2 removed watcher, disabling cache 2024-09-14T11:35:16.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.944+0000 7f3d59f28800 20 remove_watcher() i=1 2024-09-14T11:35:16.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.945+0000 7f3d59f28800 20 remove_watcher() i=2 2024-09-14T11:35:16.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.945+0000 7f3d59f28800 20 remove_watcher() i=3 2024-09-14T11:35:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.947+0000 7f3d59f28800 20 remove_watcher() i=4 2024-09-14T11:35:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.948+0000 7f3d59f28800 20 remove_watcher() i=5 2024-09-14T11:35:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.949+0000 7f3d59f28800 20 remove_watcher() i=6 2024-09-14T11:35:16.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:16.950+0000 7f3d59f28800 20 remove_watcher() i=7 2024-09-14T11:35:16.958 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:16.959 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:16.960 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:35:16.994 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:16.994 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:17.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.032+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 realm 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:17.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.035+0000 7f09f1abb800 20 searching for the correct realm 2024-09-14T11:35:17.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.037+0000 7f09ef5a5640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f09e8061040 msgr2=0x7f09e80b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.242+0000 7f09efda6640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f09e40275c0 msgr2=0x7f09e4027a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:17.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zone default found 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Realm: () 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zonegroup default 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started sync module instance, tier type = 2024-09-14T11:35:17.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=0 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=1 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=2 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=3 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=4 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=5 2024-09-14T11:35:17.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=6 2024-09-14T11:35:17.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.259+0000 7f09f1abb800 20 add_watcher() i=7 2024-09-14T11:35:17.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.259+0000 7f09f1abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:17.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f08a57ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:17.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:17.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f09f1abb800 5 note: GC not initialized 2024-09-14T11:35:17.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f081ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:17.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.261+0000 7f09f1abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:17.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 20 Filter name: none 2024-09-14T11:35:17.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f081dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:17.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:35:17.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : miss 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.263+0000 7f09f1abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f09f1abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f09f1abb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94009013187264 notifier 7497 bl.length()=995 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:17.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:17.274 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09f1abb800 time 2024-09-14T11:35:17.277219+0000 2024-09-14T11:35:17.274 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f09f4f8c76a] 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09f1abb800 time 2024-09-14T11:35:17.277219+0000 2024-09-14T11:35:17.275 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f09f4f8c76a] 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:17.276 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f09f1abb800 thread_name:radosgw-admin 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f09f3c3e6f0] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f09f3c8b99c] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f09f4f8c7c4] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.294 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f09f1abb800 thread_name:radosgw-admin 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f09f3c3e6f0] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f09f3c8b99c] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f09f4f8c7c4] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.295 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: secure 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: crc 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: secure 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:35:17.017+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:35:17.017+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key hook 0x55802dc6c5f8 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.296 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802db19c40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802db1a020 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dbb2670 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.508922s 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802db19c40 auth_method 0 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802db1a020 auth_method 0 2024-09-14T11:35:17.297 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dbb2670 auth_method 0 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-14T11:35:17.298 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 1 monclient: found mon.noname-c 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: dump: 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.299 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: dump: 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.300 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:35:17.018+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7103 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:35:17.018+0000 7f08dd60a640 4 set_mon_vals no callback set 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:35:17.018+0000 7f09f1abb800 1 librados: init done 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.301 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:35:17.020+0000 7f09eeda4640 10 monclient: get_auth_request con 0x7f08d4077230 auth_method 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:35:17.021+0000 7f09efda6640 10 monclient: get_auth_request con 0x55802dc94ab0 auth_method 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:35:17.021+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dcb7b00 auth_method 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:35:17.023+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dcbd090 auth_method 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:35:17.023+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:35:17.023+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:35:17.023+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.303 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command objecter_requests cmddesc objecter_requests hook 0x55802dcc4400 EEXIST 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.304 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x55802dcbff70 EEXIST 2024-09-14T11:35:17.305 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dce8720 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dce8b00 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dce7430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.515895s 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dce7430 auth_method 0 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.306 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dce8b00 auth_method 0 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dce8720 auth_method 0 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.307 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7491 payload 824 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:35:17.025+0000 7f09efda6640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: dump: 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.308 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: dump: 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.309 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:35:17.025+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7491 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:35:17.025+0000 7f09f05a7640 4 set_mon_vals no callback set 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.310 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:35:17.027+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f08c8077140 auth_method 0 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: get_monmap_and_config 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:35:17.027+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.312 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.313 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x7ffd5d5e53d8 EEXIST 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dd3cbb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.314 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dd2d500 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dd37fe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.519725s 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.315 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:35:17.029+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:35:17.029+0000 7f09efda6640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.316 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:35:17.029+0000 7f09efda6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: dump: 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.317 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:35:17.029+0000 7f09f1abb800 4 set_mon_vals no callback set 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: dump: 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: shutdown 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:35:17.029+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.320 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: starting msgr at 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: starting objecter 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command objecter_requests cmddesc objecter_requests hook 0x55802dce6b60 EEXIST 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: setting wanted keys 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: calling monclient init 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.321 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.322 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x55802dcfd128 EEXIST 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dd2d500 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dd37fe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dd3cbb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.521837s 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.323 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:35:17.030+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.324 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: dump: 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.326 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.b con 0x55802dd37fe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.c con 0x55802dd3cbb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.a con 0x7f08b8007560 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x7f08b8007560 auth_method 0 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.327 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7497 payload 293 2024-09-14T11:35:17.328 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:35:17.031+0000 7f09efda6640 1 monclient: found mon.a 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:35:17.031+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7497 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:35:17.031+0000 7f09f1abb800 1 librados: init done 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:35:17.031+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cr dump hook 0x55802dd33ce8 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.329 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: dump: 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:35:17.032+0000 7f08d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:35:17.032+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.330 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:35:17.033+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:35:17.034+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dd50490 auth_method 0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 realm 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:35:17.034+0000 7f09f1abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:35:17.035+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dd54770 auth_method 0 2024-09-14T11:35:17.331 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 searching for the correct realm 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:35:17.036+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dd599a0 auth_method 0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:35:17.036+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f09e40275c0 auth_method 0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:35:17.037+0000 7f09ef5a5640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f09e8061040 msgr2=0x7f09e80b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:35:17.238+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e8061040 auth_method 0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:35:17.239+0000 7f09eeda4640 10 monclient: get_auth_request con 0x7f09e0050040 auth_method 0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:35:17.241+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f09e4046430 auth_method 0 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:35:17.242+0000 7f09efda6640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f09e40275c0 msgr2=0x7f09e4027a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:35:17.242+0000 7f08d17fa640 1 client.7497.objecter ms_handle_reset 0x7f09e40275c0 session 0x7f09e4028e40 osd.7 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:35:17.242+0000 7f08d17fa640 10 monclient: _renew_subs 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:35:17.242+0000 7f08d17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:35:17.242+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f08b808f3b0 auth_method 0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:35:17.243+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e4035430 auth_method 0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:17.333 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zone default found 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Realm: () 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:35:17.248+0000 7f09f1abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zonegroup default 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started sync module instance, tier type = 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=0 2024-09-14T11:35:17.334 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=1 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=2 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=3 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=4 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=5 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=6 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:35:17.258+0000 7f08d17fa640 1 client.7497.objecter ms_handle_reset 0x7f09e4035430 session 0x7f09e4046df0 osd.0 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:35:17.258+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e40275c0 auth_method 0 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:35:17.259+0000 7f09f1abb800 20 add_watcher() i=7 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:35:17.259+0000 7f09f1abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.335 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:35:17.261+0000 7f08a57ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:35:17.261+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache list hook 0x55802dd31ac0 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache inspect hook 0x55802dd31ac0 2024-09-14T11:35:17.336 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache erase hook 0x55802dd31ac0 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache zap hook 0x55802dd31ac0 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 note: GC not initialized 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:35:17.261+0000 7f081ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace show hook 0x7f09e8064030 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace history hook 0x7f09e8064030 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace active hook 0x7f09e8064030 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace active_short hook 0x7f09e8064030 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 Filter name: none 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:35:17.262+0000 7f081dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:35:17.337 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : miss 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:35:17.263+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94009013187264 notifier 7497 bl.length()=995 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09f1abb800 time 2024-09-14T11:35:17.277219+0000 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f09f4f8c76a] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:35:17.339 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f09f1abb800 thread_name:radosgw-admin 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f09f3c3e6f0] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f09f3c8b99c] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f09f4f8c7c4] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:35:17.340 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:35:17.341 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:35:17.342 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:17.343 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:35:17.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:17.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:17.346 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f081dffb640 / http_manager 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f081ffff640 / http_manager 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08a57ea640 / rgw_dt_lg_renew 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d17fa640 / ms_dispatch 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d2ffd640 / io_context_pool 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d9602640 / ms_dispatch 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08dbe07640 / ms_dispatch 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08dd60a640 / io_context_pool 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09eeda4640 / msgr-worker-2 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09ef5a5640 / msgr-worker-1 2024-09-14T11:35:17.347 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09efda6640 / msgr-worker-0 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09f05a7640 / io_context_pool 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09f1abb800 / radosgw-admin 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.128293.log 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: secure 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: crc 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 AuthRegistry(0x55802dc6c4b0) adding con mode: secure 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:35:17.017+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:35:17.017+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:35:17.017+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key hook 0x55802dc6c5f8 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:17.348 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802db19c40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802db1a020 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dbb2670 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:35:17.017+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.508922s 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802db19c40 auth_method 0 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802db1a020 auth_method 0 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.349 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:35:17.018+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dbb2670 auth_method 0 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:35:17.018+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 1 monclient: found mon.noname-c 2024-09-14T11:35:17.350 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:35:17.018+0000 7f09ef5a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: dump: 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:35:17.018+0000 7f08dbe07640 10 monclient: dump: 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.352 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:35:17.018+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7103 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:35:17.018+0000 7f08dd60a640 4 set_mon_vals no callback set 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:35:17.018+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:35:17.018+0000 7f09f1abb800 1 librados: init done 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:35:17.020+0000 7f08dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:35:17.020+0000 7f09eeda4640 10 monclient: get_auth_request con 0x7f08d4077230 auth_method 0 2024-09-14T11:35:17.353 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:35:17.021+0000 7f09efda6640 10 monclient: get_auth_request con 0x55802dc94ab0 auth_method 0 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:35:17.021+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dcb7b00 auth_method 0 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:35:17.023+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dcbd090 auth_method 0 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:35:17.023+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:35:17.023+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:35:17.023+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.354 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding auth protocol: cephx 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.355 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: crc 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:35:17.023+0000 7f09f1abb800 5 AuthRegistry(0x55802dcc0e90) adding con mode: secure 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command objecter_requests cmddesc objecter_requests hook 0x55802dcc4400 EEXIST 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding auth protocol: cephx 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.356 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: crc 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 AuthRegistry(0x55802dcbfe28) adding con mode: secure 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:35:17.024+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:35:17.024+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x55802dcbff70 EEXIST 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dce8720 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dce8b00 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dce7430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.357 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:35:17.024+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.515895s 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dce7430 auth_method 0 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dce8b00 auth_method 0 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dce8720 auth_method 0 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.358 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:35:17.025+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:35:17.025+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7491 payload 824 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:35:17.025+0000 7f09efda6640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:35:17.025+0000 7f09efda6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.359 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: dump: 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.360 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:35:17.025+0000 7f08d9602640 10 monclient: dump: 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:35:17.025+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7491 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.361 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:35:17.025+0000 7f09f05a7640 4 set_mon_vals no callback set 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:35:17.025+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:35:17.027+0000 7f08d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:35:17.027+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f08c8077140 auth_method 0 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: get_monmap_and_config 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:35:17.027+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:35:17.027+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.362 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding auth protocol: cephx 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.363 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: crc 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:35:17.027+0000 7f09f1abb800 5 AuthRegistry(0x55802dd08590) adding con mode: secure 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding auth protocol: cephx 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.364 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: crc 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5290) adding con mode: secure 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:35:17.028+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:35:17.028+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x7ffd5d5e53d8 EEXIST 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dd3cbb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.365 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dd2d500 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dd37fe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:35:17.028+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.519725s 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.366 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:35:17.028+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:35:17.028+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:35:17.028+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:35:17.029+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:35:17.029+0000 7f09efda6640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.367 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:35:17.029+0000 7f09efda6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: dump: 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.368 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:35:17.029+0000 7f09f1abb800 4 set_mon_vals no callback set 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:35:17.029+0000 7f08d2ffd640 10 monclient: dump: 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.369 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: shutdown 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: build_initial_monmap 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:35:17.029+0000 7f09f1abb800 1 build_initial for_mkfs: 0 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:35:17.029+0000 7f09f1abb800 10 monclient: monmap: 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:17.370 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding auth protocol: cephx 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: crc 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:35:17.029+0000 7f09f1abb800 5 AuthRegistry(0x55802dd2d9d0) adding con mode: secure 2024-09-14T11:35:17.371 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: starting msgr at 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: starting objecter 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command objecter_requests cmddesc objecter_requests hook 0x55802dce6b60 EEXIST 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: setting wanted keys 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:35:17.030+0000 7f09f1abb800 1 librados: calling monclient init 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: init 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding auth protocol: cephx 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.372 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: crc 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 AuthRegistry(0x55802dcfcfe0) adding con mode: secure 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:35:17.030+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:35:17.030+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command rotate-key cmddesc rotate-key hook 0x55802dcfd128 EEXIST 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-a con 0x55802dd2d500 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-b con 0x55802dd37fe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): picked mon.noname-c con 0x55802dd3cbb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.373 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:35:17.030+0000 7f09f1abb800 10 monclient(hunting): authenticate will time out at 2030.521837s 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:35:17.030+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.374 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:35:17.030+0000 7f09efda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:35:17.030+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 1 monclient: found mon.noname-a 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.375 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: dump: 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.376 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _reopen_session rank -1 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.b con 0x55802dd37fe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.c con 0x55802dd3cbb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): picked mon.a con 0x7f08b8007560 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:35:17.031+0000 7f08d17fa640 10 monclient(hunting): _renew_subs 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): get_auth_request con 0x7f08b8007560 auth_method 0 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request con 0x55802dd3cbb0 auth_method 0 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.377 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request con 0x55802dd37fe0 auth_method 0 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:35:17.031+0000 7f09eeda4640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:17.378 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:35:17.031+0000 7f09ef5a5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient(hunting): handle_auth_done global_id 7497 payload 293 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _finish_hunting 0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:35:17.031+0000 7f09efda6640 1 monclient: found mon.a 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _finish_auth 0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:35:17.031+0000 7f09efda6640 10 monclient: _check_auth_tickets 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:35:17.031+0000 7f09f1abb800 5 monclient: authenticate success, global_id 7497 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _renew_subs 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:35:17.031+0000 7f09f1abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:35:17.031+0000 7f09f1abb800 1 librados: init done 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:35:17.031+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cr dump hook 0x55802dd33ce8 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:17.379 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: dump: 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:35:17.032+0000 7f08d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:35:17.032+0000 7f08d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:35:17.032+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.380 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:35:17.033+0000 7f08d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:35:17.033+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dd2d500 auth_method 0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:35:17.034+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dd50490 auth_method 0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 realm 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:35:17.034+0000 7f09f1abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:35:17.034+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:35:17.035+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x55802dd54770 auth_method 0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:17.381 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:35:17.035+0000 7f09f1abb800 20 searching for the correct realm 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:35:17.036+0000 7f09eeda4640 10 monclient: get_auth_request con 0x55802dd599a0 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:35:17.036+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f09e40275c0 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:35:17.037+0000 7f09ef5a5640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f09e8061040 msgr2=0x7f09e80b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:35:17.238+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e8061040 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:35:17.239+0000 7f09eeda4640 10 monclient: get_auth_request con 0x7f09e0050040 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:35:17.241+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f09e4046430 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:35:17.242+0000 7f09efda6640 0 -- 172.21.15.94:0/1477567647 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f09e40275c0 msgr2=0x7f09e4027a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:35:17.242+0000 7f08d17fa640 1 client.7497.objecter ms_handle_reset 0x7f09e40275c0 session 0x7f09e4028e40 osd.7 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:35:17.242+0000 7f08d17fa640 10 monclient: _renew_subs 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:35:17.242+0000 7f08d17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:35:17.242+0000 7f09efda6640 10 monclient: get_auth_request con 0x7f08b808f3b0 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:35:17.243+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e4035430 auth_method 0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:17.382 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:35:17.247+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zone default found 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Realm: () 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:17.383 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:35:17.248+0000 7f09f1abb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:35:17.248+0000 7f09f1abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 zonegroup default 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:35:17.248+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started sync module instance, tier type = 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:35:17.249+0000 7f09f1abb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=0 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=1 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=2 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=3 2024-09-14T11:35:17.384 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=4 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=5 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:35:17.258+0000 7f09f1abb800 20 add_watcher() i=6 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:35:17.258+0000 7f08d17fa640 1 client.7497.objecter ms_handle_reset 0x7f09e4035430 session 0x7f09e4046df0 osd.0 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:35:17.258+0000 7f09ef5a5640 10 monclient: get_auth_request con 0x7f09e40275c0 auth_method 0 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:35:17.259+0000 7f09f1abb800 20 add_watcher() i=7 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:35:17.259+0000 7f09f1abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding auth protocol: cephx 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.385 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: crc 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 AuthRegistry(0x7ffd5d5e5770) adding con mode: secure 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:35:17.261+0000 7f08a57ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:35:17.261+0000 7f09f1abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache list hook 0x55802dd31ac0 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache inspect hook 0x55802dd31ac0 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache erase hook 0x55802dd31ac0 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command cache zap hook 0x55802dd31ac0 2024-09-14T11:35:17.386 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 note: GC not initialized 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:35:17.261+0000 7f081ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace show hook 0x7f09e8064030 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace history hook 0x7f09e8064030 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace active hook 0x7f09e8064030 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:35:17.261+0000 7f09f1abb800 5 asok(0x55802da4d270) register_command sync trace active_short hook 0x7f09e8064030 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:35:17.261+0000 7f09f1abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 Filter name: none 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:35:17.262+0000 7f081dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:35:17.262+0000 7f09f1abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : miss 2024-09-14T11:35:17.387 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:35:17.262+0000 7f09f1abb800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:35:17.263+0000 7f09f1abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:35:17.263+0000 7f09f1abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:35:17.268+0000 7f09f1abb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94009013187264 notifier 7497 bl.length()=995 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.388 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:35:17.268+0000 7f08d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:35:17.269+0000 7f09f1abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09f1abb800 time 2024-09-14T11:35:17.277219+0000 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f09f4f8c76a] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.389 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:35:17.277+0000 7f09f1abb800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f09f1abb800 thread_name:radosgw-admin 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f09f3c3e6f0] 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f09f3c8b99c] 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f09f4f8c7c4] 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f09f4f8c928] 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55802b4930b1] 2024-09-14T11:35:17.390 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55802b4a2f6a] 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f09f3c29590] 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:35:17.391 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:35:17.392 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:35:17.393 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:35:17.394 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:17.395 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:17.396 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 7f081dffb640 / http_manager 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 7f081ffff640 / http_manager 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08a57ea640 / rgw_dt_lg_renew 2024-09-14T11:35:17.397 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d17fa640 / ms_dispatch 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d2ffd640 / io_context_pool 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08d9602640 / ms_dispatch 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08dbe07640 / ms_dispatch 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f08dd60a640 / io_context_pool 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09eeda4640 / msgr-worker-2 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09ef5a5640 / msgr-worker-1 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09efda6640 / msgr-worker-0 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09f05a7640 / io_context_pool 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: 7f09f1abb800 / radosgw-admin 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:17.278610Z_e807ddee-b721-405c-a04e-d9679d5cd038/log 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:35:17.398 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:35:17.403 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:17.403 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:17.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.352+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.354+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.354+0000 7fd6db011800 20 realm 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.354+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.355+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.356+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:17.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.356+0000 7fd6db011800 20 searching for the correct realm 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.359+0000 7fd6cdf21640 0 -- 172.21.15.94:0/928313441 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5649d4a0d220 msgr2=0x5649d4a0f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.362+0000 7fd6d6722640 0 -- 172.21.15.94:0/928313441 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd6c00e5430 msgr2=0x7fd6c00c2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 zone default found 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 4 Realm: () 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 zonegroup default 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.366+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 started sync module instance, tier type = 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.367+0000 7fd6db011800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:17.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=0 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=1 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=2 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=3 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=4 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=5 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.375+0000 7fd6db011800 20 add_watcher() i=6 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.376+0000 7fd6db011800 20 add_watcher() i=7 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.376+0000 7fd6db011800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd58cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd6db011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd6db011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd6db011800 5 note: GC not initialized 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd5077fe640 20 reqs_thread_entry: start 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.378+0000 7fd6db011800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.379+0000 7fd6db011800 20 Filter name: none 2024-09-14T11:35:17.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.379+0000 7fd5057fa640 20 reqs_thread_entry: start 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.379+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.379+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.379+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.380+0000 7fd6db011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.382+0000 7fd58cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.384+0000 7fd6db011800 20 remove_watcher() i=0 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.384+0000 7fd6db011800 2 removed watcher, disabling cache 2024-09-14T11:35:17.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.385+0000 7fd6db011800 20 remove_watcher() i=1 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.386+0000 7fd6db011800 20 remove_watcher() i=2 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.387+0000 7fd6db011800 20 remove_watcher() i=3 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.387+0000 7fd6db011800 20 remove_watcher() i=4 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.388+0000 7fd6db011800 20 remove_watcher() i=5 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.389+0000 7fd6db011800 20 remove_watcher() i=6 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.390+0000 7fd6db011800 20 remove_watcher() i=7 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:17.409 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:17.410 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:17.410 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:17.452 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:17.483 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:17.483 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:17.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.522+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 realm 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.523+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.524+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.524+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.525+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:17.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.525+0000 7fd86cf23800 20 searching for the correct realm 2024-09-14T11:35:17.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.527+0000 7fd86040b640 0 -- 172.21.15.94:0/1433207895 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fd8580c3730 msgr2=0x7fd8580a4570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.733+0000 7fd868c0c640 0 -- 172.21.15.94:0/1433207895 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd850051440 msgr2=0x7fd8500518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:17.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:17.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.940+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 zone default found 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 4 Realm: () 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:17.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 zonegroup default 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 started sync module instance, tier type = 2024-09-14T11:35:17.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.941+0000 7fd86cf23800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=0 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=1 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=2 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=3 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=4 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=5 2024-09-14T11:35:17.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.950+0000 7fd86cf23800 20 add_watcher() i=6 2024-09-14T11:35:17.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.951+0000 7fd86cf23800 20 add_watcher() i=7 2024-09-14T11:35:17.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.951+0000 7fd86cf23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:17.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.952+0000 7fd71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.952+0000 7fd86cf23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:17.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.952+0000 7fd86cf23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:17.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 5 note: GC not initialized 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd71dfe3640 20 reqs_thread_entry: start 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 20 Filter name: none 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd68f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:35:17.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:17.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:35:17.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.953+0000 7fd86cf23800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:35:17.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : miss 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 20 rados->read ofs=0 len=0 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.954+0000 7fd86cf23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.955+0000 7fd86cf23800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to be held by another RGW process; skipping for now 2024-09-14T11:35:17.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.956+0000 7fd71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:17.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.958+0000 7fd86cf23800 20 remove_watcher() i=0 2024-09-14T11:35:17.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.958+0000 7fd86cf23800 2 removed watcher, disabling cache 2024-09-14T11:35:17.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.959+0000 7fd86cf23800 20 remove_watcher() i=1 2024-09-14T11:35:17.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.960+0000 7fd86cf23800 20 remove_watcher() i=2 2024-09-14T11:35:17.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.961+0000 7fd86cf23800 20 remove_watcher() i=3 2024-09-14T11:35:17.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.962+0000 7fd86cf23800 20 remove_watcher() i=4 2024-09-14T11:35:17.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.963+0000 7fd86cf23800 20 remove_watcher() i=5 2024-09-14T11:35:17.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.964+0000 7fd86cf23800 20 remove_watcher() i=6 2024-09-14T11:35:17.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:17.965+0000 7fd86cf23800 20 remove_watcher() i=7 2024-09-14T11:35:17.973 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:35:47.997 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:48.032 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:48.032 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:48.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.076+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.077+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.077+0000 7f2066740800 20 realm 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.077+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.077+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.077+0000 7f2066740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.078+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.078+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.078+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.079+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.079+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.079+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:48.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.079+0000 7f2066740800 20 searching for the correct realm 2024-09-14T11:35:48.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.082+0000 7f2061cbf640 0 -- 172.21.15.94:0/1714983948 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f2054041040 msgr2=0x7f2054032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.086+0000 7f20624c0640 0 -- 172.21.15.94:0/1714983948 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f205806a5a0 msgr2=0x7f205807b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.293+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 zone default found 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 4 Realm: () 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 zonegroup default 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.294+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 started sync module instance, tier type = 2024-09-14T11:35:48.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.295+0000 7f2066740800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=0 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=1 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=2 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=3 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=4 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=5 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.306+0000 7f2066740800 20 add_watcher() i=6 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.307+0000 7f2066740800 20 add_watcher() i=7 2024-09-14T11:35:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.307+0000 7f2066740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:48.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f1f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f2066740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f2066740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:48.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f2066740800 5 note: GC not initialized 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f1e937fe640 20 reqs_thread_entry: start 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f2066740800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.310+0000 7f2066740800 20 Filter name: none 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f1e917fa640 20 reqs_thread_entry: start 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:35:48.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:35:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:35:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : miss 2024-09-14T11:35:48.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.311+0000 7f2066740800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.312+0000 7f2066740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:48.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.313+0000 7f2066740800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f2066740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f2066740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f2066740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f2066740800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f1f457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94301001352640 notifier 7551 bl.length()=995 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f1f457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f1f457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.323+0000 7f1f457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.324+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.324+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.324+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.324+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.0 2024-09-14T11:35:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.0 2024-09-14T11:35:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.1 2024-09-14T11:35:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.1 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.2 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.2 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.3 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.3 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.4 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.4 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.5 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.5 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.6 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.6 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.7 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.7 2024-09-14T11:35:48.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.8 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.8 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.9 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.9 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.10 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.10 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.11 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2.11 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.0 2024-09-14T11:35:48.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.332+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.1 2024-09-14T11:35:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.333+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2 2024-09-14T11:35:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.333+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.3 2024-09-14T11:35:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.334+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.4 2024-09-14T11:35:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.335+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.5 2024-09-14T11:35:48.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.335+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.6 2024-09-14T11:35:48.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.336+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.7 2024-09-14T11:35:48.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.336+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.8 2024-09-14T11:35:48.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.337+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.9 2024-09-14T11:35:48.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.338+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.10 2024-09-14T11:35:48.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.341+0000 7f2066740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:48.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.341+0000 7f2066740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.342+0000 7f2066740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.342+0000 7f2066740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.342+0000 7f2066740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.342+0000 7f2066740800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f1f45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94301001352640 notifier 7551 bl.length()=995 2024-09-14T11:35:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f1f45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f1f45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f1f45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.343+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:48.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.347+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.0 2024-09-14T11:35:48.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.347+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.1 2024-09-14T11:35:48.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.348+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.2 2024-09-14T11:35:48.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.348+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.3 2024-09-14T11:35:48.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.348+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.4 2024-09-14T11:35:48.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.349+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.5 2024-09-14T11:35:48.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.349+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.6 2024-09-14T11:35:48.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.350+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.7 2024-09-14T11:35:48.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.350+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.8 2024-09-14T11:35:48.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.351+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.9 2024-09-14T11:35:48.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.351+0000 7f2066740800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35.10 2024-09-14T11:35:48.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.352+0000 7f2066740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:48.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.352+0000 7f2066740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 2024-09-14T11:35:48.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f2066740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f2066740800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f2066740800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f2066740800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35, ofs0, ns] 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f1f457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94301001352640 notifier 7551 bl.length()=963 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f1f457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 info.flags=0x17 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f1f457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 to cache LRU end 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.353+0000 7f1f457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.354+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_sources= new_sources= 2024-09-14T11:35:48.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.354+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential sources added=[] removed=[] 2024-09-14T11:35:48.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.354+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): orig_dests= new_dests= 2024-09-14T11:35:48.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.354+0000 7f2066740800 20 handle_bi_update(): bucket=:abort-at-do-reshard[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35]): potential dests added=[] removed=[] 2024-09-14T11:35:48.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.358+0000 7f2066740800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:48.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.361+0000 7f1f18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.364+0000 7f2066740800 20 remove_watcher() i=0 2024-09-14T11:35:48.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.364+0000 7f2066740800 2 removed watcher, disabling cache 2024-09-14T11:35:48.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.365+0000 7f2066740800 20 remove_watcher() i=1 2024-09-14T11:35:48.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.366+0000 7f2066740800 20 remove_watcher() i=2 2024-09-14T11:35:48.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.367+0000 7f2066740800 20 remove_watcher() i=3 2024-09-14T11:35:48.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.368+0000 7f2066740800 20 remove_watcher() i=4 2024-09-14T11:35:48.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.369+0000 7f2066740800 20 remove_watcher() i=5 2024-09-14T11:35:48.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.370+0000 7f2066740800 20 remove_watcher() i=6 2024-09-14T11:35:48.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.371+0000 7f2066740800 20 remove_watcher() i=7 2024-09-14T11:35:48.382 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:35:48.411 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:48.411 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:48.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.449+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.451+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.451+0000 7fbce6328800 20 realm 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.451+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.452+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.452+0000 7fbce6328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.452+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.452+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.452+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.453+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.453+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.453+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:48.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.453+0000 7fbce6328800 20 searching for the correct realm 2024-09-14T11:35:48.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.456+0000 7fbcd975c640 0 -- 172.21.15.94:0/1848400153 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55aaa0164820 msgr2=0x55aaa0166c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:48.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.460+0000 7fbce1f5d640 0 -- 172.21.15.94:0/1848400153 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbccc0cc0e0 msgr2=0x7fbccc0b8ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:48.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.464+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 zone default found 2024-09-14T11:35:48.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 4 Realm: () 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 zonegroup default 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.465+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.466+0000 7fbce6328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.466+0000 7fbce6328800 20 started sync module instance, tier type = 2024-09-14T11:35:48.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.466+0000 7fbce6328800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:48.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=0 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=1 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=2 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=3 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=4 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=5 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.474+0000 7fbce6328800 20 add_watcher() i=6 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.475+0000 7fbce6328800 20 add_watcher() i=7 2024-09-14T11:35:48.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.475+0000 7fbce6328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:48.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbb937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbce6328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbce6328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbce6328800 5 note: GC not initialized 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbb927fc640 20 reqs_thread_entry: start 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbce6328800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbce6328800 20 Filter name: none 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.477+0000 7fbb03fff640 20 reqs_thread_entry: start 2024-09-14T11:35:48.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:48.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.478+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.479+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.479+0000 7fbce6328800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.479+0000 7fbce6328800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:35:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.479+0000 7fbce6328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:48.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.481+0000 7fbb937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.483+0000 7fbce6328800 20 remove_watcher() i=0 2024-09-14T11:35:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.483+0000 7fbce6328800 2 removed watcher, disabling cache 2024-09-14T11:35:48.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.484+0000 7fbce6328800 20 remove_watcher() i=1 2024-09-14T11:35:48.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.485+0000 7fbce6328800 20 remove_watcher() i=2 2024-09-14T11:35:48.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.486+0000 7fbce6328800 20 remove_watcher() i=3 2024-09-14T11:35:48.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.487+0000 7fbce6328800 20 remove_watcher() i=4 2024-09-14T11:35:48.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.488+0000 7fbce6328800 20 remove_watcher() i=5 2024-09-14T11:35:48.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.489+0000 7fbce6328800 20 remove_watcher() i=6 2024-09-14T11:35:48.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.490+0000 7fbce6328800 20 remove_watcher() i=7 2024-09-14T11:35:48.498 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:48.498 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:48.498 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:48.498 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:48.500 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.500 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.504 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.504 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.546 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.547 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.575 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:35:48.575 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:48.576 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.576 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.587 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.587 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.630 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.630 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.638 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.638 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.646 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.646 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.654 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.654 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.661 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.670 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.670 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.677 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.677 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.685 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.685 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.693 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.693 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.701 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.701 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.709 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.709 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.717 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.717 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.726 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.726 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.733 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.733 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.741 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.741 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.749 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.749 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.757 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.757 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.764 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.764 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.773 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.773 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.780 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:48.781 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:48.789 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:35:48.816 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:48.817 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:48.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.856+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 20 realm 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.858+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.859+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.859+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.859+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.859+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.860+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:48.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.860+0000 7f9f84346800 20 searching for the correct realm 2024-09-14T11:35:48.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.863+0000 7f9f82638640 0 -- 172.21.15.94:0/2456973704 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f9f6c02d070 msgr2=0x7f9f6c0a57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.866+0000 7f9f81e37640 0 -- 172.21.15.94:0/2456973704 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f9f6c0a57f0 msgr2=0x7f9f6c008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:48.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:48.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.870+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 zone default found 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 4 Realm: () 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:48.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 zonegroup default 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.871+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.872+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.872+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.872+0000 7f9f84346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.872+0000 7f9f84346800 20 started sync module instance, tier type = 2024-09-14T11:35:48.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.872+0000 7f9f84346800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=0 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=1 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=2 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=3 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=4 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=5 2024-09-14T11:35:48.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.880+0000 7f9f84346800 20 add_watcher() i=6 2024-09-14T11:35:48.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.881+0000 7f9f84346800 20 add_watcher() i=7 2024-09-14T11:35:48.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.881+0000 7f9f84346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:48.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.882+0000 7f9e337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.882+0000 7f9f84346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:48.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.882+0000 7f9f84346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:48.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.882+0000 7f9f84346800 5 note: GC not initialized 2024-09-14T11:35:48.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.883+0000 7f9e327fc640 20 reqs_thread_entry: start 2024-09-14T11:35:48.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.883+0000 7f9f84346800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:48.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.883+0000 7f9f84346800 20 Filter name: none 2024-09-14T11:35:48.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.883+0000 7f9da3fff640 20 reqs_thread_entry: start 2024-09-14T11:35:48.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.883+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.884+0000 7f9f84346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.885+0000 7f9f84346800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:48.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.885+0000 7f9f84346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:48.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.886+0000 7f9e337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.888+0000 7f9f84346800 20 remove_watcher() i=0 2024-09-14T11:35:48.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.888+0000 7f9f84346800 2 removed watcher, disabling cache 2024-09-14T11:35:48.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.889+0000 7f9f84346800 20 remove_watcher() i=1 2024-09-14T11:35:48.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.890+0000 7f9f84346800 20 remove_watcher() i=2 2024-09-14T11:35:48.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.891+0000 7f9f84346800 20 remove_watcher() i=3 2024-09-14T11:35:48.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.892+0000 7f9f84346800 20 remove_watcher() i=4 2024-09-14T11:35:48.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.893+0000 7f9f84346800 20 remove_watcher() i=5 2024-09-14T11:35:48.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.894+0000 7f9f84346800 20 remove_watcher() i=6 2024-09-14T11:35:48.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.895+0000 7f9f84346800 20 remove_watcher() i=7 2024-09-14T11:35:48.903 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:48.903 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:48.903 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:48.903 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:48.904 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:35:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:48.938 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:48.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.976+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 realm 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:48.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.978+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.979+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.979+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.979+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:48.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.979+0000 7fdd87d46800 20 searching for the correct realm 2024-09-14T11:35:48.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.982+0000 7fdd7d02f640 0 -- 172.21.15.94:0/3418970197 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x56415cce0a80 msgr2=0x56415cce2f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.985+0000 7fdd85830640 0 -- 172.21.15.94:0/3418970197 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fdd700553d0 msgr2=0x7fdd700ab1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.989+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:48.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 zone default found 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 4 Realm: () 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 zonegroup default 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.990+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.991+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.991+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.991+0000 7fdd87d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.991+0000 7fdd87d46800 20 started sync module instance, tier type = 2024-09-14T11:35:48.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.991+0000 7fdd87d46800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=0 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=1 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=2 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=3 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=4 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=5 2024-09-14T11:35:48.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:48.999+0000 7fdd87d46800 20 add_watcher() i=6 2024-09-14T11:35:48.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.000+0000 7fdd87d46800 20 add_watcher() i=7 2024-09-14T11:35:48.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.000+0000 7fdd87d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:48.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.001+0000 7fdc377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:48.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.001+0000 7fdd87d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:49.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.001+0000 7fdd87d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:49.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdd87d46800 5 note: GC not initialized 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdc367fc640 20 reqs_thread_entry: start 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdd87d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdd87d46800 20 Filter name: none 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdba7fff640 20 reqs_thread_entry: start 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdd87d46800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:35:49.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.002+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 : miss 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.003+0000 7fdd87d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.008+0000 7fdd87d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.008+0000 7fdd87d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.008+0000 7fdd87d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.008+0000 7fdd87d46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36, ofs0, ns] 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdc697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94838729874672 notifier 7608 bl.length()=1007 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdc697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdc697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdc697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_sources= new_sources= 2024-09-14T11:35:49.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential sources added=[] removed=[] 2024-09-14T11:35:49.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_dests= new_dests= 2024-09-14T11:35:49.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.009+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential dests added=[] removed=[] 2024-09-14T11:35:49.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.011+0000 7fdd87d46800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:35:49.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.011+0000 7fdd87d46800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:35:49.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.016+0000 7fdd87d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:49.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.016+0000 7fdd87d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 2024-09-14T11:35:49.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdd87d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdd87d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdd87d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdd87d46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36, ofs0, ns] 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdc697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94838729874672 notifier 7608 bl.length()=975 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdc697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdc697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.017+0000 7fdc697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.018+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_sources= new_sources= 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.018+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential sources added=[] removed=[] 2024-09-14T11:35:49.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.018+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_dests= new_dests= 2024-09-14T11:35:49.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.018+0000 7fdd87d46800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential dests added=[] removed=[] 2024-09-14T11:35:49.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.020+0000 7fdc377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.021+0000 7fdd87d46800 20 remove_watcher() i=0 2024-09-14T11:35:49.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.021+0000 7fdd87d46800 2 removed watcher, disabling cache 2024-09-14T11:35:49.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.022+0000 7fdd87d46800 20 remove_watcher() i=1 2024-09-14T11:35:49.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.023+0000 7fdd87d46800 20 remove_watcher() i=2 2024-09-14T11:35:49.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.024+0000 7fdd87d46800 20 remove_watcher() i=3 2024-09-14T11:35:49.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.025+0000 7fdd87d46800 20 remove_watcher() i=4 2024-09-14T11:35:49.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.026+0000 7fdd87d46800 20 remove_watcher() i=5 2024-09-14T11:35:49.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.027+0000 7fdd87d46800 20 remove_watcher() i=6 2024-09-14T11:35:49.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.028+0000 7fdd87d46800 20 remove_watcher() i=7 2024-09-14T11:35:49.037 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:35:49.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:49.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:49.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.103+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 20 realm 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.105+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.106+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.106+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.106+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.106+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.107+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:49.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.107+0000 7ffb1973c800 20 searching for the correct realm 2024-09-14T11:35:49.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.110+0000 7ffb14c80640 0 -- 172.21.15.94:0/2831707046 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ffb080aec20 msgr2=0x7ffb08057ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.114+0000 7ffb15c82640 0 -- 172.21.15.94:0/2831707046 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7ffb0c06db50 msgr2=0x7ffb0c070db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 zone default found 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 4 Realm: () 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 zonegroup default 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.117+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 started sync module instance, tier type = 2024-09-14T11:35:49.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.118+0000 7ffb1973c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=0 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=1 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=2 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=3 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=4 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=5 2024-09-14T11:35:49.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.127+0000 7ffb1973c800 20 add_watcher() i=6 2024-09-14T11:35:49.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.128+0000 7ffb1973c800 20 add_watcher() i=7 2024-09-14T11:35:49.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.128+0000 7ffb1973c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.129+0000 7ff9cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.129+0000 7ffb1973c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.129+0000 7ffb1973c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.129+0000 7ffb1973c800 5 note: GC not initialized 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.130+0000 7ff9cafe5640 20 reqs_thread_entry: start 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.130+0000 7ffb1973c800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.130+0000 7ffb1973c800 20 Filter name: none 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.130+0000 7ff9c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:49.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.130+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:49.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.131+0000 7ffb1973c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.132+0000 7ffb1973c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.132+0000 7ffb1973c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:49.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.134+0000 7ff9cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.135+0000 7ffb1973c800 20 remove_watcher() i=0 2024-09-14T11:35:49.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.135+0000 7ffb1973c800 2 removed watcher, disabling cache 2024-09-14T11:35:49.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.136+0000 7ffb1973c800 20 remove_watcher() i=1 2024-09-14T11:35:49.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.137+0000 7ffb1973c800 20 remove_watcher() i=2 2024-09-14T11:35:49.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.138+0000 7ffb1973c800 20 remove_watcher() i=3 2024-09-14T11:35:49.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.139+0000 7ffb1973c800 20 remove_watcher() i=4 2024-09-14T11:35:49.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.140+0000 7ffb1973c800 20 remove_watcher() i=5 2024-09-14T11:35:49.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.141+0000 7ffb1973c800 20 remove_watcher() i=6 2024-09-14T11:35:49.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.142+0000 7ffb1973c800 20 remove_watcher() i=7 2024-09-14T11:35:49.150 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:49.151 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:49.151 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:49.151 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:49.152 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.152 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.160 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.160 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.203 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:49.234 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:49.234 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:49.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.272+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 realm 2024-09-14T11:35:49.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.274+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.275+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.275+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.275+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:49.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.275+0000 7fad19546800 20 searching for the correct realm 2024-09-14T11:35:49.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.278+0000 7fad16836640 0 -- 172.21.15.94:0/885958434 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5641ab665bd0 msgr2=0x5641ab668090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.281+0000 7fad17037640 0 -- 172.21.15.94:0/885958434 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fad0007d1e0 msgr2=0x7fad000899c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:49.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.285+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 zone default found 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 4 Realm: () 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 zonegroup default 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.286+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.287+0000 7fad19546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.287+0000 7fad19546800 20 started sync module instance, tier type = 2024-09-14T11:35:49.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.287+0000 7fad19546800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=0 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=1 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=2 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=3 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=4 2024-09-14T11:35:49.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=5 2024-09-14T11:35:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.295+0000 7fad19546800 20 add_watcher() i=6 2024-09-14T11:35:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.296+0000 7fad19546800 20 add_watcher() i=7 2024-09-14T11:35:49.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.296+0000 7fad19546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:49.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.297+0000 7fabcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.297+0000 7fad19546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.297+0000 7fad19546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.297+0000 7fad19546800 5 note: GC not initialized 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fabccfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 20 Filter name: none 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fab467fc640 20 reqs_thread_entry: start 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 : miss 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.298+0000 7fad19546800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.299+0000 7fad19546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 2024-09-14T11:35:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.303+0000 7fad19546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.303+0000 7fad19546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.303+0000 7fad19546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.303+0000 7fad19546800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36, ofs0, ns] 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fabfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94840048483136 notifier 7650 bl.length()=1007 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fabfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fabfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fabfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_sources= new_sources= 2024-09-14T11:35:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential sources added=[] removed=[] 2024-09-14T11:35:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_dests= new_dests= 2024-09-14T11:35:49.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.304+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential dests added=[] removed=[] 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.0 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.0 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.1 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.1 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.2 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.2 2024-09-14T11:35:49.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.3 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.3 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.4 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.4 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.5 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.5 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.6 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.6 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.7 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.7 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.8 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.8 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.9 2024-09-14T11:35:49.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.9 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.10 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.10 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.11 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1.11 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.0 2024-09-14T11:35:49.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.309+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.2 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.310+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.3 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.310+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.4 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.311+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.5 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.311+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.6 2024-09-14T11:35:49.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.312+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.7 2024-09-14T11:35:49.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.312+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.8 2024-09-14T11:35:49.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.313+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.9 2024-09-14T11:35:49.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.313+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.10 2024-09-14T11:35:49.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.316+0000 7fad19546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:49.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.316+0000 7fad19546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.317+0000 7fad19546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.317+0000 7fad19546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.317+0000 7fad19546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.317+0000 7fad19546800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36, ofs0, ns] 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fabfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94840048483136 notifier 7650 bl.length()=1007 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fabfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fabfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fabfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_sources= new_sources= 2024-09-14T11:35:49.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential sources added=[] removed=[] 2024-09-14T11:35:49.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_dests= new_dests= 2024-09-14T11:35:49.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.318+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential dests added=[] removed=[] 2024-09-14T11:35:49.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.320+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.0 2024-09-14T11:35:49.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.320+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.1 2024-09-14T11:35:49.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.321+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.2 2024-09-14T11:35:49.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.321+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.3 2024-09-14T11:35:49.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.321+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.4 2024-09-14T11:35:49.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.322+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.5 2024-09-14T11:35:49.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.322+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.6 2024-09-14T11:35:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.322+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.7 2024-09-14T11:35:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.323+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.8 2024-09-14T11:35:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.323+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.9 2024-09-14T11:35:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.323+0000 7fad19546800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36.10 2024-09-14T11:35:49.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.324+0000 7fad19546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:49.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.324+0000 7fad19546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.325+0000 7fad19546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.325+0000 7fad19546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.325+0000 7fad19546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.325+0000 7fad19546800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36, ofs0, ns] 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fabfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94840048483136 notifier 7650 bl.length()=975 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fabfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 info.flags=0x17 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fabfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 to cache LRU end 2024-09-14T11:35:49.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fabfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:49.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_sources= new_sources= 2024-09-14T11:35:49.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential sources added=[] removed=[] 2024-09-14T11:35:49.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): orig_dests= new_dests= 2024-09-14T11:35:49.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.326+0000 7fad19546800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36]): potential dests added=[] removed=[] 2024-09-14T11:35:49.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.328+0000 7fad19546800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:49.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.330+0000 7fabcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.332+0000 7fad19546800 20 remove_watcher() i=0 2024-09-14T11:35:49.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.332+0000 7fad19546800 2 removed watcher, disabling cache 2024-09-14T11:35:49.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.333+0000 7fad19546800 20 remove_watcher() i=1 2024-09-14T11:35:49.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.334+0000 7fad19546800 20 remove_watcher() i=2 2024-09-14T11:35:49.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.335+0000 7fad19546800 20 remove_watcher() i=3 2024-09-14T11:35:49.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.336+0000 7fad19546800 20 remove_watcher() i=4 2024-09-14T11:35:49.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.337+0000 7fad19546800 20 remove_watcher() i=5 2024-09-14T11:35:49.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.338+0000 7fad19546800 20 remove_watcher() i=6 2024-09-14T11:35:49.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.339+0000 7fad19546800 20 remove_watcher() i=7 2024-09-14T11:35:49.348 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:35:49.377 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:49.377 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:49.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.415+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 realm 2024-09-14T11:35:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:49.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.417+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.418+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.418+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.418+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.418+0000 7fd318d2a800 20 searching for the correct realm 2024-09-14T11:35:49.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.421+0000 7fd3152ae640 0 -- 172.21.15.94:0/3020788941 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fd2fc003930 msgr2=0x7fd2fc0a3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.425+0000 7fd314aad640 0 -- 172.21.15.94:0/3020788941 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd2fc090bc0 msgr2=0x7fd2fc088ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.631+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.632+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.632+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.632+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:49.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.632+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 zone default found 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 4 Realm: () 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 zonegroup default 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.633+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.634+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.634+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.634+0000 7fd318d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:49.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.634+0000 7fd318d2a800 20 started sync module instance, tier type = 2024-09-14T11:35:49.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.634+0000 7fd318d2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:49.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=0 2024-09-14T11:35:49.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=1 2024-09-14T11:35:49.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=2 2024-09-14T11:35:49.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=3 2024-09-14T11:35:49.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=4 2024-09-14T11:35:49.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=5 2024-09-14T11:35:49.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.643+0000 7fd318d2a800 20 add_watcher() i=6 2024-09-14T11:35:49.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.644+0000 7fd318d2a800 20 add_watcher() i=7 2024-09-14T11:35:49.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.644+0000 7fd318d2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:49.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 5 note: GC not initialized 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd1ca7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 20 Filter name: none 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd1c37fe640 20 reqs_thread_entry: start 2024-09-14T11:35:49.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.646+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.647+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.647+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.647+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.647+0000 7fd318d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.647+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.648+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:49.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.648+0000 7fd318d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:35:49.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.648+0000 7fd318d2a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:49.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.648+0000 7fd318d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:49.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.650+0000 7fd1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:49.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.651+0000 7fd318d2a800 20 remove_watcher() i=0 2024-09-14T11:35:49.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.651+0000 7fd318d2a800 2 removed watcher, disabling cache 2024-09-14T11:35:49.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.652+0000 7fd318d2a800 20 remove_watcher() i=1 2024-09-14T11:35:49.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.653+0000 7fd318d2a800 20 remove_watcher() i=2 2024-09-14T11:35:49.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.654+0000 7fd318d2a800 20 remove_watcher() i=3 2024-09-14T11:35:49.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.655+0000 7fd318d2a800 20 remove_watcher() i=4 2024-09-14T11:35:49.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.656+0000 7fd318d2a800 20 remove_watcher() i=5 2024-09-14T11:35:49.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.657+0000 7fd318d2a800 20 remove_watcher() i=6 2024-09-14T11:35:49.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:49.658+0000 7fd318d2a800 20 remove_watcher() i=7 2024-09-14T11:35:49.666 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:49.666 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:49.666 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:49.666 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:49.668 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.668 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.671 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.672 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.714 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.714 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.742 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:35:49.742 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:49.743 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.743 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.757 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.800 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.800 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.809 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.809 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.816 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.816 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.825 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.825 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.834 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.834 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.842 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.842 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.849 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.849 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.857 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.857 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.865 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.865 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.873 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.873 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.880 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.880 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.888 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.888 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.896 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.896 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.903 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.903 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.911 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.911 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.919 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.919 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.927 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.927 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.935 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.935 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.944 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.944 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:49.952 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:49.959 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:35:49.988 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:49.988 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:50.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.026+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.027+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.027+0000 7f077c415800 20 realm 2024-09-14T11:35:50.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.027+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.028+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.028+0000 7f077c415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.028+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.028+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.028+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.029+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.029+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.029+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.029+0000 7f077c415800 20 searching for the correct realm 2024-09-14T11:35:50.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.032+0000 7f0778393640 0 -- 172.21.15.94:0/673533430 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x55f1c4217dc0 msgr2=0x55f1c421a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.035+0000 7f076ffff640 0 -- 172.21.15.94:0/673533430 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f076804c060 msgr2=0x7f0768042460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.039+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 zone default found 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 4 Realm: () 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 zonegroup default 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 started sync module instance, tier type = 2024-09-14T11:35:50.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.040+0000 7f077c415800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=0 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=1 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=2 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=3 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=4 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=5 2024-09-14T11:35:50.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=6 2024-09-14T11:35:50.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 20 add_watcher() i=7 2024-09-14T11:35:50.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.049+0000 7f077c415800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.051+0000 7f062dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.051+0000 7f077c415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.051+0000 7f077c415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.051+0000 7f077c415800 5 note: GC not initialized 2024-09-14T11:35:50.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f062cfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:50.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f077c415800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f077c415800 20 Filter name: none 2024-09-14T11:35:50.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f05a67fc640 20 reqs_thread_entry: start 2024-09-14T11:35:50.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.052+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.053+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.053+0000 7f077c415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.053+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.053+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.053+0000 7f077c415800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.054+0000 7f077c415800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:50.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.054+0000 7f077c415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:50.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.055+0000 7f062dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.057+0000 7f077c415800 20 remove_watcher() i=0 2024-09-14T11:35:50.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.057+0000 7f077c415800 2 removed watcher, disabling cache 2024-09-14T11:35:50.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.058+0000 7f077c415800 20 remove_watcher() i=1 2024-09-14T11:35:50.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.059+0000 7f077c415800 20 remove_watcher() i=2 2024-09-14T11:35:50.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.060+0000 7f077c415800 20 remove_watcher() i=3 2024-09-14T11:35:50.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.061+0000 7f077c415800 20 remove_watcher() i=4 2024-09-14T11:35:50.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.062+0000 7f077c415800 20 remove_watcher() i=5 2024-09-14T11:35:50.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.063+0000 7f077c415800 20 remove_watcher() i=6 2024-09-14T11:35:50.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.064+0000 7f077c415800 20 remove_watcher() i=7 2024-09-14T11:35:50.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.072 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:50.072 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:50.072 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.074 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:35:50.107 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:50.108 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:50.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.146+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 realm 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.148+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.148+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.149+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.149+0000 7fb773325800 20 searching for the correct realm 2024-09-14T11:35:50.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.151+0000 7fb766732640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb760031070 msgr2=0x7fb760057400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.155+0000 7fb76ef33640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb7580b4dc0 msgr2=0x7fb7580a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 zone default found 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 4 Realm: () 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 zonegroup default 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.363+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.363+0000 7fb773325800 20 started sync module instance, tier type = 2024-09-14T11:35:50.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.363+0000 7fb773325800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=0 2024-09-14T11:35:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=1 2024-09-14T11:35:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=2 2024-09-14T11:35:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=3 2024-09-14T11:35:50.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=4 2024-09-14T11:35:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=5 2024-09-14T11:35:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=6 2024-09-14T11:35:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.372+0000 7fb773325800 20 add_watcher() i=7 2024-09-14T11:35:50.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.372+0000 7fb773325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.373+0000 7fb6257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 5 note: GC not initialized 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb59ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 20 Filter name: none 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb59dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:35:50.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.374+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : miss 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.375+0000 7fb773325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:35:50.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb773325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb773325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94526710803424 notifier 7710 bl.length()=1007 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:35:50.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:35:50.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:35:50.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:35:50.383 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb773325800 time 2024-09-14T11:35:50.386491+0000 2024-09-14T11:35:50.383 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:50.384 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.384 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb77498c76a] 2024-09-14T11:35:50.384 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.384 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.384 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.386+0000 7fb773325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb773325800 time 2024-09-14T11:35:50.386491+0000 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb77498c76a] 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.385 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:50.386 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fb773325800 thread_name:radosgw-admin 2024-09-14T11:35:50.401 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb77363e6f0] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb77368b99c] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb77498c7c4] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.402 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.387+0000 7fb773325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fb773325800 thread_name:radosgw-admin 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb77363e6f0] 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb77368b99c] 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb77498c7c4] 2024-09-14T11:35:50.403 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:35:50.130+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.404 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.405 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.406 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: starting msgr at 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: starting objecter 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:35:50.130+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests hook 0x55f8b6f5bd90 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: setting wanted keys 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: calling monclient init 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:35:50.130+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.407 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.408 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:35:50.131+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key hook 0x55f8b6f567d8 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b6e0e8c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6e98950 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b6e9ebe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.622071s 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b6e9ebe0 auth_method 0 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.409 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6e0e8c0 auth_method 0 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6e98950 auth_method 0 2024-09-14T11:35:50.410 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_done global_id 7701 payload 824 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:35:50.131+0000 7fb76f734640 1 monclient: found mon.noname-a 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: dump: 2024-09-14T11:35:50.411 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.412 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: dump: 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.413 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:35:50.131+0000 7fb773325800 5 monclient: authenticate success, global_id 7701 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:35:50.131+0000 7fb65ce09640 4 set_mon_vals no callback set 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:35:50.131+0000 7fb773325800 1 librados: init done 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:35:50.133+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb654077230 auth_method 0 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:35:50.134+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b6f7d7c0 auth_method 0 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:35:50.134+0000 7fb76ef33640 10 monclient: get_auth_request con 0x55f8b6fa1fd0 auth_method 0 2024-09-14T11:35:50.414 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:35:50.136+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b6fa5880 auth_method 0 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:35:50.136+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:35:50.136+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:35:50.136+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.415 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.416 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:35:50.137+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests cmddesc objecter_requests hook 0x55f8b6fae690 EEXIST 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.417 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:35:50.137+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x55f8b6faa300 EEXIST 2024-09-14T11:35:50.418 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b6fd29b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b6fd2d90 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6fd16c0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.628913s 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6fd2d90 auth_method 0 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.419 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6fd29b0 auth_method 0 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b6fd16c0 auth_method 0 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.420 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:35:50.138+0000 7fb766732640 1 monclient: found mon.noname-c 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.421 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: dump: 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.422 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: dump: 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.423 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:35:50.138+0000 7fb773325800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:35:50.138+0000 7fb76ff35640 4 set_mon_vals no callback set 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.424 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: get_monmap_and_config 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:35:50.140+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.425 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.426 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:35:50.140+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb648077140 auth_method 0 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.427 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:35:50.141+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x7ffe710033c8 EEXIST 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:50.428 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b7026db0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6ff7dc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b7022290 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.632781s 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b7026db0 auth_method 0 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.429 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b7022290 auth_method 0 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6ff7dc0 auth_method 0 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.430 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient(hunting): handle_auth_done global_id 7289 payload 274 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:35:50.142+0000 7fb76ef33640 1 monclient: found mon.noname-c 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.431 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: dump: 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.432 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: dump: 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.433 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:35:50.142+0000 7fb773325800 5 monclient: authenticate success, global_id 7289 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:35:50.142+0000 7fb773325800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:35:50.142+0000 7fb773325800 4 set_mon_vals no callback set 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:35:50.142+0000 7fb773325800 10 monclient: shutdown 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:35:50.143+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.434 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.435 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: starting msgr at 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: starting objecter 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:35:50.143+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests cmddesc objecter_requests hook 0x55f8b6ff2460 EEXIST 2024-09-14T11:35:50.436 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: setting wanted keys 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: calling monclient init 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.437 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:35:50.143+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x55f8b6fe73b8 EEXIST 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6ff7dc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.438 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b7022290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b7026db0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.635038s 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b7022290 auth_method 0 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b7026db0 auth_method 0 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.439 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6ff7dc0 auth_method 0 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.440 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_done global_id 7710 payload 824 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:35:50.144+0000 7fb76f734640 1 monclient: found mon.noname-a 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: dump: 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.441 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:50.442 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: dump: 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:35:50.144+0000 7fb773325800 5 monclient: authenticate success, global_id 7710 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:35:50.144+0000 7fb6527fc640 4 set_mon_vals no callback set 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.443 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:35:50.144+0000 7fb773325800 1 librados: init done 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:35:50.144+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cr dump hook 0x55f8b701ec68 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:35:50.146+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:35:50.146+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb638077230 auth_method 0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:35:50.147+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b7041110 auth_method 0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:35:50.147+0000 7fb773325800 20 realm 2024-09-14T11:35:50.444 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:35:50.147+0000 7fb773325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:35:50.148+0000 7fb76ef33640 10 monclient: get_auth_request con 0x55f8b70453a0 auth_method 0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:35:50.148+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:35:50.148+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:35:50.149+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:35:50.149+0000 7fb773325800 20 searching for the correct realm 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:35:50.149+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b704a260 auth_method 0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:35:50.149+0000 7fb76f734640 10 monclient: get_auth_request con 0x7fb7580abbd0 auth_method 0 2024-09-14T11:35:50.445 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:35:50.150+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb76806b050 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:35:50.151+0000 7fb766732640 10 monclient: get_auth_request con 0x7fb760031070 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:35:50.151+0000 7fb766732640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb760031070 msgr2=0x7fb760057400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:35:50.151+0000 7fb650ff9640 1 client.7710.objecter ms_handle_reset 0x7fb760031070 session 0x7fb760005040 osd.4 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:35:50.151+0000 7fb650ff9640 10 monclient: _renew_subs 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:35:50.151+0000 7fb650ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:35:50.151+0000 7fb766732640 10 monclient: get_auth_request con 0x7fb6380878e0 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:35:50.153+0000 7fb76f734640 10 monclient: get_auth_request con 0x7fb7580c1040 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:35:50.155+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb7580b4dc0 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:35:50.155+0000 7fb76ef33640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb7580b4dc0 msgr2=0x7fb7580a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:35:50.356+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb7580b4dc0 auth_method 0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.446 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:35:50.362+0000 7fb773325800 20 zone default found 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:35:50.362+0000 7fb773325800 4 Realm: () 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:35:50.362+0000 7fb773325800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.447 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:35:50.362+0000 7fb773325800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:35:50.362+0000 7fb773325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:35:50.362+0000 7fb773325800 20 zonegroup default 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:35:50.363+0000 7fb773325800 20 started sync module instance, tier type = 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:35:50.363+0000 7fb773325800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=0 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=1 2024-09-14T11:35:50.448 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=2 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=3 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=4 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=5 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=6 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:35:50.372+0000 7fb773325800 20 add_watcher() i=7 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:35:50.372+0000 7fb773325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.449 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:35:50.373+0000 7fb6257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:35:50.374+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache list hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.450 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache inspect hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache erase hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache zap hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:35:50.374+0000 7fb773325800 5 note: GC not initialized 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:35:50.374+0000 7fb59ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace show hook 0x7fb76000ce70 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace history hook 0x7fb76000ce70 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace active hook 0x7fb76000ce70 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace active_short hook 0x7fb76000ce70 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:35:50.374+0000 7fb773325800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:35:50.374+0000 7fb773325800 20 Filter name: none 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:35:50.374+0000 7fb59dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:50.451 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:35:50.374+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : miss 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.452 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:35:50.375+0000 7fb773325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:35:50.382+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:35:50.382+0000 7fb773325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:35:50.382+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:35:50.382+0000 7fb773325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94526710803424 notifier 7710 bl.length()=1007 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:35:50.453 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:35:50.386+0000 7fb773325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb773325800 time 2024-09-14T11:35:50.386491+0000 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb77498c76a] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:35:50.454 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:35:50.387+0000 7fb773325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fb773325800 thread_name:radosgw-admin 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb77363e6f0] 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb77368b99c] 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb77498c7c4] 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.455 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:35:50.456 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:35:50.457 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:35:50.458 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:35:50.459 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:35:50.460 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:35:50.461 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:50.462 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:50.463 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb59dffb640 / http_manager 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb59ffff640 / http_manager 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb6257e2640 / rgw_dt_lg_renew 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb650ff9640 / ms_dispatch 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb6527fc640 / io_context_pool 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb658e01640 / ms_dispatch 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb65b606640 / ms_dispatch 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb65ce09640 / io_context_pool 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb766732640 / msgr-worker-2 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76ef33640 / msgr-worker-1 2024-09-14T11:35:50.464 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76f734640 / msgr-worker-0 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76ff35640 / io_context_pool 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb773325800 / radosgw-admin 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.134772.log 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:35:50.130+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.465 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding auth protocol: cephx 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.466 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: crc 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f5c3f0) adding con mode: secure 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: starting msgr at 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: starting objecter 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:35:50.130+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests hook 0x55f8b6f5bd90 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: setting wanted keys 2024-09-14T11:35:50.467 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:35:50.130+0000 7fb773325800 1 librados: calling monclient init 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:35:50.130+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding auth protocol: cephx 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.468 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: crc 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:35:50.130+0000 7fb773325800 5 AuthRegistry(0x55f8b6f56690) adding con mode: secure 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:35:50.130+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:35:50.131+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key hook 0x55f8b6f567d8 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b6e0e8c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6e98950 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b6e9ebe0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.469 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.622071s 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b6e9ebe0 auth_method 0 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6e0e8c0 auth_method 0 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.470 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:35:50.131+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6e98950 auth_method 0 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.471 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:35:50.131+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient(hunting): handle_auth_done global_id 7701 payload 824 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:35:50.131+0000 7fb76f734640 1 monclient: found mon.noname-a 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:35:50.131+0000 7fb76f734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: dump: 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:35:50.131+0000 7fb65b606640 10 monclient: dump: 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:35:50.131+0000 7fb773325800 5 monclient: authenticate success, global_id 7701 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:35:50.131+0000 7fb65ce09640 4 set_mon_vals no callback set 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.474 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:35:50.131+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:35:50.131+0000 7fb773325800 1 librados: init done 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:35:50.133+0000 7fb65b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:35:50.133+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb654077230 auth_method 0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:35:50.134+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b6f7d7c0 auth_method 0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:35:50.134+0000 7fb76ef33640 10 monclient: get_auth_request con 0x55f8b6fa1fd0 auth_method 0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:35:50.136+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b6fa5880 auth_method 0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:35:50.136+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:35:50.136+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:35:50.136+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.475 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.476 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding auth protocol: cephx 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: crc 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:35:50.136+0000 7fb773325800 5 AuthRegistry(0x55f8b6fab220) adding con mode: secure 2024-09-14T11:35:50.477 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:35:50.137+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests cmddesc objecter_requests hook 0x55f8b6fae690 EEXIST 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding auth protocol: cephx 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.478 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: crc 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:35:50.137+0000 7fb773325800 5 AuthRegistry(0x55f8b6faa1b8) adding con mode: secure 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:35:50.137+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:35:50.137+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x55f8b6faa300 EEXIST 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b6fd29b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b6fd2d90 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.479 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6fd16c0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:35:50.137+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.628913s 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6fd2d90 auth_method 0 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6fd29b0 auth_method 0 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.480 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b6fd16c0 auth_method 0 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:35:50.138+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.481 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:35:50.138+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:35:50.138+0000 7fb766732640 1 monclient: found mon.noname-c 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:35:50.138+0000 7fb766732640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: dump: 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:35:50.138+0000 7fb658e01640 10 monclient: dump: 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:35:50.138+0000 7fb773325800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:35:50.138+0000 7fb76ff35640 4 set_mon_vals no callback set 2024-09-14T11:35:50.484 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:35:50.138+0000 7fb773325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:35:50.140+0000 7fb658e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: get_monmap_and_config 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:35:50.140+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:35:50.140+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding auth protocol: cephx 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.486 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: crc 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:35:50.140+0000 7fb773325800 5 AuthRegistry(0x55f8b6ff2770) adding con mode: secure 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:35:50.140+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb648077140 auth_method 0 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding auth protocol: cephx 2024-09-14T11:35:50.487 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: crc 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:35:50.141+0000 7fb773325800 5 AuthRegistry(0x7ffe71003280) adding con mode: secure 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.488 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:35:50.141+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:35:50.141+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x7ffe710033c8 EEXIST 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b7026db0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6ff7dc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b7022290 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:35:50.141+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.632781s 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b7026db0 auth_method 0 2024-09-14T11:35:50.489 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b7022290 auth_method 0 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:35:50.141+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b6ff7dc0 auth_method 0 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.490 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:35:50.141+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:35:50.141+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:35:50.142+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient(hunting): handle_auth_done global_id 7289 payload 274 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:35:50.142+0000 7fb76ef33640 1 monclient: found mon.noname-c 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:35:50.142+0000 7fb76ef33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:50.491 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: dump: 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.492 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:35:50.142+0000 7fb6527fc640 10 monclient: dump: 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.493 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:35:50.142+0000 7fb773325800 5 monclient: authenticate success, global_id 7289 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:35:50.142+0000 7fb773325800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:35:50.142+0000 7fb773325800 4 set_mon_vals no callback set 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:35:50.142+0000 7fb773325800 10 monclient: shutdown 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: build_initial_monmap 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:35:50.143+0000 7fb773325800 1 build_initial for_mkfs: 0 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: monmap: 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding auth protocol: cephx 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.495 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: crc 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b70175a0) adding con mode: secure 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: starting msgr at 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: starting objecter 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:35:50.143+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command objecter_requests cmddesc objecter_requests hook 0x55f8b6ff2460 EEXIST 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: setting wanted keys 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:35:50.143+0000 7fb773325800 1 librados: calling monclient init 2024-09-14T11:35:50.496 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: init 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding auth protocol: cephx 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.497 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: crc 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:35:50.143+0000 7fb773325800 5 AuthRegistry(0x55f8b6fe7270) adding con mode: secure 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:35:50.143+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:35:50.143+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command rotate-key cmddesc rotate-key hook 0x55f8b6fe73b8 EEXIST 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:35:50.143+0000 7fb773325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-b con 0x55f8b6ff7dc0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-c con 0x55f8b7022290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): picked mon.noname-a con 0x55f8b7026db0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.498 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient(hunting): authenticate will time out at 2063.635038s 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): get_auth_request con 0x55f8b7022290 auth_method 0 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): get_auth_request con 0x55f8b7026db0 auth_method 0 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.499 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:35:50.144+0000 7fb766732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): get_auth_request con 0x55f8b6ff7dc0 auth_method 0 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:35:50.144+0000 7fb76ef33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient(hunting): handle_auth_done global_id 7710 payload 824 2024-09-14T11:35:50.500 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient: _finish_hunting 0 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:35:50.144+0000 7fb76f734640 1 monclient: found mon.noname-a 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:35:50.144+0000 7fb76f734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: dump: 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.501 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: _finish_auth 0 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:35:50.144+0000 7fb650ff9640 10 monclient: dump: 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:35:50.502 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:35:50.144+0000 7fb773325800 5 monclient: authenticate success, global_id 7710 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:35:50.144+0000 7fb6527fc640 4 set_mon_vals no callback set 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _renew_subs 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:35:50.144+0000 7fb773325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.503 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:35:50.144+0000 7fb773325800 1 librados: init done 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:35:50.144+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cr dump hook 0x55f8b701ec68 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:35:50.146+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:35:50.146+0000 7fb650ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:35:50.146+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb638077230 auth_method 0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:35:50.147+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b7041110 auth_method 0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:35:50.147+0000 7fb773325800 20 realm 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:35:50.147+0000 7fb773325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.504 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:35:50.147+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:35:50.148+0000 7fb76ef33640 10 monclient: get_auth_request con 0x55f8b70453a0 auth_method 0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:35:50.148+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:35:50.148+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:35:50.149+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:35:50.149+0000 7fb773325800 20 searching for the correct realm 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:35:50.149+0000 7fb766732640 10 monclient: get_auth_request con 0x55f8b704a260 auth_method 0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:35:50.149+0000 7fb76f734640 10 monclient: get_auth_request con 0x7fb7580abbd0 auth_method 0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:35:50.150+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb76806b050 auth_method 0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:35:50.151+0000 7fb766732640 10 monclient: get_auth_request con 0x7fb760031070 auth_method 0 2024-09-14T11:35:50.505 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:35:50.151+0000 7fb766732640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb760031070 msgr2=0x7fb760057400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:35:50.151+0000 7fb650ff9640 1 client.7710.objecter ms_handle_reset 0x7fb760031070 session 0x7fb760005040 osd.4 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:35:50.151+0000 7fb650ff9640 10 monclient: _renew_subs 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:35:50.151+0000 7fb650ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:35:50.151+0000 7fb766732640 10 monclient: get_auth_request con 0x7fb6380878e0 auth_method 0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:35:50.153+0000 7fb76f734640 10 monclient: get_auth_request con 0x7fb7580c1040 auth_method 0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:35:50.155+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb7580b4dc0 auth_method 0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:35:50.155+0000 7fb76ef33640 0 -- 172.21.15.94:0/1725240243 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb7580b4dc0 msgr2=0x7fb7580a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:35:50.356+0000 7fb76ef33640 10 monclient: get_auth_request con 0x7fb7580b4dc0 auth_method 0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:35:50.361+0000 7fb773325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:35:50.361+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:35:50.362+0000 7fb773325800 20 zone default found 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:35:50.362+0000 7fb773325800 4 Realm: () 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:35:50.362+0000 7fb773325800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:35:50.362+0000 7fb773325800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:35:50.362+0000 7fb773325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:35:50.362+0000 7fb773325800 20 zonegroup default 2024-09-14T11:35:50.507 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:35:50.362+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:35:50.363+0000 7fb773325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:35:50.363+0000 7fb773325800 20 started sync module instance, tier type = 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:35:50.363+0000 7fb773325800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=0 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=1 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=2 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=3 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=4 2024-09-14T11:35:50.508 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=5 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:35:50.371+0000 7fb773325800 20 add_watcher() i=6 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:35:50.372+0000 7fb773325800 20 add_watcher() i=7 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:35:50.372+0000 7fb773325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding auth protocol: cephx 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:35:50.373+0000 7fb6257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.509 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: crc 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:35:50.373+0000 7fb773325800 5 AuthRegistry(0x7ffe71003760) adding con mode: secure 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:35:50.374+0000 7fb773325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache list hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache inspect hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache erase hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.510 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command cache zap hook 0x55f8b6ff5ee0 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:35:50.374+0000 7fb773325800 5 note: GC not initialized 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:35:50.374+0000 7fb59ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace show hook 0x7fb76000ce70 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace history hook 0x7fb76000ce70 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace active hook 0x7fb76000ce70 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:35:50.374+0000 7fb773325800 5 asok(0x55f8b6d36270) register_command sync trace active_short hook 0x7fb76000ce70 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:35:50.374+0000 7fb773325800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:35:50.374+0000 7fb773325800 20 Filter name: none 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:35:50.374+0000 7fb59dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:35:50.374+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:35:50.374+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.511 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : miss 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:35:50.375+0000 7fb773325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:35:50.375+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:35:50.375+0000 7fb773325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:35:50.375+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:35:50.375+0000 7fb773325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:35:50.382+0000 7fb773325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:35:50.382+0000 7fb773325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.512 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:35:50.382+0000 7fb773325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:35:50.382+0000 7fb773325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94526710803424 notifier 7710 bl.length()=1007 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:35:50.382+0000 7fb6527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:35:50.383+0000 7fb773325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:35:50.386+0000 7fb773325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb773325800 time 2024-09-14T11:35:50.386491+0000 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.513 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb77498c76a] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:35:50.387+0000 7fb773325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fb773325800 thread_name:radosgw-admin 2024-09-14T11:35:50.514 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb77363e6f0] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb77368b99c] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb77498c7c4] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb77498c928] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8b58ca0b1] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x55f8b5dde07c] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f8b58d9efd] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb773629590] 2024-09-14T11:35:50.515 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:35:50.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:35:50.517 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:35:50.518 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:35:50.519 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:35:50.520 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:35:50.521 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:35:50.522 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb59dffb640 / http_manager 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb59ffff640 / http_manager 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb6257e2640 / rgw_dt_lg_renew 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb650ff9640 / ms_dispatch 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb6527fc640 / io_context_pool 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb658e01640 / ms_dispatch 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb65b606640 / ms_dispatch 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb65ce09640 / io_context_pool 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb766732640 / msgr-worker-2 2024-09-14T11:35:50.523 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76ef33640 / msgr-worker-1 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76f734640 / msgr-worker-0 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb76ff35640 / io_context_pool 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: 7fb773325800 / radosgw-admin 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:50.388162Z_349c8736-3acc-4818-bc3f-72763a6985d1/log 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:35:50.524 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:35:50.525 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.461+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 20 realm 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.463+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.464+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.464+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.464+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.464+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.464+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.465+0000 7f45a4d1f800 20 searching for the correct realm 2024-09-14T11:35:50.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.467+0000 7f45a1193640 0 -- 172.21.15.94:0/3269458289 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f4594048070 msgr2=0x7f4594048960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:50.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.471+0000 7f45a0992640 0 -- 172.21.15.94:0/3269458289 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f459400b400 msgr2=0x7f459400b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.676+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.677+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.677+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 zone default found 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 4 Realm: () 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 zonegroup default 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.678+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.679+0000 7f45a4d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.679+0000 7f45a4d1f800 20 started sync module instance, tier type = 2024-09-14T11:35:50.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.679+0000 7f45a4d1f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=0 2024-09-14T11:35:50.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=1 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=2 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=3 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=4 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=5 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.687+0000 7f45a4d1f800 20 add_watcher() i=6 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.688+0000 7f45a4d1f800 20 add_watcher() i=7 2024-09-14T11:35:50.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.688+0000 7f45a4d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f4456fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f45a4d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f45a4d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f45a4d1f800 5 note: GC not initialized 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f4455fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f45a4d1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f45a4d1f800 20 Filter name: none 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.690+0000 7f43c77fe640 20 reqs_thread_entry: start 2024-09-14T11:35:50.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.691+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.691+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.691+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:35:50.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.692+0000 7f45a4d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:50.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.694+0000 7f4456fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.696+0000 7f45a4d1f800 20 remove_watcher() i=0 2024-09-14T11:35:50.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.696+0000 7f45a4d1f800 2 removed watcher, disabling cache 2024-09-14T11:35:50.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.697+0000 7f45a4d1f800 20 remove_watcher() i=1 2024-09-14T11:35:50.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.698+0000 7f45a4d1f800 20 remove_watcher() i=2 2024-09-14T11:35:50.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.699+0000 7f45a4d1f800 20 remove_watcher() i=3 2024-09-14T11:35:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.699+0000 7f45a4d1f800 20 remove_watcher() i=4 2024-09-14T11:35:50.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.700+0000 7f45a4d1f800 20 remove_watcher() i=5 2024-09-14T11:35:50.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.701+0000 7f45a4d1f800 20 remove_watcher() i=6 2024-09-14T11:35:50.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.702+0000 7f45a4d1f800 20 remove_watcher() i=7 2024-09-14T11:35:50.710 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.710 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:35:50.710 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:50.710 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:35:50.712 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:50.712 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:50.720 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:50.720 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:35:50.764 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:50.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:50.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.837+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.838+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.838+0000 7fe5df519800 20 realm 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:50.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.839+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.840+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.840+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.840+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:50.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.840+0000 7fe5df519800 20 searching for the correct realm 2024-09-14T11:35:50.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.843+0000 7fe5dc802640 0 -- 172.21.15.94:0/1325366818 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55f3494cb080 msgr2=0x55f3494cd4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.846+0000 7fe5dd003640 0 -- 172.21.15.94:0/1325366818 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fe5c8073510 msgr2=0x7fe5c8068490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.850+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 zone default found 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 4 Realm: () 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 zonegroup default 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.851+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:50.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 started sync module instance, tier type = 2024-09-14T11:35:50.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.852+0000 7fe5df519800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:35:50.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=0 2024-09-14T11:35:50.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=1 2024-09-14T11:35:50.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=2 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=3 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=4 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=5 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.860+0000 7fe5df519800 20 add_watcher() i=6 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.861+0000 7fe5df519800 20 add_watcher() i=7 2024-09-14T11:35:50.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.861+0000 7fe5df519800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe493fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe5df519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe5df519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe5df519800 5 note: GC not initialized 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe492fe5640 20 reqs_thread_entry: start 2024-09-14T11:35:50.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe5df519800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.863+0000 7fe5df519800 20 Filter name: none 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe490fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : miss 2024-09-14T11:35:50.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 20 rados->read ofs=0 len=0 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.864+0000 7fe5df519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:35:50.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.865+0000 7fe5df519800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to be held by another RGW process; skipping for now 2024-09-14T11:35:50.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.866+0000 7fe493fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:50.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.868+0000 7fe5df519800 20 remove_watcher() i=0 2024-09-14T11:35:50.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.868+0000 7fe5df519800 2 removed watcher, disabling cache 2024-09-14T11:35:50.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.869+0000 7fe5df519800 20 remove_watcher() i=1 2024-09-14T11:35:50.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.870+0000 7fe5df519800 20 remove_watcher() i=2 2024-09-14T11:35:50.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.871+0000 7fe5df519800 20 remove_watcher() i=3 2024-09-14T11:35:50.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.872+0000 7fe5df519800 20 remove_watcher() i=4 2024-09-14T11:35:50.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.873+0000 7fe5df519800 20 remove_watcher() i=5 2024-09-14T11:35:50.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.873+0000 7fe5df519800 20 remove_watcher() i=6 2024-09-14T11:35:50.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:35:50.874+0000 7fe5df519800 20 remove_watcher() i=7 2024-09-14T11:35:50.882 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:36:20.890 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:20.925 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:20.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.968+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 realm 2024-09-14T11:36:20.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.970+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.971+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:20.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.971+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.971+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:20.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.971+0000 7f2162723800 20 searching for the correct realm 2024-09-14T11:36:20.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.975+0000 7f215ec0d640 0 -- 172.21.15.94:0/2303014465 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f21480690c0 msgr2=0x7f2148067b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:20.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.978+0000 7f215e40c640 0 -- 172.21.15.94:0/2303014465 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f2148070b80 msgr2=0x7f214806ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.983+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:20.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 zone default found 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 4 Realm: () 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 zonegroup default 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.984+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.985+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.985+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.985+0000 7f2162723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.985+0000 7f2162723800 20 started sync module instance, tier type = 2024-09-14T11:36:20.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.985+0000 7f2162723800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=0 2024-09-14T11:36:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=1 2024-09-14T11:36:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=2 2024-09-14T11:36:20.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=3 2024-09-14T11:36:20.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=4 2024-09-14T11:36:20.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=5 2024-09-14T11:36:20.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.994+0000 7f2162723800 20 add_watcher() i=6 2024-09-14T11:36:20.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.995+0000 7f2162723800 20 add_watcher() i=7 2024-09-14T11:36:20.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.995+0000 7f2162723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:20.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2014fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 5 note: GC not initialized 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f1f8f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 20 Filter name: none 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f1f8d7fa640 20 reqs_thread_entry: start 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:36:20.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.997+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : miss 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 20 rados->read ofs=0 len=0 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:20.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:20.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:20.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:20.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:20.998+0000 7f2162723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:36:20.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.000+0000 7f2162723800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f2162723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f2162723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f2162723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f2162723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f20417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94807528670560 notifier 7346 bl.length()=1007 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f20417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f20417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.006+0000 7f20417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.007+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:36:21.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.007+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:36:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.007+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:36:21.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.007+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.0 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.0 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.1 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.1 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.2 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.2 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.3 2024-09-14T11:36:21.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.3 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.4 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.4 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.5 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.5 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.6 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.6 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.7 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.7 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.8 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.8 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.9 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.9 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.10 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.10 2024-09-14T11:36:21.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.11 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2.11 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.013+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.0 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.014+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.1 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.014+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.015+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.3 2024-09-14T11:36:21.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.016+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.4 2024-09-14T11:36:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.016+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.5 2024-09-14T11:36:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.017+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.6 2024-09-14T11:36:21.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.017+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.7 2024-09-14T11:36:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.018+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.8 2024-09-14T11:36:21.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.018+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.9 2024-09-14T11:36:21.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.019+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.10 2024-09-14T11:36:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.022+0000 7f2162723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:21.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.022+0000 7f2162723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.023+0000 7f2162723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.023+0000 7f2162723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.023+0000 7f2162723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.023+0000 7f2162723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f20417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94807528670560 notifier 7346 bl.length()=1007 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f20417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f20417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f20417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:36:21.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:36:21.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:36:21.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.024+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:36:21.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.027+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.0 2024-09-14T11:36:21.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.027+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.1 2024-09-14T11:36:21.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.027+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.2 2024-09-14T11:36:21.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.028+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.3 2024-09-14T11:36:21.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.028+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.4 2024-09-14T11:36:21.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.029+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.5 2024-09-14T11:36:21.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.029+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.6 2024-09-14T11:36:21.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.029+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.7 2024-09-14T11:36:21.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.030+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.8 2024-09-14T11:36:21.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.030+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.9 2024-09-14T11:36:21.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.030+0000 7f2162723800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37.10 2024-09-14T11:36:21.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.031+0000 7f2162723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:21.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.031+0000 7f2162723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 2024-09-14T11:36:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f2162723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f2162723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f2162723800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f2162723800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37, ofs0, ns] 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f20417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 94807528670560 notifier 7346 bl.length()=975 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f20417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 info.flags=0x17 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f20417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 to cache LRU end 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.032+0000 7f20417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.033+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_sources= new_sources= 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.033+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential sources added=[] removed=[] 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.033+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): orig_dests= new_dests= 2024-09-14T11:36:21.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.033+0000 7f2162723800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37]): potential dests added=[] removed=[] 2024-09-14T11:36:21.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.035+0000 7f2162723800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:21.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.037+0000 7f2014fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:21.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.039+0000 7f2162723800 20 remove_watcher() i=0 2024-09-14T11:36:21.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.039+0000 7f2162723800 2 removed watcher, disabling cache 2024-09-14T11:36:21.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.040+0000 7f2162723800 20 remove_watcher() i=1 2024-09-14T11:36:21.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.041+0000 7f2162723800 20 remove_watcher() i=2 2024-09-14T11:36:21.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.042+0000 7f2162723800 20 remove_watcher() i=3 2024-09-14T11:36:21.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.043+0000 7f2162723800 20 remove_watcher() i=4 2024-09-14T11:36:21.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.044+0000 7f2162723800 20 remove_watcher() i=5 2024-09-14T11:36:21.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.045+0000 7f2162723800 20 remove_watcher() i=6 2024-09-14T11:36:21.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.046+0000 7f2162723800 20 remove_watcher() i=7 2024-09-14T11:36:21.056 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:36:21.085 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:21.085 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:21.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.122+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 realm 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.124+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.125+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:21.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.125+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.125+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:21.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.126+0000 7f870a746800 20 searching for the correct realm 2024-09-14T11:36:21.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.128+0000 7f8708a38640 0 -- 172.21.15.94:0/210890490 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f86f007b070 msgr2=0x7f86f008d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:21.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.132+0000 7f8708237640 0 -- 172.21.15.94:0/210890490 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f86f0064910 msgr2=0x7f86f0054370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:21.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.338+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 zone default found 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 4 Realm: () 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 zonegroup default 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.339+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.340+0000 7f870a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.340+0000 7f870a746800 20 started sync module instance, tier type = 2024-09-14T11:36:21.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.340+0000 7f870a746800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:21.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=0 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=1 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=2 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=3 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=4 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=5 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.348+0000 7f870a746800 20 add_watcher() i=6 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.349+0000 7f870a746800 20 add_watcher() i=7 2024-09-14T11:36:21.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.349+0000 7f870a746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:21.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f85befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 5 note: GC not initialized 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f85bdfdb640 20 reqs_thread_entry: start 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 20 Filter name: none 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f852f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:21.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.351+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.352+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:36:21.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.352+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.352+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:36:21.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:21.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:36:21.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:36:21.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.353+0000 7f870a746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:21.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.355+0000 7f85befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:21.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.357+0000 7f870a746800 20 remove_watcher() i=0 2024-09-14T11:36:21.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.357+0000 7f870a746800 2 removed watcher, disabling cache 2024-09-14T11:36:21.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.358+0000 7f870a746800 20 remove_watcher() i=1 2024-09-14T11:36:21.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.359+0000 7f870a746800 20 remove_watcher() i=2 2024-09-14T11:36:21.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.360+0000 7f870a746800 20 remove_watcher() i=3 2024-09-14T11:36:21.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.361+0000 7f870a746800 20 remove_watcher() i=4 2024-09-14T11:36:21.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.362+0000 7f870a746800 20 remove_watcher() i=5 2024-09-14T11:36:21.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.363+0000 7f870a746800 20 remove_watcher() i=6 2024-09-14T11:36:21.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.364+0000 7f870a746800 20 remove_watcher() i=7 2024-09-14T11:36:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:21.372 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:21.372 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:21.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:21.374 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.374 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.377 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.377 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.420 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.421 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.446 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:36:21.446 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:21.448 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.448 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.459 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.459 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.501 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.501 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.509 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.509 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.517 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.517 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.525 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.525 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.533 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.533 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.540 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.541 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.548 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.548 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.556 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.556 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.564 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.564 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.571 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.572 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.579 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.579 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.588 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.588 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.596 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.596 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.603 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.603 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.611 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.611 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.619 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.619 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.626 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.626 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.634 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.634 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.642 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.642 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.649 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:21.649 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:21.657 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:21.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.723+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 20 realm 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.724+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.725+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.725+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.725+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:21.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.725+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.726+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:21.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.726+0000 7fe05f72f800 20 searching for the correct realm 2024-09-14T11:36:21.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.727+0000 7fe05b476640 0 -- 172.21.15.94:0/3703685152 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fe048003cb0 msgr2=0x7fe0540303d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:21.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.932+0000 7fe05bc77640 0 -- 172.21.15.94:0/3703685152 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fe044075020 msgr2=0x7fe044003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:21.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:21.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:21.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:21.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.938+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 zone default found 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 4 Realm: () 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:21.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 zonegroup default 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 started sync module instance, tier type = 2024-09-14T11:36:21.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.939+0000 7fe05f72f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=0 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=1 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=2 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=3 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=4 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=5 2024-09-14T11:36:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.948+0000 7fe05f72f800 20 add_watcher() i=6 2024-09-14T11:36:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.949+0000 7fe05f72f800 20 add_watcher() i=7 2024-09-14T11:36:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.949+0000 7fe05f72f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.950+0000 7fdf11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 5 note: GC not initialized 2024-09-14T11:36:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fdf10fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 20 Filter name: none 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fde8a7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.951+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.952+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:21.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.952+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.953+0000 7fe05f72f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:21.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.955+0000 7fdf11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:21.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.957+0000 7fe05f72f800 20 remove_watcher() i=0 2024-09-14T11:36:21.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.957+0000 7fe05f72f800 2 removed watcher, disabling cache 2024-09-14T11:36:21.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.958+0000 7fe05f72f800 20 remove_watcher() i=1 2024-09-14T11:36:21.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.959+0000 7fe05f72f800 20 remove_watcher() i=2 2024-09-14T11:36:21.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.960+0000 7fe05f72f800 20 remove_watcher() i=3 2024-09-14T11:36:21.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.961+0000 7fe05f72f800 20 remove_watcher() i=4 2024-09-14T11:36:21.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.962+0000 7fe05f72f800 20 remove_watcher() i=5 2024-09-14T11:36:21.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.963+0000 7fe05f72f800 20 remove_watcher() i=6 2024-09-14T11:36:21.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:21.964+0000 7fe05f72f800 20 remove_watcher() i=7 2024-09-14T11:36:21.971 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:21.972 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:21.972 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:21.972 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:21.973 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:36:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:22.007 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:22.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.044+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 realm 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.046+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.047+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.047+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.047+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:22.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.047+0000 7f09f8c2f800 20 searching for the correct realm 2024-09-14T11:36:22.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.050+0000 7f09f5f1f640 0 -- 172.21.15.94:0/153901417 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5605c85958a0 msgr2=0x5605c8597d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:22.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.053+0000 7f09f6720640 0 -- 172.21.15.94:0/153901417 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f09e004c640 msgr2=0x7f09e0062590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:22.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.057+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 zone default found 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 4 Realm: () 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 zonegroup default 2024-09-14T11:36:22.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.058+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 started sync module instance, tier type = 2024-09-14T11:36:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.059+0000 7f09f8c2f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:22.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=0 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=1 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=2 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=3 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=4 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=5 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.067+0000 7f09f8c2f800 20 add_watcher() i=6 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.068+0000 7f09f8c2f800 20 add_watcher() i=7 2024-09-14T11:36:22.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.068+0000 7f09f8c2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:22.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f08acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 5 note: GC not initialized 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f08277fe640 20 reqs_thread_entry: start 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 20 Filter name: none 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f08257fa640 20 reqs_thread_entry: start 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:36:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.070+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 : miss 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:22.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:22.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.071+0000 7f09f8c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f09f8c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f09f8c2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f09f8c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f09f8c2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38, ofs0, ns] 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f08d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94582836137792 notifier 7391 bl.length()=1015 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f08d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f08d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.076+0000 7f08d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.077+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_sources= new_sources= 2024-09-14T11:36:22.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.077+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential sources added=[] removed=[] 2024-09-14T11:36:22.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.077+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_dests= new_dests= 2024-09-14T11:36:22.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.077+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential dests added=[] removed=[] 2024-09-14T11:36:22.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.0 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.0 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.1 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.1 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.2 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.2 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.3 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.3 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.4 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.4 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.5 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.5 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.6 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.6 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.7 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.7 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.8 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.8 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.9 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.9 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.10 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.10 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.11 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.11 2024-09-14T11:36:22.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.0 2024-09-14T11:36:22.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.081+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.082+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.2 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.082+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.3 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.083+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.4 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.083+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.5 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.083+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.6 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.084+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.7 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.084+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.8 2024-09-14T11:36:22.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.085+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.9 2024-09-14T11:36:22.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.085+0000 7f09f8c2f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.10 2024-09-14T11:36:22.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.088+0000 7f09f8c2f800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:36:22.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.088+0000 7f09f8c2f800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:36:22.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.097+0000 7f09f8c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:22.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.097+0000 7f09f8c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 2024-09-14T11:36:22.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f09f8c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f09f8c2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f09f8c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f09f8c2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38, ofs0, ns] 2024-09-14T11:36:22.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f08d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94582836137792 notifier 7391 bl.length()=983 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f08d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f08d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.098+0000 7f08d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.099+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_sources= new_sources= 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.099+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential sources added=[] removed=[] 2024-09-14T11:36:22.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.099+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_dests= new_dests= 2024-09-14T11:36:22.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.099+0000 7f09f8c2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential dests added=[] removed=[] 2024-09-14T11:36:22.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.099+0000 7f09f8c2f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:36:22.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.100+0000 7f08acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.102+0000 7f09f8c2f800 20 remove_watcher() i=0 2024-09-14T11:36:22.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.102+0000 7f09f8c2f800 2 removed watcher, disabling cache 2024-09-14T11:36:22.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.103+0000 7f09f8c2f800 20 remove_watcher() i=1 2024-09-14T11:36:22.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.104+0000 7f09f8c2f800 20 remove_watcher() i=2 2024-09-14T11:36:22.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.105+0000 7f09f8c2f800 20 remove_watcher() i=3 2024-09-14T11:36:22.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.107+0000 7f09f8c2f800 20 remove_watcher() i=4 2024-09-14T11:36:22.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.108+0000 7f09f8c2f800 20 remove_watcher() i=5 2024-09-14T11:36:22.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.109+0000 7f09f8c2f800 20 remove_watcher() i=6 2024-09-14T11:36:22.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.110+0000 7f09f8c2f800 20 remove_watcher() i=7 2024-09-14T11:36:22.119 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:36:22.148 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:22.148 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:22.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.188+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 realm 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.190+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.191+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.191+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.192+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:22.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.192+0000 7fb6d7c0e800 20 searching for the correct realm 2024-09-14T11:36:22.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.195+0000 7fb6cbfff640 0 -- 172.21.15.94:0/1327406388 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55f5ed81e930 msgr2=0x55f5ed820d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:22.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.198+0000 7fb6d336b640 0 -- 172.21.15.94:0/1327406388 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb6bc068da0 msgr2=0x7fb6bc02f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:22.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.202+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 zone default found 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 4 Realm: () 2024-09-14T11:36:22.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 zonegroup default 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 started sync module instance, tier type = 2024-09-14T11:36:22.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.203+0000 7fb6d7c0e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=0 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=1 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=2 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=3 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=4 2024-09-14T11:36:22.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=5 2024-09-14T11:36:22.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.212+0000 7fb6d7c0e800 20 add_watcher() i=6 2024-09-14T11:36:22.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.213+0000 7fb6d7c0e800 20 add_watcher() i=7 2024-09-14T11:36:22.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.213+0000 7fb6d7c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:22.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.214+0000 7fb589fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.214+0000 7fb6d7c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.214+0000 7fb6d7c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.214+0000 7fb6d7c0e800 5 note: GC not initialized 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb588fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb6d7c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:22.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb6d7c0e800 20 Filter name: none 2024-09-14T11:36:22.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb5027fc640 20 reqs_thread_entry: start 2024-09-14T11:36:22.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.215+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.216+0000 7fb6d7c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.217+0000 7fb6d7c0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:22.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.217+0000 7fb6d7c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:22.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.218+0000 7fb589fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.220+0000 7fb6d7c0e800 20 remove_watcher() i=0 2024-09-14T11:36:22.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.220+0000 7fb6d7c0e800 2 removed watcher, disabling cache 2024-09-14T11:36:22.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.221+0000 7fb6d7c0e800 20 remove_watcher() i=1 2024-09-14T11:36:22.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.222+0000 7fb6d7c0e800 20 remove_watcher() i=2 2024-09-14T11:36:22.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.223+0000 7fb6d7c0e800 20 remove_watcher() i=3 2024-09-14T11:36:22.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.224+0000 7fb6d7c0e800 20 remove_watcher() i=4 2024-09-14T11:36:22.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.225+0000 7fb6d7c0e800 20 remove_watcher() i=5 2024-09-14T11:36:22.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.226+0000 7fb6d7c0e800 20 remove_watcher() i=6 2024-09-14T11:36:22.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.227+0000 7fb6d7c0e800 20 remove_watcher() i=7 2024-09-14T11:36:22.235 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:22.235 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:22.235 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:22.235 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:22.237 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:22.237 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:22.245 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:22.245 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:22.289 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:22.319 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:22.319 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:22.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.359+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 realm 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.361+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.564+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.564+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.564+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:22.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.564+0000 7f5ddce20800 20 searching for the correct realm 2024-09-14T11:36:22.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.567+0000 7f5dda109640 0 -- 172.21.15.94:0/421521717 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5dcc018070 msgr2=0x7f5dcc0605e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:22.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.571+0000 7f5dda90a640 0 -- 172.21.15.94:0/421521717 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f5dd0078790 msgr2=0x7f5dd0095040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:22.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.777+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:22.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 zone default found 2024-09-14T11:36:22.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 4 Realm: () 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 zonegroup default 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.778+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 started sync module instance, tier type = 2024-09-14T11:36:22.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.779+0000 7f5ddce20800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=0 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=1 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=2 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=3 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=4 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=5 2024-09-14T11:36:22.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.788+0000 7f5ddce20800 20 add_watcher() i=6 2024-09-14T11:36:22.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.789+0000 7f5ddce20800 20 add_watcher() i=7 2024-09-14T11:36:22.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.789+0000 7f5ddce20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:22.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.791+0000 7f5c917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.791+0000 7f5ddce20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:22.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.791+0000 7f5ddce20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:22.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.791+0000 7f5ddce20800 5 note: GC not initialized 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5c0bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 20 Filter name: none 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5c09ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:36:22.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:22.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.792+0000 7f5ddce20800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 : miss 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.793+0000 7f5ddce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5ddce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5ddce20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5ddce20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5ddce20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38, ofs0, ns] 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5cbdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 93935575868384 notifier 7857 bl.length()=1015 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5cbdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5cbdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.798+0000 7f5cbdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.799+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_sources= new_sources= 2024-09-14T11:36:22.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.799+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential sources added=[] removed=[] 2024-09-14T11:36:22.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.799+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_dests= new_dests= 2024-09-14T11:36:22.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.799+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential dests added=[] removed=[] 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.0 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.0 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.1 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.1 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.2 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.2 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.3 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.3 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.4 2024-09-14T11:36:22.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.4 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.5 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.5 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.6 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.6 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.7 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.7 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.8 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.8 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.9 2024-09-14T11:36:22.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.9 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.10 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.10 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.11 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1.11 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.0 2024-09-14T11:36:22.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.803+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.804+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.2 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.805+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.3 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.805+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.4 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.805+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.5 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.806+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.6 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.806+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.7 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.807+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.8 2024-09-14T11:36:22.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.807+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.9 2024-09-14T11:36:22.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.808+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.10 2024-09-14T11:36:22.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.811+0000 7f5ddce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.811+0000 7f5ddce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38, ofs0, ns] 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5cbdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 93935575868384 notifier 7857 bl.length()=1015 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5cbdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5cbdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5cbdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_sources= new_sources= 2024-09-14T11:36:22.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential sources added=[] removed=[] 2024-09-14T11:36:22.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_dests= new_dests= 2024-09-14T11:36:22.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.813+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential dests added=[] removed=[] 2024-09-14T11:36:22.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.816+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.0 2024-09-14T11:36:22.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.816+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.1 2024-09-14T11:36:22.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.816+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.2 2024-09-14T11:36:22.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.817+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.3 2024-09-14T11:36:22.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.817+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.4 2024-09-14T11:36:22.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.817+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.5 2024-09-14T11:36:22.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.818+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.6 2024-09-14T11:36:22.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.818+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.7 2024-09-14T11:36:22.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.818+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.8 2024-09-14T11:36:22.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.819+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.9 2024-09-14T11:36:22.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.819+0000 7f5ddce20800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38.10 2024-09-14T11:36:22.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.819+0000 7f5ddce20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:22.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.819+0000 7f5ddce20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38, ofs0, ns] 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5cbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 93935575868384 notifier 7857 bl.length()=983 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5cbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 info.flags=0x17 2024-09-14T11:36:22.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5cbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 to cache LRU end 2024-09-14T11:36:22.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5cbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:22.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_sources= new_sources= 2024-09-14T11:36:22.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential sources added=[] removed=[] 2024-09-14T11:36:22.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): orig_dests= new_dests= 2024-09-14T11:36:22.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.821+0000 7f5ddce20800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38]): potential dests added=[] removed=[] 2024-09-14T11:36:22.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.824+0000 7f5ddce20800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:22.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.826+0000 7f5c917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.828+0000 7f5ddce20800 20 remove_watcher() i=0 2024-09-14T11:36:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.828+0000 7f5ddce20800 2 removed watcher, disabling cache 2024-09-14T11:36:22.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.829+0000 7f5ddce20800 20 remove_watcher() i=1 2024-09-14T11:36:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.830+0000 7f5ddce20800 20 remove_watcher() i=2 2024-09-14T11:36:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.831+0000 7f5ddce20800 20 remove_watcher() i=3 2024-09-14T11:36:22.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.833+0000 7f5ddce20800 20 remove_watcher() i=4 2024-09-14T11:36:22.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.834+0000 7f5ddce20800 20 remove_watcher() i=5 2024-09-14T11:36:22.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.835+0000 7f5ddce20800 20 remove_watcher() i=6 2024-09-14T11:36:22.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.835+0000 7f5ddce20800 20 remove_watcher() i=7 2024-09-14T11:36:22.846 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:36:22.875 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:22.875 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:22.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.913+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 realm 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.915+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.916+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.916+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.916+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.916+0000 7f839050c800 20 searching for the correct realm 2024-09-14T11:36:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:22.918+0000 7f838d7f5640 0 -- 172.21.15.94:0/2232174686 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f8380073070 msgr2=0x7f83800e0aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:23.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.124+0000 7f838dff6640 0 -- 172.21.15.94:0/2232174686 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f838400a950 msgr2=0x7f83840343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:23.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.330+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 zone default found 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 4 Realm: () 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 zonegroup default 2024-09-14T11:36:23.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 started sync module instance, tier type = 2024-09-14T11:36:23.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.331+0000 7f839050c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=0 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=1 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=2 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=3 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=4 2024-09-14T11:36:23.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=5 2024-09-14T11:36:23.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.341+0000 7f839050c800 20 add_watcher() i=6 2024-09-14T11:36:23.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.342+0000 7f839050c800 20 add_watcher() i=7 2024-09-14T11:36:23.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.342+0000 7f839050c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f823ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f839050c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f839050c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f839050c800 5 note: GC not initialized 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f823effd640 20 reqs_thread_entry: start 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f839050c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f839050c800 20 Filter name: none 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.344+0000 7f823cff9640 20 reqs_thread_entry: start 2024-09-14T11:36:23.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.345+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.346+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.346+0000 7f839050c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.346+0000 7f839050c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:23.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.346+0000 7f839050c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:23.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.348+0000 7f823ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:23.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.350+0000 7f839050c800 20 remove_watcher() i=0 2024-09-14T11:36:23.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.350+0000 7f839050c800 2 removed watcher, disabling cache 2024-09-14T11:36:23.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.351+0000 7f839050c800 20 remove_watcher() i=1 2024-09-14T11:36:23.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.352+0000 7f839050c800 20 remove_watcher() i=2 2024-09-14T11:36:23.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.353+0000 7f839050c800 20 remove_watcher() i=3 2024-09-14T11:36:23.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.354+0000 7f839050c800 20 remove_watcher() i=4 2024-09-14T11:36:23.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.355+0000 7f839050c800 20 remove_watcher() i=5 2024-09-14T11:36:23.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.356+0000 7f839050c800 20 remove_watcher() i=6 2024-09-14T11:36:23.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.357+0000 7f839050c800 20 remove_watcher() i=7 2024-09-14T11:36:23.366 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:23.366 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:23.366 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:23.366 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:23.368 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.368 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.371 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.371 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.414 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.414 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.441 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:36:23.441 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:23.442 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.442 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.453 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.453 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.495 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.495 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.502 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.502 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.510 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.510 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.517 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.517 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.526 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.526 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.533 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.533 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.541 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.541 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.548 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.548 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.555 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.555 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.562 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.562 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.569 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.569 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.576 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.576 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.583 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.583 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.591 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.591 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.598 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.599 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.606 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.606 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.613 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.613 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.620 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.620 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.628 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.628 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.635 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.635 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:23.644 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:36:23.672 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:23.672 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:23.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.710+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.711+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.711+0000 7fbbb95a9800 20 realm 2024-09-14T11:36:23.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.711+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.712+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.712+0000 7fbbb95a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:23.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.712+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.712+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.712+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.713+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:23.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.713+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.713+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:23.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.713+0000 7fbbb95a9800 20 searching for the correct realm 2024-09-14T11:36:23.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.716+0000 7fbbb7894640 0 -- 172.21.15.94:0/3673687252 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fbbac082940 msgr2=0x7fbbac056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:23.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.719+0000 7fbbb7093640 0 -- 172.21.15.94:0/3673687252 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbbac0a0920 msgr2=0x7fbbac062410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.723+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 zone default found 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 4 Realm: () 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 zonegroup default 2024-09-14T11:36:23.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.724+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.725+0000 7fbbb95a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.725+0000 7fbbb95a9800 20 started sync module instance, tier type = 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.725+0000 7fbbb95a9800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:23.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=0 2024-09-14T11:36:23.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=1 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=2 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=3 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=4 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=5 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.733+0000 7fbbb95a9800 20 add_watcher() i=6 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.734+0000 7fbbb95a9800 20 add_watcher() i=7 2024-09-14T11:36:23.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.734+0000 7fbbb95a9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:23.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.735+0000 7fba6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 5 note: GC not initialized 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fba6cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 20 Filter name: none 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fb9e67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:23.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.736+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.737+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.737+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.737+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.737+0000 7fbbb95a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.737+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.738+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.738+0000 7fbbb95a9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.738+0000 7fbbb95a9800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:23.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.738+0000 7fbbb95a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:23.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.739+0000 7fba6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:23.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.741+0000 7fbbb95a9800 20 remove_watcher() i=0 2024-09-14T11:36:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.741+0000 7fbbb95a9800 2 removed watcher, disabling cache 2024-09-14T11:36:23.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.742+0000 7fbbb95a9800 20 remove_watcher() i=1 2024-09-14T11:36:23.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.743+0000 7fbbb95a9800 20 remove_watcher() i=2 2024-09-14T11:36:23.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.744+0000 7fbbb95a9800 20 remove_watcher() i=3 2024-09-14T11:36:23.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.745+0000 7fbbb95a9800 20 remove_watcher() i=4 2024-09-14T11:36:23.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.746+0000 7fbbb95a9800 20 remove_watcher() i=5 2024-09-14T11:36:23.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.747+0000 7fbbb95a9800 20 remove_watcher() i=6 2024-09-14T11:36:23.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.748+0000 7fbbb95a9800 20 remove_watcher() i=7 2024-09-14T11:36:23.756 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:23.756 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:23.757 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:23.757 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:23.758 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:36:23.794 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:23.794 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:23.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.833+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 realm 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:23.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.834+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.835+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:23.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.835+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:23.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.836+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:23.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.836+0000 7fd87d640800 20 searching for the correct realm 2024-09-14T11:36:23.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.838+0000 7fd87b92b640 0 -- 172.21.15.94:0/1808464144 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fd86408d720 msgr2=0x7fd864060320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:23.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:23.842+0000 7fd87b12a640 0 -- 172.21.15.94:0/1808464144 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd8640a2bc0 msgr2=0x7fd8640962e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.048+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 zone default found 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 4 Realm: () 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 zonegroup default 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.049+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.050+0000 7fd87d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.050+0000 7fd87d640800 20 started sync module instance, tier type = 2024-09-14T11:36:24.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.050+0000 7fd87d640800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=0 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=1 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=2 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=3 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=4 2024-09-14T11:36:24.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=5 2024-09-14T11:36:24.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.058+0000 7fd87d640800 20 add_watcher() i=6 2024-09-14T11:36:24.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.059+0000 7fd87d640800 20 add_watcher() i=7 2024-09-14T11:36:24.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.059+0000 7fd87d640800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.061+0000 7fd731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.061+0000 7fd87d640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.061+0000 7fd87d640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.061+0000 7fd87d640800 5 note: GC not initialized 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd730fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 20 Filter name: none 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd6aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 : miss 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.062+0000 7fd87d640800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.063+0000 7fd87d640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 2024-09-14T11:36:24.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.067+0000 7fd87d640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.067+0000 7fd87d640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.067+0000 7fd87d640800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.067+0000 7fd87d640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39, ofs0, ns] 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd75effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497066 cookie 94791432836240 notifier 7472 bl.length()=1015 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd75effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd75effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd75effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_sources= new_sources= 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential sources added=[] removed=[] 2024-09-14T11:36:24.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_dests= new_dests= 2024-09-14T11:36:24.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.068+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential dests added=[] removed=[] 2024-09-14T11:36:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.0 2024-09-14T11:36:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.0 2024-09-14T11:36:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.1 2024-09-14T11:36:24.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.1 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.2 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.2 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.3 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.3 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.4 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.4 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.5 2024-09-14T11:36:24.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.5 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.6 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.6 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.7 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.7 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.8 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.8 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.9 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.9 2024-09-14T11:36:24.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.10 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.10 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.11 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1.11 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.073+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.0 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.074+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1 2024-09-14T11:36:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.074+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.2 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.074+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.3 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.075+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.4 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.075+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.5 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.076+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.6 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.076+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.7 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.077+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.8 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.077+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.9 2024-09-14T11:36:24.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.078+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.10 2024-09-14T11:36:24.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.081+0000 7fd87d640800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:36:24.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.081+0000 7fd87d640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:24.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.081+0000 7fd87d640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 2024-09-14T11:36:24.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39, ofs0, ns] 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd75e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94791432836240 notifier 7472 bl.length()=1015 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd75e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd75e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd75e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_sources= new_sources= 2024-09-14T11:36:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential sources added=[] removed=[] 2024-09-14T11:36:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_dests= new_dests= 2024-09-14T11:36:24.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.082+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential dests added=[] removed=[] 2024-09-14T11:36:24.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.084+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.0 2024-09-14T11:36:24.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.085+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.1 2024-09-14T11:36:24.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.085+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.2 2024-09-14T11:36:24.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.085+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.3 2024-09-14T11:36:24.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.086+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.4 2024-09-14T11:36:24.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.086+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.5 2024-09-14T11:36:24.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.086+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.6 2024-09-14T11:36:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.087+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.7 2024-09-14T11:36:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.087+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.8 2024-09-14T11:36:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.087+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.9 2024-09-14T11:36:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.087+0000 7fd87d640800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39.10 2024-09-14T11:36:24.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.088+0000 7fd87d640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:24.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.088+0000 7fd87d640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 2024-09-14T11:36:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.089+0000 7fd87d640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.089+0000 7fd87d640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.089+0000 7fd87d640800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.089+0000 7fd87d640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39, ofs0, ns] 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd75e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94791432836240 notifier 7472 bl.length()=983 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd75e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 info.flags=0x17 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd75e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 to cache LRU end 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd75e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_sources= new_sources= 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential sources added=[] removed=[] 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): orig_dests= new_dests= 2024-09-14T11:36:24.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.090+0000 7fd87d640800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39]): potential dests added=[] removed=[] 2024-09-14T11:36:24.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.092+0000 7fd87d640800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:24.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.094+0000 7fd731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.096+0000 7fd87d640800 20 remove_watcher() i=0 2024-09-14T11:36:24.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.096+0000 7fd87d640800 2 removed watcher, disabling cache 2024-09-14T11:36:24.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.097+0000 7fd87d640800 20 remove_watcher() i=1 2024-09-14T11:36:24.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.098+0000 7fd87d640800 20 remove_watcher() i=2 2024-09-14T11:36:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.099+0000 7fd87d640800 20 remove_watcher() i=3 2024-09-14T11:36:24.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.100+0000 7fd87d640800 20 remove_watcher() i=4 2024-09-14T11:36:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.101+0000 7fd87d640800 20 remove_watcher() i=5 2024-09-14T11:36:24.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.101+0000 7fd87d640800 20 remove_watcher() i=6 2024-09-14T11:36:24.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.102+0000 7fd87d640800 20 remove_watcher() i=7 2024-09-14T11:36:24.112 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:36:24.140 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:24.141 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:24.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.178+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 20 realm 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.180+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.181+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.181+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.181+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.182+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.182+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.182+0000 7fb2ec3ad800 20 searching for the correct realm 2024-09-14T11:36:24.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.185+0000 7fb2e1696640 0 -- 172.21.15.94:0/3612564058 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5606e6b1e710 msgr2=0x5606e6b20b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.188+0000 7fb2e9e97640 0 -- 172.21.15.94:0/3612564058 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb2d4069390 msgr2=0x7fb2d4057210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.192+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 zone default found 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 4 Realm: () 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 zonegroup default 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.193+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.194+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.194+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.194+0000 7fb2ec3ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.194+0000 7fb2ec3ad800 20 started sync module instance, tier type = 2024-09-14T11:36:24.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.194+0000 7fb2ec3ad800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=0 2024-09-14T11:36:24.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=1 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=2 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=3 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=4 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=5 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.202+0000 7fb2ec3ad800 20 add_watcher() i=6 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.203+0000 7fb2ec3ad800 20 add_watcher() i=7 2024-09-14T11:36:24.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.203+0000 7fb2ec3ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.204+0000 7fb19b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 5 note: GC not initialized 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb19a7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 20 Filter name: none 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb10bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:24.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.205+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.206+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.206+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.207+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.207+0000 7fb2ec3ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.207+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.207+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.207+0000 7fb2ec3ad800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.208+0000 7fb2ec3ad800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.208+0000 7fb2ec3ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.210+0000 7fb19b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.212+0000 7fb2ec3ad800 20 remove_watcher() i=0 2024-09-14T11:36:24.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.212+0000 7fb2ec3ad800 2 removed watcher, disabling cache 2024-09-14T11:36:24.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.213+0000 7fb2ec3ad800 20 remove_watcher() i=1 2024-09-14T11:36:24.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.213+0000 7fb2ec3ad800 20 remove_watcher() i=2 2024-09-14T11:36:24.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.214+0000 7fb2ec3ad800 20 remove_watcher() i=3 2024-09-14T11:36:24.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.215+0000 7fb2ec3ad800 20 remove_watcher() i=4 2024-09-14T11:36:24.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.216+0000 7fb2ec3ad800 20 remove_watcher() i=5 2024-09-14T11:36:24.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.217+0000 7fb2ec3ad800 20 remove_watcher() i=6 2024-09-14T11:36:24.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.218+0000 7fb2ec3ad800 20 remove_watcher() i=7 2024-09-14T11:36:24.226 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.227 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:24.227 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:36:24.227 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.228 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.228 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.231 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.232 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.275 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.275 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.301 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:36:24.301 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.303 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.303 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.314 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.356 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.372 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.381 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.389 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.396 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.412 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.419 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.427 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.428 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.435 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.435 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.443 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.443 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.451 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.451 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.460 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.460 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.468 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.468 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.475 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.475 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.483 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.483 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.491 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.491 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.499 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.499 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.506 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.506 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.514 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:36:24.542 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:24.542 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:24.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.581+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 realm 2024-09-14T11:36:24.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.583+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.584+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.584+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.584+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.584+0000 7fa3bd340800 20 searching for the correct realm 2024-09-14T11:36:24.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.587+0000 7fa3b3fff640 0 -- 172.21.15.94:0/3884483072 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55a6c1a36c70 msgr2=0x55a6c1a39060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.590+0000 7fa3b90c0640 0 -- 172.21.15.94:0/3884483072 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fa3a40e4b30 msgr2=0x7fa3a40ad570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.594+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 zone default found 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 4 Realm: () 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 zonegroup default 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.595+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.596+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.596+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.596+0000 7fa3bd340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.596+0000 7fa3bd340800 20 started sync module instance, tier type = 2024-09-14T11:36:24.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.596+0000 7fa3bd340800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=0 2024-09-14T11:36:24.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=1 2024-09-14T11:36:24.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=2 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=3 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=4 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=5 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.604+0000 7fa3bd340800 20 add_watcher() i=6 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.605+0000 7fa3bd340800 20 add_watcher() i=7 2024-09-14T11:36:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.605+0000 7fa3bd340800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa26ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 5 note: GC not initialized 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa26efe5640 20 reqs_thread_entry: start 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 20 Filter name: none 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa26cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.607+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.608+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.609+0000 7fa3bd340800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.609+0000 7fa3bd340800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.609+0000 7fa3bd340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.611+0000 7fa26ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.613+0000 7fa3bd340800 20 remove_watcher() i=0 2024-09-14T11:36:24.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.613+0000 7fa3bd340800 2 removed watcher, disabling cache 2024-09-14T11:36:24.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.614+0000 7fa3bd340800 20 remove_watcher() i=1 2024-09-14T11:36:24.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.615+0000 7fa3bd340800 20 remove_watcher() i=2 2024-09-14T11:36:24.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.616+0000 7fa3bd340800 20 remove_watcher() i=3 2024-09-14T11:36:24.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.617+0000 7fa3bd340800 20 remove_watcher() i=4 2024-09-14T11:36:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.618+0000 7fa3bd340800 20 remove_watcher() i=5 2024-09-14T11:36:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.619+0000 7fa3bd340800 20 remove_watcher() i=6 2024-09-14T11:36:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.620+0000 7fa3bd340800 20 remove_watcher() i=7 2024-09-14T11:36:24.628 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.628 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:24.628 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:24.628 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.629 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:36:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:24.663 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:24.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.701+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 realm 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.704+0000 7f297bb26800 20 searching for the correct realm 2024-09-14T11:36:24.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.707+0000 7f296f06e640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x563d89e29b30 msgr2=0x563d89e2bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.711+0000 7f297786f640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f296008f480 msgr2=0x7f296007b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 zone default found 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 4 Realm: () 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 zonegroup default 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 started sync module instance, tier type = 2024-09-14T11:36:24.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.716+0000 7f297bb26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=0 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=1 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=2 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=3 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=4 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=5 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=6 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.725+0000 7f297bb26800 20 add_watcher() i=7 2024-09-14T11:36:24.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.725+0000 7f297bb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.727+0000 7f282dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.727+0000 7f297bb26800 5 note: GC not initialized 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f282cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 20 Filter name: none 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f27a67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : miss 2024-09-14T11:36:24.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.729+0000 7f297bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94822306331280 notifier 7526 bl.length()=1015 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:24.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:24.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:24.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.0 2024-09-14T11:36:24.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.742+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.3 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.4 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.5 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.6 2024-09-14T11:36:24.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.7 2024-09-14T11:36:24.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.8 2024-09-14T11:36:24.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.9 2024-09-14T11:36:24.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.746+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.10 2024-09-14T11:36:24.747 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f297bb26800 time 2024-09-14T11:36:24.749937+0000 2024-09-14T11:36:24.747 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f297d38c76a] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:24.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.749+0000 7f297bb26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f297bb26800 time 2024-09-14T11:36:24.749937+0000 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f297d38c76a] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:24.749 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.750 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:24.750 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f297bb26800 thread_name:radosgw-admin 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f297c03e6f0] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f297c08b99c] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f297d38c7c4] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.766 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.750+0000 7f297bb26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f297bb26800 thread_name:radosgw-admin 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f297c03e6f0] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f297c08b99c] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f297d38c7c4] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.767 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.768 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:36:24.686+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:36:24.687+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:36:24.687+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key hook 0x563d89d34698 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89bed8c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89c77950 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89c7ddb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.769 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.178212s 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89c77950 auth_method 0 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89bed8c0 auth_method 0 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.770 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:36:24.687+0000 7f296f06e640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: dump: 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.771 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:36:24.687+0000 7f297bb26800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: dump: 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.772 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:36:24.687+0000 7f2865e0b640 4 set_mon_vals no callback set 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:36:24.687+0000 7f297bb26800 1 librados: init done 2024-09-14T11:36:24.773 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:36:24.689+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2860077230 auth_method 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:36:24.690+0000 7f2978070640 10 monclient: get_auth_request con 0x563d89d7d050 auth_method 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:36:24.690+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89d80230 auth_method 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:36:24.692+0000 7f296f06e640 10 monclient: get_auth_request con 0x563d89d852c0 auth_method 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:36:24.692+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:36:24.692+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:36:24.692+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.774 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.775 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:36:24.692+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 asok(0x563d89b15270) register_command objecter_requests cmddesc objecter_requests hook 0x563d89d8c700 EEXIST 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.776 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:36:24.693+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:36:24.693+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x563d89d882d0 EEXIST 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89db0a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.777 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89db0e00 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89daf730 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.184743s 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89db0a20 auth_method 0 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89daf730 auth_method 0 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.778 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89db0e00 auth_method 0 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.779 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:36:24.694+0000 7f297786f640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: dump: 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.780 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:36:24.694+0000 7f297bb26800 5 monclient: authenticate success, global_id 7520 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: dump: 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.781 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:36:24.694+0000 7f2978871640 4 set_mon_vals no callback set 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: get_monmap_and_config 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:36:24.696+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.782 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.783 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:36:24.696+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f2850077140 auth_method 0 2024-09-14T11:36:24.784 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:36:24.696+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.785 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:36:24.697+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:36:24.697+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x7ffc67c6c918 EEXIST 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89dd5840 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89e057d0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89e001e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.786 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.188504s 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89dd5840 auth_method 0 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89e001e0 auth_method 0 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89e057d0 auth_method 0 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.787 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_done global_id 7968 payload 274 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:36:24.697+0000 7f297786f640 1 monclient: found mon.noname-a 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:36:24.697+0000 7f2856ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: dump: 2024-09-14T11:36:24.788 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:24.789 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: dump: 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 monclient: authenticate success, global_id 7968 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:36:24.698+0000 7f297bb26800 4 set_mon_vals no callback set 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: shutdown 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.790 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.791 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:36:24.698+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 librados: starting msgr at 2024-09-14T11:36:24.792 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 librados: starting objecter 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 asok(0x563d89b15270) register_command objecter_requests cmddesc objecter_requests hook 0x563d89dd0280 EEXIST 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:36:24.699+0000 7f297bb26800 1 librados: setting wanted keys 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:36:24.699+0000 7f297bb26800 1 librados: calling monclient init 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.793 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:36:24.699+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:36:24.699+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x563d89dc5428 EEXIST 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89dd5840 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89e001e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89e057d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.794 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.190668s 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89e001e0 auth_method 0 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89e057d0 auth_method 0 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.795 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89dd5840 auth_method 0 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.796 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:36:24.699+0000 7f296f06e640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: dump: 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.797 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: dump: 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.798 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:36:24.700+0000 7f297bb26800 5 monclient: authenticate success, global_id 7526 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:36:24.700+0000 7f2856ffd640 4 set_mon_vals no callback set 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:36:24.700+0000 7f297bb26800 1 librados: init done 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:36:24.700+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cr dump hook 0x563d89df3d18 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:36:24.701+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.799 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:36:24.702+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2840077230 auth_method 0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:36:24.702+0000 7f2978070640 10 monclient: get_auth_request con 0x563d89e20640 auth_method 0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 realm 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:36:24.703+0000 7f297bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:36:24.703+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89e24900 auth_method 0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.800 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 searching for the correct realm 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:36:24.704+0000 7f296f06e640 10 monclient: get_auth_request con 0x563d89e29b30 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:36:24.705+0000 7f2978070640 10 monclient: get_auth_request con 0x7f296006f030 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:36:24.705+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2970020040 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:36:24.706+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f2968085070 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:36:24.707+0000 7f296f06e640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x563d89e29b30 msgr2=0x563d89e2bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:36:24.707+0000 7f28557fa640 1 client.7526.objecter ms_handle_reset 0x563d89e29b30 session 0x563d89e294b0 osd.3 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:36:24.707+0000 7f28557fa640 10 monclient: _renew_subs 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:36:24.707+0000 7f28557fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:36:24.707+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f28400878e0 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:36:24.708+0000 7f2978070640 10 monclient: get_auth_request con 0x7f296000b040 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:36:24.710+0000 7f297786f640 10 monclient: get_auth_request con 0x7f296008f480 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:36:24.711+0000 7f297786f640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f296008f480 msgr2=0x7f296007b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:36:24.711+0000 7f28557fa640 1 client.7526.objecter ms_handle_reset 0x7f296008f480 session 0x7f296004df70 osd.0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:36:24.711+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89e29b30 auth_method 0 2024-09-14T11:36:24.801 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 zone default found 2024-09-14T11:36:24.802 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 Realm: () 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:36:24.715+0000 7f297bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 zonegroup default 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 started sync module instance, tier type = 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=0 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=1 2024-09-14T11:36:24.803 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=2 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=3 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=4 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=5 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=6 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:36:24.725+0000 7f297bb26800 20 add_watcher() i=7 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:36:24.725+0000 7f297bb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.804 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:36:24.727+0000 7f282dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:36:24.727+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache list hook 0x563d89e04eb0 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache inspect hook 0x563d89e04eb0 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache erase hook 0x563d89e04eb0 2024-09-14T11:36:24.805 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache zap hook 0x563d89e04eb0 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 note: GC not initialized 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:36:24.728+0000 7f282cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace show hook 0x7f296805a070 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace history hook 0x7f296805a070 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace active hook 0x7f296805a070 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace active_short hook 0x7f296805a070 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 Filter name: none 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:36:24.728+0000 7f27a67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:36:24.806 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : miss 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:36:24.729+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94822306331280 notifier 7526 bl.length()=1015 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.807 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.808 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.809 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.0 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:36:24.742+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.3 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.4 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.5 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.6 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.7 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.8 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.9 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:36:24.746+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.10 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:36:24.749+0000 7f297bb26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f297bb26800 time 2024-09-14T11:36:24.749937+0000 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.810 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f297d38c76a] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:36:24.750+0000 7f297bb26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f297bb26800 thread_name:radosgw-admin 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.811 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f297c03e6f0] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f297c08b99c] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f297d38c7c4] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:36:24.813 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:36:24.814 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:36:24.815 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:36:24.816 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:36:24.818 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f27a67fc640 / http_manager 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f282cfe1640 / http_manager 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f282dfe3640 / rgw_dt_lg_renew 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28557fa640 / ms_dispatch 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2856ffd640 / io_context_pool 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f285d7fa640 / ms_dispatch 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f285ffff640 / ms_dispatch 2024-09-14T11:36:24.819 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2865e0b640 / io_context_pool 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: 7f296f06e640 / msgr-worker-2 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: 7f297786f640 / msgr-worker-1 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2978070640 / msgr-worker-0 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2978871640 / io_context_pool 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: 7f297bb26800 / radosgw-admin 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.143018.log 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.820 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: crc 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:36:24.686+0000 7f297bb26800 5 AuthRegistry(0x563d89d34550) adding con mode: secure 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:36:24.686+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:36:24.687+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:36:24.687+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key hook 0x563d89d34698 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89bed8c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.821 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89c77950 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89c7ddb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.178212s 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89c77950 auth_method 0 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89bed8c0 auth_method 0 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.822 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:36:24.687+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:36:24.687+0000 7f296f06e640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:36:24.687+0000 7f296f06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: dump: 2024-09-14T11:36:24.823 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:36:24.687+0000 7f297bb26800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.824 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:36:24.687+0000 7f285ffff640 10 monclient: dump: 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.825 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:36:24.687+0000 7f2865e0b640 4 set_mon_vals no callback set 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:36:24.687+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:36:24.687+0000 7f297bb26800 1 librados: init done 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:36:24.689+0000 7f285ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:36:24.689+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2860077230 auth_method 0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:36:24.690+0000 7f2978070640 10 monclient: get_auth_request con 0x563d89d7d050 auth_method 0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:36:24.690+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89d80230 auth_method 0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:36:24.692+0000 7f296f06e640 10 monclient: get_auth_request con 0x563d89d852c0 auth_method 0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:36:24.692+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:36:24.692+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.826 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:36:24.692+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding auth protocol: cephx 2024-09-14T11:36:24.827 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: crc 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:36:24.692+0000 7f297bb26800 5 AuthRegistry(0x563d89d891d0) adding con mode: secure 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:36:24.692+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.828 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 asok(0x563d89b15270) register_command objecter_requests cmddesc objecter_requests hook 0x563d89d8c700 EEXIST 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding auth protocol: cephx 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.829 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: crc 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 AuthRegistry(0x563d89d88188) adding con mode: secure 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:36:24.693+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:36:24.693+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:36:24.693+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x563d89d882d0 EEXIST 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89db0a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89db0e00 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89daf730 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.830 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:36:24.693+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.184743s 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89db0a20 auth_method 0 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89daf730 auth_method 0 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.831 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:36:24.693+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:36:24.693+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89db0e00 auth_method 0 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:36:24.693+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:36:24.694+0000 7f297786f640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:36:24.694+0000 7f297786f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.832 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: dump: 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.833 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:36:24.694+0000 7f297bb26800 5 monclient: authenticate success, global_id 7520 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:36:24.694+0000 7f285d7fa640 10 monclient: dump: 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.834 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:36:24.694+0000 7f2978871640 4 set_mon_vals no callback set 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:36:24.694+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:36:24.696+0000 7f285d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: get_monmap_and_config 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:36:24.696+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.835 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding auth protocol: cephx 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.836 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: crc 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x563d89dd0590) adding con mode: secure 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:36:24.696+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f2850077140 auth_method 0 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:36:24.696+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:36:24.696+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.837 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding auth protocol: cephx 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:36:24.696+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: crc 2024-09-14T11:36:24.838 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6c7d0) adding con mode: secure 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:36:24.697+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:36:24.697+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:36:24.697+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x7ffc67c6c918 EEXIST 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89dd5840 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89e057d0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89e001e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:36:24.697+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.188504s 2024-09-14T11:36:24.839 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89dd5840 auth_method 0 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89e001e0 auth_method 0 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89e057d0 auth_method 0 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.840 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:36:24.697+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:36:24.697+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient(hunting): handle_auth_done global_id 7968 payload 274 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:36:24.697+0000 7f297786f640 1 monclient: found mon.noname-a 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:36:24.697+0000 7f297786f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:36:24.697+0000 7f2856ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:24.841 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: dump: 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:24.842 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:36:24.698+0000 7f2856ffd640 10 monclient: dump: 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 monclient: authenticate success, global_id 7968 2024-09-14T11:36:24.843 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:36:24.698+0000 7f297bb26800 4 set_mon_vals no callback set 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: shutdown 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: build_initial_monmap 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 build_initial for_mkfs: 0 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:36:24.698+0000 7f297bb26800 10 monclient: monmap: 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.844 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding auth protocol: cephx 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: crc 2024-09-14T11:36:24.845 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:36:24.698+0000 7f297bb26800 5 AuthRegistry(0x563d89dd6890) adding con mode: secure 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:36:24.698+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 librados: starting msgr at 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:36:24.698+0000 7f297bb26800 1 librados: starting objecter 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 asok(0x563d89b15270) register_command objecter_requests cmddesc objecter_requests hook 0x563d89dd0280 EEXIST 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:36:24.699+0000 7f297bb26800 1 librados: setting wanted keys 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:36:24.699+0000 7f297bb26800 1 librados: calling monclient init 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: init 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding auth protocol: cephx 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.846 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: crc 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 AuthRegistry(0x563d89dc52e0) adding con mode: secure 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:36:24.699+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:36:24.699+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:36:24.699+0000 7f297bb26800 5 asok(0x563d89b15270) register_command rotate-key cmddesc rotate-key hook 0x563d89dc5428 EEXIST 2024-09-14T11:36:24.847 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-b con 0x563d89dd5840 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-c con 0x563d89e001e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): picked mon.noname-a con 0x563d89e057d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:36:24.699+0000 7f297bb26800 10 monclient(hunting): authenticate will time out at 2098.190668s 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): get_auth_request con 0x563d89e001e0 auth_method 0 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): get_auth_request con 0x563d89e057d0 auth_method 0 2024-09-14T11:36:24.848 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): get_auth_request con 0x563d89dd5840 auth_method 0 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:36:24.699+0000 7f2978070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.849 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:36:24.699+0000 7f297786f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient: _finish_hunting 0 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:36:24.699+0000 7f296f06e640 1 monclient: found mon.noname-c 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:36:24.699+0000 7f296f06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: dump: 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.850 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:36:24.700+0000 7f28557fa640 10 monclient: dump: 2024-09-14T11:36:24.851 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:36:24.700+0000 7f297bb26800 5 monclient: authenticate success, global_id 7526 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:36:24.700+0000 7f2856ffd640 4 set_mon_vals no callback set 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _renew_subs 2024-09-14T11:36:24.852 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:36:24.700+0000 7f297bb26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:36:24.700+0000 7f297bb26800 1 librados: init done 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:36:24.700+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cr dump hook 0x563d89df3d18 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:36:24.701+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:36:24.702+0000 7f28557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:36:24.702+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2840077230 auth_method 0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:36:24.702+0000 7f2978070640 10 monclient: get_auth_request con 0x563d89e20640 auth_method 0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 realm 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.853 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:36:24.703+0000 7f297bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:36:24.703+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:36:24.703+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89e24900 auth_method 0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:36:24.704+0000 7f297bb26800 20 searching for the correct realm 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:36:24.704+0000 7f296f06e640 10 monclient: get_auth_request con 0x563d89e29b30 auth_method 0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:36:24.705+0000 7f2978070640 10 monclient: get_auth_request con 0x7f296006f030 auth_method 0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:36:24.705+0000 7f297786f640 10 monclient: get_auth_request con 0x7f2970020040 auth_method 0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:36:24.706+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f2968085070 auth_method 0 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:36:24.707+0000 7f296f06e640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x563d89e29b30 msgr2=0x563d89e2bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.854 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:36:24.707+0000 7f28557fa640 1 client.7526.objecter ms_handle_reset 0x563d89e29b30 session 0x563d89e294b0 osd.3 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:36:24.707+0000 7f28557fa640 10 monclient: _renew_subs 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:36:24.707+0000 7f28557fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:36:24.707+0000 7f296f06e640 10 monclient: get_auth_request con 0x7f28400878e0 auth_method 0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:36:24.708+0000 7f2978070640 10 monclient: get_auth_request con 0x7f296000b040 auth_method 0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:36:24.710+0000 7f297786f640 10 monclient: get_auth_request con 0x7f296008f480 auth_method 0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:36:24.711+0000 7f297786f640 0 -- 172.21.15.94:0/292517132 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f296008f480 msgr2=0x7f296007b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:36:24.711+0000 7f28557fa640 1 client.7526.objecter ms_handle_reset 0x7f296008f480 session 0x7f296004df70 osd.0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:36:24.711+0000 7f297786f640 10 monclient: get_auth_request con 0x563d89e29b30 auth_method 0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.855 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:36:24.714+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 zone default found 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 Realm: () 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:36:24.715+0000 7f297bb26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:36:24.715+0000 7f297bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 zonegroup default 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:36:24.715+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.856 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 started sync module instance, tier type = 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:36:24.716+0000 7f297bb26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=0 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=1 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=2 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=3 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=4 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=5 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:36:24.724+0000 7f297bb26800 20 add_watcher() i=6 2024-09-14T11:36:24.857 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:36:24.725+0000 7f297bb26800 20 add_watcher() i=7 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:36:24.725+0000 7f297bb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding auth protocol: cephx 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:36:24.727+0000 7f282dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.858 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: crc 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 AuthRegistry(0x7ffc67c6ccb0) adding con mode: secure 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:36:24.727+0000 7f297bb26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:36:24.727+0000 7f297bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache list hook 0x563d89e04eb0 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache inspect hook 0x563d89e04eb0 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache erase hook 0x563d89e04eb0 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 asok(0x563d89b15270) register_command cache zap hook 0x563d89e04eb0 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:36:24.727+0000 7f297bb26800 5 note: GC not initialized 2024-09-14T11:36:24.859 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:36:24.728+0000 7f282cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace show hook 0x7f296805a070 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace history hook 0x7f296805a070 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace active hook 0x7f296805a070 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:36:24.728+0000 7f297bb26800 5 asok(0x563d89b15270) register_command sync trace active_short hook 0x7f296805a070 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 Filter name: none 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:36:24.728+0000 7f27a67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:36:24.728+0000 7f297bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : miss 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:36:24.728+0000 7f297bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:36:24.729+0000 7f297bb26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:36:24.729+0000 7f297bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:36:24.735+0000 7f297bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94822306331280 notifier 7526 bl.length()=1015 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:36:24.735+0000 7f2856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:36:24.735+0000 7f297bb26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.0 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.1 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.2 2024-09-14T11:36:24.862 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.3 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.4 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.5 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.6 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.7 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.8 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.9 2024-09-14T11:36:24.863 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.10 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:36:24.741+0000 7f297bb26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1.11 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.0 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:36:24.741+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:36:24.742+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.3 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.4 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:36:24.743+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.5 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.6 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:36:24.744+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.7 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.8 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:36:24.745+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.9 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:36:24.746+0000 7f297bb26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.10 2024-09-14T11:36:24.864 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:36:24.749+0000 7f297bb26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f297bb26800 time 2024-09-14T11:36:24.749937+0000 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f297d38c76a] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:36:24.750+0000 7f297bb26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:24.865 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f297bb26800 thread_name:radosgw-admin 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f297c03e6f0] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f297c08b99c] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f297d38c7c4] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f297d38c928] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563d879280b1] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x563d87937124] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x563d87937fc4] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f297c029590] 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:24.866 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:24.867 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:36:24.868 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:36:24.869 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:36:24.870 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:36:24.871 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:36:24.872 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f27a67fc640 / http_manager 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f282cfe1640 / http_manager 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f282dfe3640 / rgw_dt_lg_renew 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28557fa640 / ms_dispatch 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2856ffd640 / io_context_pool 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f285d7fa640 / ms_dispatch 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f285ffff640 / ms_dispatch 2024-09-14T11:36:24.873 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2865e0b640 / io_context_pool 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: 7f296f06e640 / msgr-worker-2 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: 7f297786f640 / msgr-worker-1 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2978070640 / msgr-worker-0 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2978871640 / io_context_pool 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: 7f297bb26800 / radosgw-admin 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:24.751589Z_0b9bfcf3-159d-46f4-a529-e9b91993cbb0/log 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:36:24.874 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.825+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 realm 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.827+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.828+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.828+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.828+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.828+0000 7fe41601d800 20 searching for the correct realm 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.831+0000 7fe408fea640 0 -- 172.21.15.94:0/4247770738 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55cafeb40820 msgr2=0x55cafeb42c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.835+0000 7fe4117eb640 0 -- 172.21.15.94:0/4247770738 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fe3fc06dd30 msgr2=0x7fe3fc02fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.839+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 zone default found 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 4 Realm: () 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 zonegroup default 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.840+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.841+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.841+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.841+0000 7fe41601d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.841+0000 7fe41601d800 20 started sync module instance, tier type = 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.841+0000 7fe41601d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=0 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=1 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=2 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=3 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=4 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=5 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.849+0000 7fe41601d800 20 add_watcher() i=6 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.850+0000 7fe41601d800 20 add_watcher() i=7 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.850+0000 7fe41601d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.851+0000 7fe2c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:24.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 5 note: GC not initialized 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe2c67e4640 20 reqs_thread_entry: start 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 20 Filter name: none 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe237fff640 20 reqs_thread_entry: start 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.852+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.853+0000 7fe41601d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.854+0000 7fe41601d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.854+0000 7fe41601d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:24.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.855+0000 7fe2c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.858+0000 7fe41601d800 20 remove_watcher() i=0 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.858+0000 7fe41601d800 2 removed watcher, disabling cache 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.859+0000 7fe41601d800 20 remove_watcher() i=1 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.859+0000 7fe41601d800 20 remove_watcher() i=2 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.860+0000 7fe41601d800 20 remove_watcher() i=3 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.861+0000 7fe41601d800 20 remove_watcher() i=4 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.862+0000 7fe41601d800 20 remove_watcher() i=5 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.863+0000 7fe41601d800 20 remove_watcher() i=6 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.864+0000 7fe41601d800 20 remove_watcher() i=7 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.884 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.885 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:24.885 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:24.927 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:24.958 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:24.958 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:24.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.996+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 realm 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:24.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:24.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.998+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.999+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:24.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.999+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:24.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.999+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:24.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:24.999+0000 7f69a3c10800 20 searching for the correct realm 2024-09-14T11:36:25.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.002+0000 7f6997fff640 0 -- 172.21.15.94:0/997600896 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f699009a040 msgr2=0x7f699007d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:25.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.206+0000 7f699f41a640 0 -- 172.21.15.94:0/997600896 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f698806cb00 msgr2=0x7f6988064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:25.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:25.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.412+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:25.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 zone default found 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 4 Realm: () 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 zonegroup default 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.413+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.414+0000 7f69a3c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.414+0000 7f69a3c10800 20 started sync module instance, tier type = 2024-09-14T11:36:25.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.414+0000 7f69a3c10800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:25.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=0 2024-09-14T11:36:25.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=1 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=2 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=3 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=4 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=5 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.422+0000 7f69a3c10800 20 add_watcher() i=6 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.423+0000 7f69a3c10800 20 add_watcher() i=7 2024-09-14T11:36:25.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.423+0000 7f69a3c10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:25.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f6855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f69a3c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f69a3c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f69a3c10800 5 note: GC not initialized 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f6854fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f69a3c10800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.425+0000 7f69a3c10800 20 Filter name: none 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f67ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:36:25.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:25.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:25.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:36:25.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : miss 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.426+0000 7f69a3c10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:25.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.428+0000 7f69a3c10800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to be held by another RGW process; skipping for now 2024-09-14T11:36:25.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.429+0000 7f6855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.430+0000 7f69a3c10800 20 remove_watcher() i=0 2024-09-14T11:36:25.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.430+0000 7f69a3c10800 2 removed watcher, disabling cache 2024-09-14T11:36:25.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.431+0000 7f69a3c10800 20 remove_watcher() i=1 2024-09-14T11:36:25.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.432+0000 7f69a3c10800 20 remove_watcher() i=2 2024-09-14T11:36:25.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.433+0000 7f69a3c10800 20 remove_watcher() i=3 2024-09-14T11:36:25.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.434+0000 7f69a3c10800 20 remove_watcher() i=4 2024-09-14T11:36:25.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.435+0000 7f69a3c10800 20 remove_watcher() i=5 2024-09-14T11:36:25.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.436+0000 7f69a3c10800 20 remove_watcher() i=6 2024-09-14T11:36:25.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:25.437+0000 7f69a3c10800 20 remove_watcher() i=7 2024-09-14T11:36:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:36:55.476 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:55.511 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:55.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.555+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.556+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.556+0000 7f4a6af22800 20 realm 2024-09-14T11:36:55.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.556+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.557+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.557+0000 7f4a6af22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.557+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.557+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.557+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.558+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.558+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.558+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:55.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.558+0000 7f4a6af22800 20 searching for the correct realm 2024-09-14T11:36:55.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.562+0000 7f4a663d1640 0 -- 172.21.15.94:0/3809131010 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5579e43b33b0 msgr2=0x5579e43b5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.566+0000 7f4a66bd2640 0 -- 172.21.15.94:0/3809131010 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4a5c070370 msgr2=0x7f4a5c09f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:55.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.571+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 zone default found 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 4 Realm: () 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 zonegroup default 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.572+0000 7f4a6af22800 20 started sync module instance, tier type = 2024-09-14T11:36:55.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.573+0000 7f4a6af22800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=0 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=1 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=2 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=3 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=4 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=5 2024-09-14T11:36:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.582+0000 7f4a6af22800 20 add_watcher() i=6 2024-09-14T11:36:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.583+0000 7f4a6af22800 20 add_watcher() i=7 2024-09-14T11:36:55.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.583+0000 7f4a6af22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.585+0000 7f491d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.585+0000 7f4a6af22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.585+0000 7f4a6af22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.585+0000 7f4a6af22800 5 note: GC not initialized 2024-09-14T11:36:55.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4897fff640 20 reqs_thread_entry: start 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 20 Filter name: none 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4895ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:36:55.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : miss 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.586+0000 7f4a6af22800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.587+0000 7f4a6af22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:55.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.588+0000 7f4a6af22800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4a6af22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4a6af22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4a6af22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4a6af22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 93982008497280 notifier 8028 bl.length()=1015 2024-09-14T11:36:55.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.595+0000 7f4949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.596+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.596+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.596+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:55.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.596+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.0 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.0 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.1 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.1 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.2 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.2 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.3 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.3 2024-09-14T11:36:55.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.4 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.4 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.5 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.5 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.6 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.6 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.7 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.7 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.8 2024-09-14T11:36:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.8 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.9 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.9 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.10 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.10 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.11 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2.11 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.0 2024-09-14T11:36:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.602+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1 2024-09-14T11:36:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.603+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2 2024-09-14T11:36:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.603+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.3 2024-09-14T11:36:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.604+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.4 2024-09-14T11:36:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.604+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.5 2024-09-14T11:36:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.605+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.6 2024-09-14T11:36:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.605+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.7 2024-09-14T11:36:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.605+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.8 2024-09-14T11:36:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.606+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.9 2024-09-14T11:36:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.607+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.10 2024-09-14T11:36:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.610+0000 7f4a6af22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.610+0000 7f4a6af22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.611+0000 7f4a6af22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.611+0000 7f4a6af22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.611+0000 7f4a6af22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.611+0000 7f4a6af22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.611+0000 7f4949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 93982008497280 notifier 8028 bl.length()=1015 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:55.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.612+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.615+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.0 2024-09-14T11:36:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.615+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.1 2024-09-14T11:36:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.615+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.2 2024-09-14T11:36:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.616+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.3 2024-09-14T11:36:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.616+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.4 2024-09-14T11:36:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.617+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.5 2024-09-14T11:36:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.617+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.6 2024-09-14T11:36:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.617+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.7 2024-09-14T11:36:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.617+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.8 2024-09-14T11:36:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.618+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.9 2024-09-14T11:36:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.618+0000 7f4a6af22800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40.10 2024-09-14T11:36:55.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.618+0000 7f4a6af22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:55.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.618+0000 7f4a6af22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 2024-09-14T11:36:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4a6af22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4a6af22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4a6af22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4a6af22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40, ofs0, ns] 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 93982008497280 notifier 8028 bl.length()=983 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 info.flags=0x17 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 to cache LRU end 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.620+0000 7f4949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.621+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_sources= new_sources= 2024-09-14T11:36:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.621+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential sources added=[] removed=[] 2024-09-14T11:36:55.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.621+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): orig_dests= new_dests= 2024-09-14T11:36:55.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.621+0000 7f4a6af22800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40]): potential dests added=[] removed=[] 2024-09-14T11:36:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.623+0000 7f4a6af22800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.625+0000 7f491d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.627+0000 7f4a6af22800 20 remove_watcher() i=0 2024-09-14T11:36:55.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.627+0000 7f4a6af22800 2 removed watcher, disabling cache 2024-09-14T11:36:55.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.628+0000 7f4a6af22800 20 remove_watcher() i=1 2024-09-14T11:36:55.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.629+0000 7f4a6af22800 20 remove_watcher() i=2 2024-09-14T11:36:55.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.630+0000 7f4a6af22800 20 remove_watcher() i=3 2024-09-14T11:36:55.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.631+0000 7f4a6af22800 20 remove_watcher() i=4 2024-09-14T11:36:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.632+0000 7f4a6af22800 20 remove_watcher() i=5 2024-09-14T11:36:55.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.633+0000 7f4a6af22800 20 remove_watcher() i=6 2024-09-14T11:36:55.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.634+0000 7f4a6af22800 20 remove_watcher() i=7 2024-09-14T11:36:55.644 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:36:55.673 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:55.673 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:55.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.711+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 realm 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.713+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.714+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.714+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.714+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:55.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.714+0000 7fe3b4137800 20 searching for the correct realm 2024-09-14T11:36:55.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.717+0000 7fe3a7fff640 0 -- 172.21.15.94:0/2911677671 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5624e7a135f0 msgr2=0x5624e7a159e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.721+0000 7fe3afe7d640 0 -- 172.21.15.94:0/2911677671 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fe3980bf820 msgr2=0x7fe3980a38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:55.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 zone default found 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 4 Realm: () 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:55.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 zonegroup default 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.725+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.726+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.726+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.726+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.726+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.727+0000 7fe3b4137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.727+0000 7fe3b4137800 20 started sync module instance, tier type = 2024-09-14T11:36:55.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.727+0000 7fe3b4137800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:55.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=0 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=1 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=2 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=3 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=4 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=5 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.735+0000 7fe3b4137800 20 add_watcher() i=6 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.736+0000 7fe3b4137800 20 add_watcher() i=7 2024-09-14T11:36:55.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.736+0000 7fe3b4137800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:55.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 5 note: GC not initialized 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe264fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 20 Filter name: none 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe1de7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:55.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.738+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:55.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.739+0000 7fe3b4137800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.740+0000 7fe3b4137800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.740+0000 7fe3b4137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:55.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.742+0000 7fe265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.744+0000 7fe3b4137800 20 remove_watcher() i=0 2024-09-14T11:36:55.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.744+0000 7fe3b4137800 2 removed watcher, disabling cache 2024-09-14T11:36:55.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.745+0000 7fe3b4137800 20 remove_watcher() i=1 2024-09-14T11:36:55.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.746+0000 7fe3b4137800 20 remove_watcher() i=2 2024-09-14T11:36:55.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.747+0000 7fe3b4137800 20 remove_watcher() i=3 2024-09-14T11:36:55.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.748+0000 7fe3b4137800 20 remove_watcher() i=4 2024-09-14T11:36:55.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.749+0000 7fe3b4137800 20 remove_watcher() i=5 2024-09-14T11:36:55.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.750+0000 7fe3b4137800 20 remove_watcher() i=6 2024-09-14T11:36:55.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.751+0000 7fe3b4137800 20 remove_watcher() i=7 2024-09-14T11:36:55.758 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:55.758 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:55.759 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:55.759 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:55.760 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:55.761 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:55.765 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:55.807 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:55.807 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:55.837 INFO:tasks.workunit.client.0.smithi094.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:36:55.838 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:55.866 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:55.866 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:55.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.904+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.905+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.905+0000 7f29a581d800 20 realm 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.905+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.906+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.906+0000 7f29a581d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.906+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.906+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.906+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.907+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.907+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.907+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:55.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.907+0000 7f29a581d800 20 searching for the correct realm 2024-09-14T11:36:55.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.910+0000 7f29a17f3640 0 -- 172.21.15.94:0/3830074311 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x563912ac1b80 msgr2=0x563912ac4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.914+0000 7f299bfff640 0 -- 172.21.15.94:0/3830074311 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f2994062c20 msgr2=0x7f299401a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:55.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.917+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 zone default found 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 4 Realm: () 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:55.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 zonegroup default 2024-09-14T11:36:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.918+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.919+0000 7f29a581d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:55.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.919+0000 7f29a581d800 20 started sync module instance, tier type = 2024-09-14T11:36:55.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.919+0000 7f29a581d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=0 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=1 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=2 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=3 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=4 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=5 2024-09-14T11:36:55.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.931+0000 7f29a581d800 20 add_watcher() i=6 2024-09-14T11:36:55.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.932+0000 7f29a581d800 20 add_watcher() i=7 2024-09-14T11:36:55.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.932+0000 7f29a581d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:55.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.933+0000 7f2856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.933+0000 7f29a581d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.933+0000 7f29a581d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.933+0000 7f29a581d800 5 note: GC not initialized 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f2855fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f29a581d800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:55.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f29a581d800 20 Filter name: none 2024-09-14T11:36:55.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f27c77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:55.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.934+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.935+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.935+0000 7f29a581d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.935+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.935+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.935+0000 7f29a581d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.936+0000 7f29a581d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:55.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.936+0000 7f29a581d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:55.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.937+0000 7f2856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:55.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.940+0000 7f29a581d800 20 remove_watcher() i=0 2024-09-14T11:36:55.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.940+0000 7f29a581d800 2 removed watcher, disabling cache 2024-09-14T11:36:55.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.940+0000 7f29a581d800 20 remove_watcher() i=1 2024-09-14T11:36:55.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.941+0000 7f29a581d800 20 remove_watcher() i=2 2024-09-14T11:36:55.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.942+0000 7f29a581d800 20 remove_watcher() i=3 2024-09-14T11:36:55.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.943+0000 7f29a581d800 20 remove_watcher() i=4 2024-09-14T11:36:55.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.944+0000 7f29a581d800 20 remove_watcher() i=5 2024-09-14T11:36:55.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.945+0000 7f29a581d800 20 remove_watcher() i=6 2024-09-14T11:36:55.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:55.946+0000 7f29a581d800 20 remove_watcher() i=7 2024-09-14T11:36:55.954 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:55.954 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:36:55.954 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:36:55.954 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:55.956 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:55.985 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:55.985 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:56.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.023+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 realm 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:56.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.025+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.026+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.026+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.026+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:56.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.026+0000 7fb038539800 20 searching for the correct realm 2024-09-14T11:36:56.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.028+0000 7fb02b9cd640 0 -- 172.21.15.94:0/3960018258 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb02409a050 msgr2=0x7fb024077040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.032+0000 7fb0341ce640 0 -- 172.21.15.94:0/3960018258 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb01c0b3230 msgr2=0x7fb01c0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:56.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.237+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 zone default found 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 4 Realm: () 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:56.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 zonegroup default 2024-09-14T11:36:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.238+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.239+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.239+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.239+0000 7fb038539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.239+0000 7fb038539800 20 started sync module instance, tier type = 2024-09-14T11:36:56.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.239+0000 7fb038539800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=0 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=1 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=2 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=3 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=4 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=5 2024-09-14T11:36:56.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.248+0000 7fb038539800 20 add_watcher() i=6 2024-09-14T11:36:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.249+0000 7fb038539800 20 add_watcher() i=7 2024-09-14T11:36:56.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.249+0000 7fb038539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:56.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7faeeafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fb038539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fb038539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fb038539800 5 note: GC not initialized 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7faee9fdb640 20 reqs_thread_entry: start 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fb038539800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fb038539800 20 Filter name: none 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.251+0000 7fae5b7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:56.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:56.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.252+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.253+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.253+0000 7fb038539800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.253+0000 7fb038539800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:56.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.253+0000 7fb038539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:56.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.255+0000 7faeeafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.257+0000 7fb038539800 20 remove_watcher() i=0 2024-09-14T11:36:56.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.257+0000 7fb038539800 2 removed watcher, disabling cache 2024-09-14T11:36:56.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.259+0000 7fb038539800 20 remove_watcher() i=1 2024-09-14T11:36:56.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.260+0000 7fb038539800 20 remove_watcher() i=2 2024-09-14T11:36:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.261+0000 7fb038539800 20 remove_watcher() i=3 2024-09-14T11:36:56.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.263+0000 7fb038539800 20 remove_watcher() i=4 2024-09-14T11:36:56.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.263+0000 7fb038539800 20 remove_watcher() i=5 2024-09-14T11:36:56.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.264+0000 7fb038539800 20 remove_watcher() i=6 2024-09-14T11:36:56.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.265+0000 7fb038539800 20 remove_watcher() i=7 2024-09-14T11:36:56.275 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:36:56.308 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:56.308 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:56.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.347+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 realm 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:56.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:56.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.350+0000 7f1b8380f800 20 searching for the correct realm 2024-09-14T11:36:56.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.352+0000 7f1b812f9640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1b7c030040 msgr2=0x7f1b7c0243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.557+0000 7f1b81afa640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f1b6c017020 msgr2=0x7f1b6c089b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.562+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zone default found 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Realm: () 2024-09-14T11:36:56.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zonegroup default 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started sync module instance, tier type = 2024-09-14T11:36:56.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=0 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=1 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=2 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=3 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=4 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=5 2024-09-14T11:36:56.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=6 2024-09-14T11:36:56.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.576+0000 7f1b8380f800 20 add_watcher() i=7 2024-09-14T11:36:56.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.576+0000 7f1b8380f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1a377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:56.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 5 note: GC not initialized 2024-09-14T11:36:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1a367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 20 Filter name: none 2024-09-14T11:36:56.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f19a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.579+0000 7f1b8380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:36:56.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1b8380f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1b8380f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497071 cookie 94555922484208 notifier 8100 bl.length()=911 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:36:56.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:36:56.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.596+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.596+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.596 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1b8380f800 time 2024-09-14T11:36:56.599001+0000 2024-09-14T11:36:56.596 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:56.596 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1b86d8c76a] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.598+0000 7f1b8380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1b8380f800 time 2024-09-14T11:36:56.599001+0000 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.597 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1b86d8c76a] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:56.598 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f1b8380f800 thread_name:radosgw-admin 2024-09-14T11:36:56.611 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.611 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1b85a3e6f0] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1b85a8b99c] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1b86d8c7c4] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:56.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.599+0000 7f1b8380f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f1b8380f800 thread_name:radosgw-admin 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1b85a3e6f0] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1b85a8b99c] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1b86d8c7c4] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.613 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:36:56.332+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key hook 0x55ff841c4898 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff841ee700 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff841f5ae0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x7f1b70002520 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.614 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.823577s 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff841f5ae0 auth_method 0 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x7f1b70002520 auth_method 0 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff841ee700 auth_method 0 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.615 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_done global_id 8091 payload 824 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:36:56.332+0000 7f1b80af8640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.616 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: dump: 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.617 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: dump: 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.618 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:36:56.333+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8091 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:36:56.333+0000 7f1a6f606640 4 set_mon_vals no callback set 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:36:56.333+0000 7f1b8380f800 1 librados: init done 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:36:56.335+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1a68077230 auth_method 0 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:36:56.335+0000 7f1b81afa640 10 monclient: get_auth_request con 0x55ff8420d770 auth_method 0 2024-09-14T11:36:56.619 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:36:56.336+0000 7f1b812f9640 10 monclient: get_auth_request con 0x55ff84210950 auth_method 0 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:36:56.337+0000 7f1b80af8640 10 monclient: get_auth_request con 0x55ff842159e0 auth_method 0 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:36:56.338+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.620 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.621 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:36:56.338+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command objecter_requests cmddesc objecter_requests hook 0x55ff8421cf90 EEXIST 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.622 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:36:56.339+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:36:56.339+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:36:56.339+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x55ff84218ae0 EEXIST 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff842412b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84241690 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff84240060 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.623 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.830351s 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff842412b0 auth_method 0 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff84241690 auth_method 0 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.624 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff84240060 auth_method 0 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_done global_id 8094 payload 824 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:36:56.339+0000 7f1b80af8640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.625 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: dump: 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.626 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:36:56.340+0000 7f1a66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:36:56.340+0000 7f1a66ffd640 10 monclient: dump: 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:36:56.340+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8094 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:36:56.340+0000 7f1b822fb640 4 set_mon_vals no callback set 2024-09-14T11:36:56.627 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:36:56.341+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1a5c077140 auth_method 0 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: get_monmap_and_config 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:36:56.342+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.628 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.629 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.630 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:36:56.343+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x7ffdc56a58a8 EEXIST 2024-09-14T11:36:56.631 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff842957f0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84265600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff84290bb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.834079s 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff84290bb0 auth_method 0 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.632 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff84265600 auth_method 0 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:36:56.343+0000 7f1b81afa640 1 monclient: found mon.noname-c 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:56.633 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: dump: 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.634 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:36:56.343+0000 7f1b8380f800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:36:56.343+0000 7f1b8380f800 4 set_mon_vals no callback set 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: dump: 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.635 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: shutdown 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.636 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.637 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:36:56.344+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: starting msgr at 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: starting objecter 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command objecter_requests cmddesc objecter_requests hook 0x55ff84263b60 EEXIST 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: setting wanted keys 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: calling monclient init 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.638 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:36:56.345+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:36:56.345+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:36:56.345+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x55ff842591d8 EEXIST 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:56.639 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84265600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff84290bb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff842957f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.836348s 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff84265600 auth_method 0 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff842957f0 auth_method 0 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.640 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_done global_id 8100 payload 824 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:36:56.345+0000 7f1b812f9640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: dump: 2024-09-14T11:36:56.641 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: dump: 2024-09-14T11:36:56.642 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:36:56.345+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8100 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:36:56.345+0000 7f1a64ff9640 4 set_mon_vals no callback set 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:36:56.346+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.643 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:36:56.346+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:36:56.346+0000 7f1b8380f800 1 librados: init done 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:36:56.346+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cr dump hook 0x55ff8428ccb8 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:36:56.347+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:36:56.348+0000 7f1b81afa640 10 monclient: get_auth_request con 0x55ff842afab0 auth_method 0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:36:56.348+0000 7f1b80af8640 10 monclient: get_auth_request con 0x7f1a4c077230 auth_method 0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 realm 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:36:56.349+0000 7f1b8380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:56.644 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:36:56.349+0000 7f1b812f9640 10 monclient: get_auth_request con 0x55ff842b3be0 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 searching for the correct realm 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:36:56.350+0000 7f1b80af8640 10 monclient: get_auth_request con 0x55ff842b8ed0 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:36:56.351+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1b6c017020 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:36:56.352+0000 7f1b812f9640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1b7c030040 msgr2=0x7f1b7c0243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:36:56.352+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b7c030040 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:36:56.553+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b7c030040 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:36:56.554+0000 7f1b80af8640 10 monclient: get_auth_request con 0x7f1b7405d040 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:36:56.556+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1b6c0942a0 auth_method 0 2024-09-14T11:36:56.645 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:36:56.557+0000 7f1b81afa640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f1b6c017020 msgr2=0x7f1b6c089b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 1 client.8100.objecter ms_handle_reset 0x7f1b6c017020 session 0x7f1b6c005040 osd.7 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 10 monclient: _renew_subs 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:36:56.558+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1a4c0878e0 auth_method 0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:36:56.558+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b6c05a040 auth_method 0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.646 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zone default found 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Realm: () 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:36:56.563+0000 7f1b8380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zonegroup default 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.647 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started sync module instance, tier type = 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=0 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=1 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=2 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=3 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=4 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=5 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=6 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:36:56.576+0000 7f1b8380f800 20 add_watcher() i=7 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:36:56.576+0000 7f1b8380f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.648 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:36:56.578+0000 7f1a377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:36:56.578+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.649 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache list hook 0x55ff8428b860 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache inspect hook 0x55ff8428b860 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache erase hook 0x55ff8428b860 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache zap hook 0x55ff8428b860 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 note: GC not initialized 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:36:56.578+0000 7f1a367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace show hook 0x7f1b7c0013a0 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace history hook 0x7f1b7c0013a0 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace active hook 0x7f1b7c0013a0 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace active_short hook 0x7f1b7c0013a0 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 Filter name: none 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:36:56.578+0000 7f19a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:36:56.578+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.651 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497071 cookie 94555922484208 notifier 8100 bl.length()=911 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.652 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.653 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.654 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.655 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:36:56.596+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:36:56.596+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:36:56.598+0000 7f1b8380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1b8380f800 time 2024-09-14T11:36:56.599001+0000 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1b86d8c76a] 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.656 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:36:56.599+0000 7f1b8380f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f1b8380f800 thread_name:radosgw-admin 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1b85a3e6f0] 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1b85a8b99c] 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1b86d8c7c4] 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.657 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:36:56.658 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:56.659 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:36:56.660 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:36:56.661 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:36:56.662 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:56.663 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 7f19a7fff640 / http_manager 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a367e4640 / http_manager 2024-09-14T11:36:56.664 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a377e6640 / rgw_dt_lg_renew 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a52ffd640 / ms_dispatch 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a64ff9640 / io_context_pool 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a66ffd640 / ms_dispatch 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a6de03640 / ms_dispatch 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a6f606640 / io_context_pool 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b80af8640 / msgr-worker-2 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b812f9640 / msgr-worker-1 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b81afa640 / msgr-worker-0 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b822fb640 / io_context_pool 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b8380f800 / radosgw-admin 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.147141.log 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:36:56.665 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:36:56.332+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key hook 0x55ff841c4898 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff841ee700 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff841f5ae0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x7f1b70002520 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:36:56.332+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.823577s 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff841f5ae0 auth_method 0 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.666 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x7f1b70002520 auth_method 0 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff841ee700 auth_method 0 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:36:56.332+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.667 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:36:56.332+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient(hunting): handle_auth_done global_id 8091 payload 824 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:36:56.332+0000 7f1b80af8640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:36:56.332+0000 7f1b80af8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: dump: 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.668 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:36:56.333+0000 7f1a6de03640 10 monclient: dump: 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.669 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:36:56.333+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8091 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:36:56.333+0000 7f1a6f606640 4 set_mon_vals no callback set 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:36:56.333+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:36:56.333+0000 7f1b8380f800 1 librados: init done 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:36:56.335+0000 7f1a6de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.670 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:36:56.335+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1a68077230 auth_method 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:36:56.335+0000 7f1b81afa640 10 monclient: get_auth_request con 0x55ff8420d770 auth_method 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:36:56.336+0000 7f1b812f9640 10 monclient: get_auth_request con 0x55ff84210950 auth_method 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:36:56.337+0000 7f1b80af8640 10 monclient: get_auth_request con 0x55ff842159e0 auth_method 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:36:56.338+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.671 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding auth protocol: cephx 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.672 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: crc 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84219a60) adding con mode: secure 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:36:56.338+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command objecter_requests cmddesc objecter_requests hook 0x55ff8421cf90 EEXIST 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:36:56.338+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding auth protocol: cephx 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.673 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: crc 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:36:56.338+0000 7f1b8380f800 5 AuthRegistry(0x55ff84218998) adding con mode: secure 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:36:56.339+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:36:56.339+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:36:56.339+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x55ff84218ae0 EEXIST 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff842412b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84241690 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff84240060 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.674 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:36:56.339+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.830351s 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff842412b0 auth_method 0 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff84241690 auth_method 0 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.675 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:36:56.339+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff84240060 auth_method 0 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:36:56.339+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient(hunting): handle_auth_done global_id 8094 payload 824 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:36:56.339+0000 7f1b80af8640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:36:56.339+0000 7f1b80af8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: dump: 2024-09-14T11:36:56.676 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:36:56.339+0000 7f1a66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:36:56.340+0000 7f1a66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.677 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:36:56.340+0000 7f1a66ffd640 10 monclient: dump: 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:36:56.340+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8094 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:36:56.340+0000 7f1b822fb640 4 set_mon_vals no callback set 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.678 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:36:56.340+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:36:56.341+0000 7f1a66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:36:56.341+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1a5c077140 auth_method 0 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: get_monmap_and_config 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:36:56.342+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.679 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding auth protocol: cephx 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.680 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: crc 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x55ff84261110) adding con mode: secure 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:36:56.342+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding auth protocol: cephx 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.681 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: crc 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:36:56.342+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5760) adding con mode: secure 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:36:56.342+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:36:56.343+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x7ffdc56a58a8 EEXIST 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff842957f0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.682 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84265600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff84290bb0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.834079s 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff84290bb0 auth_method 0 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): get_auth_request con 0x55ff84265600 auth_method 0 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.683 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:36:56.343+0000 7f1b80af8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:36:56.343+0000 7f1b81afa640 1 monclient: found mon.noname-c 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:36:56.343+0000 7f1b81afa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: dump: 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:36:56.343+0000 7f1b8380f800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:36:56.343+0000 7f1b8380f800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:36:56.343+0000 7f1b8380f800 4 set_mon_vals no callback set 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.685 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:36:56.343+0000 7f1a64ff9640 10 monclient: dump: 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: shutdown 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: build_initial_monmap 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 build_initial for_mkfs: 0 2024-09-14T11:36:56.686 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: monmap: 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding auth protocol: cephx 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.687 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: crc 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84291060) adding con mode: secure 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:36:56.344+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: starting msgr at 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: starting objecter 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command objecter_requests cmddesc objecter_requests hook 0x55ff84263b60 EEXIST 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: setting wanted keys 2024-09-14T11:36:56.688 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:36:56.344+0000 7f1b8380f800 1 librados: calling monclient init 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:36:56.344+0000 7f1b8380f800 10 monclient: init 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding auth protocol: cephx 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.689 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: crc 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:36:56.344+0000 7f1b8380f800 5 AuthRegistry(0x55ff84259090) adding con mode: secure 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:36:56.345+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:36:56.345+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:36:56.345+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command rotate-key cmddesc rotate-key hook 0x55ff842591d8 EEXIST 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-a con 0x55ff84265600 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-b con 0x55ff84290bb0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): picked mon.noname-c con 0x55ff842957f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:56.690 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient(hunting): authenticate will time out at 2129.836348s 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): get_auth_request con 0x55ff84265600 auth_method 0 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): get_auth_request con 0x55ff842957f0 auth_method 0 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:56.691 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:36:56.345+0000 7f1b81afa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient(hunting): handle_auth_done global_id 8100 payload 824 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient: _finish_hunting 0 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:36:56.345+0000 7f1b812f9640 1 monclient: found mon.noname-a 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:36:56.345+0000 7f1b812f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: dump: 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: _finish_auth 0 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:36:56.345+0000 7f1a52ffd640 10 monclient: dump: 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:36:56.345+0000 7f1b8380f800 5 monclient: authenticate success, global_id 8100 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:36:56.345+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:36:56.345+0000 7f1a64ff9640 4 set_mon_vals no callback set 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:36:56.346+0000 7f1b8380f800 10 monclient: _renew_subs 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:36:56.346+0000 7f1b8380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:36:56.346+0000 7f1b8380f800 1 librados: init done 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:36:56.346+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cr dump hook 0x55ff8428ccb8 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:36:56.347+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.694 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:36:56.348+0000 7f1a52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:36:56.348+0000 7f1b81afa640 10 monclient: get_auth_request con 0x55ff842afab0 auth_method 0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:36:56.348+0000 7f1b80af8640 10 monclient: get_auth_request con 0x7f1a4c077230 auth_method 0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 realm 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:36:56.349+0000 7f1b8380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:36:56.349+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:36:56.349+0000 7f1b812f9640 10 monclient: get_auth_request con 0x55ff842b3be0 auth_method 0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.695 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:36:56.350+0000 7f1b8380f800 20 searching for the correct realm 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:36:56.350+0000 7f1b80af8640 10 monclient: get_auth_request con 0x55ff842b8ed0 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:36:56.351+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1b6c017020 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:36:56.352+0000 7f1b812f9640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1b7c030040 msgr2=0x7f1b7c0243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:36:56.352+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b7c030040 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:36:56.553+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b7c030040 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:36:56.554+0000 7f1b80af8640 10 monclient: get_auth_request con 0x7f1b7405d040 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:36:56.556+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1b6c0942a0 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:36:56.557+0000 7f1b81afa640 0 -- 172.21.15.94:0/1954688947 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f1b6c017020 msgr2=0x7f1b6c089b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 1 client.8100.objecter ms_handle_reset 0x7f1b6c017020 session 0x7f1b6c005040 osd.7 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 10 monclient: _renew_subs 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:36:56.557+0000 7f1a52ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:36:56.558+0000 7f1b81afa640 10 monclient: get_auth_request con 0x7f1a4c0878e0 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:36:56.558+0000 7f1b812f9640 10 monclient: get_auth_request con 0x7f1b6c05a040 auth_method 0 2024-09-14T11:36:56.696 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:36:56.562+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zone default found 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Realm: () 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:56.697 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:36:56.563+0000 7f1b8380f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:36:56.563+0000 7f1b8380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 zonegroup default 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:36:56.563+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started sync module instance, tier type = 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:36:56.564+0000 7f1b8380f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=0 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=1 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=2 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=3 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=4 2024-09-14T11:36:56.698 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=5 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:36:56.574+0000 7f1b8380f800 20 add_watcher() i=6 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:36:56.576+0000 7f1b8380f800 20 add_watcher() i=7 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:36:56.576+0000 7f1b8380f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding auth protocol: cephx 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.699 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: crc 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 AuthRegistry(0x7ffdc56a5c40) adding con mode: secure 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:36:56.578+0000 7f1a377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:36:56.578+0000 7f1b8380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache list hook 0x55ff8428b860 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache inspect hook 0x55ff8428b860 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache erase hook 0x55ff8428b860 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command cache zap hook 0x55ff8428b860 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 note: GC not initialized 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:36:56.578+0000 7f1a367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:56.700 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace show hook 0x7f1b7c0013a0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace history hook 0x7f1b7c0013a0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace active hook 0x7f1b7c0013a0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:36:56.578+0000 7f1b8380f800 5 asok(0x55ff83fa4270) register_command sync trace active_short hook 0x7f1b7c0013a0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 Filter name: none 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:36:56.578+0000 7f19a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:36:56.578+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:36:56.578+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.701 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:36:56.579+0000 7f1b8380f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:36:56.579+0000 7f1b8380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:36:56.584+0000 7f1b8380f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497071 cookie 94555922484208 notifier 8100 bl.length()=911 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:36:56.584+0000 7f1a64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:36:56.702 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:36:56.585+0000 7f1b8380f800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.1 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.2 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.3 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.4 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.5 2024-09-14T11:36:56.703 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.6 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.7 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.8 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.9 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.10 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.11 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.12 2024-09-14T11:36:56.704 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.13 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:36:56.590+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:36:56.590+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:36:56.591+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:36:56.591+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:36:56.592+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:36:56.592+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:56.705 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:36:56.593+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:36:56.593+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:36:56.594+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:36:56.594+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:36:56.595+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:36:56.595+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:36:56.596+0000 7f1b8380f800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:36:56.596+0000 7f1b8380f800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:36:56.598+0000 7f1b8380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1b8380f800 time 2024-09-14T11:36:56.599001+0000 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:56.706 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1b86d8c76a] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:36:56.599+0000 7f1b8380f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f1b8380f800 thread_name:radosgw-admin 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.707 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1b85a3e6f0] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1b85a8b99c] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1b86d8c7c4] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f1b86d8c928] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff820500b1] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ff8205f124] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ff8205ffc4] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1b85a29590] 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:36:56.708 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:56.709 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:36:56.710 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:36:56.711 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:36:56.712 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:56.713 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:36:56.714 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f19a7fff640 / http_manager 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a367e4640 / http_manager 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a377e6640 / rgw_dt_lg_renew 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a52ffd640 / ms_dispatch 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a64ff9640 / io_context_pool 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a66ffd640 / ms_dispatch 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a6de03640 / ms_dispatch 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1a6f606640 / io_context_pool 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b80af8640 / msgr-worker-2 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b812f9640 / msgr-worker-1 2024-09-14T11:36:56.715 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b81afa640 / msgr-worker-0 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b822fb640 / io_context_pool 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr: 7f1b8380f800 / radosgw-admin 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:56.600613Z_495cb509-01ad-4b67-9303-302aa88712f6/log 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:36:56.716 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.673+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 realm 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.675+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.676+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.676+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.676+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.676+0000 7fbabd532800 20 searching for the correct realm 2024-09-14T11:36:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.679+0000 7fbab9ab1640 0 -- 172.21.15.94:0/2957277575 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fbab0087b10 msgr2=0x7fbab0090910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.682+0000 7fbab92b0640 0 -- 172.21.15.94:0/2957277575 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbab00863e0 msgr2=0x7fbab0086860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:56.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.888+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 zone default found 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 4 Realm: () 2024-09-14T11:36:56.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 zonegroup default 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.889+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.890+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.890+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.890+0000 7fbabd532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.890+0000 7fbabd532800 20 started sync module instance, tier type = 2024-09-14T11:36:56.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.890+0000 7fbabd532800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=0 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=1 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=2 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=3 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=4 2024-09-14T11:36:56.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=5 2024-09-14T11:36:56.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.900+0000 7fbabd532800 20 add_watcher() i=6 2024-09-14T11:36:56.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.901+0000 7fbabd532800 20 add_watcher() i=7 2024-09-14T11:36:56.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.901+0000 7fbabd532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fb96f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:56.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 5 note: GC not initialized 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fb96e7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 20 Filter name: none 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fb8dffff640 20 reqs_thread_entry: start 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.903+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.904+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.904+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.904+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:56.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.904+0000 7fbabd532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:56.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.904+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.905+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.905+0000 7fbabd532800 20 rados->read ofs=0 len=0 2024-09-14T11:36:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.905+0000 7fbabd532800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.905+0000 7fbabd532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:56.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.907+0000 7fb96f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.909+0000 7fbabd532800 20 remove_watcher() i=0 2024-09-14T11:36:56.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.909+0000 7fbabd532800 2 removed watcher, disabling cache 2024-09-14T11:36:56.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.910+0000 7fbabd532800 20 remove_watcher() i=1 2024-09-14T11:36:56.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.911+0000 7fbabd532800 20 remove_watcher() i=2 2024-09-14T11:36:56.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.912+0000 7fbabd532800 20 remove_watcher() i=3 2024-09-14T11:36:56.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.913+0000 7fbabd532800 20 remove_watcher() i=4 2024-09-14T11:36:56.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.914+0000 7fbabd532800 20 remove_watcher() i=5 2024-09-14T11:36:56.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.915+0000 7fbabd532800 20 remove_watcher() i=6 2024-09-14T11:36:56.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:56.916+0000 7fbabd532800 20 remove_watcher() i=7 2024-09-14T11:36:56.927 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:56.928 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:36:56.937 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:36:56.965 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:56.965 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:57.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.004+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 realm 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.006+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.007+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:57.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.007+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.007+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:57.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.007+0000 7fedd6213800 20 searching for the correct realm 2024-09-14T11:36:57.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.010+0000 7fedd1147640 0 -- 172.21.15.94:0/857360247 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55de09bf46f0 msgr2=0x55de09bf6b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:57.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.013+0000 7fedd1948640 0 -- 172.21.15.94:0/857360247 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fedbc077db0 msgr2=0x7fedbc056a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:57.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 zone default found 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 4 Realm: () 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 zonegroup default 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.018+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 started sync module instance, tier type = 2024-09-14T11:36:57.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.019+0000 7fedd6213800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=0 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=1 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=2 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=3 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=4 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=5 2024-09-14T11:36:57.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.028+0000 7fedd6213800 20 add_watcher() i=6 2024-09-14T11:36:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.029+0000 7fedd6213800 20 add_watcher() i=7 2024-09-14T11:36:57.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.029+0000 7fedd6213800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.030+0000 7fec837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 5 note: GC not initialized 2024-09-14T11:36:57.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fec827fc640 20 reqs_thread_entry: start 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 20 Filter name: none 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7febf3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.031+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.032+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.032+0000 7fedd6213800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.032+0000 7fedd6213800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.032+0000 7fedd6213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.032+0000 7fedd6213800 20 rados->read ofs=0 len=0 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.033+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.034+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.034+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.034+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:57.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.034+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:36:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:36:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:36:57.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.035+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.036+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:57.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.037+0000 7fedd6213800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:36:57.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.038+0000 7fec837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.041+0000 7fedd6213800 20 remove_watcher() i=0 2024-09-14T11:36:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.041+0000 7fedd6213800 2 removed watcher, disabling cache 2024-09-14T11:36:57.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.042+0000 7fedd6213800 20 remove_watcher() i=1 2024-09-14T11:36:57.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.043+0000 7fedd6213800 20 remove_watcher() i=2 2024-09-14T11:36:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.044+0000 7fedd6213800 20 remove_watcher() i=3 2024-09-14T11:36:57.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.044+0000 7fedd6213800 20 remove_watcher() i=4 2024-09-14T11:36:57.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.045+0000 7fedd6213800 20 remove_watcher() i=5 2024-09-14T11:36:57.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.046+0000 7fedd6213800 20 remove_watcher() i=6 2024-09-14T11:36:57.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:36:57.047+0000 7fedd6213800 20 remove_watcher() i=7 2024-09-14T11:37:27.079 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:37:27.111 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:27.111 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:27.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.154+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 20 realm 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.156+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.157+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.157+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.157+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.157+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.158+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:27.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.158+0000 7f0217498800 20 searching for the correct realm 2024-09-14T11:37:27.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.161+0000 7f020ffff640 0 -- 172.21.15.94:0/1839829914 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f0208040020 msgr2=0x7f020806bec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.165+0000 7f0214f82640 0 -- 172.21.15.94:0/1839829914 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f02000450b0 msgr2=0x7f0200050380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:27.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:27.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:27.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:27.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:27.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:27.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.373+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 zone default found 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 4 Realm: () 2024-09-14T11:37:27.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 zonegroup default 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.374+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.375+0000 7f0217498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.375+0000 7f0217498800 20 started sync module instance, tier type = 2024-09-14T11:37:27.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.375+0000 7f0217498800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:27.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=0 2024-09-14T11:37:27.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=1 2024-09-14T11:37:27.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=2 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=3 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=4 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=5 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.385+0000 7f0217498800 20 add_watcher() i=6 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.386+0000 7f0217498800 20 add_watcher() i=7 2024-09-14T11:37:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.386+0000 7f0217498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:27.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.388+0000 7f00cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:27.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:27.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 5 note: GC not initialized 2024-09-14T11:37:27.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f00c9fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:27.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:27.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 20 Filter name: none 2024-09-14T11:37:27.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f003b7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:27.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.389+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.390+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.390+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:27.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.391+0000 7f0217498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.393+0000 7f00cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.396+0000 7f0217498800 20 remove_watcher() i=0 2024-09-14T11:37:27.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.396+0000 7f0217498800 2 removed watcher, disabling cache 2024-09-14T11:37:27.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.397+0000 7f0217498800 20 remove_watcher() i=1 2024-09-14T11:37:27.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.398+0000 7f0217498800 20 remove_watcher() i=2 2024-09-14T11:37:27.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.399+0000 7f0217498800 20 remove_watcher() i=3 2024-09-14T11:37:27.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.400+0000 7f0217498800 20 remove_watcher() i=4 2024-09-14T11:37:27.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.401+0000 7f0217498800 20 remove_watcher() i=5 2024-09-14T11:37:27.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.402+0000 7f0217498800 20 remove_watcher() i=6 2024-09-14T11:37:27.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.404+0000 7f0217498800 20 remove_watcher() i=7 2024-09-14T11:37:27.416 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:27.416 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:37:27.440 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:37:27.470 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:27.470 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:27.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.510+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 realm 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.512+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.513+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.513+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.513+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:27.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.513+0000 7efdab926800 20 searching for the correct realm 2024-09-14T11:37:27.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.516+0000 7efd9ffff640 0 -- 172.21.15.94:0/2149496282 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7efd9807e070 msgr2=0x7efd980a8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.520+0000 7efda766f640 0 -- 172.21.15.94:0/2149496282 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7efd9002c8e0 msgr2=0x7efd9004f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:27.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 zone default found 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 4 Realm: () 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 zonegroup default 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.726+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.727+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.727+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.727+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.727+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.728+0000 7efdab926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.728+0000 7efdab926800 20 started sync module instance, tier type = 2024-09-14T11:37:27.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.728+0000 7efdab926800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=0 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=1 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=2 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=3 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=4 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=5 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.737+0000 7efdab926800 20 add_watcher() i=6 2024-09-14T11:37:27.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.738+0000 7efdab926800 20 add_watcher() i=7 2024-09-14T11:37:27.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.738+0000 7efdab926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:27.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.739+0000 7efc5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:27.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:27.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 5 note: GC not initialized 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efc5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 20 Filter name: none 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efbd67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.740+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.741+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:27.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:27.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:27.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.742+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.743+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:27.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.744+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:27.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.745+0000 7efdab926800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:27.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.747+0000 7efc5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.749+0000 7efdab926800 20 remove_watcher() i=0 2024-09-14T11:37:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.749+0000 7efdab926800 2 removed watcher, disabling cache 2024-09-14T11:37:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.750+0000 7efdab926800 20 remove_watcher() i=1 2024-09-14T11:37:27.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.751+0000 7efdab926800 20 remove_watcher() i=2 2024-09-14T11:37:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.752+0000 7efdab926800 20 remove_watcher() i=3 2024-09-14T11:37:27.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.753+0000 7efdab926800 20 remove_watcher() i=4 2024-09-14T11:37:27.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.754+0000 7efdab926800 20 remove_watcher() i=5 2024-09-14T11:37:27.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.755+0000 7efdab926800 20 remove_watcher() i=6 2024-09-14T11:37:27.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.756+0000 7efdab926800 20 remove_watcher() i=7 2024-09-14T11:37:27.765 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:37:27.794 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:27.794 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:27.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.832+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 20 realm 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.834+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.835+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.835+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.836+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.836+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.836+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:27.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.836+0000 7fafcba16800 20 searching for the correct realm 2024-09-14T11:37:27.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.839+0000 7fafbe9e6640 0 -- 172.21.15.94:0/1133515390 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x558330174a50 msgr2=0x558330176e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.842+0000 7fafc71e7640 0 -- 172.21.15.94:0/1133515390 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fafb006dc50 msgr2=0x7fafb0076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.846+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 zone default found 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 4 Realm: () 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 zonegroup default 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.847+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.848+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.848+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.848+0000 7fafcba16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.848+0000 7fafcba16800 20 started sync module instance, tier type = 2024-09-14T11:37:27.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.848+0000 7fafcba16800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=0 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=1 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=2 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=3 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=4 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=5 2024-09-14T11:37:27.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.857+0000 7fafcba16800 20 add_watcher() i=6 2024-09-14T11:37:27.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.858+0000 7fafcba16800 20 add_watcher() i=7 2024-09-14T11:37:27.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.858+0000 7fafcba16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.859+0000 7fae7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 5 note: GC not initialized 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fae7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:27.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:27.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 20 Filter name: none 2024-09-14T11:37:27.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fadf67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:27.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.860+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.861+0000 7fafcba16800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.862+0000 7fafcba16800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:27.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.862+0000 7fafcba16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.863+0000 7fae7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.865+0000 7fafcba16800 20 remove_watcher() i=0 2024-09-14T11:37:27.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.865+0000 7fafcba16800 2 removed watcher, disabling cache 2024-09-14T11:37:27.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.866+0000 7fafcba16800 20 remove_watcher() i=1 2024-09-14T11:37:27.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.867+0000 7fafcba16800 20 remove_watcher() i=2 2024-09-14T11:37:27.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.868+0000 7fafcba16800 20 remove_watcher() i=3 2024-09-14T11:37:27.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.869+0000 7fafcba16800 20 remove_watcher() i=4 2024-09-14T11:37:27.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.870+0000 7fafcba16800 20 remove_watcher() i=5 2024-09-14T11:37:27.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.871+0000 7fafcba16800 20 remove_watcher() i=6 2024-09-14T11:37:27.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.872+0000 7fafcba16800 20 remove_watcher() i=7 2024-09-14T11:37:27.880 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:37:27.882 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:37:27.910 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:27.911 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:27.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.949+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 realm 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.951+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.952+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.952+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.952+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:27.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.952+0000 7f5f84a0f800 20 searching for the correct realm 2024-09-14T11:37:27.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.956+0000 7f5f81cff640 0 -- 172.21.15.94:0/839509885 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5f7406d060 msgr2=0x7f5f740b9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:27.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.959+0000 7f5f81cff640 0 -- 172.21.15.94:0/839509885 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f5e4c087890 msgr2=0x7f5e4c089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:27.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.963+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 zone default found 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 4 Realm: () 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 zonegroup default 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.964+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.965+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.965+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.965+0000 7f5f84a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.965+0000 7f5f84a0f800 20 started sync module instance, tier type = 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.965+0000 7f5f84a0f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:27.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=0 2024-09-14T11:37:27.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=1 2024-09-14T11:37:27.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=2 2024-09-14T11:37:27.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=3 2024-09-14T11:37:27.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=4 2024-09-14T11:37:27.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=5 2024-09-14T11:37:27.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.973+0000 7f5f84a0f800 20 add_watcher() i=6 2024-09-14T11:37:27.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.974+0000 7f5f84a0f800 20 add_watcher() i=7 2024-09-14T11:37:27.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.974+0000 7f5f84a0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:27.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.975+0000 7f5e38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:27.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:27.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 5 note: GC not initialized 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5db37fe640 20 reqs_thread_entry: start 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 20 Filter name: none 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5db17fa640 20 reqs_thread_entry: start 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.976+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.977+0000 7f5f84a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.978+0000 7f5f84a0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:27.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.978+0000 7f5f84a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:27.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.979+0000 7f5e38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.982+0000 7f5f84a0f800 20 remove_watcher() i=0 2024-09-14T11:37:27.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.982+0000 7f5f84a0f800 2 removed watcher, disabling cache 2024-09-14T11:37:27.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.983+0000 7f5f84a0f800 20 remove_watcher() i=1 2024-09-14T11:37:27.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.983+0000 7f5f84a0f800 20 remove_watcher() i=2 2024-09-14T11:37:27.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.984+0000 7f5f84a0f800 20 remove_watcher() i=3 2024-09-14T11:37:27.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.985+0000 7f5f84a0f800 20 remove_watcher() i=4 2024-09-14T11:37:27.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.986+0000 7f5f84a0f800 20 remove_watcher() i=5 2024-09-14T11:37:27.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.987+0000 7f5f84a0f800 20 remove_watcher() i=6 2024-09-14T11:37:27.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:27.988+0000 7f5f84a0f800 20 remove_watcher() i=7 2024-09-14T11:37:27.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:27.997 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:37:27.997 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:37:27.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:27.998 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:37:28.031 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:28.031 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:28.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.257+0000 7fa65ebd9640 0 --2- 172.21.15.94:0/2703750684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56346cb64c40 0x56346cce7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:37:28.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.272+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 20 realm 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.275+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.275+0000 7fa662f26800 20 searching for the correct realm 2024-09-14T11:37:28.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.277+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa658071040 msgr2=0x7fa658055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.280+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa528087940 msgr2=0x7fa528089d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:28.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:28.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 zone default found 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 4 Realm: () 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 zonegroup default 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.287+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.287+0000 7fa662f26800 20 started sync module instance, tier type = 2024-09-14T11:37:28.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.287+0000 7fa662f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=0 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=1 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=2 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=3 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=4 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=5 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=6 2024-09-14T11:37:28.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.296+0000 7fa662f26800 20 add_watcher() i=7 2024-09-14T11:37:28.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.296+0000 7fa662f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.298+0000 7fa515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa662f26800 5 note: GC not initialized 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa514fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa662f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa662f26800 20 Filter name: none 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa50dffb640 20 reqs_thread_entry: start 2024-09-14T11:37:28.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:28.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.299+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.300+0000 7fa662f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94783164550704 notifier 7763 bl.length()=911 2024-09-14T11:37:28.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:28.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:28.310 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa662f26800 time 2024-09-14T11:37:28.313403+0000 2024-09-14T11:37:28.310 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa66458c76a] 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:37:28.311 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.313+0000 7fa662f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa662f26800 time 2024-09-14T11:37:28.313403+0000 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa66458c76a] 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:37:28.312 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:37:28.313 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.313 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:28.313 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa662f26800 thread_name:radosgw-admin 2024-09-14T11:37:28.328 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa66323e6f0] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa66328b99c] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa66458c7c4] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:37:28.329 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.314+0000 7fa662f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa662f26800 thread_name:radosgw-admin 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa66323e6f0] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa66328b99c] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa66458c7c4] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.330 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:37:28.054+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:37:28.054+0000 7fa662f26800 1 librados: starting msgr at 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:37:28.054+0000 7fa662f26800 1 librados: starting objecter 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests hook 0x56346ccbafb0 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:37:28.055+0000 7fa662f26800 1 librados: setting wanted keys 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:37:28.055+0000 7fa662f26800 1 librados: calling monclient init 2024-09-14T11:37:28.331 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.332 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:37:28.055+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:37:28.055+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key hook 0x56346ccb76f8 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cb64c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cb65020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cbfd670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.333 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.546643s 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cbfd670 auth_method 0 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.334 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 1 monclient: found mon.noname-a 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:37:28.055+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cb65020 auth_method 0 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 0 --2- 172.21.15.94:0/2703750684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56346cb64c40 0x56346cce7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.335 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-c con 0x56346cbfd670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-a con 0x7fa544004940 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-b con 0x56346cb65020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cbfd670 auth_method 0 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:37:28.336 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x7fa544004940 auth_method 0 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 8214 payload 293 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.337 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:37:28.257+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346cb65020 auth_method 0 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: dump: 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.338 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:37:28.258+0000 7fa662f26800 5 monclient: authenticate success, global_id 8214 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: dump: 2024-09-14T11:37:28.339 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:37:28.258+0000 7fa54ce09640 4 set_mon_vals no callback set 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.340 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:37:28.258+0000 7fa662f26800 1 librados: init done 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:37:28.260+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:37:28.260+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346ccf5f50 auth_method 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:37:28.261+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cce0760 auth_method 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:37:28.262+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346ccff4f0 auth_method 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:37:28.262+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:37:28.262+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:37:28.262+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.341 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.342 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests cmddesc objecter_requests hook 0x56346cd08560 EEXIST 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.343 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.344 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x56346cd04030 EEXIST 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd2c880 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd2cc60 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd2b590 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.754968s 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd2c880 auth_method 0 2024-09-14T11:37:28.345 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd2b590 auth_method 0 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:37:28.346 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:37:28.264+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cd2cc60 auth_method 0 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: dump: 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.347 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:37:28.264+0000 7fa662f26800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: dump: 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.348 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:37:28.264+0000 7fa65fbdb640 4 set_mon_vals no callback set 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.349 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: get_monmap_and_config 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:37:28.266+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.350 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.351 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:37:28.266+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa538077140 auth_method 0 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:37:28.266+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.352 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:37:28.267+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:37:28.267+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:37:28.267+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x7ffee1b536e8 EEXIST 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.353 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd80830 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd50640 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd7bbf0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.758488s 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd80830 auth_method 0 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.354 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x56346cd50640 auth_method 0 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd7bbf0 auth_method 0 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.355 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7760 payload 274 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: dump: 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.356 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: dump: 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.357 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:37:28.268+0000 7fa662f26800 4 set_mon_vals no callback set 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: shutdown 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.358 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:37:28.268+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 librados: starting msgr at 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 librados: starting objecter 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests cmddesc objecter_requests hook 0x56346cd4ed50 EEXIST 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:37:28.269+0000 7fa662f26800 1 librados: setting wanted keys 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:37:28.269+0000 7fa662f26800 1 librados: calling monclient init 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:37:28.269+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:37:28.269+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x56346cd41288 EEXIST 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd50640 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd7bbf0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd80830 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.760658s 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd50640 auth_method 0 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x56346cd7bbf0 auth_method 0 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd80830 auth_method 0 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: dump: 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.365 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: dump: 2024-09-14T11:37:28.366 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:37:28.270+0000 7fa662f26800 5 monclient: authenticate success, global_id 7763 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:37:28.270+0000 7fa5427fc640 4 set_mon_vals no callback set 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.367 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:37:28.270+0000 7fa662f26800 1 librados: init done 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:37:28.270+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cr dump hook 0x56346cd6f878 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:37:28.272+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:37:28.272+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa528077230 auth_method 0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:37:28.273+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346cd99e40 auth_method 0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 realm 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:37:28.273+0000 7fa662f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.368 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:37:28.274+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cd9e070 auth_method 0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:37:28.275+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:37:28.275+0000 7fa662f26800 20 searching for the correct realm 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:37:28.275+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cda3300 auth_method 0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:37:28.275+0000 7fa65f3da640 10 monclient: get_auth_request con 0x7fa648034940 auth_method 0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:37:28.276+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa658071040 auth_method 0 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:37:28.277+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa658071040 msgr2=0x7fa658055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:37:28.277+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x7fa658071040 session 0x7fa658068040 osd.2 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:37:28.277+0000 7fa540ff9640 10 monclient: _renew_subs 2024-09-14T11:37:28.369 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:37:28.277+0000 7fa540ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:37:28.277+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa528087940 auth_method 0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:37:28.277+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa65006be40 auth_method 0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:37:28.279+0000 7fa65f3da640 10 monclient: get_auth_request con 0x7fa64804f950 auth_method 0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:37:28.280+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa528087940 msgr2=0x7fa528089d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:37:28.280+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x7fa528087940 session 0x7fa658068040 osd.2 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:37:28.280+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa658071040 auth_method 0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:37:28.281+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa648041400 auth_method 0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.370 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 zone default found 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 Realm: () 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:37:28.286+0000 7fa662f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 zonegroup default 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.371 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 started sync module instance, tier type = 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=0 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=1 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=2 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=3 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=4 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=5 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=6 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:37:28.296+0000 7fa662f26800 20 add_watcher() i=7 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:37:28.296+0000 7fa662f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.372 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:37:28.298+0000 7fa515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.373 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:37:28.298+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache list hook 0x56346cd76f30 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache inspect hook 0x56346cd76f30 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache erase hook 0x56346cd76f30 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache zap hook 0x56346cd76f30 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 note: GC not initialized 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:37:28.299+0000 7fa514fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace show hook 0x7fa65804d880 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace history hook 0x7fa65804d880 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace active hook 0x7fa65804d880 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace active_short hook 0x7fa65804d880 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.374 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 Filter name: none 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:37:28.299+0000 7fa50dffb640 20 reqs_thread_entry: start 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:37:28.299+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:28.375 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:37:28.301+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x56346cda3300 session 0x56346cda2c80 osd.3 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:37:28.302+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa528087940 auth_method 0 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94783164550704 notifier 7763 bl.length()=911 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:28.376 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:37:28.313+0000 7fa662f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa662f26800 time 2024-09-14T11:37:28.313403+0000 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa66458c76a] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:37:28.377 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:37:28.314+0000 7fa662f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa662f26800 thread_name:radosgw-admin 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa66323e6f0] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa66328b99c] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa66458c7c4] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:37:28.378 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:28.379 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:28.380 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:37:28.381 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:37:28.382 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:28.383 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:28.384 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa50dffb640 / http_manager 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa514fe1640 / http_manager 2024-09-14T11:37:28.385 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa515fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa540ff9640 / ms_dispatch 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa541ffb640 / io_context_pool 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa5427fc640 / io_context_pool 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa548e01640 / ms_dispatch 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa54b606640 / ms_dispatch 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa54ce09640 / io_context_pool 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa6563d8640 / msgr-worker-2 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65ebd9640 / msgr-worker-1 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65f3da640 / msgr-worker-0 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65fbdb640 / io_context_pool 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa662f26800 / radosgw-admin 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:37:28.386 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.151265.log 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:37:28.054+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:37:28.054+0000 7fa662f26800 1 librados: starting msgr at 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:37:28.054+0000 7fa662f26800 1 librados: starting objecter 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests hook 0x56346ccbafb0 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:37:28.055+0000 7fa662f26800 1 librados: setting wanted keys 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:37:28.055+0000 7fa662f26800 1 librados: calling monclient init 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding auth protocol: cephx 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.387 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: crc 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 AuthRegistry(0x56346ccb75b0) adding con mode: secure 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:37:28.055+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:37:28.055+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.388 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:37:28.055+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key hook 0x56346ccb76f8 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cb64c40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cb65020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cbfd670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:37:28.055+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.546643s 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cbfd670 auth_method 0 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:37:28.055+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-14T11:37:28.390 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 1 monclient: found mon.noname-a 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:37:28.055+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:37:28.055+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cb65020 auth_method 0 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 0 --2- 172.21.15.94:0/2703750684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x56346cb64c40 0x56346cce7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: ms_handle_reset current mon [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-c con 0x56346cbfd670 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-a con 0x7fa544004940 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): picked mon.noname-b con 0x56346cb65020 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:37:28.257+0000 7fa54b606640 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cbfd670 auth_method 0 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x7fa544004940 auth_method 0 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:37:28.257+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 8214 payload 293 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:37:28.257+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:37:28.257+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346cb65020 auth_method 0 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: dump: 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.393 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:37:28.258+0000 7fa662f26800 5 monclient: authenticate success, global_id 8214 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.394 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:37:28.258+0000 7fa54b606640 10 monclient: dump: 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:37:28.258+0000 7fa54ce09640 4 set_mon_vals no callback set 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:37:28.258+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:37:28.258+0000 7fa662f26800 1 librados: init done 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:37:28.259+0000 7fa54b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:37:28.260+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cb64c40 auth_method 0 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:37:28.260+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346ccf5f50 auth_method 0 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:37:28.261+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cce0760 auth_method 0 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:37:28.262+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346ccff4f0 auth_method 0 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:37:28.262+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:37:28.262+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:37:28.262+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding auth protocol: cephx 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: crc 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:37:28.262+0000 7fa662f26800 5 AuthRegistry(0x56346cd05090) adding con mode: secure 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests cmddesc objecter_requests hook 0x56346cd08560 EEXIST 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding auth protocol: cephx 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: crc 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 AuthRegistry(0x56346cd03ee8) adding con mode: secure 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:37:28.263+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:37:28.263+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x56346cd04030 EEXIST 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd2c880 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd2cc60 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd2b590 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:37:28.263+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.754968s 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd2c880 auth_method 0 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd2b590 auth_method 0 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.401 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:37:28.264+0000 7fa65f3da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:37:28.264+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:37:28.264+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cd2cc60 auth_method 0 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: dump: 2024-09-14T11:37:28.402 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:37:28.264+0000 7fa662f26800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.403 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:37:28.264+0000 7fa548e01640 10 monclient: dump: 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.404 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:37:28.264+0000 7fa65fbdb640 4 set_mon_vals no callback set 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:37:28.264+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:37:28.266+0000 7fa548e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: get_monmap_and_config 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:37:28.266+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.405 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding auth protocol: cephx 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.406 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: crc 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x56346cd4c1f0) adding con mode: secure 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:37:28.266+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa538077140 auth_method 0 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:37:28.266+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:37:28.266+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding auth protocol: cephx 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.407 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: crc 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:37:28.266+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b535a0) adding con mode: secure 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:37:28.267+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:37:28.267+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:37:28.267+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x7ffee1b536e8 EEXIST 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd80830 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.408 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd50640 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd7bbf0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:37:28.267+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.758488s 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd80830 auth_method 0 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x56346cd50640 auth_method 0 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.409 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:37:28.267+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd7bbf0 auth_method 0 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:37:28.267+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7760 payload 274 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:37:28.267+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.410 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:37:28.267+0000 7fa5427fc640 10 monclient: dump: 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.411 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:37:28.268+0000 7fa5427fc640 10 monclient: dump: 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.412 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:37:28.268+0000 7fa662f26800 4 set_mon_vals no callback set 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: shutdown 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: build_initial_monmap 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 build_initial for_mkfs: 0 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:37:28.268+0000 7fa662f26800 10 monclient: monmap: 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:28.413 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding auth protocol: cephx 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: crc 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:37:28.268+0000 7fa662f26800 5 AuthRegistry(0x56346cd51480) adding con mode: secure 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:37:28.268+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 librados: starting msgr at 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:37:28.268+0000 7fa662f26800 1 librados: starting objecter 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 asok(0x56346ca98270) register_command objecter_requests cmddesc objecter_requests hook 0x56346cd4ed50 EEXIST 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:37:28.269+0000 7fa662f26800 1 librados: setting wanted keys 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:37:28.269+0000 7fa662f26800 1 librados: calling monclient init 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: init 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding auth protocol: cephx 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.416 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: crc 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 AuthRegistry(0x56346cd41140) adding con mode: secure 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:37:28.269+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:37:28.269+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:37:28.269+0000 7fa662f26800 5 asok(0x56346ca98270) register_command rotate-key cmddesc rotate-key hook 0x56346cd41288 EEXIST 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-c con 0x56346cd50640 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-a con 0x56346cd7bbf0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): picked mon.noname-b con 0x56346cd80830 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:28.417 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:37:28.269+0000 7fa662f26800 10 monclient(hunting): authenticate will time out at 2161.760658s 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request con 0x56346cd50640 auth_method 0 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): get_auth_request con 0x56346cd7bbf0 auth_method 0 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:28.418 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:37:28.269+0000 7fa6563d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): get_auth_request con 0x56346cd80830 auth_method 0 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:37:28.269+0000 7fa65f3da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient: _finish_hunting 0 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 1 monclient: found mon.noname-c 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:37:28.269+0000 7fa65ebd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: dump: 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: _finish_auth 0 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:28.420 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:37:28.270+0000 7fa540ff9640 10 monclient: dump: 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:37:28.270+0000 7fa662f26800 5 monclient: authenticate success, global_id 7763 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.421 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:37:28.270+0000 7fa5427fc640 4 set_mon_vals no callback set 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _renew_subs 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:37:28.270+0000 7fa662f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:37:28.270+0000 7fa662f26800 1 librados: init done 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:37:28.270+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cr dump hook 0x56346cd6f878 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:37:28.272+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:37:28.272+0000 7fa540ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:37:28.272+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa528077230 auth_method 0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:37:28.273+0000 7fa65f3da640 10 monclient: get_auth_request con 0x56346cd99e40 auth_method 0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 realm 2024-09-14T11:37:28.422 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:37:28.273+0000 7fa662f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:37:28.273+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:37:28.274+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x56346cd9e070 auth_method 0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:37:28.274+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:37:28.275+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:37:28.275+0000 7fa662f26800 20 searching for the correct realm 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:37:28.275+0000 7fa6563d8640 10 monclient: get_auth_request con 0x56346cda3300 auth_method 0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:37:28.275+0000 7fa65f3da640 10 monclient: get_auth_request con 0x7fa648034940 auth_method 0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:37:28.276+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa658071040 auth_method 0 2024-09-14T11:37:28.423 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:37:28.277+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa658071040 msgr2=0x7fa658055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:37:28.277+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x7fa658071040 session 0x7fa658068040 osd.2 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:37:28.277+0000 7fa540ff9640 10 monclient: _renew_subs 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:37:28.277+0000 7fa540ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:37:28.277+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa528087940 auth_method 0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:37:28.277+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa65006be40 auth_method 0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:37:28.279+0000 7fa65f3da640 10 monclient: get_auth_request con 0x7fa64804f950 auth_method 0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:37:28.280+0000 7fa65ebd9640 0 -- 172.21.15.94:0/3351983503 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa528087940 msgr2=0x7fa528089d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:37:28.280+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x7fa528087940 session 0x7fa658068040 osd.2 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:37:28.280+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa658071040 auth_method 0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:37:28.281+0000 7fa65ebd9640 10 monclient: get_auth_request con 0x7fa648041400 auth_method 0 2024-09-14T11:37:28.424 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:37:28.285+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 zone default found 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 Realm: () 2024-09-14T11:37:28.425 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:37:28.286+0000 7fa662f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:37:28.286+0000 7fa662f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 zonegroup default 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:37:28.286+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 started sync module instance, tier type = 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:37:28.287+0000 7fa662f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:28.426 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=0 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=1 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=2 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=3 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=4 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=5 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:37:28.295+0000 7fa662f26800 20 add_watcher() i=6 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:37:28.296+0000 7fa662f26800 20 add_watcher() i=7 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:37:28.296+0000 7fa662f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding auth protocol: cephx 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.427 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:37:28.298+0000 7fa515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: crc 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 AuthRegistry(0x7ffee1b53a80) adding con mode: secure 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:37:28.298+0000 7fa662f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:37:28.298+0000 7fa662f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache list hook 0x56346cd76f30 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache inspect hook 0x56346cd76f30 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache erase hook 0x56346cd76f30 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:37:28.298+0000 7fa662f26800 5 asok(0x56346ca98270) register_command cache zap hook 0x56346cd76f30 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 note: GC not initialized 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:37:28.299+0000 7fa514fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace show hook 0x7fa65804d880 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace history hook 0x7fa65804d880 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace active hook 0x7fa65804d880 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:37:28.299+0000 7fa662f26800 5 asok(0x56346ca98270) register_command sync trace active_short hook 0x7fa65804d880 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 Filter name: none 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:37:28.299+0000 7fa50dffb640 20 reqs_thread_entry: start 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:37:28.299+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:28.429 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:37:28.299+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:37:28.300+0000 7fa662f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:37:28.300+0000 7fa662f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:37:28.301+0000 7fa540ff9640 1 client.7763.objecter ms_handle_reset 0x56346cda3300 session 0x56346cda2c80 osd.3 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:37:28.302+0000 7fa6563d8640 10 monclient: get_auth_request con 0x7fa528087940 auth_method 0 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.430 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:37:28.307+0000 7fa662f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94783164550704 notifier 7763 bl.length()=911 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:37:28.307+0000 7fa541ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:37:28.307+0000 7fa662f26800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:37:28.313+0000 7fa662f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa662f26800 time 2024-09-14T11:37:28.313403+0000 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:28.431 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa66458c76a] 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:37:28.314+0000 7fa662f26800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa662f26800 thread_name:radosgw-admin 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:28.432 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa66323e6f0] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa66328b99c] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa66458c7c4] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa66458c928] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56346af470b1] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56346af56f6a] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa663229590] 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:37:28.433 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:37:28.434 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:37:28.435 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:28.436 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:37:28.437 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:28.438 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:28.439 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa50dffb640 / http_manager 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa514fe1640 / http_manager 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa515fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa540ff9640 / ms_dispatch 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa541ffb640 / io_context_pool 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa5427fc640 / io_context_pool 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa548e01640 / ms_dispatch 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa54b606640 / ms_dispatch 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa54ce09640 / io_context_pool 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa6563d8640 / msgr-worker-2 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65ebd9640 / msgr-worker-1 2024-09-14T11:37:28.440 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65f3da640 / msgr-worker-0 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa65fbdb640 / io_context_pool 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa662f26800 / radosgw-admin 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:28.314807Z_c1bd8070-802d-4709-9d67-c41226629a8b/log 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:37:28.441 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:37:28.442 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.388+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.389+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.389+0000 7ff928332800 20 realm 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.390+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.391+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.391+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.391+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.391+0000 7ff928332800 20 searching for the correct realm 2024-09-14T11:37:28.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.394+0000 7ff9247bd640 0 -- 172.21.15.94:0/3829834784 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ff9180a4020 msgr2=0x7ff9180ae170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.397+0000 7ff923fbc640 0 -- 172.21.15.94:0/3829834784 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7ff9180a75e0 msgr2=0x7ff9180a7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:28.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:28.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 zone default found 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 4 Realm: () 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 zonegroup default 2024-09-14T11:37:28.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.603+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 started sync module instance, tier type = 2024-09-14T11:37:28.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.604+0000 7ff928332800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:28.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=0 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=1 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=2 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=3 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=4 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=5 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.613+0000 7ff928332800 20 add_watcher() i=6 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.614+0000 7ff928332800 20 add_watcher() i=7 2024-09-14T11:37:28.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.614+0000 7ff928332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff7d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff928332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff928332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff928332800 5 note: GC not initialized 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff7d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff928332800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.616+0000 7ff928332800 20 Filter name: none 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff7527fc640 20 reqs_thread_entry: start 2024-09-14T11:37:28.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:28.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:28.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.617+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.618+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.618+0000 7ff928332800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.618+0000 7ff928332800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:28.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.618+0000 7ff928332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:28.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.620+0000 7ff7d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.621+0000 7ff928332800 20 remove_watcher() i=0 2024-09-14T11:37:28.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.621+0000 7ff928332800 2 removed watcher, disabling cache 2024-09-14T11:37:28.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.622+0000 7ff928332800 20 remove_watcher() i=1 2024-09-14T11:37:28.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.623+0000 7ff928332800 20 remove_watcher() i=2 2024-09-14T11:37:28.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.625+0000 7ff928332800 20 remove_watcher() i=3 2024-09-14T11:37:28.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.625+0000 7ff928332800 20 remove_watcher() i=4 2024-09-14T11:37:28.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.626+0000 7ff928332800 20 remove_watcher() i=5 2024-09-14T11:37:28.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.627+0000 7ff928332800 20 remove_watcher() i=6 2024-09-14T11:37:28.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.628+0000 7ff928332800 20 remove_watcher() i=7 2024-09-14T11:37:28.638 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:28.638 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:37:28.648 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:37:28.676 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:28.677 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:28.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.715+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 realm 2024-09-14T11:37:28.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.717+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.718+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.718+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.718+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.718+0000 7fab1b220800 20 searching for the correct realm 2024-09-14T11:37:28.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.720+0000 7fab18d0a640 0 -- 172.21.15.94:0/4163920709 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55dd2102bd00 msgr2=0x7fab14035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.723+0000 7fab1950b640 0 -- 172.21.15.94:0/4163920709 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fab0001a020 msgr2=0x7fab00085930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.728+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 zone default found 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 4 Realm: () 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 zonegroup default 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.729+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.730+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.730+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.730+0000 7fab1b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.730+0000 7fab1b220800 20 started sync module instance, tier type = 2024-09-14T11:37:28.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.730+0000 7fab1b220800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:28.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=0 2024-09-14T11:37:28.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=1 2024-09-14T11:37:28.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=2 2024-09-14T11:37:28.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=3 2024-09-14T11:37:28.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=4 2024-09-14T11:37:28.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=5 2024-09-14T11:37:28.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.738+0000 7fab1b220800 20 add_watcher() i=6 2024-09-14T11:37:28.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.739+0000 7fab1b220800 20 add_watcher() i=7 2024-09-14T11:37:28.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.739+0000 7fab1b220800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fa9cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fab1b220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fab1b220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fab1b220800 5 note: GC not initialized 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fa9ce7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fab1b220800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fab1b220800 20 Filter name: none 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.741+0000 7fa9c77fe640 20 reqs_thread_entry: start 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:28.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.742+0000 7fab1b220800 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:28.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.743+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.744+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:28.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:28.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:28.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:28.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.745+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.746+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.747+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:28.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.747+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:28.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.747+0000 7fab1b220800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:28.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.747+0000 7fab1b220800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:28.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.748+0000 7fa9cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.750+0000 7fab1b220800 20 remove_watcher() i=0 2024-09-14T11:37:28.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.750+0000 7fab1b220800 2 removed watcher, disabling cache 2024-09-14T11:37:28.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.751+0000 7fab1b220800 20 remove_watcher() i=1 2024-09-14T11:37:28.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.752+0000 7fab1b220800 20 remove_watcher() i=2 2024-09-14T11:37:28.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.753+0000 7fab1b220800 20 remove_watcher() i=3 2024-09-14T11:37:28.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.754+0000 7fab1b220800 20 remove_watcher() i=4 2024-09-14T11:37:28.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.755+0000 7fab1b220800 20 remove_watcher() i=5 2024-09-14T11:37:28.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.756+0000 7fab1b220800 20 remove_watcher() i=6 2024-09-14T11:37:28.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:28.757+0000 7fab1b220800 20 remove_watcher() i=7 2024-09-14T11:37:58.792 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:37:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:58.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.874+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 20 realm 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.877+0000 7f23db43e800 20 searching for the correct realm 2024-09-14T11:37:58.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.880+0000 7f23d9729640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f23c407bba0 msgr2=0x7f23c4060550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.884+0000 7f23d8f28640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f23c4062210 msgr2=0x7f23c4083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 zone default found 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 4 Realm: () 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 zonegroup default 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.891+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.891+0000 7f23db43e800 20 started sync module instance, tier type = 2024-09-14T11:37:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.891+0000 7f23db43e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:58.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=0 2024-09-14T11:37:58.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=1 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=2 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=3 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=4 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=5 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=6 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.901+0000 7f23db43e800 20 add_watcher() i=7 2024-09-14T11:37:58.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.901+0000 7f23db43e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f228f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f23db43e800 5 note: GC not initialized 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f228e7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f23db43e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.903+0000 7f23db43e800 20 Filter name: none 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f2287fff640 20 reqs_thread_entry: start 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.904+0000 7f23db43e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.906+0000 7f23db43e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:37:58.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.912+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.912+0000 7f23db43e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.912+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.912+0000 7f23db43e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94889188837040 notifier 8274 bl.length()=911 2024-09-14T11:37:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:58.914 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f23db43e800 time 2024-09-14T11:37:58.917482+0000 2024-09-14T11:37:58.914 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f23de98c76a] 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.915 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.917+0000 7f23db43e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f23db43e800 time 2024-09-14T11:37:58.917482+0000 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f23de98c76a] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f23db43e800 thread_name:radosgw-admin 2024-09-14T11:37:58.933 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f23dd63e6f0] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f23dd68b99c] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f23de98c7c4] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.918+0000 7f23db43e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f23db43e800 thread_name:radosgw-admin 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f23dd63e6f0] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f23dd68b99c] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f23de98c7c4] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:37:58.854+0000 7f22c6e05640 10 monclient: dump: 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:37:58.854+0000 7f23db43e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:37:58.854+0000 7f23db43e800 4 set_mon_vals no callback set 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: shutdown 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 asok(0x564d1c334270) unregister_commands rotate-key 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:37:58.855+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: starting msgr at 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: starting objecter 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests hook 0x564d1c55a340 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: setting wanted keys 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: calling monclient init 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key hook 0x564d1c554e78 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c400d50 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c401c30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c55c040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.347952s 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c401c30 auth_method 0 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c55c040 auth_method 0 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c400d50 auth_method 0 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:37:58.857+0000 7f23d3fff640 1 monclient: found mon.noname-c 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:58.943 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: dump: 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.944 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: dump: 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:37:58.857+0000 7f23db43e800 5 monclient: authenticate success, global_id 7802 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.945 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:37:58.857+0000 7f22c6e05640 4 set_mon_vals no callback set 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:37:58.857+0000 7f23db43e800 1 librados: init done 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:37:58.859+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f22c0077260 auth_method 0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:37:58.860+0000 7f23d9729640 10 monclient: get_auth_request con 0x564d1c59da40 auth_method 0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:37:58.861+0000 7f23d8f28640 10 monclient: get_auth_request con 0x564d1c5a0c20 auth_method 0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:37:58.863+0000 7f23d3fff640 10 monclient: get_auth_request con 0x564d1c5a5cb0 auth_method 0 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:37:58.863+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.946 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:37:58.863+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:37:58.863+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:58.947 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:37:58.863+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.948 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests cmddesc objecter_requests hook 0x564d1c5ad660 EEXIST 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.949 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:37:58.864+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:37:58.864+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x564d1c5a8da0 EEXIST 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c5d1350 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c5d3620 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c5cfb20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.950 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.355835s 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c5d3620 auth_method 0 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c5cfb20 auth_method 0 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.951 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c5d1350 auth_method 0 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:37:58.865+0000 7f23d9729640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: dump: 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:37:58.865+0000 7f23db43e800 5 monclient: authenticate success, global_id 8268 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: dump: 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:37:58.865+0000 7f23d9f2a640 4 set_mon_vals no callback set 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:37:58.868+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f22b0077140 auth_method 0 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: get_monmap_and_config 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.955 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:37:58.868+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:58.956 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:58.957 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:58.958 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x7ffedde19188 EEXIST 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c625810 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c5f6760 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c6210b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.360065s 2024-09-14T11:37:58.959 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c625810 auth_method 0 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c6210b0 auth_method 0 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.960 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c5f6760 auth_method 0 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_done global_id 7808 payload 274 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:37:58.869+0000 7f23d8f28640 1 monclient: found mon.noname-c 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: dump: 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:58.962 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: dump: 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:37:58.869+0000 7f23db43e800 5 monclient: authenticate success, global_id 7808 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:37:58.869+0000 7f23db43e800 4 set_mon_vals no callback set 2024-09-14T11:37:58.963 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: shutdown 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.964 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:58.965 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:37:58.870+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: starting msgr at 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: starting objecter 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests cmddesc objecter_requests hook 0x564d1c5d3550 EEXIST 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: setting wanted keys 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: calling monclient init 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.966 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:37:58.871+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:37:58.871+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:37:58.871+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x564d1c5e9248 EEXIST 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.967 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c5f6760 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c6210b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c625810 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.362510s 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c5f6760 auth_method 0 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c6210b0 auth_method 0 2024-09-14T11:37:58.968 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c625810 auth_method 0 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:37:58.969 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:37:58.871+0000 7f23d8f28640 1 monclient: found mon.noname-a 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: dump: 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: dump: 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:37:58.872+0000 7f23db43e800 5 monclient: authenticate success, global_id 8274 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:37:58.872+0000 7f22affff640 4 set_mon_vals no callback set 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:37:58.872+0000 7f23db43e800 1 librados: init done 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:37:58.872+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cr dump hook 0x564d1c5f5908 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:37:58.874+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:58.972 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:37:58.874+0000 7f23d3fff640 10 monclient: get_auth_request con 0x7f22a4077230 auth_method 0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:37:58.875+0000 7f23d9729640 10 monclient: get_auth_request con 0x564d1c63f8d0 auth_method 0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 realm 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:37:58.875+0000 7f23db43e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:37:58.876+0000 7f23d8f28640 10 monclient: get_auth_request con 0x564d1c643b00 auth_method 0 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.973 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 searching for the correct realm 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:37:58.877+0000 7f23d3fff640 10 monclient: get_auth_request con 0x564d1c648d50 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:37:58.878+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f23c407bba0 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:37:58.879+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23d4065520 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:37:58.879+0000 7f23d3fff640 10 monclient: get_auth_request con 0x7f23cc076040 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:37:58.880+0000 7f23d9729640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f23c407bba0 msgr2=0x7f23c4060550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 1 client.8274.objecter ms_handle_reset 0x7f23c407bba0 session 0x7f23c405daf0 osd.7 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 10 monclient: _renew_subs 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:37:58.881+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f22a40878e0 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:37:58.881+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f23c406a750 auth_method 0 2024-09-14T11:37:58.974 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:37:58.884+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23c4062210 auth_method 0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:37:58.884+0000 7f23d8f28640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f23c4062210 msgr2=0x7f23c4083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:37:58.884+0000 7f22ae7fc640 1 client.8274.objecter ms_handle_reset 0x7f23c4062210 session 0x7f23c406ab90 osd.0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:37:58.884+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23c407bba0 auth_method 0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.975 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 zone default found 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 Realm: () 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:37:58.890+0000 7f23db43e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 zonegroup default 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.976 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 started sync module instance, tier type = 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=0 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=1 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=2 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=3 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=4 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=5 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=6 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:37:58.901+0000 7f23db43e800 20 add_watcher() i=7 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:37:58.901+0000 7f23db43e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:58.977 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:37:58.903+0000 7f228f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:37:58.903+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.978 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache list hook 0x564d1c61b310 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache inspect hook 0x564d1c61b310 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache erase hook 0x564d1c61b310 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache zap hook 0x564d1c61b310 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 note: GC not initialized 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:37:58.903+0000 7f228e7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace show hook 0x7f23cc079040 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace history hook 0x7f23cc079040 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace active hook 0x7f23cc079040 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace active_short hook 0x7f23cc079040 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 Filter name: none 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:37:58.904+0000 7f2287fff640 20 reqs_thread_entry: start 2024-09-14T11:37:58.979 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:58.980 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:37:58.906+0000 7f23db43e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94889188837040 notifier 8274 bl.length()=911 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:58.981 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:37:58.917+0000 7f23db43e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f23db43e800 time 2024-09-14T11:37:58.917482+0000 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f23de98c76a] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.982 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:37:58.918+0000 7f23db43e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f23db43e800 thread_name:radosgw-admin 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f23dd63e6f0] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f23dd68b99c] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f23de98c7c4] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:37:58.983 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:58.984 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:37:58.985 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:37:58.986 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:58.989 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:58.990 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2287fff640 / http_manager 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f228e7e4640 / http_manager 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f228f7e6640 / rgw_dt_lg_renew 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22ae7fc640 / ms_dispatch 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22affff640 / io_context_pool 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22be7fc640 / ms_dispatch 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22c5602640 / ms_dispatch 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22c6e05640 / io_context_pool 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d3fff640 / msgr-worker-2 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d8f28640 / msgr-worker-1 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d9729640 / msgr-worker-0 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d9f2a640 / io_context_pool 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23db43e800 / radosgw-admin 2024-09-14T11:37:58.991 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.153033.log 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:37:58.854+0000 7f22c6e05640 10 monclient: dump: 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:37:58.854+0000 7f23db43e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:37:58.854+0000 7f23db43e800 4 set_mon_vals no callback set 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: shutdown 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 asok(0x564d1c334270) unregister_commands rotate-key 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:37:58.855+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:37:58.855+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding auth protocol: cephx 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.994 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: crc 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:37:58.855+0000 7f23db43e800 5 AuthRegistry(0x564d1c55aa00) adding con mode: secure 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: starting msgr at 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: starting objecter 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests hook 0x564d1c55a340 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: setting wanted keys 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:37:58.856+0000 7f23db43e800 1 librados: calling monclient init 2024-09-14T11:37:58.995 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding auth protocol: cephx 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.996 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: crc 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 AuthRegistry(0x564d1c554d30) adding con mode: secure 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:37:58.856+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:37:58.856+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key hook 0x564d1c554e78 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c400d50 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c401c30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c55c040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:58.997 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:37:58.856+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.347952s 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c401c30 auth_method 0 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c55c040 auth_method 0 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.998 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:37:58.857+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c400d50 auth_method 0 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:37:58.857+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:37:58.857+0000 7f23d3fff640 1 monclient: found mon.noname-c 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:37:58.857+0000 7f23d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:58.999 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: dump: 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.000 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:37:58.857+0000 7f22c5602640 10 monclient: dump: 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:37:58.857+0000 7f23db43e800 5 monclient: authenticate success, global_id 7802 2024-09-14T11:37:59.001 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:37:58.857+0000 7f22c6e05640 4 set_mon_vals no callback set 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:37:58.857+0000 7f23db43e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:37:58.857+0000 7f23db43e800 1 librados: init done 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:37:58.859+0000 7f22c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:37:58.859+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f22c0077260 auth_method 0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:37:58.860+0000 7f23d9729640 10 monclient: get_auth_request con 0x564d1c59da40 auth_method 0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:37:58.861+0000 7f23d8f28640 10 monclient: get_auth_request con 0x564d1c5a0c20 auth_method 0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:37:58.863+0000 7f23d3fff640 10 monclient: get_auth_request con 0x564d1c5a5cb0 auth_method 0 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:37:58.863+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.002 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:37:58.863+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:37:58.863+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:59.003 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding auth protocol: cephx 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: crc 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:37:58.863+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a9c10) adding con mode: secure 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:37:58.863+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests cmddesc objecter_requests hook 0x564d1c5ad660 EEXIST 2024-09-14T11:37:59.004 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding auth protocol: cephx 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.005 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: crc 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 AuthRegistry(0x564d1c5a8c58) adding con mode: secure 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:37:58.864+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:37:58.864+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:37:58.864+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x564d1c5a8da0 EEXIST 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c5d1350 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c5d3620 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c5cfb20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.006 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:37:58.864+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.355835s 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c5d3620 auth_method 0 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:37:58.864+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c5cfb20 auth_method 0 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:37:58.864+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:37:58.865+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.007 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c5d1350 auth_method 0 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:37:58.865+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:37:58.865+0000 7f23d9729640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:37:58.865+0000 7f23d9729640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.008 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: dump: 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:37:58.865+0000 7f23db43e800 5 monclient: authenticate success, global_id 8268 2024-09-14T11:37:59.009 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:37:58.865+0000 7f22be7fc640 10 monclient: dump: 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:37:58.865+0000 7f23d9f2a640 4 set_mon_vals no callback set 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:37:58.865+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:37:58.867+0000 7f22be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:37:58.868+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f22b0077140 auth_method 0 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: get_monmap_and_config 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.011 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:37:58.868+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:59.012 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding auth protocol: cephx 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: crc 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x564d1c5f11e0) adding con mode: secure 2024-09-14T11:37:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:37:58.868+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding auth protocol: cephx 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.014 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: crc 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19040) adding con mode: secure 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:37:58.868+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:37:58.868+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x7ffedde19188 EEXIST 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c625810 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c5f6760 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c6210b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.015 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.360065s 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c625810 auth_method 0 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c6210b0 auth_method 0 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.016 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:37:58.869+0000 7f23d9729640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c5f6760 auth_method 0 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:37:58.869+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient(hunting): handle_auth_done global_id 7808 payload 274 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:37:58.869+0000 7f23d8f28640 1 monclient: found mon.noname-c 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:37:58.869+0000 7f23d8f28640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: dump: 2024-09-14T11:37:59.017 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.018 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:37:58.869+0000 7f22affff640 10 monclient: dump: 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:37:58.869+0000 7f23db43e800 5 monclient: authenticate success, global_id 7808 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:37:58.869+0000 7f23db43e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:59.019 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:37:58.869+0000 7f23db43e800 4 set_mon_vals no callback set 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: shutdown 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: monmap: 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:37:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding auth protocol: cephx 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.021 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: crc 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c617a90) adding con mode: secure 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:37:58.870+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: starting msgr at 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: starting objecter 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 asok(0x564d1c334270) register_command objecter_requests cmddesc objecter_requests hook 0x564d1c5d3550 EEXIST 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: setting wanted keys 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:37:58.870+0000 7f23db43e800 1 librados: calling monclient init 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:37:58.870+0000 7f23db43e800 10 monclient: init 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding auth protocol: cephx 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.022 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: crc 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:37:58.870+0000 7f23db43e800 5 AuthRegistry(0x564d1c5e9100) adding con mode: secure 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:37:58.871+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:37:58.871+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.023 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:37:58.871+0000 7f23db43e800 5 asok(0x564d1c334270) register_command rotate-key cmddesc rotate-key hook 0x564d1c5e9248 EEXIST 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-a con 0x564d1c5f6760 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-c con 0x564d1c6210b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): picked mon.noname-b con 0x564d1c625810 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:37:58.871+0000 7f23db43e800 10 monclient(hunting): authenticate will time out at 2192.362510s 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): get_auth_request con 0x564d1c5f6760 auth_method 0 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.024 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): get_auth_request con 0x564d1c6210b0 auth_method 0 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:37:58.871+0000 7f23d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): get_auth_request con 0x564d1c625810 auth_method 0 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:37:58.871+0000 7f23d9729640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:37:58.871+0000 7f23d8f28640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:37:58.871+0000 7f23d8f28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: dump: 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.026 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:37:58.872+0000 7f22ae7fc640 10 monclient: dump: 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:37:58.872+0000 7f23db43e800 5 monclient: authenticate success, global_id 8274 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:37:58.872+0000 7f22affff640 4 set_mon_vals no callback set 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _renew_subs 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:37:58.872+0000 7f23db43e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:37:58.872+0000 7f23db43e800 1 librados: init done 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:37:58.872+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cr dump hook 0x564d1c5f5908 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:37:58.874+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:37:58.874+0000 7f22ae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:37:58.874+0000 7f23d3fff640 10 monclient: get_auth_request con 0x7f22a4077230 auth_method 0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:37:58.875+0000 7f23d9729640 10 monclient: get_auth_request con 0x564d1c63f8d0 auth_method 0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 realm 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:37:58.875+0000 7f23db43e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:37:58.875+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.029 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:37:58.876+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:37:58.876+0000 7f23d8f28640 10 monclient: get_auth_request con 0x564d1c643b00 auth_method 0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:37:58.877+0000 7f23db43e800 20 searching for the correct realm 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:37:58.877+0000 7f23d3fff640 10 monclient: get_auth_request con 0x564d1c648d50 auth_method 0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:37:58.878+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f23c407bba0 auth_method 0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:37:58.879+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23d4065520 auth_method 0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:37:58.879+0000 7f23d3fff640 10 monclient: get_auth_request con 0x7f23cc076040 auth_method 0 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:37:58.880+0000 7f23d9729640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f23c407bba0 msgr2=0x7f23c4060550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 1 client.8274.objecter ms_handle_reset 0x7f23c407bba0 session 0x7f23c405daf0 osd.7 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 10 monclient: _renew_subs 2024-09-14T11:37:59.030 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:37:58.880+0000 7f22ae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:37:58.881+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f22a40878e0 auth_method 0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:37:58.881+0000 7f23d9729640 10 monclient: get_auth_request con 0x7f23c406a750 auth_method 0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:37:58.884+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23c4062210 auth_method 0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:37:58.884+0000 7f23d8f28640 0 -- 172.21.15.94:0/2727958790 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f23c4062210 msgr2=0x7f23c4083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:37:58.884+0000 7f22ae7fc640 1 client.8274.objecter ms_handle_reset 0x7f23c4062210 session 0x7f23c406ab90 osd.0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:37:58.884+0000 7f23d8f28640 10 monclient: get_auth_request con 0x7f23c407bba0 auth_method 0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:37:58.889+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 zone default found 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 Realm: () 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:37:58.890+0000 7f23db43e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:37:58.890+0000 7f23db43e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 zonegroup default 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.032 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:37:58.890+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 started sync module instance, tier type = 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:37:58.891+0000 7f23db43e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=0 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=1 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=2 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=3 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=4 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=5 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:37:58.900+0000 7f23db43e800 20 add_watcher() i=6 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:37:58.901+0000 7f23db43e800 20 add_watcher() i=7 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:37:58.901+0000 7f23db43e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.033 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding auth protocol: cephx 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:37:58.903+0000 7f228f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: crc 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 AuthRegistry(0x7ffedde19520) adding con mode: secure 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:37:58.903+0000 7f23db43e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache list hook 0x564d1c61b310 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache inspect hook 0x564d1c61b310 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache erase hook 0x564d1c61b310 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command cache zap hook 0x564d1c61b310 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 note: GC not initialized 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:37:58.903+0000 7f228e7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace show hook 0x7f23cc079040 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace history hook 0x7f23cc079040 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace active hook 0x7f23cc079040 2024-09-14T11:37:59.035 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:37:58.903+0000 7f23db43e800 5 asok(0x564d1c334270) register_command sync trace active_short hook 0x7f23cc079040 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:37:58.903+0000 7f23db43e800 20 Filter name: none 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:37:58.904+0000 7f2287fff640 20 reqs_thread_entry: start 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:37:58.904+0000 7f23db43e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:59.036 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:37:58.904+0000 7f23db43e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:37:58.906+0000 7f23db43e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:37:58.912+0000 7f23db43e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94889188837040 notifier 8274 bl.length()=911 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:37:58.913+0000 7f22affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:37:59.037 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:37:58.913+0000 7f23db43e800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:37:58.917+0000 7f23db43e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f23db43e800 time 2024-09-14T11:37:58.917482+0000 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f23de98c76a] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:37:58.918+0000 7f23db43e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f23db43e800 thread_name:radosgw-admin 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f23dd63e6f0] 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f23dd68b99c] 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f23de98c7c4] 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f23de98c928] 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d1b3240b1] 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd8907c) [0x564d1b83807c] 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d1b333efd] 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f23dd629590] 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:37:59.042 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:59.043 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:37:59.044 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:37:59.045 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:59.046 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2287fff640 / http_manager 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f228e7e4640 / http_manager 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f228f7e6640 / rgw_dt_lg_renew 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22ae7fc640 / ms_dispatch 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22affff640 / io_context_pool 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22be7fc640 / ms_dispatch 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22c5602640 / ms_dispatch 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f22c6e05640 / io_context_pool 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d3fff640 / msgr-worker-2 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d8f28640 / msgr-worker-1 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d9729640 / msgr-worker-0 2024-09-14T11:37:59.047 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23d9f2a640 / io_context_pool 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr: 7f23db43e800 / radosgw-admin 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:58.919170Z_830c6f12-d163-48ba-bf44-5274dadd30e8/log 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.993+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 realm 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.995+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.996+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.996+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.996+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.996+0000 7f6ac3a1d800 20 searching for the correct realm 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:58.998+0000 7f6abf1eb640 0 -- 172.21.15.94:0/1709594972 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x555b817ca310 msgr2=0x7f6ab8061490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:59.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.203+0000 7f6abf9ec640 0 -- 172.21.15.94:0/1709594972 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f6aa80030f0 msgr2=0x7f6ab4080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:37:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:37:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.209+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 zone default found 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 4 Realm: () 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 zonegroup default 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.210+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.211+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.211+0000 7f6ac3a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.211+0000 7f6ac3a1d800 20 started sync module instance, tier type = 2024-09-14T11:37:59.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.211+0000 7f6ac3a1d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=0 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=1 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=2 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=3 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=4 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=5 2024-09-14T11:37:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.220+0000 7f6ac3a1d800 20 add_watcher() i=6 2024-09-14T11:37:59.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.221+0000 7f6ac3a1d800 20 add_watcher() i=7 2024-09-14T11:37:59.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.221+0000 7f6ac3a1d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.222+0000 7f6975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 5 note: GC not initialized 2024-09-14T11:37:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6974fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 20 Filter name: none 2024-09-14T11:37:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f68ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:59.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.223+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.224+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.224+0000 7f6ac3a1d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.224+0000 7f6ac3a1d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.224+0000 7f6ac3a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.224+0000 7f6ac3a1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.225+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.226+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.227+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.227+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.227+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.227+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.228+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:37:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.229+0000 7f6ac3a1d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:37:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.230+0000 7f6975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.233+0000 7f6ac3a1d800 20 remove_watcher() i=0 2024-09-14T11:37:59.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.233+0000 7f6ac3a1d800 2 removed watcher, disabling cache 2024-09-14T11:37:59.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.234+0000 7f6ac3a1d800 20 remove_watcher() i=1 2024-09-14T11:37:59.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.235+0000 7f6ac3a1d800 20 remove_watcher() i=2 2024-09-14T11:37:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.236+0000 7f6ac3a1d800 20 remove_watcher() i=3 2024-09-14T11:37:59.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.237+0000 7f6ac3a1d800 20 remove_watcher() i=4 2024-09-14T11:37:59.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.238+0000 7f6ac3a1d800 20 remove_watcher() i=5 2024-09-14T11:37:59.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.239+0000 7f6ac3a1d800 20 remove_watcher() i=6 2024-09-14T11:37:59.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:37:59.240+0000 7f6ac3a1d800 20 remove_watcher() i=7 2024-09-14T11:37:59.248 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries can be purged manually 2024-09-14T11:38:29.272 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:29.302 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:29.303 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:29.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.343+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 20 realm 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.345+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.346+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.346+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.347+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.347+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.347+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.347+0000 7f7651487800 20 searching for the correct realm 2024-09-14T11:38:29.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.351+0000 7f764f772640 0 -- 172.21.15.94:0/2613972837 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f7638036040 msgr2=0x7f7638018910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.354+0000 7f764ef71640 0 -- 172.21.15.94:0/2613972837 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f7638051920 msgr2=0x7f763801a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.561+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 zone default found 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 4 Realm: () 2024-09-14T11:38:29.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 zonegroup default 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.562+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.563+0000 7f7651487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.563+0000 7f7651487800 20 started sync module instance, tier type = 2024-09-14T11:38:29.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.563+0000 7f7651487800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=0 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=1 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=2 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=3 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=4 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=5 2024-09-14T11:38:29.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.573+0000 7f7651487800 20 add_watcher() i=6 2024-09-14T11:38:29.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.574+0000 7f7651487800 20 add_watcher() i=7 2024-09-14T11:38:29.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.574+0000 7f7651487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.575+0000 7f75057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 5 note: GC not initialized 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f747ffff640 20 reqs_thread_entry: start 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 20 Filter name: none 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f747dffb640 20 reqs_thread_entry: start 2024-09-14T11:38:29.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.576+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.577+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:29.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.577+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.578+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:29.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.578+0000 7f7651487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:29.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.578+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.578+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:29.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.578+0000 7f7651487800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.579+0000 7f7651487800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:29.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.579+0000 7f7651487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:29.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.580+0000 7f75057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.583+0000 7f7651487800 20 remove_watcher() i=0 2024-09-14T11:38:29.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.583+0000 7f7651487800 2 removed watcher, disabling cache 2024-09-14T11:38:29.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.584+0000 7f7651487800 20 remove_watcher() i=1 2024-09-14T11:38:29.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.585+0000 7f7651487800 20 remove_watcher() i=2 2024-09-14T11:38:29.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.587+0000 7f7651487800 20 remove_watcher() i=3 2024-09-14T11:38:29.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.588+0000 7f7651487800 20 remove_watcher() i=4 2024-09-14T11:38:29.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.589+0000 7f7651487800 20 remove_watcher() i=5 2024-09-14T11:38:29.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.590+0000 7f7651487800 20 remove_watcher() i=6 2024-09-14T11:38:29.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.591+0000 7f7651487800 20 remove_watcher() i=7 2024-09-14T11:38:29.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.599 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:38:29.600 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:38:29.600 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.601 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:38:29.635 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:29.635 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:29.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.673+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 realm 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.676+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.676+0000 7f450a740800 20 searching for the correct realm 2024-09-14T11:38:29.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.680+0000 7f4506cc1640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f44f0040410 msgr2=0x7f44f0040890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.886+0000 7f45064c0640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x562b5607e650 msgr2=0x562b56080a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:29.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:29.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 zone default found 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 4 Realm: () 2024-09-14T11:38:29.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 zonegroup default 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.891+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.891+0000 7f450a740800 20 started sync module instance, tier type = 2024-09-14T11:38:29.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.891+0000 7f450a740800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:29.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=0 2024-09-14T11:38:29.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=1 2024-09-14T11:38:29.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=2 2024-09-14T11:38:29.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=3 2024-09-14T11:38:29.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=4 2024-09-14T11:38:29.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=5 2024-09-14T11:38:29.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=6 2024-09-14T11:38:29.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.901+0000 7f450a740800 20 add_watcher() i=7 2024-09-14T11:38:29.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.901+0000 7f450a740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f43bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 5 note: GC not initialized 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f43377fe640 20 reqs_thread_entry: start 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 20 Filter name: none 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f43357fa640 20 reqs_thread_entry: start 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:29.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.903+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:29.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.904+0000 7f450a740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:38:29.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.906+0000 7f450a740800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:29.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.912+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.912+0000 7f450a740800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.912+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.912+0000 7f450a740800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:38:29.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94744126948688 notifier 8331 bl.length()=911 2024-09-14T11:38:29.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:38:29.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:38:29.916 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f450a740800 time 2024-09-14T11:38:29.919311+0000 2024-09-14T11:38:29.916 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f450bf8c76a] 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:38:29.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.919+0000 7f450a740800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f450a740800 time 2024-09-14T11:38:29.919311+0000 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f450bf8c76a] 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.918 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f450a740800 thread_name:radosgw-admin 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f450ac3e6f0] 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f450ac8b99c] 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f450bf8c7c4] 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.919+0000 7f450a740800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f450a740800 thread_name:radosgw-admin 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f450ac3e6f0] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f450ac8b99c] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f450bf8c7c4] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: dump: 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:38:29.657+0000 7f450a740800 5 monclient: authenticate success, global_id 8319 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:38:29.657+0000 7f450a740800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:38:29.657+0000 7f450a740800 4 set_mon_vals no callback set 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: shutdown 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:38:29.658+0000 7f450a740800 5 asok(0x562b55d6f270) unregister_commands rotate-key 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:38:29.658+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:29.942 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:38:29.658+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: starting msgr at 2024-09-14T11:38:29.943 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: starting objecter 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:38:29.658+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests hook 0x562b55f95020 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: setting wanted keys 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: calling monclient init 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.944 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:38:29.658+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:38:29.659+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:38:29.659+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key hook 0x562b55f8fa28 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b55e19870 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b55e3c290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:29.945 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b55fc1870 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.150153s 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b55e19870 auth_method 0 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b55e3c290 auth_method 0 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.946 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b55fc1870 auth_method 0 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_done global_id 8322 payload 824 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient: _finish_hunting 0 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:38:29.659+0000 7f45064c0640 1 monclient: found mon.noname-a 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.947 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: dump: 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: _finish_auth 0 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:38:29.659+0000 7f450a740800 5 monclient: authenticate success, global_id 8322 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: dump: 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:38:29.659+0000 7f43f4608640 4 set_mon_vals no callback set 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:38:29.659+0000 7f450a740800 1 librados: init done 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:38:29.661+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x7f43ec077230 auth_method 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:38:29.662+0000 7f4506cc1640 10 monclient: get_auth_request con 0x562b55fb8810 auth_method 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:38:29.662+0000 7f45064c0640 10 monclient: get_auth_request con 0x562b55fdb5d0 auth_method 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:38:29.664+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b55fe0660 auth_method 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:38:29.664+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:38:29.664+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:38:29.664+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:29.951 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.952 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:38:29.665+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests cmddesc objecter_requests hook 0x562b55fe7b50 EEXIST 2024-09-14T11:38:29.953 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:38:29.665+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x562b55fe3700 EEXIST 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b5600be70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b5600c250 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b5600ab80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.156866s 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b5600ab80 auth_method 0 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b5600c250 auth_method 0 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b5600be70 auth_method 0 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient: _finish_hunting 0 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:38:29.666+0000 7f4506cc1640 1 monclient: found mon.noname-c 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: dump: 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: _finish_auth 0 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:38:29.666+0000 7f450a740800 5 monclient: authenticate success, global_id 7850 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: dump: 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.960 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:38:29.666+0000 7f45074c2640 4 set_mon_vals no callback set 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:38:29.668+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43e0077140 auth_method 0 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: get_monmap_and_config 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:29.961 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:38:29.668+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.963 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:38:29.669+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x7ffdfc232f58 EEXIST 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b56060390 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b56050ce0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b5605b7c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.160785s 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b56060390 auth_method 0 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b5605b7c0 auth_method 0 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient(hunting): handle_auth_done global_id 7853 payload 274 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient: _finish_hunting 0 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:38:29.670+0000 7f45064c0640 1 monclient: found mon.noname-c 2024-09-14T11:38:29.967 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: dump: 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: dump: 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:38:29.670+0000 7f450a740800 5 monclient: authenticate success, global_id 7853 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:38:29.670+0000 7f450a740800 4 set_mon_vals no callback set 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: shutdown 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:38:29.670+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.972 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: starting msgr at 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: starting objecter 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:38:29.671+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests cmddesc objecter_requests hook 0x562b5602e7e0 EEXIST 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: setting wanted keys 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: calling monclient init 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:38:29.671+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x562b56020878 EEXIST 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b56050ce0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b5605b7c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b56060390 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.162817s 2024-09-14T11:38:29.975 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b56060390 auth_method 0 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b5605b7c0 auth_method 0 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b56050ce0 auth_method 0 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:38:29.672+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient(hunting): handle_auth_done global_id 8331 payload 824 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient: _finish_hunting 0 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:38:29.672+0000 7f4506cc1640 1 monclient: found mon.noname-a 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.977 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: dump: 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: dump: 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:29.979 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:38:29.672+0000 7f450a740800 5 monclient: authenticate success, global_id 8331 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:38:29.672+0000 7f43e9ffb640 4 set_mon_vals no callback set 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:38:29.672+0000 7f450a740800 1 librados: init done 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:38:29.672+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cr dump hook 0x562b56058198 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:38:29.673+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:38:29.674+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b5607a460 auth_method 0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:38:29.674+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43d0077230 auth_method 0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:38:29.675+0000 7f450a740800 20 realm 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:38:29.675+0000 7f450a740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:38:29.675+0000 7f45064c0640 10 monclient: get_auth_request con 0x562b5607e650 auth_method 0 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:38:29.676+0000 7f450a740800 20 searching for the correct realm 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:38:29.676+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b56083a00 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:38:29.677+0000 7f4506cc1640 10 monclient: get_auth_request con 0x7f44f0009040 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:38:29.678+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f45000b1040 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:38:29.678+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x7f44f8020030 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:38:29.680+0000 7f4506cc1640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f44f0040410 msgr2=0x7f44f0040890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:38:29.881+0000 7f4506cc1640 10 monclient: get_auth_request con 0x7f44f0040410 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:38:29.884+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f44f00168d0 auth_method 0 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:38:29.886+0000 7f45064c0640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x562b5607e650 msgr2=0x562b56080a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:38:29.886+0000 7f43d7fff640 1 client.8331.objecter ms_handle_reset 0x562b5607e650 session 0x562b5607dfd0 osd.5 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:38:29.886+0000 7f43d7fff640 10 monclient: _renew_subs 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:38:29.886+0000 7f43d7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:38:29.887+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43d00878c0 auth_method 0 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:38:29.890+0000 7f450a740800 20 zone default found 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:38:29.890+0000 7f450a740800 4 Realm: () 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:38:29.890+0000 7f450a740800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:38:29.890+0000 7f450a740800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:38:29.890+0000 7f450a740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:38:29.890+0000 7f450a740800 20 zonegroup default 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:38:29.891+0000 7f450a740800 20 started sync module instance, tier type = 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:38:29.891+0000 7f450a740800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=0 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=1 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=2 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=3 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=4 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=5 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=6 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:38:29.901+0000 7f450a740800 20 add_watcher() i=7 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:38:29.901+0000 7f450a740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:38:29.903+0000 7f43bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:38:29.903+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache list hook 0x562b56055bc0 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache inspect hook 0x562b56055bc0 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache erase hook 0x562b56055bc0 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache zap hook 0x562b56055bc0 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:38:29.903+0000 7f450a740800 5 note: GC not initialized 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:38:29.903+0000 7f43377fe640 20 reqs_thread_entry: start 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace show hook 0x7f44f0004580 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace history hook 0x7f44f0004580 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace active hook 0x7f44f0004580 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace active_short hook 0x7f44f0004580 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:38:29.903+0000 7f450a740800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:38:29.903+0000 7f450a740800 20 Filter name: none 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:38:29.903+0000 7f43357fa640 20 reqs_thread_entry: start 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:38:29.903+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.988 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:38:29.904+0000 7f450a740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:38:29.906+0000 7f450a740800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:38:29.912+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.989 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:38:29.912+0000 7f450a740800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:38:29.912+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:38:29.912+0000 7f450a740800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94744126948688 notifier 8331 bl.length()=911 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:38:29.919+0000 7f450a740800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f450a740800 time 2024-09-14T11:38:29.919311+0000 2024-09-14T11:38:29.990 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f450bf8c76a] 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:38:29.919+0000 7f450a740800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f450a740800 thread_name:radosgw-admin 2024-09-14T11:38:29.991 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f450ac3e6f0] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f450ac8b99c] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f450bf8c7c4] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:38:29.992 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:29.993 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:38:29.994 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:38:29.995 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:38:29.996 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:38:29.997 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:29.998 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:29.999 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43357fa640 / http_manager 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43377fe640 / http_manager 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43bcfe1640 / rgw_dt_lg_renew 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43d7fff640 / ms_dispatch 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43e9ffb640 / io_context_pool 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43ebfff640 / ms_dispatch 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43f2e05640 / ms_dispatch 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43f4608640 / io_context_pool 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f44fdcbf640 / msgr-worker-2 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f45064c0640 / msgr-worker-1 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4506cc1640 / msgr-worker-0 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: 7f45074c2640 / io_context_pool 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: 7f450a740800 / radosgw-admin 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.154800.log 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-14T11:38:29.657+0000 7f43f4608640 10 monclient: dump: 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.001 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-14T11:38:29.657+0000 7f450a740800 5 monclient: authenticate success, global_id 8319 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-14T11:38:29.657+0000 7f450a740800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-14T11:38:29.657+0000 7f450a740800 4 set_mon_vals no callback set 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: shutdown 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-14T11:38:29.658+0000 7f450a740800 5 asok(0x562b55d6f270) unregister_commands rotate-key 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:30.002 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-14T11:38:29.658+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:30.003 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding auth protocol: cephx 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: crc 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f95550) adding con mode: secure 2024-09-14T11:38:30.004 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-14T11:38:29.658+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: starting msgr at 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: starting objecter 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-14T11:38:29.658+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests hook 0x562b55f95020 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: setting wanted keys 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-14T11:38:29.658+0000 7f450a740800 1 librados: calling monclient init 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-14T11:38:29.658+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding auth protocol: cephx 2024-09-14T11:38:30.005 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: crc 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-14T11:38:29.658+0000 7f450a740800 5 AuthRegistry(0x562b55f8f8e0) adding con mode: secure 2024-09-14T11:38:30.006 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-14T11:38:29.658+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-14T11:38:29.659+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-14T11:38:29.659+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key hook 0x562b55f8fa28 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b55e19870 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b55e3c290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b55fc1870 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:30.007 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.150153s 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b55e19870 auth_method 0 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b55e3c290 auth_method 0 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.008 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-14T11:38:29.659+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b55fc1870 auth_method 0 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-14T11:38:29.659+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient(hunting): handle_auth_done global_id 8322 payload 824 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient: _finish_hunting 0 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-14T11:38:29.659+0000 7f45064c0640 1 monclient: found mon.noname-a 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-14T11:38:29.659+0000 7f45064c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: dump: 2024-09-14T11:38:30.009 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: _finish_auth 0 2024-09-14T11:38:30.010 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-14T11:38:29.659+0000 7f450a740800 5 monclient: authenticate success, global_id 8322 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-14T11:38:29.659+0000 7f43f2e05640 10 monclient: dump: 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.011 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-14T11:38:29.659+0000 7f43f4608640 4 set_mon_vals no callback set 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-14T11:38:29.659+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-14T11:38:29.659+0000 7f450a740800 1 librados: init done 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:30.012 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-14T11:38:29.661+0000 7f43f2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-14T11:38:29.661+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x7f43ec077230 auth_method 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-14T11:38:29.662+0000 7f4506cc1640 10 monclient: get_auth_request con 0x562b55fb8810 auth_method 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-14T11:38:29.662+0000 7f45064c0640 10 monclient: get_auth_request con 0x562b55fdb5d0 auth_method 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-14T11:38:29.664+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b55fe0660 auth_method 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-14T11:38:29.664+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-14T11:38:29.664+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-14T11:38:29.664+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:30.013 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding auth protocol: cephx 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.014 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: crc 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-14T11:38:29.664+0000 7f450a740800 5 AuthRegistry(0x562b55fe4670) adding con mode: secure 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-14T11:38:29.665+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests cmddesc objecter_requests hook 0x562b55fe7b50 EEXIST 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:30.015 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding auth protocol: cephx 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.016 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: crc 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-14T11:38:29.665+0000 7f450a740800 5 AuthRegistry(0x562b55fe35b8) adding con mode: secure 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-14T11:38:29.665+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-14T11:38:29.665+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x562b55fe3700 EEXIST 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b5600be70 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b5600c250 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b5600ab80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:30.017 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-14T11:38:29.665+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.156866s 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b5600ab80 auth_method 0 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-14T11:38:29.665+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b5600c250 auth_method 0 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-14T11:38:29.665+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b5600be70 auth_method 0 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.018 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-14T11:38:29.666+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-14T11:38:29.666+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient: _finish_hunting 0 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-14T11:38:29.666+0000 7f4506cc1640 1 monclient: found mon.noname-c 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-14T11:38:29.666+0000 7f4506cc1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.019 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: dump: 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: _finish_auth 0 2024-09-14T11:38:30.020 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-14T11:38:29.666+0000 7f450a740800 5 monclient: authenticate success, global_id 7850 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-14T11:38:29.666+0000 7f43ebfff640 10 monclient: dump: 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.021 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-14T11:38:29.666+0000 7f45074c2640 4 set_mon_vals no callback set 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-14T11:38:29.666+0000 7f450a740800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-14T11:38:29.668+0000 7f43ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-14T11:38:29.668+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43e0077140 auth_method 0 2024-09-14T11:38:30.022 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: get_monmap_and_config 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-14T11:38:29.668+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-14T11:38:29.668+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.023 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding auth protocol: cephx 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.024 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: crc 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-14T11:38:29.668+0000 7f450a740800 5 AuthRegistry(0x562b5602bd70) adding con mode: secure 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding auth protocol: cephx 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.025 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: crc 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-14T11:38:29.669+0000 7f450a740800 5 AuthRegistry(0x7ffdfc232e10) adding con mode: secure 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-14T11:38:29.669+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.026 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-14T11:38:29.669+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x7ffdfc232f58 EEXIST 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b56060390 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b56050ce0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b5605b7c0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-14T11:38:29.669+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.160785s 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b56060390 auth_method 0 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.027 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b5605b7c0 auth_method 0 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-14T11:38:29.669+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.028 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-14T11:38:29.669+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient(hunting): handle_auth_done global_id 7853 payload 274 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient: _finish_hunting 0 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-14T11:38:29.670+0000 7f45064c0640 1 monclient: found mon.noname-c 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-14T11:38:29.670+0000 7f45064c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: dump: 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.030 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-14T11:38:29.670+0000 7f43e9ffb640 10 monclient: dump: 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-14T11:38:29.670+0000 7f450a740800 5 monclient: authenticate success, global_id 7853 2024-09-14T11:38:30.031 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-14T11:38:29.670+0000 7f450a740800 4 set_mon_vals no callback set 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: shutdown 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: build_initial_monmap 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-14T11:38:29.670+0000 7f450a740800 1 build_initial for_mkfs: 0 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-14T11:38:29.670+0000 7f450a740800 10 monclient: monmap: 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.032 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-b 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding auth protocol: cephx 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.033 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: crc 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-14T11:38:29.670+0000 7f450a740800 5 AuthRegistry(0x562b5602f8f0) adding con mode: secure 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: starting msgr at 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: starting objecter 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-14T11:38:29.671+0000 7f450a740800 5 asok(0x562b55d6f270) register_command objecter_requests cmddesc objecter_requests hook 0x562b5602e7e0 EEXIST 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: setting wanted keys 2024-09-14T11:38:30.034 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-14T11:38:29.671+0000 7f450a740800 1 librados: calling monclient init 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: init 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding auth protocol: cephx 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.035 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: crc 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-14T11:38:29.671+0000 7f450a740800 5 AuthRegistry(0x562b56020730) adding con mode: secure 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-14T11:38:29.671+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-14T11:38:29.671+0000 7f450a740800 5 asok(0x562b55d6f270) register_command rotate-key cmddesc rotate-key hook 0x562b56020878 EEXIST 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-b con 0x562b56050ce0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-c con 0x562b5605b7c0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): picked mon.noname-a con 0x562b56060390 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.036 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-14T11:38:29.671+0000 7f450a740800 10 monclient(hunting): authenticate will time out at 2223.162817s 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): get_auth_request con 0x562b56060390 auth_method 0 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request con 0x562b5605b7c0 auth_method 0 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.037 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-14T11:38:29.671+0000 7f4506cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): get_auth_request con 0x562b56050ce0 auth_method 0 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-14T11:38:29.671+0000 7f45064c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-14T11:38:29.671+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-14T11:38:29.672+0000 7f44fdcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-14T11:38:29.672+0000 7f45064c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient(hunting): handle_auth_done global_id 8331 payload 824 2024-09-14T11:38:30.038 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient: _finish_hunting 0 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-14T11:38:29.672+0000 7f4506cc1640 1 monclient: found mon.noname-a 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-14T11:38:29.672+0000 7f4506cc1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: dump: 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.039 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: _finish_auth 0 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-14T11:38:29.672+0000 7f43d7fff640 10 monclient: dump: 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:fsid f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-14T11:12:59.108153+0000 2024-09-14T11:38:30.040 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-14T11:38:29.672+0000 7f450a740800 5 monclient: authenticate success, global_id 8331 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-14T11:38:29.672+0000 7f43e9ffb640 4 set_mon_vals no callback set 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _renew_subs 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-14T11:38:29.672+0000 7f450a740800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-14T11:38:29.672+0000 7f450a740800 1 librados: init done 2024-09-14T11:38:30.041 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-14T11:38:29.672+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cr dump hook 0x562b56058198 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-14T11:38:29.673+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-14T11:38:29.674+0000 7f43d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.131:6824/513960180,v1:172.21.15.131:6825/513960180] 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-14T11:38:29.674+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b5607a460 auth_method 0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-14T11:38:29.674+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43d0077230 auth_method 0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-14T11:38:29.675+0000 7f450a740800 20 realm 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-14T11:38:29.675+0000 7f450a740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.042 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-14T11:38:29.675+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-14T11:38:29.675+0000 7f45064c0640 10 monclient: get_auth_request con 0x562b5607e650 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-14T11:38:29.676+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-14T11:38:29.676+0000 7f450a740800 20 searching for the correct realm 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-14T11:38:29.676+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x562b56083a00 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-14T11:38:29.677+0000 7f4506cc1640 10 monclient: get_auth_request con 0x7f44f0009040 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-14T11:38:29.678+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f45000b1040 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-14T11:38:29.678+0000 7f44fdcbf640 10 monclient: get_auth_request con 0x7f44f8020030 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-14T11:38:29.680+0000 7f4506cc1640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f44f0040410 msgr2=0x7f44f0040890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-14T11:38:29.881+0000 7f4506cc1640 10 monclient: get_auth_request con 0x7f44f0040410 auth_method 0 2024-09-14T11:38:30.043 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-14T11:38:29.884+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f44f00168d0 auth_method 0 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-14T11:38:29.886+0000 7f45064c0640 0 -- 172.21.15.94:0/3153075134 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x562b5607e650 msgr2=0x562b56080a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-14T11:38:29.886+0000 7f43d7fff640 1 client.8331.objecter ms_handle_reset 0x562b5607e650 session 0x562b5607dfd0 osd.5 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-14T11:38:29.886+0000 7f43d7fff640 10 monclient: _renew_subs 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-14T11:38:29.886+0000 7f43d7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-14T11:38:29.887+0000 7f45064c0640 10 monclient: get_auth_request con 0x7f43d00878c0 auth_method 0 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-14T11:38:29.889+0000 7f450a740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.044 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-14T11:38:29.889+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-14T11:38:29.890+0000 7f450a740800 20 zone default found 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-14T11:38:29.890+0000 7f450a740800 4 Realm: () 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-14T11:38:29.890+0000 7f450a740800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-14T11:38:29.890+0000 7f450a740800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-14T11:38:29.890+0000 7f450a740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-14T11:38:29.890+0000 7f450a740800 20 zonegroup default 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.045 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-14T11:38:29.890+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-14T11:38:29.891+0000 7f450a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-14T11:38:29.891+0000 7f450a740800 20 started sync module instance, tier type = 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-14T11:38:29.891+0000 7f450a740800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=0 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=1 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=2 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=3 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=4 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=5 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-14T11:38:29.900+0000 7f450a740800 20 add_watcher() i=6 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-14T11:38:29.901+0000 7f450a740800 20 add_watcher() i=7 2024-09-14T11:38:30.046 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-14T11:38:29.901+0000 7f450a740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding auth protocol: cephx 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.047 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: crc 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-14T11:38:29.903+0000 7f450a740800 5 AuthRegistry(0x7ffdfc2332f0) adding con mode: secure 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-14T11:38:29.903+0000 7f43bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-14T11:38:29.903+0000 7f450a740800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache list hook 0x562b56055bc0 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache inspect hook 0x562b56055bc0 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache erase hook 0x562b56055bc0 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command cache zap hook 0x562b56055bc0 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-14T11:38:29.903+0000 7f450a740800 5 note: GC not initialized 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-14T11:38:29.903+0000 7f43377fe640 20 reqs_thread_entry: start 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace show hook 0x7f44f0004580 2024-09-14T11:38:30.048 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace history hook 0x7f44f0004580 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace active hook 0x7f44f0004580 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-14T11:38:29.903+0000 7f450a740800 5 asok(0x562b55d6f270) register_command sync trace active_short hook 0x7f44f0004580 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-14T11:38:29.903+0000 7f450a740800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-14T11:38:29.903+0000 7f450a740800 20 Filter name: none 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-14T11:38:29.903+0000 7f43357fa640 20 reqs_thread_entry: start 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-14T11:38:29.903+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-14T11:38:29.903+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:38:30.049 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-14T11:38:29.904+0000 7f450a740800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-14T11:38:29.904+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-14T11:38:29.904+0000 7f450a740800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-14T11:38:29.904+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-14T11:38:29.904+0000 7f450a740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-14T11:38:29.906+0000 7f450a740800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-14T11:38:29.912+0000 7f450a740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-14T11:38:29.912+0000 7f450a740800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-14T11:38:29.912+0000 7f450a740800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-14T11:38:29.912+0000 7f450a740800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94744126948688 notifier 8331 bl.length()=911 2024-09-14T11:38:30.050 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-14T11:38:29.913+0000 7f43e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-14T11:38:29.913+0000 7f450a740800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-14T11:38:29.919+0000 7f450a740800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f450a740800 time 2024-09-14T11:38:29.919311+0000 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f450bf8c76a] 2024-09-14T11:38:30.051 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-14T11:38:29.919+0000 7f450a740800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f450a740800 thread_name:radosgw-admin 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:30.052 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f450ac3e6f0] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f450ac8b99c] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f450bf8c7c4] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f450bf8c928] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562b549e60b1] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562b549f5f6a] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f450ac29590] 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:30.053 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-14T11:38:30.054 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-14T11:38:30.055 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-14T11:38:30.056 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-14T11:38:30.057 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-14T11:38:30.058 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:30.059 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:30.060 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43357fa640 / http_manager 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43377fe640 / http_manager 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43bcfe1640 / rgw_dt_lg_renew 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43d7fff640 / ms_dispatch 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43e9ffb640 / io_context_pool 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43ebfff640 / ms_dispatch 2024-09-14T11:38:30.061 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43f2e05640 / ms_dispatch 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f43f4608640 / io_context_pool 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f44fdcbf640 / msgr-worker-2 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f45064c0640 / msgr-worker-1 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4506cc1640 / msgr-worker-0 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f45074c2640 / io_context_pool 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: 7f450a740800 / radosgw-admin 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:38:29.920742Z_86e86100-d1a9-45cb-be15-319b69d3adc2/log 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-14T11:38:30.062 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:38:30.064 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.064 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.995+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 20 realm 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.997+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.998+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.998+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.998+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.998+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.999+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:29.999+0000 7f71abf2a800 20 searching for the correct realm 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.001+0000 7f71a7416640 0 -- 172.21.15.94:0/1172726855 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f7198078070 msgr2=0x7f7198083a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.208+0000 7f71a7c17640 0 -- 172.21.15.94:0/1172726855 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f719c07b040 msgr2=0x7f719c063910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:30.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:30.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.414+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 zone default found 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 4 Realm: () 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:30.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 zonegroup default 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.415+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.416+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.416+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.416+0000 7f71abf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.416+0000 7f71abf2a800 20 started sync module instance, tier type = 2024-09-14T11:38:30.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.416+0000 7f71abf2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=0 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=1 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=2 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=3 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=4 2024-09-14T11:38:30.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=5 2024-09-14T11:38:30.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.425+0000 7f71abf2a800 20 add_watcher() i=6 2024-09-14T11:38:30.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.426+0000 7f71abf2a800 20 add_watcher() i=7 2024-09-14T11:38:30.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.426+0000 7f71abf2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f705dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 5 note: GC not initialized 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f705cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 20 Filter name: none 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f6fd67fc640 20 reqs_thread_entry: start 2024-09-14T11:38:30.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.428+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.429+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:30.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.429+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.429+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:30.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.429+0000 7f71abf2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.429+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.430+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:30.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.430+0000 7f71abf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.430+0000 7f71abf2a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:30.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.430+0000 7f71abf2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.431+0000 7f705dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.434+0000 7f71abf2a800 20 remove_watcher() i=0 2024-09-14T11:38:30.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.434+0000 7f71abf2a800 2 removed watcher, disabling cache 2024-09-14T11:38:30.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.435+0000 7f71abf2a800 20 remove_watcher() i=1 2024-09-14T11:38:30.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.436+0000 7f71abf2a800 20 remove_watcher() i=2 2024-09-14T11:38:30.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.437+0000 7f71abf2a800 20 remove_watcher() i=3 2024-09-14T11:38:30.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.438+0000 7f71abf2a800 20 remove_watcher() i=4 2024-09-14T11:38:30.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.439+0000 7f71abf2a800 20 remove_watcher() i=5 2024-09-14T11:38:30.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.440+0000 7f71abf2a800 20 remove_watcher() i=6 2024-09-14T11:38:30.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.441+0000 7f71abf2a800 20 remove_watcher() i=7 2024-09-14T11:38:30.451 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:38:30.451 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:38:30.461 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:38:30.488 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.488 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.527+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.528+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.528+0000 7fadb3b75800 20 realm 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.528+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.529+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.529+0000 7fadb3b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.529+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.529+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.529+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.530+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.530+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.530+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.530+0000 7fadb3b75800 20 searching for the correct realm 2024-09-14T11:38:30.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.534+0000 7fada8e65640 0 -- 172.21.15.94:0/3756991782 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x556a924aab80 msgr2=0x556a924acf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.538+0000 7fadb1666640 0 -- 172.21.15.94:0/3756991782 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fad9c049a00 msgr2=0x7fad9c0638f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 zone default found 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 4 Realm: () 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 zonegroup default 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.542+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 started sync module instance, tier type = 2024-09-14T11:38:30.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.543+0000 7fadb3b75800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=0 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=1 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=2 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=3 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=4 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=5 2024-09-14T11:38:30.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.552+0000 7fadb3b75800 20 add_watcher() i=6 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.553+0000 7fadb3b75800 20 add_watcher() i=7 2024-09-14T11:38:30.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.553+0000 7fadb3b75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.554+0000 7fac67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 5 note: GC not initialized 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fac66fe5640 20 reqs_thread_entry: start 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 20 Filter name: none 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fac64fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:38:30.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.555+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:38:30.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:38:30.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:38:30.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.556+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:38:30.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.557+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.557+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.557+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:38:30.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.557+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.558+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.558+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.558+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.558+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:38:30.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.559+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.560+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.560+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.560+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:38:30.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.560+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.561+0000 7fadb3b75800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:38:30.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.562+0000 7fac67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.564+0000 7fadb3b75800 20 remove_watcher() i=0 2024-09-14T11:38:30.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.564+0000 7fadb3b75800 2 removed watcher, disabling cache 2024-09-14T11:38:30.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.566+0000 7fadb3b75800 20 remove_watcher() i=1 2024-09-14T11:38:30.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.566+0000 7fadb3b75800 20 remove_watcher() i=2 2024-09-14T11:38:30.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.567+0000 7fadb3b75800 20 remove_watcher() i=3 2024-09-14T11:38:30.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.568+0000 7fadb3b75800 20 remove_watcher() i=4 2024-09-14T11:38:30.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.569+0000 7fadb3b75800 20 remove_watcher() i=5 2024-09-14T11:38:30.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.570+0000 7fadb3b75800 20 remove_watcher() i=6 2024-09-14T11:38:30.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:38:30.571+0000 7fadb3b75800 20 remove_watcher() i=7 2024-09-14T11:39:00.590 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:39:00.622 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:00.622 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.665+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 20 realm 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.667+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.668+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.668+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.668+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.668+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.669+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:00.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.669+0000 7f72e490c800 20 searching for the correct realm 2024-09-14T11:39:00.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.672+0000 7f72e1bf5640 0 -- 172.21.15.94:0/4261782632 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55e54d6beb00 msgr2=0x55e54d6c0f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:00.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.676+0000 7f72e23f6640 0 -- 172.21.15.94:0/4261782632 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f72d8073510 msgr2=0x7f72d80683e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.681+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 zone default found 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 4 Realm: () 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 zonegroup default 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.682+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.683+0000 7f72e490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.683+0000 7f72e490c800 20 started sync module instance, tier type = 2024-09-14T11:39:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.683+0000 7f72e490c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=0 2024-09-14T11:39:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=1 2024-09-14T11:39:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=2 2024-09-14T11:39:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=3 2024-09-14T11:39:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=4 2024-09-14T11:39:00.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=5 2024-09-14T11:39:00.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.692+0000 7f72e490c800 20 add_watcher() i=6 2024-09-14T11:39:00.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.693+0000 7f72e490c800 20 add_watcher() i=7 2024-09-14T11:39:00.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.693+0000 7f72e490c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:00.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f7198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f72e490c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f72e490c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f72e490c800 5 note: GC not initialized 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f71137fe640 20 reqs_thread_entry: start 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.695+0000 7f72e490c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 20 Filter name: none 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f71117fa640 20 reqs_thread_entry: start 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.696+0000 7f72e490c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:00.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.697+0000 7f72e490c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:39:00.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.701+0000 7f7198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:00.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.703+0000 7f72e490c800 20 remove_watcher() i=0 2024-09-14T11:39:00.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.703+0000 7f72e490c800 2 removed watcher, disabling cache 2024-09-14T11:39:00.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.704+0000 7f72e490c800 20 remove_watcher() i=1 2024-09-14T11:39:00.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.705+0000 7f72e490c800 20 remove_watcher() i=2 2024-09-14T11:39:00.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.706+0000 7f72e490c800 20 remove_watcher() i=3 2024-09-14T11:39:00.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.707+0000 7f72e490c800 20 remove_watcher() i=4 2024-09-14T11:39:00.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.708+0000 7f72e490c800 20 remove_watcher() i=5 2024-09-14T11:39:00.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.709+0000 7f72e490c800 20 remove_watcher() i=6 2024-09-14T11:39:00.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.710+0000 7f72e490c800 20 remove_watcher() i=7 2024-09-14T11:39:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:39:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.787+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 realm 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.789+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.790+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.790+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.790+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.790+0000 7fb42592c800 20 searching for the correct realm 2024-09-14T11:39:00.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.793+0000 7fb420d60640 0 -- 172.21.15.94:0/749564103 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb41c045940 msgr2=0x7fb41c055400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:00.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:00.797+0000 7fb421561640 0 -- 172.21.15.94:0/749564103 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb40c0d9b10 msgr2=0x7fb40c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.004+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 zone default found 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 4 Realm: () 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 zonegroup default 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.005+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.006+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.006+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.006+0000 7fb42592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.006+0000 7fb42592c800 20 started sync module instance, tier type = 2024-09-14T11:39:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.006+0000 7fb42592c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=0 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=1 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=2 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=3 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=4 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=5 2024-09-14T11:39:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.015+0000 7fb42592c800 20 add_watcher() i=6 2024-09-14T11:39:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.016+0000 7fb42592c800 20 add_watcher() i=7 2024-09-14T11:39:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.016+0000 7fb42592c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.017+0000 7fb2d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 5 note: GC not initialized 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb2d67e4640 20 reqs_thread_entry: start 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 20 Filter name: none 2024-09-14T11:39:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb247fff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.018+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.019+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.021+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.021+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.021+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.021+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.022+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.023+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:01.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:01.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.024+0000 7fb42592c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:01.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.025+0000 7fb2d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.028+0000 7fb42592c800 20 remove_watcher() i=0 2024-09-14T11:39:01.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.028+0000 7fb42592c800 2 removed watcher, disabling cache 2024-09-14T11:39:01.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.029+0000 7fb42592c800 20 remove_watcher() i=1 2024-09-14T11:39:01.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.030+0000 7fb42592c800 20 remove_watcher() i=2 2024-09-14T11:39:01.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.032+0000 7fb42592c800 20 remove_watcher() i=3 2024-09-14T11:39:01.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.033+0000 7fb42592c800 20 remove_watcher() i=4 2024-09-14T11:39:01.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.034+0000 7fb42592c800 20 remove_watcher() i=5 2024-09-14T11:39:01.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.034+0000 7fb42592c800 20 remove_watcher() i=6 2024-09-14T11:39:01.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.035+0000 7fb42592c800 20 remove_watcher() i=7 2024-09-14T11:39:01.043 INFO:tasks.workunit.client.0.smithi094.stderr:check reshard logrecord successfully 2024-09-14T11:39:01.044 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard versioned bucket 2024-09-14T11:39:01.045 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:39:01.073 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.074 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.112+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.113+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.113+0000 7fc045f2e800 20 realm 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.113+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.114+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.114+0000 7fc045f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.114+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.114+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.114+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.115+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.115+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.115+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.115+0000 7fc045f2e800 20 searching for the correct realm 2024-09-14T11:39:01.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.119+0000 7fc03936a640 0 -- 172.21.15.94:0/672870364 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fc034018040 msgr2=0x7fc03407f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:01.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.123+0000 7fc03936a640 0 -- 172.21.15.94:0/672870364 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbf0c087940 msgr2=0x7fbf0c089d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.127+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 zone default found 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 4 Realm: () 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 zonegroup default 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.128+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.129+0000 7fc045f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.129+0000 7fc045f2e800 20 started sync module instance, tier type = 2024-09-14T11:39:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.129+0000 7fc045f2e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:01.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=0 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=1 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=2 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=3 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=4 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.137+0000 7fc045f2e800 20 add_watcher() i=5 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.138+0000 7fc045f2e800 20 add_watcher() i=6 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.138+0000 7fc045f2e800 20 add_watcher() i=7 2024-09-14T11:39:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.138+0000 7fc045f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.140+0000 7fbef37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 5 note: GC not initialized 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fbef27fc640 20 reqs_thread_entry: start 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 20 Filter name: none 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fbe63fff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.141+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.142+0000 7fc045f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.143+0000 7fc045f2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.143+0000 7fc045f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.144+0000 7fbef37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.146+0000 7fc045f2e800 20 remove_watcher() i=0 2024-09-14T11:39:01.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.147+0000 7fc045f2e800 2 removed watcher, disabling cache 2024-09-14T11:39:01.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.148+0000 7fc045f2e800 20 remove_watcher() i=1 2024-09-14T11:39:01.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.149+0000 7fc045f2e800 20 remove_watcher() i=2 2024-09-14T11:39:01.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.150+0000 7fc045f2e800 20 remove_watcher() i=3 2024-09-14T11:39:01.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.151+0000 7fc045f2e800 20 remove_watcher() i=4 2024-09-14T11:39:01.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.152+0000 7fc045f2e800 20 remove_watcher() i=5 2024-09-14T11:39:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.152+0000 7fc045f2e800 20 remove_watcher() i=6 2024-09-14T11:39:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.153+0000 7fc045f2e800 20 remove_watcher() i=7 2024-09-14T11:39:01.161 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:39:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:39:01.161 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.163 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:39:01.193 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.194 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.232+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 realm 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.234+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.235+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.235+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.235+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.235+0000 7ff16d098800 20 searching for the correct realm 2024-09-14T11:39:01.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.239+0000 7ff162381640 0 -- 172.21.15.94:0/1898627491 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff15c090c00 msgr2=0x7ff15c09d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.243+0000 7ff16b383640 0 -- 172.21.15.94:0/1898627491 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7ff15408db70 msgr2=0x7ff1540689d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.247+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 zone default found 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 4 Realm: () 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 zonegroup default 2024-09-14T11:39:01.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.248+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.249+0000 7ff16d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.249+0000 7ff16d098800 20 started sync module instance, tier type = 2024-09-14T11:39:01.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.249+0000 7ff16d098800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=0 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=1 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=2 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=3 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=4 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=5 2024-09-14T11:39:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.258+0000 7ff16d098800 20 add_watcher() i=6 2024-09-14T11:39:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.259+0000 7ff16d098800 20 add_watcher() i=7 2024-09-14T11:39:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.259+0000 7ff16d098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.260+0000 7ff0217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 5 note: GC not initialized 2024-09-14T11:39:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7fef9bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 20 Filter name: none 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7fef99ffb640 20 reqs_thread_entry: start 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.261+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : miss 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 adding default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.262+0000 7ff16d098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.267+0000 7ff16d098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.267+0000 7ff16d098800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.267+0000 7ff16d098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.267+0000 7ff16d098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff04dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94670330301408 notifier 7955 bl.length()=905 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff04dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff04dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff04dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:01.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:01.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.268+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:01.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.0 2024-09-14T11:39:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.273+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.274+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.274+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.275+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.4 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.275+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.5 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.276+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.6 2024-09-14T11:39:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.276+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.7 2024-09-14T11:39:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.277+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.8 2024-09-14T11:39:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.277+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.9 2024-09-14T11:39:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.278+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.10 2024-09-14T11:39:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.278+0000 7ff16d098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.278+0000 7ff16d098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.279+0000 7ff16d098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.279+0000 7ff16d098800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.279+0000 7ff16d098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.279+0000 7ff16d098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff04e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94670330301408 notifier 7955 bl.length()=905 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff04e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff04e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff04e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.280+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.283+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.0 2024-09-14T11:39:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.283+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1 2024-09-14T11:39:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.284+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2 2024-09-14T11:39:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.284+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3 2024-09-14T11:39:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.284+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.4 2024-09-14T11:39:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.284+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.5 2024-09-14T11:39:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.285+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.6 2024-09-14T11:39:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.285+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.7 2024-09-14T11:39:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.286+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.8 2024-09-14T11:39:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.286+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.9 2024-09-14T11:39:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.286+0000 7ff16d098800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.10 2024-09-14T11:39:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.287+0000 7ff16d098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.287+0000 7ff16d098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff16d098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff16d098800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff16d098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff16d098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff04e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94670330301408 notifier 7955 bl.length()=873 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff04e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff04e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.288+0000 7ff04e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.289+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.289+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.289+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.289+0000 7ff16d098800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:01.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.291+0000 7ff16d098800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:01.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.293+0000 7ff0217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.295+0000 7ff16d098800 20 remove_watcher() i=0 2024-09-14T11:39:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.295+0000 7ff16d098800 2 removed watcher, disabling cache 2024-09-14T11:39:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.296+0000 7ff16d098800 20 remove_watcher() i=1 2024-09-14T11:39:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.297+0000 7ff16d098800 20 remove_watcher() i=2 2024-09-14T11:39:01.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.298+0000 7ff16d098800 20 remove_watcher() i=3 2024-09-14T11:39:01.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.299+0000 7ff16d098800 20 remove_watcher() i=4 2024-09-14T11:39:01.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.300+0000 7ff16d098800 20 remove_watcher() i=5 2024-09-14T11:39:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.300+0000 7ff16d098800 20 remove_watcher() i=6 2024-09-14T11:39:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.301+0000 7ff16d098800 20 remove_watcher() i=7 2024-09-14T11:39:01.311 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:39:01.339 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.340 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.377+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 realm 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.379+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.380+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.380+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.380+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.380+0000 7f42f7e40800 20 searching for the correct realm 2024-09-14T11:39:01.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.383+0000 7f42f612b640 0 -- 172.21.15.94:0/933401286 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f42e0036060 msgr2=0x7f42e0070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.387+0000 7f42f592a640 0 -- 172.21.15.94:0/933401286 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f42e006d100 msgr2=0x7f42e006e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.594+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.595+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.595+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.595+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.595+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 zone default found 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 4 Realm: () 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 zonegroup default 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.596+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.597+0000 7f42f7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.597+0000 7f42f7e40800 20 started sync module instance, tier type = 2024-09-14T11:39:01.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.597+0000 7f42f7e40800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:01.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=0 2024-09-14T11:39:01.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=1 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=2 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=3 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=4 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=5 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.606+0000 7f42f7e40800 20 add_watcher() i=6 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.607+0000 7f42f7e40800 20 add_watcher() i=7 2024-09-14T11:39:01.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.607+0000 7f42f7e40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.609+0000 7f41a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.609+0000 7f42f7e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.609+0000 7f42f7e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.609+0000 7f42f7e40800 5 note: GC not initialized 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f41a6ffd640 20 reqs_thread_entry: start 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f42f7e40800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f42f7e40800 20 Filter name: none 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f41a4ff9640 20 reqs_thread_entry: start 2024-09-14T11:39:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.610+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.611+0000 7f42f7e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.613+0000 7f41a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.615+0000 7f42f7e40800 20 remove_watcher() i=0 2024-09-14T11:39:01.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.615+0000 7f42f7e40800 2 removed watcher, disabling cache 2024-09-14T11:39:01.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.616+0000 7f42f7e40800 20 remove_watcher() i=1 2024-09-14T11:39:01.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.618+0000 7f42f7e40800 20 remove_watcher() i=2 2024-09-14T11:39:01.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.619+0000 7f42f7e40800 20 remove_watcher() i=3 2024-09-14T11:39:01.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.620+0000 7f42f7e40800 20 remove_watcher() i=4 2024-09-14T11:39:01.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.621+0000 7f42f7e40800 20 remove_watcher() i=5 2024-09-14T11:39:01.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.622+0000 7f42f7e40800 20 remove_watcher() i=6 2024-09-14T11:39:01.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.623+0000 7f42f7e40800 20 remove_watcher() i=7 2024-09-14T11:39:01.631 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.631 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:39:01.631 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:39:01.631 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.633 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:01.633 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:01.636 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:01.636 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:01.678 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:39:01.680 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:01.680 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:01.726 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:01.726 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:01.770 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:01.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.798 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.837+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.838+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.838+0000 7fd8f600e800 20 realm 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.838+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.839+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.839+0000 7fd8f600e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.839+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.839+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.839+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.840+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.840+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.840+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.840+0000 7fd8f600e800 20 searching for the correct realm 2024-09-14T11:39:01.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.843+0000 7fd8f0fbb640 0 -- 172.21.15.94:0/3346756496 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55df2d679270 msgr2=0x55df2d67b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.847+0000 7fd8f17bc640 0 -- 172.21.15.94:0/3346756496 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd8dc087be0 msgr2=0x7fd8dc06bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.851+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 zone default found 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 4 Realm: () 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 zonegroup default 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.852+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.853+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.853+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.853+0000 7fd8f600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.853+0000 7fd8f600e800 20 started sync module instance, tier type = 2024-09-14T11:39:01.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.853+0000 7fd8f600e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=0 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=1 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=2 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=3 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=4 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=5 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.862+0000 7fd8f600e800 20 add_watcher() i=6 2024-09-14T11:39:01.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.863+0000 7fd8f600e800 20 add_watcher() i=7 2024-09-14T11:39:01.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.863+0000 7fd8f600e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.864+0000 7fd7a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.864+0000 7fd8f600e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.864+0000 7fd8f600e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.864+0000 7fd8f600e800 5 note: GC not initialized 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd7a67e4640 20 reqs_thread_entry: start 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd8f600e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd8f600e800 20 Filter name: none 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd717fff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.865+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.866+0000 7fd8f600e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.868+0000 7fd7a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.870+0000 7fd8f600e800 20 remove_watcher() i=0 2024-09-14T11:39:01.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.870+0000 7fd8f600e800 2 removed watcher, disabling cache 2024-09-14T11:39:01.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.871+0000 7fd8f600e800 20 remove_watcher() i=1 2024-09-14T11:39:01.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.872+0000 7fd8f600e800 20 remove_watcher() i=2 2024-09-14T11:39:01.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.873+0000 7fd8f600e800 20 remove_watcher() i=3 2024-09-14T11:39:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.874+0000 7fd8f600e800 20 remove_watcher() i=4 2024-09-14T11:39:01.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.875+0000 7fd8f600e800 20 remove_watcher() i=5 2024-09-14T11:39:01.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.876+0000 7fd8f600e800 20 remove_watcher() i=6 2024-09-14T11:39:01.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.877+0000 7fd8f600e800 20 remove_watcher() i=7 2024-09-14T11:39:01.885 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.885 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:39:01.885 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:39:01.886 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:01.887 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:39:01.915 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.915 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.953+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 realm 2024-09-14T11:39:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.955+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.956+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.956+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.956+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.956+0000 7f09d0b2a800 20 searching for the correct realm 2024-09-14T11:39:01.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.959+0000 7f09ccf62640 0 -- 172.21.15.94:0/2411161391 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f09c00700c0 msgr2=0x7f09c008b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:01.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:01.963+0000 7f09cc761640 0 -- 172.21.15.94:0/2411161391 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f09c008b930 msgr2=0x7f09c0091840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.170+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 zone default found 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 4 Realm: () 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 zonegroup default 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 started sync module instance, tier type = 2024-09-14T11:39:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.171+0000 7f09d0b2a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=0 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=1 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=2 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=3 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=4 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=5 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=6 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 20 add_watcher() i=7 2024-09-14T11:39:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.181+0000 7f09d0b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.183+0000 7f0882fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 5 note: GC not initialized 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f0881fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 20 Filter name: none 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f07f37fe640 20 reqs_thread_entry: start 2024-09-14T11:39:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.184+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.185+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.185+0000 7f09d0b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.185+0000 7f09d0b2a800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.185+0000 7f09d0b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:02.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.186+0000 7f0882fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.188+0000 7f09d0b2a800 20 remove_watcher() i=0 2024-09-14T11:39:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.188+0000 7f09d0b2a800 2 removed watcher, disabling cache 2024-09-14T11:39:02.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.189+0000 7f09d0b2a800 20 remove_watcher() i=1 2024-09-14T11:39:02.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.190+0000 7f09d0b2a800 20 remove_watcher() i=2 2024-09-14T11:39:02.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.191+0000 7f09d0b2a800 20 remove_watcher() i=3 2024-09-14T11:39:02.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.192+0000 7f09d0b2a800 20 remove_watcher() i=4 2024-09-14T11:39:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.193+0000 7f09d0b2a800 20 remove_watcher() i=5 2024-09-14T11:39:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.194+0000 7f09d0b2a800 20 remove_watcher() i=6 2024-09-14T11:39:02.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.195+0000 7f09d0b2a800 20 remove_watcher() i=7 2024-09-14T11:39:02.205 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.index setomapval .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:39:02.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.247 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:39:02.276 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.276 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.313+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 realm 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.315+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.316+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.316+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.316+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.316+0000 7fb919cbb800 20 searching for the correct realm 2024-09-14T11:39:02.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.320+0000 7fb90efa4640 0 -- 172.21.15.94:0/136081053 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55b373c20650 msgr2=0x55b373c22a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:02.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.323+0000 7fb9177a5640 0 -- 172.21.15.94:0/136081053 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb900041040 msgr2=0x7fb90004d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 zone default found 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 4 Realm: () 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 zonegroup default 2024-09-14T11:39:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.328+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 started sync module instance, tier type = 2024-09-14T11:39:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.329+0000 7fb919cbb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:02.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=0 2024-09-14T11:39:02.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=1 2024-09-14T11:39:02.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=2 2024-09-14T11:39:02.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=3 2024-09-14T11:39:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=4 2024-09-14T11:39:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=5 2024-09-14T11:39:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.338+0000 7fb919cbb800 20 add_watcher() i=6 2024-09-14T11:39:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.339+0000 7fb919cbb800 20 add_watcher() i=7 2024-09-14T11:39:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.339+0000 7fb919cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.340+0000 7fb7cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 5 note: GC not initialized 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb7ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 20 Filter name: none 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb7467fc640 20 reqs_thread_entry: start 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.341+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 INFO: main: starting shard=0 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 INFO: main: starting shard=1 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.342+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.343+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.343+0000 7fb919cbb800 20 INFO: main: starting shard=2 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.343+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.343+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 INFO: main: starting shard=3 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 INFO: main: starting shard=4 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.344+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 INFO: main: starting shard=5 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 INFO: main: starting shard=6 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.345+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: starting shard=7 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: starting shard=8 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 INFO: main: starting shard=9 2024-09-14T11:39:02.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.346+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 INFO: main: starting shard=10 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 INFO: main: starting shard=11 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.347+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 20 INFO: main: starting shard=12 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.348+0000 7fb919cbb800 20 INFO: main: done 2024-09-14T11:39:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.349+0000 7fb7cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.351+0000 7fb919cbb800 20 remove_watcher() i=0 2024-09-14T11:39:02.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.351+0000 7fb919cbb800 2 removed watcher, disabling cache 2024-09-14T11:39:02.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.352+0000 7fb919cbb800 20 remove_watcher() i=1 2024-09-14T11:39:02.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.353+0000 7fb919cbb800 20 remove_watcher() i=2 2024-09-14T11:39:02.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.354+0000 7fb919cbb800 20 remove_watcher() i=3 2024-09-14T11:39:02.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.355+0000 7fb919cbb800 20 remove_watcher() i=4 2024-09-14T11:39:02.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.356+0000 7fb919cbb800 20 remove_watcher() i=5 2024-09-14T11:39:02.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.357+0000 7fb919cbb800 20 remove_watcher() i=6 2024-09-14T11:39:02.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.358+0000 7fb919cbb800 20 remove_watcher() i=7 2024-09-14T11:39:02.367 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:39:02.399 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.399 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.437+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 20 realm 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.439+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.440+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.440+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.440+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.440+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.441+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.441+0000 7f975bb39800 20 searching for the correct realm 2024-09-14T11:39:02.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.443+0000 7f9757fc8640 0 -- 172.21.15.94:0/3241265702 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f974002f040 msgr2=0x7f97400433f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.447+0000 7f97577c7640 0 -- 172.21.15.94:0/3241265702 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f974003a900 msgr2=0x7f974002e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 zone default found 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 4 Realm: () 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 zonegroup default 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.653+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 started sync module instance, tier type = 2024-09-14T11:39:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.654+0000 7f975bb39800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=0 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=1 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=2 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=3 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=4 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=5 2024-09-14T11:39:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.663+0000 7f975bb39800 20 add_watcher() i=6 2024-09-14T11:39:02.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.664+0000 7f975bb39800 20 add_watcher() i=7 2024-09-14T11:39:02.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.664+0000 7f975bb39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.665+0000 7f960dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 5 note: GC not initialized 2024-09-14T11:39:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f960cfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 20 Filter name: none 2024-09-14T11:39:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f95867fc640 20 reqs_thread_entry: start 2024-09-14T11:39:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.666+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : miss 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.667+0000 7f975bb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.670+0000 7f975bb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.670+0000 7f975bb39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.670+0000 7f975bb39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.670+0000 7f975bb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f963a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497077 cookie 94124970849312 notifier 8051 bl.length()=911 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f963a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f963a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f963a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:39:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:39:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:39:02.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.671+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:39:02.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.676+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.676+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.676+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.676+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.677+0000 7f975bb39800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.677+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.677+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.677+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.677+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.678+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.678+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.678+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.678+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.679+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.680+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.680+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.680+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.680+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.681+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.681+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.681+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.681+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.682+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.682+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.682+0000 7f975bb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.682+0000 7f975bb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.683+0000 7f975bb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.683+0000 7f975bb39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.683+0000 7f975bb39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.683+0000 7f975bb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f963a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497078 cookie 94124970849312 notifier 8051 bl.length()=911 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f963a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f963a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f963a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:39:02.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:39:02.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:39:02.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.684+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:39:02.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.0 2024-09-14T11:39:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.1 2024-09-14T11:39:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.2 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.687+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.3 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.688+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.688+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.4 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.688+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.688+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.5 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.6 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.7 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.689+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.8 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.9 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.10 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.11 2024-09-14T11:39:02.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.690+0000 7f975bb39800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.2.12 2024-09-14T11:39:02.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.691+0000 7f975bb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:02.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.691+0000 7f975bb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 2024-09-14T11:39:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f975bb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f975bb39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f975bb39800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f975bb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18, ofs0, ns] 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f963a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94124970849312 notifier 8051 bl.length()=879 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f963a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 info.flags=0x17 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f963a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18 to cache LRU end 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.692+0000 7f963a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.693+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_sources= new_sources= 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.693+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential sources added=[] removed=[] 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.693+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): orig_dests= new_dests= 2024-09-14T11:39:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.693+0000 7f975bb39800 20 handle_bi_update(): bucket=:a-bucket[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18]): potential dests added=[] removed=[] 2024-09-14T11:39:02.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.695+0000 7f975bb39800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:39:02.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.697+0000 7f960dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.699+0000 7f975bb39800 20 remove_watcher() i=0 2024-09-14T11:39:02.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.699+0000 7f975bb39800 2 removed watcher, disabling cache 2024-09-14T11:39:02.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.700+0000 7f975bb39800 20 remove_watcher() i=1 2024-09-14T11:39:02.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.701+0000 7f975bb39800 20 remove_watcher() i=2 2024-09-14T11:39:02.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.703+0000 7f975bb39800 20 remove_watcher() i=3 2024-09-14T11:39:02.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.703+0000 7f975bb39800 20 remove_watcher() i=4 2024-09-14T11:39:02.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.704+0000 7f975bb39800 20 remove_watcher() i=5 2024-09-14T11:39:02.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.705+0000 7f975bb39800 20 remove_watcher() i=6 2024-09-14T11:39:02.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.706+0000 7f975bb39800 20 remove_watcher() i=7 2024-09-14T11:39:02.715 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:39:02.744 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.744 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.782+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.783+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.783+0000 7f13cc326800 20 realm 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.783+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.784+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.784+0000 7f13cc326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.784+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.784+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.784+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.785+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.785+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.785+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.785+0000 7f13cc326800 20 searching for the correct realm 2024-09-14T11:39:02.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.787+0000 7f13c804b640 0 -- 172.21.15.94:0/70726233 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f13c0023070 msgr2=0x7f13c0078550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.790+0000 7f13c804b640 0 -- 172.21.15.94:0/70726233 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1290087970 msgr2=0x7f1290089da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:02.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:02.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.795+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 zone default found 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 4 Realm: () 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 zonegroup default 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.796+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.797+0000 7f13cc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.797+0000 7f13cc326800 20 started sync module instance, tier type = 2024-09-14T11:39:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.797+0000 7f13cc326800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=0 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=1 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=2 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=3 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=4 2024-09-14T11:39:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=5 2024-09-14T11:39:02.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.805+0000 7f13cc326800 20 add_watcher() i=6 2024-09-14T11:39:02.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.806+0000 7f13cc326800 20 add_watcher() i=7 2024-09-14T11:39:02.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.806+0000 7f13cc326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.808+0000 7f127efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.808+0000 7f13cc326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.808+0000 7f13cc326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.808+0000 7f13cc326800 5 note: GC not initialized 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.808+0000 7f127dfdb640 20 reqs_thread_entry: start 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f13cc326800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f13cc326800 20 Filter name: none 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f11ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.809+0000 7f13cc326800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:39:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 20 INFO: main: starting shard=0 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.810+0000 7f13cc326800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18.3.0 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.811+0000 7f13cc326800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.811+0000 7f13cc326800 20 INFO: main: done 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.811+0000 7f127efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.814+0000 7f13cc326800 20 remove_watcher() i=0 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.814+0000 7f13cc326800 2 removed watcher, disabling cache 2024-09-14T11:39:02.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.815+0000 7f13cc326800 20 remove_watcher() i=1 2024-09-14T11:39:02.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.816+0000 7f13cc326800 20 remove_watcher() i=2 2024-09-14T11:39:02.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.817+0000 7f13cc326800 20 remove_watcher() i=3 2024-09-14T11:39:02.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.818+0000 7f13cc326800 20 remove_watcher() i=4 2024-09-14T11:39:02.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.819+0000 7f13cc326800 20 remove_watcher() i=5 2024-09-14T11:39:02.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.820+0000 7f13cc326800 20 remove_watcher() i=6 2024-09-14T11:39:02.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.821+0000 7f13cc326800 20 remove_watcher() i=7 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi094.stderr: test: PUT succeeds during reshard 2024-09-14T11:39:02.831 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:39:02.859 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.859 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.897+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.898+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.898+0000 7f817b573800 20 realm 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.898+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.899+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.899+0000 7f817b573800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.899+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.899+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.899+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.900+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.900+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.900+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.900+0000 7f817b573800 20 searching for the correct realm 2024-09-14T11:39:02.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.903+0000 7f817885c640 0 -- 172.21.15.94:0/1495112035 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55ed01a13410 msgr2=0x55ed01a15800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:02.906+0000 7f817905d640 0 -- 172.21.15.94:0/1495112035 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f817001e030 msgr2=0x7f8170003000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:03.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.112+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 zone default found 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 4 Realm: () 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 zonegroup default 2024-09-14T11:39:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 started sync module instance, tier type = 2024-09-14T11:39:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.113+0000 7f817b573800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=0 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=1 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=2 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=3 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=4 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=5 2024-09-14T11:39:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.122+0000 7f817b573800 20 add_watcher() i=6 2024-09-14T11:39:03.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.123+0000 7f817b573800 20 add_watcher() i=7 2024-09-14T11:39:03.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.123+0000 7f817b573800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.124+0000 7f802f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 5 note: GC not initialized 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f802e7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 Filter name: none 2024-09-14T11:39:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f7f9ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:03.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.125+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:03.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.126+0000 7f817b573800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:03.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.128+0000 7f802f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:03.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.130+0000 7f817b573800 20 remove_watcher() i=0 2024-09-14T11:39:03.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.130+0000 7f817b573800 2 removed watcher, disabling cache 2024-09-14T11:39:03.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.131+0000 7f817b573800 20 remove_watcher() i=1 2024-09-14T11:39:03.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.132+0000 7f817b573800 20 remove_watcher() i=2 2024-09-14T11:39:03.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.133+0000 7f817b573800 20 remove_watcher() i=3 2024-09-14T11:39:03.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.134+0000 7f817b573800 20 remove_watcher() i=4 2024-09-14T11:39:03.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.135+0000 7f817b573800 20 remove_watcher() i=5 2024-09-14T11:39:03.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.136+0000 7f817b573800 20 remove_watcher() i=6 2024-09-14T11:39:03.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.136+0000 7f817b573800 20 remove_watcher() i=7 2024-09-14T11:39:03.144 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:03.144 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-14T11:39:03.145 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:39:03.145 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:03.146 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:39:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:03.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.216+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.217+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.217+0000 7fd5907af800 20 realm 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.217+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.218+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.218+0000 7fd5907af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.218+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.218+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.218+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.219+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:03.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.219+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.219+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:03.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.219+0000 7fd5907af800 20 searching for the correct realm 2024-09-14T11:39:03.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.221+0000 7fd58da98640 0 -- 172.21.15.94:0/1529770199 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fd580061040 msgr2=0x7fd580095940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:03.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.426+0000 7fd58e299640 0 -- 172.21.15.94:0/1529770199 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fd578060ac0 msgr2=0x7fd5780698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:03.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:03.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:03.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.632+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 zone default found 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 4 Realm: () 2024-09-14T11:39:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 zonegroup default 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.633+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.634+0000 7fd5907af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.634+0000 7fd5907af800 20 started sync module instance, tier type = 2024-09-14T11:39:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.634+0000 7fd5907af800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=0 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=1 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=2 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=3 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=4 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=5 2024-09-14T11:39:03.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.643+0000 7fd5907af800 20 add_watcher() i=6 2024-09-14T11:39:03.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.644+0000 7fd5907af800 20 add_watcher() i=7 2024-09-14T11:39:03.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.644+0000 7fd5907af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:03.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.645+0000 7fd444fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:03.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:03.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 5 note: GC not initialized 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd3bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 20 Filter name: none 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd3bd7fa640 20 reqs_thread_entry: start 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:39:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.646+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : miss 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 20 rados->read ofs=0 len=0 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:03.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 adding default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:03.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:03.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:03.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.647+0000 7fd5907af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd5907af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd5907af800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd5907af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd5907af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd4717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93883444531808 notifier 8607 bl.length()=905 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd4717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd4717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.652+0000 7fd4717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.653+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.653+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.653+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:03.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.653+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:03.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:03.659+0000 7fd5907af800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:39:04.150 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:04.150 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:04.165 INFO:tasks.workunit.client.0.smithi094.stderr:put object successful 2024-09-14T11:39:08.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:08.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:08.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:08.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.659+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.660+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.660+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:08.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.661+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.661+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.661+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.661+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.662+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.662+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.663+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:08.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.663+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.664+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.664+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.664+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:08.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.664+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.665+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.665+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:08.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.666+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:08.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.666+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.667+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.667+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.667+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.667+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.670+0000 7fd5907af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.670+0000 7fd5907af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:08.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.671+0000 7fd5907af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:08.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.671+0000 7fd5907af800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:08.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.671+0000 7fd5907af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:08.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.671+0000 7fd5907af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd471ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 93883444531808 notifier 8607 bl.length()=905 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd471ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd471ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd471ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.672+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:08.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.675+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:08.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.675+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.0 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.676+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.676+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.1 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.676+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.676+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.2 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.677+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.677+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.3 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.677+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.677+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.4 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.5 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.6 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.678+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.7 2024-09-14T11:39:08.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.679+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:08.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.679+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.8 2024-09-14T11:39:08.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.679+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:08.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.679+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.9 2024-09-14T11:39:08.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.680+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:08.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.680+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.10 2024-09-14T11:39:08.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.680+0000 7fd5907af800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:08.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.680+0000 7fd5907af800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.1.11 2024-09-14T11:39:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.682+0000 7fd5907af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:08.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.682+0000 7fd5907af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:08.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd5907af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd5907af800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd5907af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd5907af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd471ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 93883444531808 notifier 8607 bl.length()=873 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd471ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd471ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:08.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.684+0000 7fd471ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:08.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.685+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:08.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.685+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:08.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.685+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:08.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.685+0000 7fd5907af800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:08.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.688+0000 7fd5907af800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.690+0000 7fd444fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.693+0000 7fd5907af800 20 remove_watcher() i=0 2024-09-14T11:39:08.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.693+0000 7fd5907af800 2 removed watcher, disabling cache 2024-09-14T11:39:08.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.694+0000 7fd5907af800 20 remove_watcher() i=1 2024-09-14T11:39:08.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.695+0000 7fd5907af800 20 remove_watcher() i=2 2024-09-14T11:39:08.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.697+0000 7fd5907af800 20 remove_watcher() i=3 2024-09-14T11:39:08.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.698+0000 7fd5907af800 20 remove_watcher() i=4 2024-09-14T11:39:08.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.699+0000 7fd5907af800 20 remove_watcher() i=5 2024-09-14T11:39:08.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.700+0000 7fd5907af800 20 remove_watcher() i=6 2024-09-14T11:39:08.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:08.701+0000 7fd5907af800 20 remove_watcher() i=7 2024-09-14T11:39:09.171 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:39:09.171 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:39:09.175 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.175 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.181 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.181 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.224 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.224 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.240 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.245 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.245 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.260 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.260 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.263 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.263 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.278 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:09.278 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:09.282 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:39:09.675 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:39:11.068 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:11.068 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:11.124 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:39:11.126 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:39:11.159 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.159 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.201+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.202+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.202+0000 7f87de923800 20 realm 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.202+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.203+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.203+0000 7f87de923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.203+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.203+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.203+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.204+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.204+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.204+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.204+0000 7f87de923800 20 searching for the correct realm 2024-09-14T11:39:11.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.208+0000 7f87d1d32640 0 -- 172.21.15.94:0/2418930671 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x555a172a9870 msgr2=0x555a172abca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.212+0000 7f87da533640 0 -- 172.21.15.94:0/2418930671 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f87c407d1e0 msgr2=0x7f87c4061b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.216+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 zone default found 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 4 Realm: () 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 zonegroup default 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.217+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 started sync module instance, tier type = 2024-09-14T11:39:11.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.218+0000 7f87de923800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:11.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=0 2024-09-14T11:39:11.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=1 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=2 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=3 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=4 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=5 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.227+0000 7f87de923800 20 add_watcher() i=6 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.228+0000 7f87de923800 20 add_watcher() i=7 2024-09-14T11:39:11.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.228+0000 7f87de923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.230+0000 7f8690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.230+0000 7f87de923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.230+0000 7f87de923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 5 note: GC not initialized 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f860b7fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 20 Filter name: none 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f86097fa640 20 reqs_thread_entry: start 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.231+0000 7f87de923800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 20 INFO: main: starting shard=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.232+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 INFO: main: starting shard=1 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 INFO: main: starting shard=2 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.233+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: starting shard=3 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: starting shard=4 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 INFO: main: starting shard=5 2024-09-14T11:39:11.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:11.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.234+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:11.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 INFO: main: starting shard=6 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 INFO: main: starting shard=7 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.235+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 INFO: main: starting shard=8 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 INFO: main: starting shard=9 2024-09-14T11:39:11.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:11.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.236+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:11.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 INFO: main: starting shard=10 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 INFO: main: starting shard=11 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.237+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.238+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.238+0000 7f87de923800 20 INFO: main: starting shard=12 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.238+0000 7f87de923800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.238+0000 7f87de923800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.239+0000 7f87de923800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.239+0000 7f87de923800 20 INFO: main: done 2024-09-14T11:39:11.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.239+0000 7f8690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.242+0000 7f87de923800 20 remove_watcher() i=0 2024-09-14T11:39:11.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.242+0000 7f87de923800 2 removed watcher, disabling cache 2024-09-14T11:39:11.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.243+0000 7f87de923800 20 remove_watcher() i=1 2024-09-14T11:39:11.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.244+0000 7f87de923800 20 remove_watcher() i=2 2024-09-14T11:39:11.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.245+0000 7f87de923800 20 remove_watcher() i=3 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.246+0000 7f87de923800 20 remove_watcher() i=4 2024-09-14T11:39:11.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.247+0000 7f87de923800 20 remove_watcher() i=5 2024-09-14T11:39:11.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.248+0000 7f87de923800 20 remove_watcher() i=6 2024-09-14T11:39:11.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.249+0000 7f87de923800 20 remove_watcher() i=7 2024-09-14T11:39:11.260 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:11.260 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:11.263 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:11.264 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:11.313 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:39:11.315 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:39:11.346 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.346 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.384+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 realm 2024-09-14T11:39:11.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.386+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.387+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.387+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.387+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.387+0000 7f1040532800 20 searching for the correct realm 2024-09-14T11:39:11.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.389+0000 7f103c1bc640 0 -- 172.21.15.94:0/4276377094 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1034029040 msgr2=0x7f103400e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.594+0000 7f103c9bd640 0 -- 172.21.15.94:0/4276377094 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f10300cf020 msgr2=0x7f10300be400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:11.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:11.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.600+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 zone default found 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 4 Realm: () 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 zonegroup default 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.601+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.602+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.602+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.602+0000 7f1040532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.602+0000 7f1040532800 20 started sync module instance, tier type = 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.602+0000 7f1040532800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:11.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=0 2024-09-14T11:39:11.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=1 2024-09-14T11:39:11.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=2 2024-09-14T11:39:11.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=3 2024-09-14T11:39:11.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=4 2024-09-14T11:39:11.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=5 2024-09-14T11:39:11.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.611+0000 7f1040532800 20 add_watcher() i=6 2024-09-14T11:39:11.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.612+0000 7f1040532800 20 add_watcher() i=7 2024-09-14T11:39:11.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.612+0000 7f1040532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.613+0000 7f0ef2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 5 note: GC not initialized 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f0ef1fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 20 Filter name: none 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f0e637fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.614+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 INFO: main: starting shard=0 2024-09-14T11:39:11.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.615+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 INFO: main: starting shard=1 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 INFO: main: starting shard=2 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:11.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.616+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: starting shard=3 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: starting shard=4 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:11.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 INFO: main: starting shard=5 2024-09-14T11:39:11.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:11.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.617+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.618+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.618+0000 7f1040532800 20 INFO: main: starting shard=6 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.618+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.618+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 INFO: main: starting shard=7 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 INFO: main: starting shard=8 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:11.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.619+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:11.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 INFO: main: starting shard=9 2024-09-14T11:39:11.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:11.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 INFO: main: starting shard=10 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.620+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 INFO: main: starting shard=11 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 INFO: main: starting shard=12 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:11.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.621+0000 7f1040532800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:11.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.622+0000 7f1040532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:11.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.622+0000 7f1040532800 20 INFO: main: done 2024-09-14T11:39:11.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.623+0000 7f0ef2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.625+0000 7f1040532800 20 remove_watcher() i=0 2024-09-14T11:39:11.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.625+0000 7f1040532800 2 removed watcher, disabling cache 2024-09-14T11:39:11.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.627+0000 7f1040532800 20 remove_watcher() i=1 2024-09-14T11:39:11.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.628+0000 7f1040532800 20 remove_watcher() i=2 2024-09-14T11:39:11.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.629+0000 7f1040532800 20 remove_watcher() i=3 2024-09-14T11:39:11.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.630+0000 7f1040532800 20 remove_watcher() i=4 2024-09-14T11:39:11.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.631+0000 7f1040532800 20 remove_watcher() i=5 2024-09-14T11:39:11.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.632+0000 7f1040532800 20 remove_watcher() i=6 2024-09-14T11:39:11.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.633+0000 7f1040532800 20 remove_watcher() i=7 2024-09-14T11:39:11.643 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:11.644 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:11.647 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:11.647 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:11.698 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:39:11.700 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:39:11.729 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.729 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.768+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.769+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.769+0000 7fcadec2d800 20 realm 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.769+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.769+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.770+0000 7fcadec2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.770+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.770+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.770+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.771+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.771+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.771+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.771+0000 7fcadec2d800 20 searching for the correct realm 2024-09-14T11:39:11.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.774+0000 7fcad3f16640 0 -- 172.21.15.94:0/1938249785 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fcacc044040 msgr2=0x7fcacc02a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.778+0000 7fcadc717640 0 -- 172.21.15.94:0/1938249785 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fcac4015ba0 msgr2=0x7fcac40959c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:11.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.985+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 zone default found 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 4 Realm: () 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 zonegroup default 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.986+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.987+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.987+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.987+0000 7fcadec2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.987+0000 7fcadec2d800 20 started sync module instance, tier type = 2024-09-14T11:39:11.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.987+0000 7fcadec2d800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:11.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=0 2024-09-14T11:39:11.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=1 2024-09-14T11:39:11.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=2 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=3 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=4 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=5 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.996+0000 7fcadec2d800 20 add_watcher() i=6 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.997+0000 7fcadec2d800 20 add_watcher() i=7 2024-09-14T11:39:11.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.997+0000 7fcadec2d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.999+0000 7fc992fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.999+0000 7fcadec2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.999+0000 7fcadec2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:11.999+0000 7fcadec2d800 5 note: GC not initialized 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fc991fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fcadec2d800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fcadec2d800 20 Filter name: none 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fc9037fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.000+0000 7fcadec2d800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 INFO: main: starting shard=0 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 INFO: main: starting shard=1 2024-09-14T11:39:12.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.001+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 INFO: main: starting shard=2 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:12.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:12.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 INFO: main: starting shard=3 2024-09-14T11:39:12.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:12.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.002+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:12.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 INFO: main: starting shard=4 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 INFO: main: starting shard=5 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.003+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 INFO: main: starting shard=6 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 INFO: main: starting shard=7 2024-09-14T11:39:12.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:12.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.004+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 INFO: main: starting shard=8 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 INFO: main: starting shard=9 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.005+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:12.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 INFO: main: starting shard=10 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 INFO: main: starting shard=11 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.006+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 20 INFO: main: starting shard=12 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:12.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:12.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:39:12.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.007+0000 7fcadec2d800 20 INFO: main: done 2024-09-14T11:39:12.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.008+0000 7fc992fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:12.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.011+0000 7fcadec2d800 20 remove_watcher() i=0 2024-09-14T11:39:12.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.011+0000 7fcadec2d800 2 removed watcher, disabling cache 2024-09-14T11:39:12.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.012+0000 7fcadec2d800 20 remove_watcher() i=1 2024-09-14T11:39:12.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.013+0000 7fcadec2d800 20 remove_watcher() i=2 2024-09-14T11:39:12.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.014+0000 7fcadec2d800 20 remove_watcher() i=3 2024-09-14T11:39:12.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.015+0000 7fcadec2d800 20 remove_watcher() i=4 2024-09-14T11:39:12.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.016+0000 7fcadec2d800 20 remove_watcher() i=5 2024-09-14T11:39:12.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.017+0000 7fcadec2d800 20 remove_watcher() i=6 2024-09-14T11:39:12.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.018+0000 7fcadec2d800 20 remove_watcher() i=7 2024-09-14T11:39:12.028 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:12.028 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:12.032 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:39:12.422 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:39:12.812 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:39:12.843 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:12.843 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:12.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.881+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 20 realm 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.883+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.884+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.884+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.885+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:12.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.885+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.885+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:12.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.885+0000 7fe3f590c800 20 searching for the correct realm 2024-09-14T11:39:12.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:12.888+0000 7fe3f3bfe640 0 -- 172.21.15.94:0/3910950510 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fe3dc085050 msgr2=0x7fe3dc061d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.093+0000 7fe3f33fd640 0 -- 172.21.15.94:0/3910950510 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fe3dc0947e0 msgr2=0x7fe3dc0941b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.300+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 zone default found 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 4 Realm: () 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 zonegroup default 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.301+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.302+0000 7fe3f590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.302+0000 7fe3f590c800 20 started sync module instance, tier type = 2024-09-14T11:39:13.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.302+0000 7fe3f590c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=0 2024-09-14T11:39:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=1 2024-09-14T11:39:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=2 2024-09-14T11:39:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=3 2024-09-14T11:39:13.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=4 2024-09-14T11:39:13.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=5 2024-09-14T11:39:13.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.313+0000 7fe3f590c800 20 add_watcher() i=6 2024-09-14T11:39:13.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.314+0000 7fe3f590c800 20 add_watcher() i=7 2024-09-14T11:39:13.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.314+0000 7fe3f590c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe3f590c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe3f590c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe3f590c800 5 note: GC not initialized 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe2a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe3f590c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe3f590c800 20 Filter name: none 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.316+0000 7fe2227fc640 20 reqs_thread_entry: start 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : miss 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 adding default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:13.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.317+0000 7fe3f590c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:13.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe3f590c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe3f590c800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe3f590c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe3f590c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94555149051840 notifier 8706 bl.length()=905 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe2d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe2d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.324+0000 7fe2d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.325+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.325+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.325+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:13.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.325+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.329+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.0 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.329+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.0 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.1 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.1 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.2 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.2 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.3 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.3 2024-09-14T11:39:13.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.4 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.4 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.5 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.5 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.6 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.6 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.7 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.7 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.8 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.8 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.10 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.10 2024-09-14T11:39:13.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.11 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.11 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.12 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.12 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.13 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.13 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.14 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.14 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.15 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.15 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.16 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.16 2024-09-14T11:39:13.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:13.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.330+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.331+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.332+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.332+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:13.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.332+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.332+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.333+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.333+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.333+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.333+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.334+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.334+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:13.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.334+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:13.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.334+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:13.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.335+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:13.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.335+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:13.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.335+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:13.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.335+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:13.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.338+0000 7fe3f590c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:13.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.338+0000 7fe3f590c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:13.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe3f590c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe3f590c800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe3f590c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe3f590c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94555149051840 notifier 8706 bl.length()=905 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe2d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe2d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.339+0000 7fe2d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.340+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.340+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.340+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:13.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.340+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:13.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.342+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.342+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.0 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.342+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.342+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.1 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.2 2024-09-14T11:39:13.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:13.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.3 2024-09-14T11:39:13.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:13.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.343+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.4 2024-09-14T11:39:13.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:13.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.5 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.6 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.344+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.7 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.8 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:13.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.9 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.10 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.345+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.11 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.346+0000 7fe3f590c800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:13.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.346+0000 7fe3f590c800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.2.12 2024-09-14T11:39:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.346+0000 7fe3f590c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.346+0000 7fe3f590c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:13.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.347+0000 7fe3f590c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.347+0000 7fe3f590c800 10 moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.347+0000 7fe3f590c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.347+0000 7fe3f590c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19, ofs0, ns] 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94555149051840 notifier 8706 bl.length()=873 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe2d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe2d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe2d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_sources= new_sources= 2024-09-14T11:39:13.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential sources added=[] removed=[] 2024-09-14T11:39:13.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): orig_dests= new_dests= 2024-09-14T11:39:13.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.348+0000 7fe3f590c800 20 handle_bi_update(): bucket=:myver[3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19]): potential dests added=[] removed=[] 2024-09-14T11:39:13.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.351+0000 7fe3f590c800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:39:13.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.353+0000 7fe2a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.355+0000 7fe3f590c800 20 remove_watcher() i=0 2024-09-14T11:39:13.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.355+0000 7fe3f590c800 2 removed watcher, disabling cache 2024-09-14T11:39:13.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.356+0000 7fe3f590c800 20 remove_watcher() i=1 2024-09-14T11:39:13.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.357+0000 7fe3f590c800 20 remove_watcher() i=2 2024-09-14T11:39:13.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.358+0000 7fe3f590c800 20 remove_watcher() i=3 2024-09-14T11:39:13.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.359+0000 7fe3f590c800 20 remove_watcher() i=4 2024-09-14T11:39:13.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.360+0000 7fe3f590c800 20 remove_watcher() i=5 2024-09-14T11:39:13.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.361+0000 7fe3f590c800 20 remove_watcher() i=6 2024-09-14T11:39:13.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.362+0000 7fe3f590c800 20 remove_watcher() i=7 2024-09-14T11:39:13.371 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:39:13.406 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:13.406 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:13.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.445+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 realm 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.446+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.447+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.447+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.448+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.448+0000 7f481db26800 20 searching for the correct realm 2024-09-14T11:39:13.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.449+0000 7f4819709640 0 -- 172.21.15.94:0/4003400293 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f481401a040 msgr2=0x7f481401c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.654+0000 7f4819f0a640 0 -- 172.21.15.94:0/4003400293 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f4810074060 msgr2=0x7f48100a4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:13.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:13.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.660+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 zone default found 2024-09-14T11:39:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 4 Realm: () 2024-09-14T11:39:13.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 zonegroup default 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.661+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.662+0000 7f481db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.662+0000 7f481db26800 20 started sync module instance, tier type = 2024-09-14T11:39:13.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.662+0000 7f481db26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=0 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=1 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=2 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=3 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=4 2024-09-14T11:39:13.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=5 2024-09-14T11:39:13.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.671+0000 7f481db26800 20 add_watcher() i=6 2024-09-14T11:39:13.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.672+0000 7f481db26800 20 add_watcher() i=7 2024-09-14T11:39:13.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.672+0000 7f481db26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f46cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f481db26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f481db26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f481db26800 5 note: GC not initialized 2024-09-14T11:39:13.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f46ce7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f481db26800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.674+0000 7f481db26800 20 Filter name: none 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f463ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 : miss 2024-09-14T11:39:13.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 info.flags=0x17 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 adding default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 to cache LRU end 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.0 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.675+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.0 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.676+0000 7f481db26800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.676+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.1 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.676+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.1 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.2 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.2 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.3 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.3 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.677+0000 7f481db26800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.4 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.4 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.5 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.5 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.6 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.678+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.6 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.7 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.7 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.8 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.679+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.8 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.680+0000 7f481db26800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.680+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.680+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.680+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.10 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.680+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.10 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.11 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.11 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.12 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.681+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.12 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.13 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.13 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.14 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.682+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.14 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.15 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.15 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 10 bucket_obj is .dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.16 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.683+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.16 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.684+0000 7f481db26800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.684+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.684+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:x state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.685+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to tqxy16cqnw0w9kgujye4x18pkx82lll9 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.685+0000 7f481db26800 20 get_obj_state_impl: setting s->olh_tag to 73v35rgjjiokxlb5hsqrlod7q8lyhig3 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.685+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=73v35rgjjiokxlb5hsqrlod7q8lyhig3 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.686+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.687+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 olh_log_entry: epoch=2 op=3 key=x[KgVwCB-fna5kO7DIXJmki5HH.43L.qp] 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:KgVwCB-fna5kO7DIXJmki5HH.43L.qp_x state=0x5557cec68de8 s->prefetch_data=0 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 10 manifest: total_size = 12 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2946656355221753096 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:KgVwCB-fna5kO7DIXJmki5HH.43L.qp_x state=0x5557cec68de8 s->prefetch_data=0 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 prepare_atomic_modification: state is not atomic. state=0x5557cec68de8 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.688+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.690+0000 7f481db26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.690+0000 7f481db26800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.690+0000 7f481db26800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.690+0000 7f481db26800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:KgVwCB-fna5kO7DIXJmki5HH.43L.qp_.cyic4kTFYG9AZq_-Cbt8tXUpjmFQeLE_0 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.691+0000 7f46fcff9640 20 handle_completion(): completion ok for obj=x[KgVwCB-fna5kO7DIXJmki5HH.43L.qp] 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.692+0000 7f481db26800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.693+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:x state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.693+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=73v35rgjjiokxlb5hsqrlod7q8lyhig3 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.696+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.698+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.698+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.698+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:y state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.699+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to 7a241lgvqyygi6dgxu1qf11e8y12b933 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.699+0000 7f481db26800 20 get_obj_state_impl: setting s->olh_tag to bhrtsco8j2cmadqrjhiwvkt0fcaws607 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.699+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bhrtsco8j2cmadqrjhiwvkt0fcaws607 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.700+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.701+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.701+0000 7f481db26800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.701+0000 7f481db26800 20 olh_log_entry: epoch=2 op=3 key=y[VjGOUD3VNGOXciFeJvg107rwiuAKI5X] 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.701+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:VjGOUD3VNGOXciFeJvg107rwiuAKI5X_y state=0x5557cec28618 s->prefetch_data=0 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.702+0000 7f481db26800 10 manifest: total_size = 12 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.702+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5117508401860592119 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.702+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:VjGOUD3VNGOXciFeJvg107rwiuAKI5X_y state=0x5557cec28618 s->prefetch_data=0 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.702+0000 7f481db26800 20 prepare_atomic_modification: state is not atomic. state=0x5557cec28618 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.702+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.704+0000 7f481db26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.704+0000 7f481db26800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.704+0000 7f481db26800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.704+0000 7f481db26800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:VjGOUD3VNGOXciFeJvg107rwiuAKI5X_.hrnZZjW_y5MFapYsU1TnGZt_K42_HLH_0 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.706+0000 7f481db26800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.706+0000 7f46effff640 20 handle_completion(): completion ok for obj=y[VjGOUD3VNGOXciFeJvg107rwiuAKI5X] 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.707+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:y state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.707+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bhrtsco8j2cmadqrjhiwvkt0fcaws607 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.710+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.711+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.711+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.712+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:z state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.712+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to fx8i84bgnevwpg9hjmas17pet1p1uutu 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.712+0000 7f481db26800 20 get_obj_state_impl: setting s->olh_tag to 3xnwletwity554z71g44fv2zmr8912t0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.712+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3xnwletwity554z71g44fv2zmr8912t0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.713+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.714+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 olh_log_entry: epoch=2 op=3 key=z[EZMwIWrBiCUKIujRQdK91DW1I4wDc3J] 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:EZMwIWrBiCUKIujRQdK91DW1I4wDc3J_z state=0x5557cec6afb8 s->prefetch_data=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 10 manifest: total_size = 22 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 get_obj_state: setting s->obj_tag to 3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13108581106252699663 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:_:EZMwIWrBiCUKIujRQdK91DW1I4wDc3J_z state=0x5557cec6afb8 s->prefetch_data=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 prepare_atomic_modification: state is not atomic. state=0x5557cec6afb8 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.715+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.717+0000 7f481db26800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.717+0000 7f481db26800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.717+0000 7f481db26800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.717+0000 7f481db26800 5 delete_objs_inline: removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:EZMwIWrBiCUKIujRQdK91DW1I4wDc3J_.zsFj3rNcdUCj6zn-wEml5uj18ZX0i7E_0 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.718+0000 7f46fcff9640 20 handle_completion(): completion ok for obj=z[EZMwIWrBiCUKIujRQdK91DW1I4wDc3J] 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.718+0000 7f481db26800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.720+0000 7f481db26800 20 get_obj_state: octx=0x5557ce96a380 obj=myver:z state=0x5557cec2d708 s->prefetch_data=0 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.720+0000 7f481db26800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3xnwletwity554z71g44fv2zmr8912t0 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.722+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.723+0000 7f481db26800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19.3.9 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.723+0000 7f481db26800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.723+0000 7f481db26800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.724+0000 7f46cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.726+0000 7f481db26800 20 remove_watcher() i=0 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.726+0000 7f481db26800 2 removed watcher, disabling cache 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.727+0000 7f481db26800 20 remove_watcher() i=1 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.728+0000 7f481db26800 20 remove_watcher() i=2 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.729+0000 7f481db26800 20 remove_watcher() i=3 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.730+0000 7f481db26800 20 remove_watcher() i=4 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.731+0000 7f481db26800 20 remove_watcher() i=5 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.732+0000 7f481db26800 20 remove_watcher() i=6 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.733+0000 7f481db26800 20 remove_watcher() i=7 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:39:13.820 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:13.820 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:13.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.858+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 realm 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.860+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.861+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.861+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.862+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.862+0000 7f2e3b687800 20 searching for the correct realm 2024-09-14T11:39:13.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.864+0000 7f2e30970640 0 -- 172.21.15.94:0/575477315 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f2e2c05fdf0 msgr2=0x7f2e2c097a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:13.868+0000 7f2e39171640 0 -- 172.21.15.94:0/575477315 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f2e2404f970 msgr2=0x7f2e240c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.074+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:14.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:14.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 zone default found 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 4 Realm: () 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 zonegroup default 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.075+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.076+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.076+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.076+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.076+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.077+0000 7f2e3b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:14.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.077+0000 7f2e3b687800 20 started sync module instance, tier type = 2024-09-14T11:39:14.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.077+0000 7f2e3b687800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=0 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=1 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=2 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=3 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=4 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=5 2024-09-14T11:39:14.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.088+0000 7f2e3b687800 20 add_watcher() i=6 2024-09-14T11:39:14.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.089+0000 7f2e3b687800 20 add_watcher() i=7 2024-09-14T11:39:14.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.089+0000 7f2e3b687800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:14.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.090+0000 7f2ceffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:14.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:14.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 5 note: GC not initialized 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2ceefe5640 20 reqs_thread_entry: start 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 Filter name: none 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2cecfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:14.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.091+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 rados->read ofs=0 len=0 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:14.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.092+0000 7f2e3b687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:14.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.095+0000 7f2ceffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:14.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.097+0000 7f2e3b687800 20 remove_watcher() i=0 2024-09-14T11:39:14.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.097+0000 7f2e3b687800 2 removed watcher, disabling cache 2024-09-14T11:39:14.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.098+0000 7f2e3b687800 20 remove_watcher() i=1 2024-09-14T11:39:14.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.099+0000 7f2e3b687800 20 remove_watcher() i=2 2024-09-14T11:39:14.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.100+0000 7f2e3b687800 20 remove_watcher() i=3 2024-09-14T11:39:14.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.101+0000 7f2e3b687800 20 remove_watcher() i=4 2024-09-14T11:39:14.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.102+0000 7f2e3b687800 20 remove_watcher() i=5 2024-09-14T11:39:14.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.103+0000 7f2e3b687800 20 remove_watcher() i=6 2024-09-14T11:39:14.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:39:14.104+0000 7f2e3b687800 20 remove_watcher() i=7 2024-09-14T11:39:14.113 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:39:14.113 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket a-bucket 2024-09-14T11:39:14.115 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:14.115 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:14.119 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:14.119 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:14.133 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket myver 2024-09-14T11:39:14.134 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:14.134 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:14.178 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:39:14.178 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:39:14.213 INFO:tasks.workunit.client.0.smithi094.stderr:Completed resharding tests 2024-09-14T11:39:14.214 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:39:14.214 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:39:14.214 INFO:tasks.workunit.client.0.smithi094.stdout:connected to https://localhost:443 2024-09-14T11:39:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-14T11:39:14.290 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-14T11:39:14.291 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-14T11:39:14.292 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-14T11:39:14.293 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:39:14.293 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:39:14.372 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:39:14.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:39:14.783 DEBUG:teuthology.parallel:result is None 2024-09-14T11:39:14.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:39:14.822 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:39:14.822 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:39:14.890 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:39:14.890 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:39:14.904 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:39:14.905 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:39:14.905 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:39:14.905 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:39:14.958 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:39:19.708 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:39:19.708 DEBUG:teuthology.orchestra.run.smithi094:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:39:21.586 INFO:teuthology.orchestra.run.smithi094.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:39:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:28:22 ago on Sat 14 Sep 2024 11:11:00 AM UTC. 2024-09-14T11:39:22.295 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:22.297 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Install 5 Packages 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 46 M 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 166 M 2024-09-14T11:39:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-14T11:39:23.185 INFO:teuthology.orchestra.run.smithi094.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 507 kB/s | 426 kB 00:00 2024-09-14T11:39:23.443 INFO:teuthology.orchestra.run.smithi094.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 3.2 MB/s | 3.5 MB 00:01 2024-09-14T11:39:23.661 INFO:teuthology.orchestra.run.smithi094.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 7.1 MB/s | 9.3 MB 00:01 2024-09-14T11:39:24.061 INFO:teuthology.orchestra.run.smithi094.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 42 kB/s | 26 kB 00:00 2024-09-14T11:39:25.186 INFO:teuthology.orchestra.run.smithi094.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 16 MB/s | 32 MB 00:02 2024-09-14T11:39:25.186 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:39:25.186 INFO:teuthology.orchestra.run.smithi094.stdout:Total 16 MB/s | 46 MB 00:02 2024-09-14T11:39:25.610 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-14T11:39:25.631 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-14T11:39:25.631 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-14T11:39:26.110 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-14T11:39:26.111 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-14T11:39:26.644 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:39:26.789 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-14T11:39:26.969 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:39:27.600 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:39:27.648 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:39:27.886 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:39:27.915 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:39:28.143 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:39:28.187 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:39:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:39:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:39:28.239 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:39:31.372 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:39:31.372 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:39:31.372 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:39:31.372 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:39:31.372 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:39:31.799 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:39:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:39:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:39:31.800 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:31.800 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-14T11:39:32.255 INFO:teuthology.orchestra.run.smithi094.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:39:32.315 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-14 11:39:32-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:39:32.438 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-14T11:39:32.446 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:39:32.543 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:39:32.543 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:39:32.544 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-14 11:39:32-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:39:32.544 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-14T11:39:32.554 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-14T11:39:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:39:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113853Z&X-Amz-Expires=300&X-Amz-Signature=b11b4d7553d661c97a1be18bf9f7c143e3c7afc5d46df656181140d6696b24b4&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:39:32.641 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-14 11:39:32-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113853Z&X-Amz-Expires=300&X-Amz-Signature=b11b4d7553d661c97a1be18bf9f7c143e3c7afc5d46df656181140d6696b24b4&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:39:32.656 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.109.133, ... 2024-09-14T11:39:32.668 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:39:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:39:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:39:32.742 INFO:teuthology.orchestra.run.smithi094.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:39:32.742 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:39:32.757 INFO:teuthology.orchestra.run.smithi094.stderr: 0K .......... .......... .......... .......... .......... 0% 3.33M 27s 2024-09-14T11:39:32.769 INFO:teuthology.orchestra.run.smithi094.stderr: 50K .......... .......... .......... .......... .......... 0% 3.90M 25s 2024-09-14T11:39:32.778 INFO:teuthology.orchestra.run.smithi094.stderr: 100K .......... .......... .......... .......... .......... 0% 5.45M 22s 2024-09-14T11:39:32.780 INFO:teuthology.orchestra.run.smithi094.stderr: 150K .......... .......... .......... .......... .......... 0% 21.3M 18s 2024-09-14T11:39:32.782 INFO:teuthology.orchestra.run.smithi094.stderr: 200K .......... .......... .......... .......... .......... 0% 21.9M 15s 2024-09-14T11:39:32.784 INFO:teuthology.orchestra.run.smithi094.stderr: 250K .......... .......... .......... .......... .......... 0% 36.2M 13s 2024-09-14T11:39:32.790 INFO:teuthology.orchestra.run.smithi094.stderr: 300K .......... .......... .......... .......... .......... 0% 8.14M 13s 2024-09-14T11:39:32.792 INFO:teuthology.orchestra.run.smithi094.stderr: 350K .......... .......... .......... .......... .......... 0% 26.2M 12s 2024-09-14T11:39:32.793 INFO:teuthology.orchestra.run.smithi094.stderr: 400K .......... .......... .......... .......... .......... 0% 52.3M 10s 2024-09-14T11:39:32.794 INFO:teuthology.orchestra.run.smithi094.stderr: 450K .......... .......... .......... .......... .......... 0% 44.9M 10s 2024-09-14T11:39:32.795 INFO:teuthology.orchestra.run.smithi094.stderr: 500K .......... .......... .......... .......... .......... 0% 37.9M 9s 2024-09-14T11:39:32.809 INFO:teuthology.orchestra.run.smithi094.stderr: 550K .......... .......... .......... .......... .......... 0% 9.20M 9s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 600K .......... .......... .......... .......... .......... 0% 180M 8s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 650K .......... .......... .......... .......... .......... 0% 56.6M 8s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 700K .......... .......... .......... .......... .......... 0% 45.4M 7s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 750K .......... .......... .......... .......... .......... 0% 62.7M 7s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 800K .......... .......... .......... .......... .......... 0% 180M 7s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 850K .......... .......... .......... .......... .......... 0% 349M 6s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 900K .......... .......... .......... .......... .......... 1% 35.6M 6s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 950K .......... .......... .......... .......... .......... 1% 212M 6s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 1000K .......... .......... .......... .......... .......... 1% 41.1M 6s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 1050K .......... .......... .......... .......... .......... 1% 179M 5s 2024-09-14T11:39:32.810 INFO:teuthology.orchestra.run.smithi094.stderr: 1100K .......... .......... .......... .......... .......... 1% 405M 5s 2024-09-14T11:39:34.185 INFO:teuthology.orchestra.run.smithi094.stderr: 1150K .......... .......... .......... .......... .......... 1% 9.66M 5s 2024-09-14T11:39:34.185 INFO:teuthology.orchestra.run.smithi094.stderr: 1200K .......... .......... .......... .......... .......... 1% 405M 5s 2024-09-14T11:39:34.185 INFO:teuthology.orchestra.run.smithi094.stderr: 1250K .......... .......... .......... .......... .......... 1% 58.4M 5s 2024-09-14T11:39:34.185 INFO:teuthology.orchestra.run.smithi094.stderr: 1300K .......... .......... .......... .......... .......... 1% 424M 5s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1350K .......... .......... .......... .......... .......... 1% 224M 5s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1400K .......... .......... .......... .......... .......... 1% 67.1M 5s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1450K .......... .......... .......... .......... .......... 1% 235M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1500K .......... .......... .......... .......... .......... 1% 87.6M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1550K .......... .......... .......... .......... .......... 1% 297M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1600K .......... .......... .......... .......... .......... 1% 281M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1650K .......... .......... .......... .......... .......... 1% 124M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1700K .......... .......... .......... .......... .......... 1% 156M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1750K .......... .......... .......... .......... .......... 1% 71.3M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1800K .......... .......... .......... .......... .......... 1% 340M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1850K .......... .......... .......... .......... .......... 2% 402M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1900K .......... .......... .......... .......... .......... 2% 150M 4s 2024-09-14T11:39:34.186 INFO:teuthology.orchestra.run.smithi094.stderr: 1950K .......... .......... .......... .......... .......... 2% 274M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2000K .......... .......... .......... .......... .......... 2% 73.3M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2050K .......... .......... .......... .......... .......... 2% 240M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2100K .......... .......... .......... .......... .......... 2% 401M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2150K .......... .......... .......... .......... .......... 2% 181M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2200K .......... .......... .......... .......... .......... 2% 194M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2250K .......... .......... .......... .......... .......... 2% 358M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2300K .......... .......... .......... .......... .......... 2% 10.5M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2350K .......... .......... .......... .......... .......... 2% 375M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2400K .......... .......... .......... .......... .......... 2% 316M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2450K .......... .......... .......... .......... .......... 2% 449M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2500K .......... .......... .......... .......... .......... 2% 194M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2550K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-14T11:39:34.187 INFO:teuthology.orchestra.run.smithi094.stderr: 2600K .......... .......... .......... .......... .......... 2% 247M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2650K .......... .......... .......... .......... .......... 2% 425M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2700K .......... .......... .......... .......... .......... 2% 242M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2750K .......... .......... .......... .......... .......... 3% 211M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2800K .......... .......... .......... .......... .......... 3% 206M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2850K .......... .......... .......... .......... .......... 3% 248M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2900K .......... .......... .......... .......... .......... 3% 249M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 2950K .......... .......... .......... .......... .......... 3% 325M 3s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 3000K .......... .......... .......... .......... .......... 3% 224M 2s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 3050K .......... .......... .......... .......... .......... 3% 301M 2s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 3100K .......... .......... .......... .......... .......... 3% 251M 2s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 3150K .......... .......... .......... .......... .......... 3% 355M 2s 2024-09-14T11:39:34.188 INFO:teuthology.orchestra.run.smithi094.stderr: 3200K .......... .......... .......... .......... .......... 3% 235M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3250K .......... .......... .......... .......... .......... 3% 254M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3300K .......... .......... .......... .......... .......... 3% 254M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3350K .......... .......... .......... .......... .......... 3% 325M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3400K .......... .......... .......... .......... .......... 3% 257M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3450K .......... .......... .......... .......... .......... 3% 294M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3500K .......... .......... .......... .......... .......... 3% 332M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3550K .......... .......... .......... .......... .......... 3% 287M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3600K .......... .......... .......... .......... .......... 3% 415M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3650K .......... .......... .......... .......... .......... 3% 221M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3700K .......... .......... .......... .......... .......... 4% 231M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3750K .......... .......... .......... .......... .......... 4% 352M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3800K .......... .......... .......... .......... .......... 4% 431M 2s 2024-09-14T11:39:34.189 INFO:teuthology.orchestra.run.smithi094.stderr: 3850K .......... .......... .......... .......... .......... 4% 397M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 3900K .......... .......... .......... .......... .......... 4% 301M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 3950K .......... .......... .......... .......... .......... 4% 430M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4000K .......... .......... .......... .......... .......... 4% 350M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4050K .......... .......... .......... .......... .......... 4% 283M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4100K .......... .......... .......... .......... .......... 4% 398M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4150K .......... .......... .......... .......... .......... 4% 421M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4200K .......... .......... .......... .......... .......... 4% 365M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4250K .......... .......... .......... .......... .......... 4% 322M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4300K .......... .......... .......... .......... .......... 4% 394M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4350K .......... .......... .......... .......... .......... 4% 368M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4400K .......... .......... .......... .......... .......... 4% 390M 2s 2024-09-14T11:39:34.190 INFO:teuthology.orchestra.run.smithi094.stderr: 4450K .......... .......... .......... .......... .......... 4% 286M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4500K .......... .......... .......... .......... .......... 4% 360M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4550K .......... .......... .......... .......... .......... 4% 449M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4600K .......... .......... .......... .......... .......... 5% 12.4M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4650K .......... .......... .......... .......... .......... 5% 389M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4700K .......... .......... .......... .......... .......... 5% 344M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4750K .......... .......... .......... .......... .......... 5% 431M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4800K .......... .......... .......... .......... .......... 5% 419M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4850K .......... .......... .......... .......... .......... 5% 436M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4900K .......... .......... .......... .......... .......... 5% 390M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 4950K .......... .......... .......... .......... .......... 5% 406M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 5000K .......... .......... .......... .......... .......... 5% 344M 2s 2024-09-14T11:39:34.191 INFO:teuthology.orchestra.run.smithi094.stderr: 5050K .......... .......... .......... .......... .......... 5% 409M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5100K .......... .......... .......... .......... .......... 5% 396M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5150K .......... .......... .......... .......... .......... 5% 425M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5200K .......... .......... .......... .......... .......... 5% 380M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5250K .......... .......... .......... .......... .......... 5% 412M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5300K .......... .......... .......... .......... .......... 5% 425M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5350K .......... .......... .......... .......... .......... 5% 387M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5400K .......... .......... .......... .......... .......... 5% 336M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5450K .......... .......... .......... .......... .......... 5% 404M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5500K .......... .......... .......... .......... .......... 5% 415M 2s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5550K .......... .......... .......... .......... .......... 6% 388M 1s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5600K .......... .......... .......... .......... .......... 6% 431M 1s 2024-09-14T11:39:34.192 INFO:teuthology.orchestra.run.smithi094.stderr: 5650K .......... .......... .......... .......... .......... 6% 359M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5700K .......... .......... .......... .......... .......... 6% 427M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5750K .......... .......... .......... .......... .......... 6% 427M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5800K .......... .......... .......... .......... .......... 6% 433M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5850K .......... .......... .......... .......... .......... 6% 377M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5900K .......... .......... .......... .......... .......... 6% 365M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 5950K .......... .......... .......... .......... .......... 6% 435M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6000K .......... .......... .......... .......... .......... 6% 432M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6050K .......... .......... .......... .......... .......... 6% 360M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6100K .......... .......... .......... .......... .......... 6% 450M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6150K .......... .......... .......... .......... .......... 6% 425M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6200K .......... .......... .......... .......... .......... 6% 417M 1s 2024-09-14T11:39:34.193 INFO:teuthology.orchestra.run.smithi094.stderr: 6250K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6300K .......... .......... .......... .......... .......... 6% 437M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6350K .......... .......... .......... .......... .......... 6% 446M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6400K .......... .......... .......... .......... .......... 6% 389M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6450K .......... .......... .......... .......... .......... 6% 376M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6500K .......... .......... .......... .......... .......... 7% 431M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6550K .......... .......... .......... .......... .......... 7% 452M 1s 2024-09-14T11:39:34.194 INFO:teuthology.orchestra.run.smithi094.stderr: 6600K .......... .......... .......... .......... .......... 7% 364M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6650K .......... .......... .......... .......... .......... 7% 413M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6700K .......... .......... .......... .......... .......... 7% 223M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6750K .......... .......... .......... .......... .......... 7% 341M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6800K .......... .......... .......... .......... .......... 7% 215M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6850K .......... .......... .......... .......... .......... 7% 399M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6900K .......... .......... .......... .......... .......... 7% 284M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 6950K .......... .......... .......... .......... .......... 7% 377M 1s 2024-09-14T11:39:34.195 INFO:teuthology.orchestra.run.smithi094.stderr: 7000K .......... .......... .......... .......... .......... 7% 424M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7050K .......... .......... .......... .......... .......... 7% 431M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7100K .......... .......... .......... .......... .......... 7% 429M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7150K .......... .......... .......... .......... .......... 7% 368M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7200K .......... .......... .......... .......... .......... 7% 442M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7250K .......... .......... .......... .......... .......... 7% 201M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7300K .......... .......... .......... .......... .......... 7% 423M 1s 2024-09-14T11:39:34.196 INFO:teuthology.orchestra.run.smithi094.stderr: 7350K .......... .......... .......... .......... .......... 7% 422M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7400K .......... .......... .......... .......... .......... 8% 373M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7450K .......... .......... .......... .......... .......... 8% 407M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7500K .......... .......... .......... .......... .......... 8% 382M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7550K .......... .......... .......... .......... .......... 8% 420M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7600K .......... .......... .......... .......... .......... 8% 429M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7650K .......... .......... .......... .......... .......... 8% 12.5M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7700K .......... .......... .......... .......... .......... 8% 200M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7750K .......... .......... .......... .......... .......... 8% 307M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7800K .......... .......... .......... .......... .......... 8% 413M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7850K .......... .......... .......... .......... .......... 8% 419M 1s 2024-09-14T11:39:34.197 INFO:teuthology.orchestra.run.smithi094.stderr: 7900K .......... .......... .......... .......... .......... 8% 369M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 7950K .......... .......... .......... .......... .......... 8% 370M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8000K .......... .......... .......... .......... .......... 8% 388M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8050K .......... .......... .......... .......... .......... 8% 119M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8100K .......... .......... .......... .......... .......... 8% 256M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8150K .......... .......... .......... .......... .......... 8% 344M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8200K .......... .......... .......... .......... .......... 8% 418M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8250K .......... .......... .......... .......... .......... 8% 330M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8300K .......... .......... .......... .......... .......... 8% 405M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8350K .......... .......... .......... .......... .......... 9% 360M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8400K .......... .......... .......... .......... .......... 9% 406M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8450K .......... .......... .......... .......... .......... 9% 380M 1s 2024-09-14T11:39:34.198 INFO:teuthology.orchestra.run.smithi094.stderr: 8500K .......... .......... .......... .......... .......... 9% 362M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8550K .......... .......... .......... .......... .......... 9% 401M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8600K .......... .......... .......... .......... .......... 9% 437M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8650K .......... .......... .......... .......... .......... 9% 420M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8700K .......... .......... .......... .......... .......... 9% 387M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8750K .......... .......... .......... .......... .......... 9% 367M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8800K .......... .......... .......... .......... .......... 9% 425M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8850K .......... .......... .......... .......... .......... 9% 409M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8900K .......... .......... .......... .......... .......... 9% 436M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 8950K .......... .......... .......... .......... .......... 9% 341M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 9000K .......... .......... .......... .......... .......... 9% 407M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 9050K .......... .......... .......... .......... .......... 9% 383M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 9100K .......... .......... .......... .......... .......... 9% 445M 1s 2024-09-14T11:39:34.199 INFO:teuthology.orchestra.run.smithi094.stderr: 9150K .......... .......... .......... .......... .......... 9% 377M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9200K .......... .......... .......... .......... .......... 9% 415M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9250K .......... .......... .......... .......... .......... 10% 372M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9300K .......... .......... .......... .......... .......... 10% 419M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9350K .......... .......... .......... .......... .......... 10% 426M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9400K .......... .......... .......... .......... .......... 10% 422M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9450K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9500K .......... .......... .......... .......... .......... 10% 394M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9550K .......... .......... .......... .......... .......... 10% 402M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9600K .......... .......... .......... .......... .......... 10% 415M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9650K .......... .......... .......... .......... .......... 10% 305M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9700K .......... .......... .......... .......... .......... 10% 408M 1s 2024-09-14T11:39:34.200 INFO:teuthology.orchestra.run.smithi094.stderr: 9750K .......... .......... .......... .......... .......... 10% 408M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 9800K .......... .......... .......... .......... .......... 10% 424M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 9850K .......... .......... .......... .......... .......... 10% 392M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 9900K .......... .......... .......... .......... .......... 10% 346M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 9950K .......... .......... .......... .......... .......... 10% 373M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10000K .......... .......... .......... .......... .......... 10% 372M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10050K .......... .......... .......... .......... .......... 10% 412M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10100K .......... .......... .......... .......... .......... 10% 379M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10150K .......... .......... .......... .......... .......... 10% 402M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10200K .......... .......... .......... .......... .......... 11% 394M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10250K .......... .......... .......... .......... .......... 11% 447M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10300K .......... .......... .......... .......... .......... 11% 380M 1s 2024-09-14T11:39:34.201 INFO:teuthology.orchestra.run.smithi094.stderr: 10350K .......... .......... .......... .......... .......... 11% 377M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10400K .......... .......... .......... .......... .......... 11% 398M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10450K .......... .......... .......... .......... .......... 11% 413M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10500K .......... .......... .......... .......... .......... 11% 340M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10550K .......... .......... .......... .......... .......... 11% 399M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10600K .......... .......... .......... .......... .......... 11% 420M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10650K .......... .......... .......... .......... .......... 11% 409M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10700K .......... .......... .......... .......... .......... 11% 14.3M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10750K .......... .......... .......... .......... .......... 11% 113M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10800K .......... .......... .......... .......... .......... 11% 132M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10850K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10900K .......... .......... .......... .......... .......... 11% 349M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 10950K .......... .......... .......... .......... .......... 11% 367M 1s 2024-09-14T11:39:34.202 INFO:teuthology.orchestra.run.smithi094.stderr: 11000K .......... .......... .......... .......... .......... 11% 306M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11050K .......... .......... .......... .......... .......... 11% 384M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11100K .......... .......... .......... .......... .......... 12% 144M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11150K .......... .......... .......... .......... .......... 12% 387M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11200K .......... .......... .......... .......... .......... 12% 179M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11250K .......... .......... .......... .......... .......... 12% 375M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11300K .......... .......... .......... .......... .......... 12% 328M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11350K .......... .......... .......... .......... .......... 12% 382M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11400K .......... .......... .......... .......... .......... 12% 366M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11450K .......... .......... .......... .......... .......... 12% 357M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11500K .......... .......... .......... .......... .......... 12% 320M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11550K .......... .......... .......... .......... .......... 12% 399M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11600K .......... .......... .......... .......... .......... 12% 384M 1s 2024-09-14T11:39:34.203 INFO:teuthology.orchestra.run.smithi094.stderr: 11650K .......... .......... .......... .......... .......... 12% 399M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11700K .......... .......... .......... .......... .......... 12% 361M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11750K .......... .......... .......... .......... .......... 12% 397M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11800K .......... .......... .......... .......... .......... 12% 368M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11850K .......... .......... .......... .......... .......... 12% 368M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11900K .......... .......... .......... .......... .......... 12% 321M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 11950K .......... .......... .......... .......... .......... 12% 402M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12000K .......... .......... .......... .......... .......... 12% 351M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12050K .......... .......... .......... .......... .......... 13% 439M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12100K .......... .......... .......... .......... .......... 13% 360M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12150K .......... .......... .......... .......... .......... 13% 333M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12200K .......... .......... .......... .......... .......... 13% 439M 1s 2024-09-14T11:39:34.204 INFO:teuthology.orchestra.run.smithi094.stderr: 12250K .......... .......... .......... .......... .......... 13% 397M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12300K .......... .......... .......... .......... .......... 13% 323M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12350K .......... .......... .......... .......... .......... 13% 378M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12400K .......... .......... .......... .......... .......... 13% 420M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12450K .......... .......... .......... .......... .......... 13% 394M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12500K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12550K .......... .......... .......... .......... .......... 13% 380M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12600K .......... .......... .......... .......... .......... 13% 404M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12650K .......... .......... .......... .......... .......... 13% 429M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12700K .......... .......... .......... .......... .......... 13% 337M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12750K .......... .......... .......... .......... .......... 13% 408M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12800K .......... .......... .......... .......... .......... 13% 398M 1s 2024-09-14T11:39:34.205 INFO:teuthology.orchestra.run.smithi094.stderr: 12850K .......... .......... .......... .......... .......... 13% 442M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 12900K .......... .......... .......... .......... .......... 13% 342M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 12950K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 13000K .......... .......... .......... .......... .......... 14% 386M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 13050K .......... .......... .......... .......... .......... 14% 385M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 13100K .......... .......... .......... .......... .......... 14% 304M 1s 2024-09-14T11:39:34.206 INFO:teuthology.orchestra.run.smithi094.stderr: 13150K .......... .......... .......... .......... .......... 14% 410M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13200K .......... .......... .......... .......... .......... 14% 394M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13250K .......... .......... .......... .......... .......... 14% 415M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13300K .......... .......... .......... .......... .......... 14% 354M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13350K .......... .......... .......... .......... .......... 14% 368M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13400K .......... .......... .......... .......... .......... 14% 394M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13450K .......... .......... .......... .......... .......... 14% 408M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13500K .......... .......... .......... .......... .......... 14% 337M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13550K .......... .......... .......... .......... .......... 14% 337M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13600K .......... .......... .......... .......... .......... 14% 358M 1s 2024-09-14T11:39:34.208 INFO:teuthology.orchestra.run.smithi094.stderr: 13650K .......... .......... .......... .......... .......... 14% 16.9M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13700K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13750K .......... .......... .......... .......... .......... 14% 381M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13800K .......... .......... .......... .......... .......... 14% 188M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13850K .......... .......... .......... .......... .......... 14% 132M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13900K .......... .......... .......... .......... .......... 15% 314M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 13950K .......... .......... .......... .......... .......... 15% 358M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14000K .......... .......... .......... .......... .......... 15% 248M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14050K .......... .......... .......... .......... .......... 15% 89.5M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14100K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14150K .......... .......... .......... .......... .......... 15% 389M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14200K .......... .......... .......... .......... .......... 15% 360M 1s 2024-09-14T11:39:34.209 INFO:teuthology.orchestra.run.smithi094.stderr: 14250K .......... .......... .......... .......... .......... 15% 200M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14300K .......... .......... .......... .......... .......... 15% 130M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14350K .......... .......... .......... .......... .......... 15% 387M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14400K .......... .......... .......... .......... .......... 15% 378M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14450K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14500K .......... .......... .......... .......... .......... 15% 324M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14550K .......... .......... .......... .......... .......... 15% 389M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14600K .......... .......... .......... .......... .......... 15% 422M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14650K .......... .......... .......... .......... .......... 15% 394M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14700K .......... .......... .......... .......... .......... 15% 355M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14750K .......... .......... .......... .......... .......... 15% 347M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14800K .......... .......... .......... .......... .......... 15% 390M 1s 2024-09-14T11:39:34.210 INFO:teuthology.orchestra.run.smithi094.stderr: 14850K .......... .......... .......... .......... .......... 16% 391M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 14900K .......... .......... .......... .......... .......... 16% 383M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 14950K .......... .......... .......... .......... .......... 16% 359M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15000K .......... .......... .......... .......... .......... 16% 370M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15050K .......... .......... .......... .......... .......... 16% 272M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15100K .......... .......... .......... .......... .......... 16% 388M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15150K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15200K .......... .......... .......... .......... .......... 16% 365M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15250K .......... .......... .......... .......... .......... 16% 362M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15300K .......... .......... .......... .......... .......... 16% 371M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15350K .......... .......... .......... .......... .......... 16% 334M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15400K .......... .......... .......... .......... .......... 16% 388M 1s 2024-09-14T11:39:34.211 INFO:teuthology.orchestra.run.smithi094.stderr: 15450K .......... .......... .......... .......... .......... 16% 419M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15500K .......... .......... .......... .......... .......... 16% 414M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15550K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15600K .......... .......... .......... .......... .......... 16% 378M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15650K .......... .......... .......... .......... .......... 16% 398M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15700K .......... .......... .......... .......... .......... 16% 383M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15750K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15800K .......... .......... .......... .......... .......... 17% 397M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15850K .......... .......... .......... .......... .......... 17% 324M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15900K .......... .......... .......... .......... .......... 17% 404M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 15950K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 16000K .......... .......... .......... .......... .......... 17% 402M 1s 2024-09-14T11:39:34.212 INFO:teuthology.orchestra.run.smithi094.stderr: 16050K .......... .......... .......... .......... .......... 17% 357M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16100K .......... .......... .......... .......... .......... 17% 354M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16150K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16200K .......... .......... .......... .......... .......... 17% 309M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16250K .......... .......... .......... .......... .......... 17% 391M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16300K .......... .......... .......... .......... .......... 17% 329M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16350K .......... .......... .......... .......... .......... 17% 359M 1s 2024-09-14T11:39:34.213 INFO:teuthology.orchestra.run.smithi094.stderr: 16400K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16450K .......... .......... .......... .......... .......... 17% 451M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16500K .......... .......... .......... .......... .......... 17% 385M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16550K .......... .......... .......... .......... .......... 17% 17.2M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16600K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16650K .......... .......... .......... .......... .......... 17% 402M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16700K .......... .......... .......... .......... .......... 18% 315M 1s 2024-09-14T11:39:34.214 INFO:teuthology.orchestra.run.smithi094.stderr: 16750K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 16800K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 16850K .......... .......... .......... .......... .......... 18% 386M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 16900K .......... .......... .......... .......... .......... 18% 353M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 16950K .......... .......... .......... .......... .......... 18% 172M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 17000K .......... .......... .......... .......... .......... 18% 375M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 17050K .......... .......... .......... .......... .......... 18% 438M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 17100K .......... .......... .......... .......... .......... 18% 120M 1s 2024-09-14T11:39:34.215 INFO:teuthology.orchestra.run.smithi094.stderr: 17150K .......... .......... .......... .......... .......... 18% 271M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17200K .......... .......... .......... .......... .......... 18% 330M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17250K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17300K .......... .......... .......... .......... .......... 18% 301M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17350K .......... .......... .......... .......... .......... 18% 145M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17400K .......... .......... .......... .......... .......... 18% 385M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17450K .......... .......... .......... .......... .......... 18% 90.9M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17500K .......... .......... .......... .......... .......... 18% 380M 1s 2024-09-14T11:39:34.216 INFO:teuthology.orchestra.run.smithi094.stderr: 17550K .......... .......... .......... .......... .......... 18% 384M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17600K .......... .......... .......... .......... .......... 18% 365M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17650K .......... .......... .......... .......... .......... 19% 392M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17700K .......... .......... .......... .......... .......... 19% 299M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17750K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17800K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17850K .......... .......... .......... .......... .......... 19% 286M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17900K .......... .......... .......... .......... .......... 19% 336M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 17950K .......... .......... .......... .......... .......... 19% 404M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 18000K .......... .......... .......... .......... .......... 19% 375M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 18050K .......... .......... .......... .......... .......... 19% 400M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 18100K .......... .......... .......... .......... .......... 19% 273M 1s 2024-09-14T11:39:34.217 INFO:teuthology.orchestra.run.smithi094.stderr: 18150K .......... .......... .......... .......... .......... 19% 381M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18200K .......... .......... .......... .......... .......... 19% 370M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18250K .......... .......... .......... .......... .......... 19% 438M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18300K .......... .......... .......... .......... .......... 19% 367M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18350K .......... .......... .......... .......... .......... 19% 328M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18400K .......... .......... .......... .......... .......... 19% 401M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18450K .......... .......... .......... .......... .......... 19% 352M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18500K .......... .......... .......... .......... .......... 19% 420M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18550K .......... .......... .......... .......... .......... 20% 410M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18600K .......... .......... .......... .......... .......... 20% 377M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18650K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18700K .......... .......... .......... .......... .......... 20% 397M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18750K .......... .......... .......... .......... .......... 20% 422M 1s 2024-09-14T11:39:34.218 INFO:teuthology.orchestra.run.smithi094.stderr: 18800K .......... .......... .......... .......... .......... 20% 431M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 18850K .......... .......... .......... .......... .......... 20% 345M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 18900K .......... .......... .......... .......... .......... 20% 443M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 18950K .......... .......... .......... .......... .......... 20% 435M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19000K .......... .......... .......... .......... .......... 20% 359M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19050K .......... .......... .......... .......... .......... 20% 389M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19100K .......... .......... .......... .......... .......... 20% 406M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19150K .......... .......... .......... .......... .......... 20% 326M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19200K .......... .......... .......... .......... .......... 20% 416M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19250K .......... .......... .......... .......... .......... 20% 416M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19300K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19350K .......... .......... .......... .......... .......... 20% 341M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19400K .......... .......... .......... .......... .......... 20% 15.7M 1s 2024-09-14T11:39:34.219 INFO:teuthology.orchestra.run.smithi094.stderr: 19450K .......... .......... .......... .......... .......... 20% 345M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19500K .......... .......... .......... .......... .......... 21% 360M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19550K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19600K .......... .......... .......... .......... .......... 21% 347M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19650K .......... .......... .......... .......... .......... 21% 375M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19700K .......... .......... .......... .......... .......... 21% 363M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19750K .......... .......... .......... .......... .......... 21% 373M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19800K .......... .......... .......... .......... .......... 21% 318M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19850K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19900K .......... .......... .......... .......... .......... 21% 406M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 19950K .......... .......... .......... .......... .......... 21% 406M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 20000K .......... .......... .......... .......... .......... 21% 381M 1s 2024-09-14T11:39:34.220 INFO:teuthology.orchestra.run.smithi094.stderr: 20050K .......... .......... .......... .......... .......... 21% 341M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20100K .......... .......... .......... .......... .......... 21% 401M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20150K .......... .......... .......... .......... .......... 21% 353M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20200K .......... .......... .......... .......... .......... 21% 292M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20250K .......... .......... .......... .......... .......... 21% 385M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20300K .......... .......... .......... .......... .......... 21% 148M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20350K .......... .......... .......... .......... .......... 21% 385M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20400K .......... .......... .......... .......... .......... 22% 383M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20450K .......... .......... .......... .......... .......... 22% 348M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20500K .......... .......... .......... .......... .......... 22% 114M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20550K .......... .......... .......... .......... .......... 22% 128M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20600K .......... .......... .......... .......... .......... 22% 388M 1s 2024-09-14T11:39:34.221 INFO:teuthology.orchestra.run.smithi094.stderr: 20650K .......... .......... .......... .......... .......... 22% 378M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20700K .......... .......... .......... .......... .......... 22% 296M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20750K .......... .......... .......... .......... .......... 22% 387M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20800K .......... .......... .......... .......... .......... 22% 376M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20850K .......... .......... .......... .......... .......... 22% 265M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20900K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 20950K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21000K .......... .......... .......... .......... .......... 22% 384M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21050K .......... .......... .......... .......... .......... 22% 409M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21100K .......... .......... .......... .......... .......... 22% 347M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21150K .......... .......... .......... .......... .......... 22% 375M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21200K .......... .......... .......... .......... .......... 22% 399M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21250K .......... .......... .......... .......... .......... 22% 389M 1s 2024-09-14T11:39:34.222 INFO:teuthology.orchestra.run.smithi094.stderr: 21300K .......... .......... .......... .......... .......... 22% 341M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21350K .......... .......... .......... .......... .......... 23% 428M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21400K .......... .......... .......... .......... .......... 23% 312M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21450K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21500K .......... .......... .......... .......... .......... 23% 345M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21550K .......... .......... .......... .......... .......... 23% 382M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21600K .......... .......... .......... .......... .......... 23% 436M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21650K .......... .......... .......... .......... .......... 23% 417M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21700K .......... .......... .......... .......... .......... 23% 345M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21750K .......... .......... .......... .......... .......... 23% 353M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21800K .......... .......... .......... .......... .......... 23% 381M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21850K .......... .......... .......... .......... .......... 23% 379M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21900K .......... .......... .......... .......... .......... 23% 419M 1s 2024-09-14T11:39:34.223 INFO:teuthology.orchestra.run.smithi094.stderr: 21950K .......... .......... .......... .......... .......... 23% 351M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22000K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22050K .......... .......... .......... .......... .......... 23% 416M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22100K .......... .......... .......... .......... .......... 23% 272M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22150K .......... .......... .......... .......... .......... 23% 398M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22200K .......... .......... .......... .......... .......... 23% 355M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22250K .......... .......... .......... .......... .......... 24% 340M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22300K .......... .......... .......... .......... .......... 24% 455M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22350K .......... .......... .......... .......... .......... 24% 15.4M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22400K .......... .......... .......... .......... .......... 24% 379M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22450K .......... .......... .......... .......... .......... 24% 382M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22500K .......... .......... .......... .......... .......... 24% 358M 1s 2024-09-14T11:39:34.224 INFO:teuthology.orchestra.run.smithi094.stderr: 22550K .......... .......... .......... .......... .......... 24% 340M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22600K .......... .......... .......... .......... .......... 24% 390M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22650K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22700K .......... .......... .......... .......... .......... 24% 399M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22750K .......... .......... .......... .......... .......... 24% 406M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22800K .......... .......... .......... .......... .......... 24% 331M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22850K .......... .......... .......... .......... .......... 24% 403M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22900K .......... .......... .......... .......... .......... 24% 381M 1s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 22950K .......... .......... .......... .......... .......... 24% 387M 0s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 23000K .......... .......... .......... .......... .......... 24% 400M 0s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 23050K .......... .......... .......... .......... .......... 24% 343M 0s 2024-09-14T11:39:34.225 INFO:teuthology.orchestra.run.smithi094.stderr: 23100K .......... .......... .......... .......... .......... 24% 410M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23150K .......... .......... .......... .......... .......... 24% 349M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23200K .......... .......... .......... .......... .......... 25% 372M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23250K .......... .......... .......... .......... .......... 25% 409M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23300K .......... .......... .......... .......... .......... 25% 332M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23350K .......... .......... .......... .......... .......... 25% 302M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23400K .......... .......... .......... .......... .......... 25% 389M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23450K .......... .......... .......... .......... .......... 25% 413M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23500K .......... .......... .......... .......... .......... 25% 368M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23550K .......... .......... .......... .......... .......... 25% 162M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23600K .......... .......... .......... .......... .......... 25% 128M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23650K .......... .......... .......... .......... .......... 25% 243M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23700K .......... .......... .......... .......... .......... 25% 377M 0s 2024-09-14T11:39:34.226 INFO:teuthology.orchestra.run.smithi094.stderr: 23750K .......... .......... .......... .......... .......... 25% 308M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 23800K .......... .......... .......... .......... .......... 25% 403M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 23850K .......... .......... .......... .......... .......... 25% 167M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 23900K .......... .......... .......... .......... .......... 25% 415M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 23950K .......... .......... .......... .......... .......... 25% 242M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24000K .......... .......... .......... .......... .......... 25% 434M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24050K .......... .......... .......... .......... .......... 25% 377M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24100K .......... .......... .......... .......... .......... 25% 149M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24150K .......... .......... .......... .......... .......... 26% 332M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24200K .......... .......... .......... .......... .......... 26% 427M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24250K .......... .......... .......... .......... .......... 26% 286M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24300K .......... .......... .......... .......... .......... 26% 365M 0s 2024-09-14T11:39:34.227 INFO:teuthology.orchestra.run.smithi094.stderr: 24350K .......... .......... .......... .......... .......... 26% 439M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24400K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24450K .......... .......... .......... .......... .......... 26% 415M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24500K .......... .......... .......... .......... .......... 26% 363M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24550K .......... .......... .......... .......... .......... 26% 408M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24600K .......... .......... .......... .......... .......... 26% 349M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24650K .......... .......... .......... .......... .......... 26% 413M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24700K .......... .......... .......... .......... .......... 26% 313M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24750K .......... .......... .......... .......... .......... 26% 378M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24800K .......... .......... .......... .......... .......... 26% 413M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24850K .......... .......... .......... .......... .......... 26% 408M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24900K .......... .......... .......... .......... .......... 26% 381M 0s 2024-09-14T11:39:34.228 INFO:teuthology.orchestra.run.smithi094.stderr: 24950K .......... .......... .......... .......... .......... 26% 409M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25000K .......... .......... .......... .......... .......... 26% 420M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25050K .......... .......... .......... .......... .......... 27% 440M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25100K .......... .......... .......... .......... .......... 27% 356M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25150K .......... .......... .......... .......... .......... 27% 363M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25200K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25250K .......... .......... .......... .......... .......... 27% 340M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25300K .......... .......... .......... .......... .......... 27% 15.0M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25350K .......... .......... .......... .......... .......... 27% 155M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25400K .......... .......... .......... .......... .......... 27% 364M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25450K .......... .......... .......... .......... .......... 27% 322M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25500K .......... .......... .......... .......... .......... 27% 391M 0s 2024-09-14T11:39:34.229 INFO:teuthology.orchestra.run.smithi094.stderr: 25550K .......... .......... .......... .......... .......... 27% 346M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25600K .......... .......... .......... .......... .......... 27% 326M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25650K .......... .......... .......... .......... .......... 27% 299M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25700K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25750K .......... .......... .......... .......... .......... 27% 311M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25800K .......... .......... .......... .......... .......... 27% 259M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25850K .......... .......... .......... .......... .......... 27% 312M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25900K .......... .......... .......... .......... .......... 27% 402M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 25950K .......... .......... .......... .......... .......... 27% 363M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 26000K .......... .......... .......... .......... .......... 28% 383M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 26050K .......... .......... .......... .......... .......... 28% 334M 0s 2024-09-14T11:39:34.230 INFO:teuthology.orchestra.run.smithi094.stderr: 26100K .......... .......... .......... .......... .......... 28% 245M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26150K .......... .......... .......... .......... .......... 28% 369M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26200K .......... .......... .......... .......... .......... 28% 410M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26250K .......... .......... .......... .......... .......... 28% 388M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26300K .......... .......... .......... .......... .......... 28% 306M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26350K .......... .......... .......... .......... .......... 28% 390M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26400K .......... .......... .......... .......... .......... 28% 422M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26450K .......... .......... .......... .......... .......... 28% 411M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26500K .......... .......... .......... .......... .......... 28% 343M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26550K .......... .......... .......... .......... .......... 28% 400M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26600K .......... .......... .......... .......... .......... 28% 432M 0s 2024-09-14T11:39:34.231 INFO:teuthology.orchestra.run.smithi094.stderr: 26650K .......... .......... .......... .......... .......... 28% 394M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26700K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26750K .......... .......... .......... .......... .......... 28% 383M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26800K .......... .......... .......... .......... .......... 28% 413M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26850K .......... .......... .......... .......... .......... 28% 417M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26900K .......... .......... .......... .......... .......... 29% 371M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 26950K .......... .......... .......... .......... .......... 29% 410M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 27000K .......... .......... .......... .......... .......... 29% 316M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 27050K .......... .......... .......... .......... .......... 29% 389M 0s 2024-09-14T11:39:34.232 INFO:teuthology.orchestra.run.smithi094.stderr: 27100K .......... .......... .......... .......... .......... 29% 203M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27150K .......... .......... .......... .......... .......... 29% 285M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27200K .......... .......... .......... .......... .......... 29% 301M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27250K .......... .......... .......... .......... .......... 29% 380M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27300K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27350K .......... .......... .......... .......... .......... 29% 377M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27400K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27450K .......... .......... .......... .......... .......... 29% 381M 0s 2024-09-14T11:39:34.233 INFO:teuthology.orchestra.run.smithi094.stderr: 27500K .......... .......... .......... .......... .......... 29% 414M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27550K .......... .......... .......... .......... .......... 29% 377M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27600K .......... .......... .......... .......... .......... 29% 391M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27650K .......... .......... .......... .......... .......... 29% 356M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27700K .......... .......... .......... .......... .......... 29% 430M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27750K .......... .......... .......... .......... .......... 29% 396M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27800K .......... .......... .......... .......... .......... 29% 322M 0s 2024-09-14T11:39:34.234 INFO:teuthology.orchestra.run.smithi094.stderr: 27850K .......... .......... .......... .......... .......... 30% 347M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 27900K .......... .......... .......... .......... .......... 30% 414M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 27950K .......... .......... .......... .......... .......... 30% 411M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 28000K .......... .......... .......... .......... .......... 30% 416M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 28050K .......... .......... .......... .......... .......... 30% 332M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 28100K .......... .......... .......... .......... .......... 30% 424M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 28150K .......... .......... .......... .......... .......... 30% 384M 0s 2024-09-14T11:39:34.235 INFO:teuthology.orchestra.run.smithi094.stderr: 28200K .......... .......... .......... .......... .......... 30% 357M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28250K .......... .......... .......... .......... .......... 30% 14.5M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28300K .......... .......... .......... .......... .......... 30% 363M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28350K .......... .......... .......... .......... .......... 30% 288M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28400K .......... .......... .......... .......... .......... 30% 374M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28450K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28500K .......... .......... .......... .......... .......... 30% 412M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28550K .......... .......... .......... .......... .......... 30% 411M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28600K .......... .......... .......... .......... .......... 30% 429M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28650K .......... .......... .......... .......... .......... 30% 370M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28700K .......... .......... .......... .......... .......... 30% 408M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28750K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-14T11:39:34.236 INFO:teuthology.orchestra.run.smithi094.stderr: 28800K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 28850K .......... .......... .......... .......... .......... 31% 382M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 28900K .......... .......... .......... .......... .......... 31% 393M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 28950K .......... .......... .......... .......... .......... 31% 292M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29000K .......... .......... .......... .......... .......... 31% 291M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29050K .......... .......... .......... .......... .......... 31% 322M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29100K .......... .......... .......... .......... .......... 31% 343M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29150K .......... .......... .......... .......... .......... 31% 342M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29200K .......... .......... .......... .......... .......... 31% 290M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29250K .......... .......... .......... .......... .......... 31% 338M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29300K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29350K .......... .......... .......... .......... .......... 31% 346M 0s 2024-09-14T11:39:34.237 INFO:teuthology.orchestra.run.smithi094.stderr: 29400K .......... .......... .......... .......... .......... 31% 251M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29450K .......... .......... .......... .......... .......... 31% 461M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29500K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29550K .......... .......... .......... .......... .......... 31% 406M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29600K .......... .......... .......... .......... .......... 31% 366M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29650K .......... .......... .......... .......... .......... 31% 309M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29700K .......... .......... .......... .......... .......... 32% 362M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29750K .......... .......... .......... .......... .......... 32% 397M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29800K .......... .......... .......... .......... .......... 32% 388M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29850K .......... .......... .......... .......... .......... 32% 358M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29900K .......... .......... .......... .......... .......... 32% 404M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 29950K .......... .......... .......... .......... .......... 32% 400M 0s 2024-09-14T11:39:34.238 INFO:teuthology.orchestra.run.smithi094.stderr: 30000K .......... .......... .......... .......... .......... 32% 412M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30050K .......... .......... .......... .......... .......... 32% 297M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30100K .......... .......... .......... .......... .......... 32% 403M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30150K .......... .......... .......... .......... .......... 32% 408M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30200K .......... .......... .......... .......... .......... 32% 429M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30250K .......... .......... .......... .......... .......... 32% 327M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30300K .......... .......... .......... .......... .......... 32% 408M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30350K .......... .......... .......... .......... .......... 32% 227M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30400K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30450K .......... .......... .......... .......... .......... 32% 336M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30500K .......... .......... .......... .......... .......... 32% 427M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30550K .......... .......... .......... .......... .......... 32% 358M 0s 2024-09-14T11:39:34.239 INFO:teuthology.orchestra.run.smithi094.stderr: 30600K .......... .......... .......... .......... .......... 32% 161M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30650K .......... .......... .......... .......... .......... 33% 419M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30700K .......... .......... .......... .......... .......... 33% 390M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30750K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30800K .......... .......... .......... .......... .......... 33% 443M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30850K .......... .......... .......... .......... .......... 33% 433M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30900K .......... .......... .......... .......... .......... 33% 423M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 30950K .......... .......... .......... .......... .......... 33% 361M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 31000K .......... .......... .......... .......... .......... 33% 415M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 31050K .......... .......... .......... .......... .......... 33% 435M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 31100K .......... .......... .......... .......... .......... 33% 365M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 31150K .......... .......... .......... .......... .......... 33% 336M 0s 2024-09-14T11:39:34.240 INFO:teuthology.orchestra.run.smithi094.stderr: 31200K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31250K .......... .......... .......... .......... .......... 33% 14.4M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31300K .......... .......... .......... .......... .......... 33% 330M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31350K .......... .......... .......... .......... .......... 33% 276M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31400K .......... .......... .......... .......... .......... 33% 362M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31450K .......... .......... .......... .......... .......... 33% 386M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31500K .......... .......... .......... .......... .......... 33% 318M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31550K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31600K .......... .......... .......... .......... .......... 34% 426M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31650K .......... .......... .......... .......... .......... 34% 369M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31700K .......... .......... .......... .......... .......... 34% 297M 0s 2024-09-14T11:39:34.241 INFO:teuthology.orchestra.run.smithi094.stderr: 31750K .......... .......... .......... .......... .......... 34% 374M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 31800K .......... .......... .......... .......... .......... 34% 409M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 31850K .......... .......... .......... .......... .......... 34% 431M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 31900K .......... .......... .......... .......... .......... 34% 358M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 31950K .......... .......... .......... .......... .......... 34% 402M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32000K .......... .......... .......... .......... .......... 34% 389M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32050K .......... .......... .......... .......... .......... 34% 402M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32100K .......... .......... .......... .......... .......... 34% 323M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32150K .......... .......... .......... .......... .......... 34% 398M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32200K .......... .......... .......... .......... .......... 34% 347M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32250K .......... .......... .......... .......... .......... 34% 399M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32300K .......... .......... .......... .......... .......... 34% 358M 0s 2024-09-14T11:39:34.242 INFO:teuthology.orchestra.run.smithi094.stderr: 32350K .......... .......... .......... .......... .......... 34% 396M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32400K .......... .......... .......... .......... .......... 34% 193M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32450K .......... .......... .......... .......... .......... 34% 335M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32500K .......... .......... .......... .......... .......... 35% 215M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32550K .......... .......... .......... .......... .......... 35% 383M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32600K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32650K .......... .......... .......... .......... .......... 35% 371M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32700K .......... .......... .......... .......... .......... 35% 401M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32750K .......... .......... .......... .......... .......... 35% 322M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32800K .......... .......... .......... .......... .......... 35% 319M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32850K .......... .......... .......... .......... .......... 35% 383M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32900K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 32950K .......... .......... .......... .......... .......... 35% 353M 0s 2024-09-14T11:39:34.243 INFO:teuthology.orchestra.run.smithi094.stderr: 33000K .......... .......... .......... .......... .......... 35% 332M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33050K .......... .......... .......... .......... .......... 35% 392M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33100K .......... .......... .......... .......... .......... 35% 396M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33150K .......... .......... .......... .......... .......... 35% 392M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33200K .......... .......... .......... .......... .......... 35% 182M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33250K .......... .......... .......... .......... .......... 35% 233M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33300K .......... .......... .......... .......... .......... 35% 423M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33350K .......... .......... .......... .......... .......... 35% 329M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33400K .......... .......... .......... .......... .......... 36% 409M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33450K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33500K .......... .......... .......... .......... .......... 36% 356M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33550K .......... .......... .......... .......... .......... 36% 366M 0s 2024-09-14T11:39:34.244 INFO:teuthology.orchestra.run.smithi094.stderr: 33600K .......... .......... .......... .......... .......... 36% 342M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33650K .......... .......... .......... .......... .......... 36% 409M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33700K .......... .......... .......... .......... .......... 36% 374M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33750K .......... .......... .......... .......... .......... 36% 401M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33800K .......... .......... .......... .......... .......... 36% 335M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33850K .......... .......... .......... .......... .......... 36% 361M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33900K .......... .......... .......... .......... .......... 36% 400M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 33950K .......... .......... .......... .......... .......... 36% 406M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 34000K .......... .......... .......... .......... .......... 36% 240M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 34050K .......... .......... .......... .......... .......... 36% 383M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 34100K .......... .......... .......... .......... .......... 36% 333M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 34150K .......... .......... .......... .......... .......... 36% 292M 0s 2024-09-14T11:39:34.245 INFO:teuthology.orchestra.run.smithi094.stderr: 34200K .......... .......... .......... .......... .......... 36% 394M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34250K .......... .......... .......... .......... .......... 36% 336M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34300K .......... .......... .......... .......... .......... 36% 16.8M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34350K .......... .......... .......... .......... .......... 37% 252M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34400K .......... .......... .......... .......... .......... 37% 337M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34450K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34500K .......... .......... .......... .......... .......... 37% 181M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34550K .......... .......... .......... .......... .......... 37% 340M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34600K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34650K .......... .......... .......... .......... .......... 37% 159M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34700K .......... .......... .......... .......... .......... 37% 345M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34750K .......... .......... .......... .......... .......... 37% 386M 0s 2024-09-14T11:39:34.246 INFO:teuthology.orchestra.run.smithi094.stderr: 34800K .......... .......... .......... .......... .......... 37% 358M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 34850K .......... .......... .......... .......... .......... 37% 391M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 34900K .......... .......... .......... .......... .......... 37% 358M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 34950K .......... .......... .......... .......... .......... 37% 408M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35000K .......... .......... .......... .......... .......... 37% 439M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35050K .......... .......... .......... .......... .......... 37% 339M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35100K .......... .......... .......... .......... .......... 37% 382M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35150K .......... .......... .......... .......... .......... 37% 302M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35200K .......... .......... .......... .......... .......... 37% 397M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35250K .......... .......... .......... .......... .......... 37% 392M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35300K .......... .......... .......... .......... .......... 38% 347M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35350K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-14T11:39:34.247 INFO:teuthology.orchestra.run.smithi094.stderr: 35400K .......... .......... .......... .......... .......... 38% 337M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35450K .......... .......... .......... .......... .......... 38% 385M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35500K .......... .......... .......... .......... .......... 38% 451M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35550K .......... .......... .......... .......... .......... 38% 229M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35600K .......... .......... .......... .......... .......... 38% 401M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35650K .......... .......... .......... .......... .......... 38% 405M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35700K .......... .......... .......... .......... .......... 38% 339M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35750K .......... .......... .......... .......... .......... 38% 390M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35800K .......... .......... .......... .......... .......... 38% 350M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35850K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35900K .......... .......... .......... .......... .......... 38% 379M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 35950K .......... .......... .......... .......... .......... 38% 422M 0s 2024-09-14T11:39:34.248 INFO:teuthology.orchestra.run.smithi094.stderr: 36000K .......... .......... .......... .......... .......... 38% 433M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36050K .......... .......... .......... .......... .......... 38% 338M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36100K .......... .......... .......... .......... .......... 38% 441M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36150K .......... .......... .......... .......... .......... 38% 403M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36200K .......... .......... .......... .......... .......... 39% 118M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36250K .......... .......... .......... .......... .......... 39% 362M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36300K .......... .......... .......... .......... .......... 39% 417M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36350K .......... .......... .......... .......... .......... 39% 436M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36400K .......... .......... .......... .......... .......... 39% 418M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36450K .......... .......... .......... .......... .......... 39% 196M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36500K .......... .......... .......... .......... .......... 39% 310M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36550K .......... .......... .......... .......... .......... 39% 380M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36600K .......... .......... .......... .......... .......... 39% 402M 0s 2024-09-14T11:39:34.249 INFO:teuthology.orchestra.run.smithi094.stderr: 36650K .......... .......... .......... .......... .......... 39% 367M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36700K .......... .......... .......... .......... .......... 39% 317M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36750K .......... .......... .......... .......... .......... 39% 394M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36800K .......... .......... .......... .......... .......... 39% 328M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36850K .......... .......... .......... .......... .......... 39% 401M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36900K .......... .......... .......... .......... .......... 39% 356M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 36950K .......... .......... .......... .......... .......... 39% 406M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37000K .......... .......... .......... .......... .......... 39% 430M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37050K .......... .......... .......... .......... .......... 39% 428M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37100K .......... .......... .......... .......... .......... 39% 369M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37150K .......... .......... .......... .......... .......... 40% 54.6M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37200K .......... .......... .......... .......... .......... 40% 389M 0s 2024-09-14T11:39:34.250 INFO:teuthology.orchestra.run.smithi094.stderr: 37250K .......... .......... .......... .......... .......... 40% 346M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37300K .......... .......... .......... .......... .......... 40% 369M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37350K .......... .......... .......... .......... .......... 40% 370M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37400K .......... .......... .......... .......... .......... 40% 27.6M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37450K .......... .......... .......... .......... .......... 40% 84.4M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37500K .......... .......... .......... .......... .......... 40% 363M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37550K .......... .......... .......... .......... .......... 40% 407M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37600K .......... .......... .......... .......... .......... 40% 137M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37650K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37700K .......... .......... .......... .......... .......... 40% 288M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37750K .......... .......... .......... .......... .......... 40% 236M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37800K .......... .......... .......... .......... .......... 40% 198M 0s 2024-09-14T11:39:34.251 INFO:teuthology.orchestra.run.smithi094.stderr: 37850K .......... .......... .......... .......... .......... 40% 343M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 37900K .......... .......... .......... .......... .......... 40% 398M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 37950K .......... .......... .......... .......... .......... 40% 374M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38000K .......... .......... .......... .......... .......... 40% 402M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38050K .......... .......... .......... .......... .......... 41% 112M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38100K .......... .......... .......... .......... .......... 41% 193M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38150K .......... .......... .......... .......... .......... 41% 364M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38200K .......... .......... .......... .......... .......... 41% 397M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38250K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38300K .......... .......... .......... .......... .......... 41% 434M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38350K .......... .......... .......... .......... .......... 41% 379M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38400K .......... .......... .......... .......... .......... 41% 401M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38450K .......... .......... .......... .......... .......... 41% 427M 0s 2024-09-14T11:39:34.252 INFO:teuthology.orchestra.run.smithi094.stderr: 38500K .......... .......... .......... .......... .......... 41% 428M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38550K .......... .......... .......... .......... .......... 41% 358M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38600K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38650K .......... .......... .......... .......... .......... 41% 421M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38700K .......... .......... .......... .......... .......... 41% 443M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38750K .......... .......... .......... .......... .......... 41% 353M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38800K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-14T11:39:34.253 INFO:teuthology.orchestra.run.smithi094.stderr: 38850K .......... .......... .......... .......... .......... 41% 381M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 38900K .......... .......... .......... .......... .......... 41% 349M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 38950K .......... .......... .......... .......... .......... 41% 298M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39000K .......... .......... .......... .......... .......... 42% 393M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39050K .......... .......... .......... .......... .......... 42% 433M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39100K .......... .......... .......... .......... .......... 42% 452M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39150K .......... .......... .......... .......... .......... 42% 350M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39200K .......... .......... .......... .......... .......... 42% 402M 0s 2024-09-14T11:39:34.254 INFO:teuthology.orchestra.run.smithi094.stderr: 39250K .......... .......... .......... .......... .......... 42% 459M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39300K .......... .......... .......... .......... .......... 42% 436M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39350K .......... .......... .......... .......... .......... 42% 426M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39400K .......... .......... .......... .......... .......... 42% 374M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39450K .......... .......... .......... .......... .......... 42% 222M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39500K .......... .......... .......... .......... .......... 42% 400M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39550K .......... .......... .......... .......... .......... 42% 396M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39600K .......... .......... .......... .......... .......... 42% 251M 0s 2024-09-14T11:39:34.255 INFO:teuthology.orchestra.run.smithi094.stderr: 39650K .......... .......... .......... .......... .......... 42% 332M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39700K .......... .......... .......... .......... .......... 42% 386M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39750K .......... .......... .......... .......... .......... 42% 436M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39800K .......... .......... .......... .......... .......... 42% 416M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39850K .......... .......... .......... .......... .......... 42% 436M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39900K .......... .......... .......... .......... .......... 43% 394M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 39950K .......... .......... .......... .......... .......... 43% 414M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 40000K .......... .......... .......... .......... .......... 43% 434M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 40050K .......... .......... .......... .......... .......... 43% 426M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 40100K .......... .......... .......... .......... .......... 43% 356M 0s 2024-09-14T11:39:34.256 INFO:teuthology.orchestra.run.smithi094.stderr: 40150K .......... .......... .......... .......... .......... 43% 45.4M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40200K .......... .......... .......... .......... .......... 43% 410M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40250K .......... .......... .......... .......... .......... 43% 458M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40300K .......... .......... .......... .......... .......... 43% 424M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40350K .......... .......... .......... .......... .......... 43% 360M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40400K .......... .......... .......... .......... .......... 43% 439M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40450K .......... .......... .......... .......... .......... 43% 32.2M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40500K .......... .......... .......... .......... .......... 43% 75.9M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40550K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40600K .......... .......... .......... .......... .......... 43% 373M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40650K .......... .......... .......... .......... .......... 43% 222M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40700K .......... .......... .......... .......... .......... 43% 106M 0s 2024-09-14T11:39:34.257 INFO:teuthology.orchestra.run.smithi094.stderr: 40750K .......... .......... .......... .......... .......... 43% 280M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 40800K .......... .......... .......... .......... .......... 43% 440M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 40850K .......... .......... .......... .......... .......... 44% 85.1M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 40900K .......... .......... .......... .......... .......... 44% 424M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 40950K .......... .......... .......... .......... .......... 44% 433M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41000K .......... .......... .......... .......... .......... 44% 374M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41050K .......... .......... .......... .......... .......... 44% 438M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41100K .......... .......... .......... .......... .......... 44% 441M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41150K .......... .......... .......... .......... .......... 44% 358M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41200K .......... .......... .......... .......... .......... 44% 137M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41250K .......... .......... .......... .......... .......... 44% 308M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41300K .......... .......... .......... .......... .......... 44% 359M 0s 2024-09-14T11:39:34.258 INFO:teuthology.orchestra.run.smithi094.stderr: 41350K .......... .......... .......... .......... .......... 44% 387M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41400K .......... .......... .......... .......... .......... 44% 390M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41450K .......... .......... .......... .......... .......... 44% 434M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41500K .......... .......... .......... .......... .......... 44% 381M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41550K .......... .......... .......... .......... .......... 44% 415M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41600K .......... .......... .......... .......... .......... 44% 437M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41650K .......... .......... .......... .......... .......... 44% 346M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41700K .......... .......... .......... .......... .......... 44% 408M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41750K .......... .......... .......... .......... .......... 44% 442M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41800K .......... .......... .......... .......... .......... 45% 439M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41850K .......... .......... .......... .......... .......... 45% 360M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41900K .......... .......... .......... .......... .......... 45% 438M 0s 2024-09-14T11:39:34.259 INFO:teuthology.orchestra.run.smithi094.stderr: 41950K .......... .......... .......... .......... .......... 45% 359M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42000K .......... .......... .......... .......... .......... 45% 430M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42050K .......... .......... .......... .......... .......... 45% 441M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42100K .......... .......... .......... .......... .......... 45% 387M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42150K .......... .......... .......... .......... .......... 45% 291M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42200K .......... .......... .......... .......... .......... 45% 438M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42250K .......... .......... .......... .......... .......... 45% 436M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42300K .......... .......... .......... .......... .......... 45% 425M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42350K .......... .......... .......... .......... .......... 45% 356M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42400K .......... .......... .......... .......... .......... 45% 434M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42450K .......... .......... .......... .......... .......... 45% 318M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42500K .......... .......... .......... .......... .......... 45% 384M 0s 2024-09-14T11:39:34.260 INFO:teuthology.orchestra.run.smithi094.stderr: 42550K .......... .......... .......... .......... .......... 45% 379M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42600K .......... .......... .......... .......... .......... 45% 425M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42650K .......... .......... .......... .......... .......... 45% 269M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42700K .......... .......... .......... .......... .......... 46% 428M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42750K .......... .......... .......... .......... .......... 46% 359M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42800K .......... .......... .......... .......... .......... 46% 420M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42850K .......... .......... .......... .......... .......... 46% 412M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42900K .......... .......... .......... .......... .......... 46% 402M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 42950K .......... .......... .......... .......... .......... 46% 390M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 43000K .......... .......... .......... .......... .......... 46% 435M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 43050K .......... .......... .......... .......... .......... 46% 420M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 43100K .......... .......... .......... .......... .......... 46% 430M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 43150K .......... .......... .......... .......... .......... 46% 345M 0s 2024-09-14T11:39:34.261 INFO:teuthology.orchestra.run.smithi094.stderr: 43200K .......... .......... .......... .......... .......... 46% 46.4M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43250K .......... .......... .......... .......... .......... 46% 334M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43300K .......... .......... .......... .......... .......... 46% 423M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43350K .......... .......... .......... .......... .......... 46% 372M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43400K .......... .......... .......... .......... .......... 46% 400M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43450K .......... .......... .......... .......... .......... 46% 46.0M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43500K .......... .......... .......... .......... .......... 46% 92.7M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43550K .......... .......... .......... .......... .......... 46% 88.0M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43600K .......... .......... .......... .......... .......... 46% 263M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43650K .......... .......... .......... .......... .......... 47% 342M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43700K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43750K .......... .......... .......... .......... .......... 47% 75.7M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43800K .......... .......... .......... .......... .......... 47% 376M 0s 2024-09-14T11:39:34.262 INFO:teuthology.orchestra.run.smithi094.stderr: 43850K .......... .......... .......... .......... .......... 47% 85.2M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 43900K .......... .......... .......... .......... .......... 47% 389M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 43950K .......... .......... .......... .......... .......... 47% 331M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44000K .......... .......... .......... .......... .......... 47% 165M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44050K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44100K .......... .......... .......... .......... .......... 47% 367M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44150K .......... .......... .......... .......... .......... 47% 318M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44200K .......... .......... .......... .......... .......... 47% 360M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44250K .......... .......... .......... .......... .......... 47% 397M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44300K .......... .......... .......... .......... .......... 47% 400M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44350K .......... .......... .......... .......... .......... 47% 222M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44400K .......... .......... .......... .......... .......... 47% 379M 0s 2024-09-14T11:39:34.263 INFO:teuthology.orchestra.run.smithi094.stderr: 44450K .......... .......... .......... .......... .......... 47% 366M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44500K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44550K .......... .......... .......... .......... .......... 48% 405M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44600K .......... .......... .......... .......... .......... 48% 396M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44650K .......... .......... .......... .......... .......... 48% 404M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44700K .......... .......... .......... .......... .......... 48% 388M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44750K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44800K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44850K .......... .......... .......... .......... .......... 48% 347M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44900K .......... .......... .......... .......... .......... 48% 433M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 44950K .......... .......... .......... .......... .......... 48% 372M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 45000K .......... .......... .......... .......... .......... 48% 366M 0s 2024-09-14T11:39:34.264 INFO:teuthology.orchestra.run.smithi094.stderr: 45050K .......... .......... .......... .......... .......... 48% 399M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45100K .......... .......... .......... .......... .......... 48% 448M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45150K .......... .......... .......... .......... .......... 48% 468M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45200K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45250K .......... .......... .......... .......... .......... 48% 415M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45300K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45350K .......... .......... .......... .......... .......... 48% 381M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45400K .......... .......... .......... .......... .......... 48% 346M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45450K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45500K .......... .......... .......... .......... .......... 49% 117M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45550K .......... .......... .......... .......... .......... 49% 370M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45600K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45650K .......... .......... .......... .......... .......... 49% 396M 0s 2024-09-14T11:39:34.265 INFO:teuthology.orchestra.run.smithi094.stderr: 45700K .......... .......... .......... .......... .......... 49% 356M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 45750K .......... .......... .......... .......... .......... 49% 394M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 45800K .......... .......... .......... .......... .......... 49% 296M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 45850K .......... .......... .......... .......... .......... 49% 396M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 45900K .......... .......... .......... .......... .......... 49% 344M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 45950K .......... .......... .......... .......... .......... 49% 405M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46000K .......... .......... .......... .......... .......... 49% 404M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46050K .......... .......... .......... .......... .......... 49% 399M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46100K .......... .......... .......... .......... .......... 49% 307M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46150K .......... .......... .......... .......... .......... 49% 391M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46200K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46250K .......... .......... .......... .......... .......... 49% 170M 0s 2024-09-14T11:39:34.266 INFO:teuthology.orchestra.run.smithi094.stderr: 46300K .......... .......... .......... .......... .......... 49% 187M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46350K .......... .......... .......... .......... .......... 49% 389M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46400K .......... .......... .......... .......... .......... 49% 148M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46450K .......... .......... .......... .......... .......... 50% 374M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46500K .......... .......... .......... .......... .......... 50% 66.9M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46550K .......... .......... .......... .......... .......... 50% 63.7M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46600K .......... .......... .......... .......... .......... 50% 366M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46650K .......... .......... .......... .......... .......... 50% 77.9M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46700K .......... .......... .......... .......... .......... 50% 393M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46750K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46800K .......... .......... .......... .......... .......... 50% 87.4M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46850K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46900K .......... .......... .......... .......... .......... 50% 103M 0s 2024-09-14T11:39:34.267 INFO:teuthology.orchestra.run.smithi094.stderr: 46950K .......... .......... .......... .......... .......... 50% 327M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47000K .......... .......... .......... .......... .......... 50% 325M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47050K .......... .......... .......... .......... .......... 50% 169M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47100K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47150K .......... .......... .......... .......... .......... 50% 230M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47200K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47250K .......... .......... .......... .......... .......... 50% 307M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47300K .......... .......... .......... .......... .......... 50% 400M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47350K .......... .......... .......... .......... .......... 51% 328M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47400K .......... .......... .......... .......... .......... 51% 306M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47450K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47500K .......... .......... .......... .......... .......... 51% 61.5M 0s 2024-09-14T11:39:34.268 INFO:teuthology.orchestra.run.smithi094.stderr: 47550K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47600K .......... .......... .......... .......... .......... 51% 323M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47650K .......... .......... .......... .......... .......... 51% 380M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47700K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47750K .......... .......... .......... .......... .......... 51% 365M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47800K .......... .......... .......... .......... .......... 51% 302M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47850K .......... .......... .......... .......... .......... 51% 374M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47900K .......... .......... .......... .......... .......... 51% 378M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 47950K .......... .......... .......... .......... .......... 51% 375M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 48000K .......... .......... .......... .......... .......... 51% 333M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 48050K .......... .......... .......... .......... .......... 51% 337M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 48100K .......... .......... .......... .......... .......... 51% 391M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 48150K .......... .......... .......... .......... .......... 51% 394M 0s 2024-09-14T11:39:34.269 INFO:teuthology.orchestra.run.smithi094.stderr: 48200K .......... .......... .......... .......... .......... 51% 330M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48250K .......... .......... .......... .......... .......... 51% 370M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48300K .......... .......... .......... .......... .......... 52% 383M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48350K .......... .......... .......... .......... .......... 52% 396M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48400K .......... .......... .......... .......... .......... 52% 397M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48450K .......... .......... .......... .......... .......... 52% 321M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48500K .......... .......... .......... .......... .......... 52% 407M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48550K .......... .......... .......... .......... .......... 52% 380M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48600K .......... .......... .......... .......... .......... 52% 360M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48650K .......... .......... .......... .......... .......... 52% 358M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48700K .......... .......... .......... .......... .......... 52% 372M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48750K .......... .......... .......... .......... .......... 52% 304M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48800K .......... .......... .......... .......... .......... 52% 338M 0s 2024-09-14T11:39:34.270 INFO:teuthology.orchestra.run.smithi094.stderr: 48850K .......... .......... .......... .......... .......... 52% 384M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 48900K .......... .......... .......... .......... .......... 52% 387M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 48950K .......... .......... .......... .......... .......... 52% 338M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49000K .......... .......... .......... .......... .......... 52% 399M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49050K .......... .......... .......... .......... .......... 52% 351M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49100K .......... .......... .......... .......... .......... 52% 360M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49150K .......... .......... .......... .......... .......... 52% 297M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49200K .......... .......... .......... .......... .......... 53% 389M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49250K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49300K .......... .......... .......... .......... .......... 53% 400M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49350K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49400K .......... .......... .......... .......... .......... 53% 367M 0s 2024-09-14T11:39:34.271 INFO:teuthology.orchestra.run.smithi094.stderr: 49450K .......... .......... .......... .......... .......... 53% 399M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49500K .......... .......... .......... .......... .......... 53% 394M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49550K .......... .......... .......... .......... .......... 53% 108M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49600K .......... .......... .......... .......... .......... 53% 79.7M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49650K .......... .......... .......... .......... .......... 53% 377M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49700K .......... .......... .......... .......... .......... 53% 42.7M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49750K .......... .......... .......... .......... .......... 53% 304M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49800K .......... .......... .......... .......... .......... 53% 393M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49850K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49900K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 49950K .......... .......... .......... .......... .......... 53% 111M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 50000K .......... .......... .......... .......... .......... 53% 160M 0s 2024-09-14T11:39:34.272 INFO:teuthology.orchestra.run.smithi094.stderr: 50050K .......... .......... .......... .......... .......... 53% 349M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50100K .......... .......... .......... .......... .......... 53% 410M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50150K .......... .......... .......... .......... .......... 54% 310M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50200K .......... .......... .......... .......... .......... 54% 185M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50250K .......... .......... .......... .......... .......... 54% 177M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50300K .......... .......... .......... .......... .......... 54% 388M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50350K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50400K .......... .......... .......... .......... .......... 54% 155M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50450K .......... .......... .......... .......... .......... 54% 360M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50500K .......... .......... .......... .......... .......... 54% 392M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50550K .......... .......... .......... .......... .......... 54% 82.3M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50600K .......... .......... .......... .......... .......... 54% 393M 0s 2024-09-14T11:39:34.273 INFO:teuthology.orchestra.run.smithi094.stderr: 50650K .......... .......... .......... .......... .......... 54% 112M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50700K .......... .......... .......... .......... .......... 54% 144M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50750K .......... .......... .......... .......... .......... 54% 231M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50800K .......... .......... .......... .......... .......... 54% 383M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50850K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50900K .......... .......... .......... .......... .......... 54% 381M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 50950K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51000K .......... .......... .......... .......... .......... 54% 348M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51050K .......... .......... .......... .......... .......... 55% 364M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51100K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51150K .......... .......... .......... .......... .......... 55% 381M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51200K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51250K .......... .......... .......... .......... .......... 55% 403M 0s 2024-09-14T11:39:34.274 INFO:teuthology.orchestra.run.smithi094.stderr: 51300K .......... .......... .......... .......... .......... 55% 356M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51350K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51400K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51450K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51500K .......... .......... .......... .......... .......... 55% 317M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51550K .......... .......... .......... .......... .......... 55% 394M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51600K .......... .......... .......... .......... .......... 55% 376M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51650K .......... .......... .......... .......... .......... 55% 351M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51700K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51750K .......... .......... .......... .......... .......... 55% 363M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51800K .......... .......... .......... .......... .......... 55% 399M 0s 2024-09-14T11:39:34.275 INFO:teuthology.orchestra.run.smithi094.stderr: 51850K .......... .......... .......... .......... .......... 55% 363M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 51900K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 51950K .......... .......... .......... .......... .......... 55% 348M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52000K .......... .......... .......... .......... .......... 56% 384M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52050K .......... .......... .......... .......... .......... 56% 334M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52100K .......... .......... .......... .......... .......... 56% 405M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52150K .......... .......... .......... .......... .......... 56% 283M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52200K .......... .......... .......... .......... .......... 56% 336M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52250K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52300K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52350K .......... .......... .......... .......... .......... 56% 397M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52400K .......... .......... .......... .......... .......... 56% 388M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52450K .......... .......... .......... .......... .......... 56% 402M 0s 2024-09-14T11:39:34.276 INFO:teuthology.orchestra.run.smithi094.stderr: 52500K .......... .......... .......... .......... .......... 56% 356M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52550K .......... .......... .......... .......... .......... 56% 380M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52600K .......... .......... .......... .......... .......... 56% 362M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52650K .......... .......... .......... .......... .......... 56% 395M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52700K .......... .......... .......... .......... .......... 56% 109M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52750K .......... .......... .......... .......... .......... 56% 40.8M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52800K .......... .......... .......... .......... .......... 56% 206M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52850K .......... .......... .......... .......... .......... 56% 376M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52900K .......... .......... .......... .......... .......... 56% 338M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 52950K .......... .......... .......... .......... .......... 57% 379M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 53000K .......... .......... .......... .......... .......... 57% 136M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 53050K .......... .......... .......... .......... .......... 57% 201M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 53100K .......... .......... .......... .......... .......... 57% 236M 0s 2024-09-14T11:39:34.277 INFO:teuthology.orchestra.run.smithi094.stderr: 53150K .......... .......... .......... .......... .......... 57% 346M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53200K .......... .......... .......... .......... .......... 57% 194M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53250K .......... .......... .......... .......... .......... 57% 180M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53300K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53350K .......... .......... .......... .......... .......... 57% 335M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53400K .......... .......... .......... .......... .......... 57% 284M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53450K .......... .......... .......... .......... .......... 57% 236M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53500K .......... .......... .......... .......... .......... 57% 165M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53550K .......... .......... .......... .......... .......... 57% 94.1M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53600K .......... .......... .......... .......... .......... 57% 268M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53650K .......... .......... .......... .......... .......... 57% 399M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53700K .......... .......... .......... .......... .......... 57% 209M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53750K .......... .......... .......... .......... .......... 57% 87.7M 0s 2024-09-14T11:39:34.278 INFO:teuthology.orchestra.run.smithi094.stderr: 53800K .......... .......... .......... .......... .......... 57% 120M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 53850K .......... .......... .......... .......... .......... 58% 378M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 53900K .......... .......... .......... .......... .......... 58% 319M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 53950K .......... .......... .......... .......... .......... 58% 300M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54000K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54050K .......... .......... .......... .......... .......... 58% 390M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54100K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54150K .......... .......... .......... .......... .......... 58% 369M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54200K .......... .......... .......... .......... .......... 58% 307M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54250K .......... .......... .......... .......... .......... 58% 397M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54300K .......... .......... .......... .......... .......... 58% 379M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54350K .......... .......... .......... .......... .......... 58% 383M 0s 2024-09-14T11:39:34.279 INFO:teuthology.orchestra.run.smithi094.stderr: 54400K .......... .......... .......... .......... .......... 58% 348M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54450K .......... .......... .......... .......... .......... 58% 398M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54500K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54550K .......... .......... .......... .......... .......... 58% 365M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54600K .......... .......... .......... .......... .......... 58% 323M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54650K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54700K .......... .......... .......... .......... .......... 58% 343M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54750K .......... .......... .......... .......... .......... 58% 406M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54800K .......... .......... .......... .......... .......... 59% 404M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54850K .......... .......... .......... .......... .......... 59% 343M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54900K .......... .......... .......... .......... .......... 59% 387M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 54950K .......... .......... .......... .......... .......... 59% 384M 0s 2024-09-14T11:39:34.280 INFO:teuthology.orchestra.run.smithi094.stderr: 55000K .......... .......... .......... .......... .......... 59% 401M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55050K .......... .......... .......... .......... .......... 59% 352M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55100K .......... .......... .......... .......... .......... 59% 319M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55150K .......... .......... .......... .......... .......... 59% 392M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55200K .......... .......... .......... .......... .......... 59% 345M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55250K .......... .......... .......... .......... .......... 59% 400M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55300K .......... .......... .......... .......... .......... 59% 374M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55350K .......... .......... .......... .......... .......... 59% 341M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55400K .......... .......... .......... .......... .......... 59% 384M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55450K .......... .......... .......... .......... .......... 59% 364M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55500K .......... .......... .......... .......... .......... 59% 384M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55550K .......... .......... .......... .......... .......... 59% 398M 0s 2024-09-14T11:39:34.281 INFO:teuthology.orchestra.run.smithi094.stderr: 55600K .......... .......... .......... .......... .......... 59% 395M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55650K .......... .......... .......... .......... .......... 59% 335M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55700K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55750K .......... .......... .......... .......... .......... 60% 394M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55800K .......... .......... .......... .......... .......... 60% 41.5M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55850K .......... .......... .......... .......... .......... 60% 158M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55900K .......... .......... .......... .......... .......... 60% 299M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 55950K .......... .......... .......... .......... .......... 60% 352M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 56000K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 56050K .......... .......... .......... .......... .......... 60% 186M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 56100K .......... .......... .......... .......... .......... 60% 273M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 56150K .......... .......... .......... .......... .......... 60% 237M 0s 2024-09-14T11:39:34.282 INFO:teuthology.orchestra.run.smithi094.stderr: 56200K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56250K .......... .......... .......... .......... .......... 60% 161M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56300K .......... .......... .......... .......... .......... 60% 189M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56350K .......... .......... .......... .......... .......... 60% 201M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56400K .......... .......... .......... .......... .......... 60% 243M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56450K .......... .......... .......... .......... .......... 60% 354M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56500K .......... .......... .......... .......... .......... 60% 396M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56550K .......... .......... .......... .......... .......... 60% 90.8M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56600K .......... .......... .......... .......... .......... 60% 104M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56650K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56700K .......... .......... .......... .......... .......... 61% 263M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56750K .......... .......... .......... .......... .......... 61% 367M 0s 2024-09-14T11:39:34.283 INFO:teuthology.orchestra.run.smithi094.stderr: 56800K .......... .......... .......... .......... .......... 61% 113M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 56850K .......... .......... .......... .......... .......... 61% 93.3M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 56900K .......... .......... .......... .......... .......... 61% 347M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 56950K .......... .......... .......... .......... .......... 61% 380M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57000K .......... .......... .......... .......... .......... 61% 188M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57050K .......... .......... .......... .......... .......... 61% 395M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57100K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57150K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57200K .......... .......... .......... .......... .......... 61% 401M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57250K .......... .......... .......... .......... .......... 61% 454M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57300K .......... .......... .......... .......... .......... 61% 429M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57350K .......... .......... .......... .......... .......... 61% 329M 0s 2024-09-14T11:39:34.284 INFO:teuthology.orchestra.run.smithi094.stderr: 57400K .......... .......... .......... .......... .......... 61% 390M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57450K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57500K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57550K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57600K .......... .......... .......... .......... .......... 62% 401M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57650K .......... .......... .......... .......... .......... 62% 393M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57700K .......... .......... .......... .......... .......... 62% 265M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57750K .......... .......... .......... .......... .......... 62% 355M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57800K .......... .......... .......... .......... .......... 62% 436M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57850K .......... .......... .......... .......... .......... 62% 394M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57900K .......... .......... .......... .......... .......... 62% 391M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 57950K .......... .......... .......... .......... .......... 62% 192M 0s 2024-09-14T11:39:34.285 INFO:teuthology.orchestra.run.smithi094.stderr: 58000K .......... .......... .......... .......... .......... 62% 423M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58050K .......... .......... .......... .......... .......... 62% 379M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58100K .......... .......... .......... .......... .......... 62% 259M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58150K .......... .......... .......... .......... .......... 62% 339M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58200K .......... .......... .......... .......... .......... 62% 439M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58250K .......... .......... .......... .......... .......... 62% 380M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58300K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58350K .......... .......... .......... .......... .......... 62% 428M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58400K .......... .......... .......... .......... .......... 62% 397M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58450K .......... .......... .......... .......... .......... 62% 425M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58500K .......... .......... .......... .......... .......... 63% 361M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58550K .......... .......... .......... .......... .......... 63% 439M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58600K .......... .......... .......... .......... .......... 63% 429M 0s 2024-09-14T11:39:34.286 INFO:teuthology.orchestra.run.smithi094.stderr: 58650K .......... .......... .......... .......... .......... 63% 410M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58700K .......... .......... .......... .......... .......... 63% 438M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58750K .......... .......... .......... .......... .......... 63% 380M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58800K .......... .......... .......... .......... .......... 63% 404M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58850K .......... .......... .......... .......... .......... 63% 49.5M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58900K .......... .......... .......... .......... .......... 63% 178M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 58950K .......... .......... .......... .......... .......... 63% 446M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59000K .......... .......... .......... .......... .......... 63% 135M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59050K .......... .......... .......... .......... .......... 63% 411M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59100K .......... .......... .......... .......... .......... 63% 390M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59150K .......... .......... .......... .......... .......... 63% 143M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59200K .......... .......... .......... .......... .......... 63% 387M 0s 2024-09-14T11:39:34.287 INFO:teuthology.orchestra.run.smithi094.stderr: 59250K .......... .......... .......... .......... .......... 63% 360M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59300K .......... .......... .......... .......... .......... 63% 161M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59350K .......... .......... .......... .......... .......... 63% 154M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59400K .......... .......... .......... .......... .......... 63% 427M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59450K .......... .......... .......... .......... .......... 64% 407M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59500K .......... .......... .......... .......... .......... 64% 170M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59550K .......... .......... .......... .......... .......... 64% 159M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59600K .......... .......... .......... .......... .......... 64% 104M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59650K .......... .......... .......... .......... .......... 64% 112M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59700K .......... .......... .......... .......... .......... 64% 424M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59750K .......... .......... .......... .......... .......... 64% 142M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59800K .......... .......... .......... .......... .......... 64% 430M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59850K .......... .......... .......... .......... .......... 64% 287M 0s 2024-09-14T11:39:34.288 INFO:teuthology.orchestra.run.smithi094.stderr: 59900K .......... .......... .......... .......... .......... 64% 446M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 59950K .......... .......... .......... .......... .......... 64% 57.3M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60000K .......... .......... .......... .......... .......... 64% 414M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60050K .......... .......... .......... .......... .......... 64% 252M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60100K .......... .......... .......... .......... .......... 64% 228M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60150K .......... .......... .......... .......... .......... 64% 369M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60200K .......... .......... .......... .......... .......... 64% 406M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60250K .......... .......... .......... .......... .......... 64% 419M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60300K .......... .......... .......... .......... .......... 64% 422M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60350K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60400K .......... .......... .......... .......... .......... 65% 400M 0s 2024-09-14T11:39:34.289 INFO:teuthology.orchestra.run.smithi094.stderr: 60450K .......... .......... .......... .......... .......... 65% 368M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60500K .......... .......... .......... .......... .......... 65% 190M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60550K .......... .......... .......... .......... .......... 65% 403M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60600K .......... .......... .......... .......... .......... 65% 385M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60650K .......... .......... .......... .......... .......... 65% 346M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60700K .......... .......... .......... .......... .......... 65% 442M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60750K .......... .......... .......... .......... .......... 65% 439M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60800K .......... .......... .......... .......... .......... 65% 383M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60850K .......... .......... .......... .......... .......... 65% 399M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60900K .......... .......... .......... .......... .......... 65% 453M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 60950K .......... .......... .......... .......... .......... 65% 380M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 61000K .......... .......... .......... .......... .......... 65% 265M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 61050K .......... .......... .......... .......... .......... 65% 391M 0s 2024-09-14T11:39:34.290 INFO:teuthology.orchestra.run.smithi094.stderr: 61100K .......... .......... .......... .......... .......... 65% 361M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61150K .......... .......... .......... .......... .......... 65% 433M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61200K .......... .......... .......... .......... .......... 65% 386M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61250K .......... .......... .......... .......... .......... 65% 419M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61300K .......... .......... .......... .......... .......... 66% 338M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61350K .......... .......... .......... .......... .......... 66% 430M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61400K .......... .......... .......... .......... .......... 66% 439M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61450K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61500K .......... .......... .......... .......... .......... 66% 407M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61550K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61600K .......... .......... .......... .......... .......... 66% 403M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61650K .......... .......... .......... .......... .......... 66% 430M 0s 2024-09-14T11:39:34.291 INFO:teuthology.orchestra.run.smithi094.stderr: 61700K .......... .......... .......... .......... .......... 66% 449M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 61750K .......... .......... .......... .......... .......... 66% 394M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 61800K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 61850K .......... .......... .......... .......... .......... 66% 63.5M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 61900K .......... .......... .......... .......... .......... 66% 245M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 61950K .......... .......... .......... .......... .......... 66% 271M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62000K .......... .......... .......... .......... .......... 66% 151M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62050K .......... .......... .......... .......... .......... 66% 421M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62100K .......... .......... .......... .......... .......... 66% 235M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62150K .......... .......... .......... .......... .......... 66% 394M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62200K .......... .......... .......... .......... .......... 67% 157M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62250K .......... .......... .......... .......... .......... 67% 329M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62300K .......... .......... .......... .......... .......... 67% 439M 0s 2024-09-14T11:39:34.292 INFO:teuthology.orchestra.run.smithi094.stderr: 62350K .......... .......... .......... .......... .......... 67% 196M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62400K .......... .......... .......... .......... .......... 67% 150M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62450K .......... .......... .......... .......... .......... 67% 452M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62500K .......... .......... .......... .......... .......... 67% 188M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62550K .......... .......... .......... .......... .......... 67% 299M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62600K .......... .......... .......... .......... .......... 67% 188M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62650K .......... .......... .......... .......... .......... 67% 96.3M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62700K .......... .......... .......... .......... .......... 67% 139M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62750K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62800K .......... .......... .......... .......... .......... 67% 124M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62850K .......... .......... .......... .......... .......... 67% 232M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62900K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-14T11:39:34.293 INFO:teuthology.orchestra.run.smithi094.stderr: 62950K .......... .......... .......... .......... .......... 67% 433M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63000K .......... .......... .......... .......... .......... 67% 59.4M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63050K .......... .......... .......... .......... .......... 67% 382M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63100K .......... .......... .......... .......... .......... 67% 357M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63150K .......... .......... .......... .......... .......... 68% 153M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63200K .......... .......... .......... .......... .......... 68% 434M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63250K .......... .......... .......... .......... .......... 68% 408M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63300K .......... .......... .......... .......... .......... 68% 338M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63350K .......... .......... .......... .......... .......... 68% 118M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63400K .......... .......... .......... .......... .......... 68% 443M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63450K .......... .......... .......... .......... .......... 68% 425M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63500K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-14T11:39:34.294 INFO:teuthology.orchestra.run.smithi094.stderr: 63550K .......... .......... .......... .......... .......... 68% 401M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63600K .......... .......... .......... .......... .......... 68% 336M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63650K .......... .......... .......... .......... .......... 68% 298M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63700K .......... .......... .......... .......... .......... 68% 392M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63750K .......... .......... .......... .......... .......... 68% 385M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63800K .......... .......... .......... .......... .......... 68% 445M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63850K .......... .......... .......... .......... .......... 68% 385M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63900K .......... .......... .......... .......... .......... 68% 438M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 63950K .......... .......... .......... .......... .......... 68% 367M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 64000K .......... .......... .......... .......... .......... 68% 316M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 64050K .......... .......... .......... .......... .......... 68% 430M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 64100K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-14T11:39:34.295 INFO:teuthology.orchestra.run.smithi094.stderr: 64150K .......... .......... .......... .......... .......... 69% 427M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64200K .......... .......... .......... .......... .......... 69% 356M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64250K .......... .......... .......... .......... .......... 69% 455M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64300K .......... .......... .......... .......... .......... 69% 407M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64350K .......... .......... .......... .......... .......... 69% 392M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64400K .......... .......... .......... .......... .......... 69% 331M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64450K .......... .......... .......... .......... .......... 69% 379M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64500K .......... .......... .......... .......... .......... 69% 421M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64550K .......... .......... .......... .......... .......... 69% 419M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64600K .......... .......... .......... .......... .......... 69% 415M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64650K .......... .......... .......... .......... .......... 69% 310M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64700K .......... .......... .......... .......... .......... 69% 368M 0s 2024-09-14T11:39:34.296 INFO:teuthology.orchestra.run.smithi094.stderr: 64750K .......... .......... .......... .......... .......... 69% 415M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 64800K .......... .......... .......... .......... .......... 69% 469M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 64850K .......... .......... .......... .......... .......... 69% 65.2M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 64900K .......... .......... .......... .......... .......... 69% 449M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 64950K .......... .......... .......... .......... .......... 69% 442M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65000K .......... .......... .......... .......... .......... 70% 414M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65050K .......... .......... .......... .......... .......... 70% 434M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65100K .......... .......... .......... .......... .......... 70% 206M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65150K .......... .......... .......... .......... .......... 70% 157M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65200K .......... .......... .......... .......... .......... 70% 334M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65250K .......... .......... .......... .......... .......... 70% 105M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65300K .......... .......... .......... .......... .......... 70% 428M 0s 2024-09-14T11:39:34.297 INFO:teuthology.orchestra.run.smithi094.stderr: 65350K .......... .......... .......... .......... .......... 70% 348M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65400K .......... .......... .......... .......... .......... 70% 427M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65450K .......... .......... .......... .......... .......... 70% 202M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65500K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65550K .......... .......... .......... .......... .......... 70% 181M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65600K .......... .......... .......... .......... .......... 70% 384M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65650K .......... .......... .......... .......... .......... 70% 114M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65700K .......... .......... .......... .......... .......... 70% 187M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65750K .......... .......... .......... .......... .......... 70% 264M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65800K .......... .......... .......... .......... .......... 70% 107M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65850K .......... .......... .......... .......... .......... 70% 129M 0s 2024-09-14T11:39:34.298 INFO:teuthology.orchestra.run.smithi094.stderr: 65900K .......... .......... .......... .......... .......... 70% 258M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 65950K .......... .......... .......... .......... .......... 71% 208M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66000K .......... .......... .......... .......... .......... 71% 229M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66050K .......... .......... .......... .......... .......... 71% 81.2M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66100K .......... .......... .......... .......... .......... 71% 178M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66150K .......... .......... .......... .......... .......... 71% 240M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66200K .......... .......... .......... .......... .......... 71% 233M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66250K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66300K .......... .......... .......... .......... .......... 71% 293M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66350K .......... .......... .......... .......... .......... 71% 136M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66400K .......... .......... .......... .......... .......... 71% 240M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66450K .......... .......... .......... .......... .......... 71% 281M 0s 2024-09-14T11:39:34.299 INFO:teuthology.orchestra.run.smithi094.stderr: 66500K .......... .......... .......... .......... .......... 71% 235M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66550K .......... .......... .......... .......... .......... 71% 267M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66600K .......... .......... .......... .......... .......... 71% 284M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66650K .......... .......... .......... .......... .......... 71% 285M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66700K .......... .......... .......... .......... .......... 71% 252M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66750K .......... .......... .......... .......... .......... 71% 279M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66800K .......... .......... .......... .......... .......... 71% 284M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66850K .......... .......... .......... .......... .......... 72% 279M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66900K .......... .......... .......... .......... .......... 72% 246M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 66950K .......... .......... .......... .......... .......... 72% 260M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 67000K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 67050K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-14T11:39:34.300 INFO:teuthology.orchestra.run.smithi094.stderr: 67100K .......... .......... .......... .......... .......... 72% 289M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67150K .......... .......... .......... .......... .......... 72% 229M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67200K .......... .......... .......... .......... .......... 72% 291M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67250K .......... .......... .......... .......... .......... 72% 282M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67300K .......... .......... .......... .......... .......... 72% 279M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67350K .......... .......... .......... .......... .......... 72% 260M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67400K .......... .......... .......... .......... .......... 72% 270M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67450K .......... .......... .......... .......... .......... 72% 225M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67500K .......... .......... .......... .......... .......... 72% 232M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67550K .......... .......... .......... .......... .......... 72% 276M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67600K .......... .......... .......... .......... .......... 72% 286M 0s 2024-09-14T11:39:34.301 INFO:teuthology.orchestra.run.smithi094.stderr: 67650K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67700K .......... .......... .......... .......... .......... 72% 270M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67750K .......... .......... .......... .......... .......... 72% 246M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67800K .......... .......... .......... .......... .......... 73% 261M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67850K .......... .......... .......... .......... .......... 73% 257M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67900K .......... .......... .......... .......... .......... 73% 297M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 67950K .......... .......... .......... .......... .......... 73% 282M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68000K .......... .......... .......... .......... .......... 73% 251M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68050K .......... .......... .......... .......... .......... 73% 280M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68100K .......... .......... .......... .......... .......... 73% 261M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68150K .......... .......... .......... .......... .......... 73% 232M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68200K .......... .......... .......... .......... .......... 73% 276M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68250K .......... .......... .......... .......... .......... 73% 247M 0s 2024-09-14T11:39:34.302 INFO:teuthology.orchestra.run.smithi094.stderr: 68300K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68350K .......... .......... .......... .......... .......... 73% 228M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68400K .......... .......... .......... .......... .......... 73% 292M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68450K .......... .......... .......... .......... .......... 73% 266M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68500K .......... .......... .......... .......... .......... 73% 229M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68550K .......... .......... .......... .......... .......... 73% 261M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68600K .......... .......... .......... .......... .......... 73% 282M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68650K .......... .......... .......... .......... .......... 73% 285M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68700K .......... .......... .......... .......... .......... 74% 293M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68750K .......... .......... .......... .......... .......... 74% 249M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68800K .......... .......... .......... .......... .......... 74% 260M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68850K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi094.stderr: 68900K .......... .......... .......... .......... .......... 74% 255M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 68950K .......... .......... .......... .......... .......... 74% 288M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69000K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69050K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69100K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69150K .......... .......... .......... .......... .......... 74% 106M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69200K .......... .......... .......... .......... .......... 74% 251M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69250K .......... .......... .......... .......... .......... 74% 277M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69300K .......... .......... .......... .......... .......... 74% 250M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69350K .......... .......... .......... .......... .......... 74% 112M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69400K .......... .......... .......... .......... .......... 74% 291M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69450K .......... .......... .......... .......... .......... 74% 232M 0s 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi094.stderr: 69500K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69550K .......... .......... .......... .......... .......... 74% 284M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69600K .......... .......... .......... .......... .......... 74% 297M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69650K .......... .......... .......... .......... .......... 75% 275M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69700K .......... .......... .......... .......... .......... 75% 231M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69750K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69800K .......... .......... .......... .......... .......... 75% 280M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69850K .......... .......... .......... .......... .......... 75% 279M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69900K .......... .......... .......... .......... .......... 75% 259M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 69950K .......... .......... .......... .......... .......... 75% 273M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 70000K .......... .......... .......... .......... .......... 75% 268M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 70050K .......... .......... .......... .......... .......... 75% 250M 0s 2024-09-14T11:39:34.305 INFO:teuthology.orchestra.run.smithi094.stderr: 70100K .......... .......... .......... .......... .......... 75% 285M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70150K .......... .......... .......... .......... .......... 75% 256M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70200K .......... .......... .......... .......... .......... 75% 285M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70250K .......... .......... .......... .......... .......... 75% 248M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70300K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70350K .......... .......... .......... .......... .......... 75% 244M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70400K .......... .......... .......... .......... .......... 75% 287M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70450K .......... .......... .......... .......... .......... 75% 293M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70500K .......... .......... .......... .......... .......... 75% 145M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70550K .......... .......... .......... .......... .......... 75% 262M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70600K .......... .......... .......... .......... .......... 76% 295M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70650K .......... .......... .......... .......... .......... 76% 245M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70700K .......... .......... .......... .......... .......... 76% 291M 0s 2024-09-14T11:39:34.306 INFO:teuthology.orchestra.run.smithi094.stderr: 70750K .......... .......... .......... .......... .......... 76% 281M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 70800K .......... .......... .......... .......... .......... 76% 287M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 70850K .......... .......... .......... .......... .......... 76% 255M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 70900K .......... .......... .......... .......... .......... 76% 282M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 70950K .......... .......... .......... .......... .......... 76% 284M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71000K .......... .......... .......... .......... .......... 76% 261M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71050K .......... .......... .......... .......... .......... 76% 233M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71100K .......... .......... .......... .......... .......... 76% 288M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71150K .......... .......... .......... .......... .......... 76% 279M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71200K .......... .......... .......... .......... .......... 76% 269M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71250K .......... .......... .......... .......... .......... 76% 290M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71300K .......... .......... .......... .......... .......... 76% 202M 0s 2024-09-14T11:39:34.307 INFO:teuthology.orchestra.run.smithi094.stderr: 71350K .......... .......... .......... .......... .......... 76% 285M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71400K .......... .......... .......... .......... .......... 76% 295M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71450K .......... .......... .......... .......... .......... 76% 279M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71500K .......... .......... .......... .......... .......... 77% 242M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71550K .......... .......... .......... .......... .......... 77% 264M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71600K .......... .......... .......... .......... .......... 77% 253M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71650K .......... .......... .......... .......... .......... 77% 242M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71700K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71750K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71800K .......... .......... .......... .......... .......... 77% 290M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71850K .......... .......... .......... .......... .......... 77% 271M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71900K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-14T11:39:34.308 INFO:teuthology.orchestra.run.smithi094.stderr: 71950K .......... .......... .......... .......... .......... 77% 228M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72000K .......... .......... .......... .......... .......... 77% 223M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72050K .......... .......... .......... .......... .......... 77% 260M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72100K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72150K .......... .......... .......... .......... .......... 77% 252M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72200K .......... .......... .......... .......... .......... 77% 290M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72250K .......... .......... .......... .......... .......... 77% 203M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72300K .......... .......... .......... .......... .......... 77% 269M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72350K .......... .......... .......... .......... .......... 77% 88.1M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72400K .......... .......... .......... .......... .......... 77% 224M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72450K .......... .......... .......... .......... .......... 78% 235M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72500K .......... .......... .......... .......... .......... 78% 289M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72550K .......... .......... .......... .......... .......... 78% 251M 0s 2024-09-14T11:39:34.309 INFO:teuthology.orchestra.run.smithi094.stderr: 72600K .......... .......... .......... .......... .......... 78% 280M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72650K .......... .......... .......... .......... .......... 78% 286M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72700K .......... .......... .......... .......... .......... 78% 256M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72750K .......... .......... .......... .......... .......... 78% 273M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72800K .......... .......... .......... .......... .......... 78% 278M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72850K .......... .......... .......... .......... .......... 78% 258M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72900K .......... .......... .......... .......... .......... 78% 287M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 72950K .......... .......... .......... .......... .......... 78% 238M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 73000K .......... .......... .......... .......... .......... 78% 288M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 73050K .......... .......... .......... .......... .......... 78% 276M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 73100K .......... .......... .......... .......... .......... 78% 233M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 73150K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-14T11:39:34.310 INFO:teuthology.orchestra.run.smithi094.stderr: 73200K .......... .......... .......... .......... .......... 78% 315M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73250K .......... .......... .......... .......... .......... 78% 384M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73300K .......... .......... .......... .......... .......... 78% 379M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73350K .......... .......... .......... .......... .......... 79% 278M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73400K .......... .......... .......... .......... .......... 79% 369M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73450K .......... .......... .......... .......... .......... 79% 305M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73500K .......... .......... .......... .......... .......... 79% 88.4M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73550K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73600K .......... .......... .......... .......... .......... 79% 278M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73650K .......... .......... .......... .......... .......... 79% 277M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73700K .......... .......... .......... .......... .......... 79% 245M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73750K .......... .......... .......... .......... .......... 79% 413M 0s 2024-09-14T11:39:34.311 INFO:teuthology.orchestra.run.smithi094.stderr: 73800K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 73850K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 73900K .......... .......... .......... .......... .......... 79% 426M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 73950K .......... .......... .......... .......... .......... 79% 152M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74000K .......... .......... .......... .......... .......... 79% 389M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74050K .......... .......... .......... .......... .......... 79% 415M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74100K .......... .......... .......... .......... .......... 79% 404M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74150K .......... .......... .......... .......... .......... 79% 365M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74200K .......... .......... .......... .......... .......... 79% 155M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74250K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74300K .......... .......... .......... .......... .......... 80% 146M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74350K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-14T11:39:34.312 INFO:teuthology.orchestra.run.smithi094.stderr: 74400K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74450K .......... .......... .......... .......... .......... 80% 368M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74500K .......... .......... .......... .......... .......... 80% 298M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74550K .......... .......... .......... .......... .......... 80% 419M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74600K .......... .......... .......... .......... .......... 80% 302M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74650K .......... .......... .......... .......... .......... 80% 441M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74700K .......... .......... .......... .......... .......... 80% 144M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74750K .......... .......... .......... .......... .......... 80% 358M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74800K .......... .......... .......... .......... .......... 80% 249M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74850K .......... .......... .......... .......... .......... 80% 400M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74900K .......... .......... .......... .......... .......... 80% 256M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 74950K .......... .......... .......... .......... .......... 80% 262M 0s 2024-09-14T11:39:34.313 INFO:teuthology.orchestra.run.smithi094.stderr: 75000K .......... .......... .......... .......... .......... 80% 85.3M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75050K .......... .......... .......... .......... .......... 80% 401M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75100K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75150K .......... .......... .......... .......... .......... 80% 392M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75200K .......... .......... .......... .......... .......... 81% 207M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75250K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75300K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75350K .......... .......... .......... .......... .......... 81% 421M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75400K .......... .......... .......... .......... .......... 81% 113M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75450K .......... .......... .......... .......... .......... 81% 207M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75500K .......... .......... .......... .......... .......... 81% 111M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75550K .......... .......... .......... .......... .......... 81% 273M 0s 2024-09-14T11:39:34.314 INFO:teuthology.orchestra.run.smithi094.stderr: 75600K .......... .......... .......... .......... .......... 81% 426M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75650K .......... .......... .......... .......... .......... 81% 309M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75700K .......... .......... .......... .......... .......... 81% 130M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75750K .......... .......... .......... .......... .......... 81% 265M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75800K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75850K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75900K .......... .......... .......... .......... .......... 81% 371M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 75950K .......... .......... .......... .......... .......... 81% 203M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76000K .......... .......... .......... .......... .......... 81% 402M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76050K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76100K .......... .......... .......... .......... .......... 81% 410M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76150K .......... .......... .......... .......... .......... 82% 312M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76200K .......... .......... .......... .......... .......... 82% 118M 0s 2024-09-14T11:39:34.315 INFO:teuthology.orchestra.run.smithi094.stderr: 76250K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76300K .......... .......... .......... .......... .......... 82% 382M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76350K .......... .......... .......... .......... .......... 82% 367M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76400K .......... .......... .......... .......... .......... 82% 414M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76450K .......... .......... .......... .......... .......... 82% 106M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76500K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76550K .......... .......... .......... .......... .......... 82% 352M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76600K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76650K .......... .......... .......... .......... .......... 82% 161M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76700K .......... .......... .......... .......... .......... 82% 244M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76750K .......... .......... .......... .......... .......... 82% 375M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76800K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-14T11:39:34.316 INFO:teuthology.orchestra.run.smithi094.stderr: 76850K .......... .......... .......... .......... .......... 82% 394M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 76900K .......... .......... .......... .......... .......... 82% 153M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 76950K .......... .......... .......... .......... .......... 82% 349M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77000K .......... .......... .......... .......... .......... 82% 433M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77050K .......... .......... .......... .......... .......... 82% 408M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77100K .......... .......... .......... .......... .......... 83% 400M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77150K .......... .......... .......... .......... .......... 83% 205M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77200K .......... .......... .......... .......... .......... 83% 370M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77250K .......... .......... .......... .......... .......... 83% 407M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77300K .......... .......... .......... .......... .......... 83% 83.9M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77350K .......... .......... .......... .......... .......... 83% 405M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77400K .......... .......... .......... .......... .......... 83% 406M 0s 2024-09-14T11:39:34.317 INFO:teuthology.orchestra.run.smithi094.stderr: 77450K .......... .......... .......... .......... .......... 83% 393M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77500K .......... .......... .......... .......... .......... 83% 329M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77550K .......... .......... .......... .......... .......... 83% 399M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77600K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77650K .......... .......... .......... .......... .......... 83% 319M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77700K .......... .......... .......... .......... .......... 83% 371M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77750K .......... .......... .......... .......... .......... 83% 244M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77800K .......... .......... .......... .......... .......... 83% 290M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77850K .......... .......... .......... .......... .......... 83% 174M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77900K .......... .......... .......... .......... .......... 83% 386M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 77950K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 78000K .......... .......... .......... .......... .......... 84% 229M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 78050K .......... .......... .......... .......... .......... 84% 72.2M 0s 2024-09-14T11:39:34.318 INFO:teuthology.orchestra.run.smithi094.stderr: 78100K .......... .......... .......... .......... .......... 84% 362M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78150K .......... .......... .......... .......... .......... 84% 304M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78200K .......... .......... .......... .......... .......... 84% 393M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78250K .......... .......... .......... .......... .......... 84% 402M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78300K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78350K .......... .......... .......... .......... .......... 84% 154M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78400K .......... .......... .......... .......... .......... 84% 273M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78450K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78500K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78550K .......... .......... .......... .......... .......... 84% 152M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78600K .......... .......... .......... .......... .......... 84% 272M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78650K .......... .......... .......... .......... .......... 84% 154M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78700K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-14T11:39:34.319 INFO:teuthology.orchestra.run.smithi094.stderr: 78750K .......... .......... .......... .......... .......... 84% 143M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 78800K .......... .......... .......... .......... .......... 84% 183M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 78850K .......... .......... .......... .......... .......... 84% 407M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 78900K .......... .......... .......... .......... .......... 84% 405M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 78950K .......... .......... .......... .......... .......... 85% 375M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79000K .......... .......... .......... .......... .......... 85% 237M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79050K .......... .......... .......... .......... .......... 85% 342M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79100K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79150K .......... .......... .......... .......... .......... 85% 380M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79200K .......... .......... .......... .......... .......... 85% 367M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79250K .......... .......... .......... .......... .......... 85% 136M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79300K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-14T11:39:34.320 INFO:teuthology.orchestra.run.smithi094.stderr: 79350K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79400K .......... .......... .......... .......... .......... 85% 168M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79450K .......... .......... .......... .......... .......... 85% 106M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79500K .......... .......... .......... .......... .......... 85% 416M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79550K .......... .......... .......... .......... .......... 85% 394M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79600K .......... .......... .......... .......... .......... 85% 210M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79650K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79700K .......... .......... .......... .......... .......... 85% 196M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79750K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79800K .......... .......... .......... .......... .......... 85% 390M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79850K .......... .......... .......... .......... .......... 86% 323M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79900K .......... .......... .......... .......... .......... 86% 387M 0s 2024-09-14T11:39:34.321 INFO:teuthology.orchestra.run.smithi094.stderr: 79950K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80000K .......... .......... .......... .......... .......... 86% 331M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80050K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80100K .......... .......... .......... .......... .......... 86% 260M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80150K .......... .......... .......... .......... .......... 86% 276M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80200K .......... .......... .......... .......... .......... 86% 285M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80250K .......... .......... .......... .......... .......... 86% 349M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80300K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80350K .......... .......... .......... .......... .......... 86% 103M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80400K .......... .......... .......... .......... .......... 86% 183M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80450K .......... .......... .......... .......... .......... 86% 252M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80500K .......... .......... .......... .......... .......... 86% 367M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80550K .......... .......... .......... .......... .......... 86% 351M 0s 2024-09-14T11:39:34.322 INFO:teuthology.orchestra.run.smithi094.stderr: 80600K .......... .......... .......... .......... .......... 86% 343M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80650K .......... .......... .......... .......... .......... 86% 394M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80700K .......... .......... .......... .......... .......... 86% 419M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80750K .......... .......... .......... .......... .......... 86% 325M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80800K .......... .......... .......... .......... .......... 87% 400M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80850K .......... .......... .......... .......... .......... 87% 272M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80900K .......... .......... .......... .......... .......... 87% 412M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 80950K .......... .......... .......... .......... .......... 87% 343M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81000K .......... .......... .......... .......... .......... 87% 436M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81050K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81100K .......... .......... .......... .......... .......... 87% 72.9M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81150K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81200K .......... .......... .......... .......... .......... 87% 108M 0s 2024-09-14T11:39:34.323 INFO:teuthology.orchestra.run.smithi094.stderr: 81250K .......... .......... .......... .......... .......... 87% 402M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81300K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81350K .......... .......... .......... .......... .......... 87% 377M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81400K .......... .......... .......... .......... .......... 87% 359M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81450K .......... .......... .......... .......... .......... 87% 361M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81500K .......... .......... .......... .......... .......... 87% 247M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81550K .......... .......... .......... .......... .......... 87% 131M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81600K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81650K .......... .......... .......... .......... .......... 87% 444M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81700K .......... .......... .......... .......... .......... 87% 89.4M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81750K .......... .......... .......... .......... .......... 88% 350M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81800K .......... .......... .......... .......... .......... 88% 368M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81850K .......... .......... .......... .......... .......... 88% 302M 0s 2024-09-14T11:39:34.324 INFO:teuthology.orchestra.run.smithi094.stderr: 81900K .......... .......... .......... .......... .......... 88% 375M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 81950K .......... .......... .......... .......... .......... 88% 147M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82000K .......... .......... .......... .......... .......... 88% 409M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82050K .......... .......... .......... .......... .......... 88% 351M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82100K .......... .......... .......... .......... .......... 88% 407M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82150K .......... .......... .......... .......... .......... 88% 209M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82200K .......... .......... .......... .......... .......... 88% 260M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82250K .......... .......... .......... .......... .......... 88% 364M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82300K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82350K .......... .......... .......... .......... .......... 88% 230M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82400K .......... .......... .......... .......... .......... 88% 348M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82450K .......... .......... .......... .......... .......... 88% 366M 0s 2024-09-14T11:39:34.325 INFO:teuthology.orchestra.run.smithi094.stderr: 82500K .......... .......... .......... .......... .......... 88% 104M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82550K .......... .......... .......... .......... .......... 88% 239M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82600K .......... .......... .......... .......... .......... 88% 434M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82650K .......... .......... .......... .......... .......... 89% 228M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82700K .......... .......... .......... .......... .......... 89% 190M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82750K .......... .......... .......... .......... .......... 89% 267M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82800K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82850K .......... .......... .......... .......... .......... 89% 403M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82900K .......... .......... .......... .......... .......... 89% 236M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 82950K .......... .......... .......... .......... .......... 89% 260M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 83000K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 83050K .......... .......... .......... .......... .......... 89% 392M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 83100K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-14T11:39:34.326 INFO:teuthology.orchestra.run.smithi094.stderr: 83150K .......... .......... .......... .......... .......... 89% 346M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83200K .......... .......... .......... .......... .......... 89% 415M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83250K .......... .......... .......... .......... .......... 89% 401M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83300K .......... .......... .......... .......... .......... 89% 363M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83350K .......... .......... .......... .......... .......... 89% 76.8M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83400K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83450K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83500K .......... .......... .......... .......... .......... 89% 399M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83550K .......... .......... .......... .......... .......... 89% 77.3M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83600K .......... .......... .......... .......... .......... 90% 329M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83650K .......... .......... .......... .......... .......... 90% 350M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83700K .......... .......... .......... .......... .......... 90% 392M 0s 2024-09-14T11:39:34.327 INFO:teuthology.orchestra.run.smithi094.stderr: 83750K .......... .......... .......... .......... .......... 90% 374M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 83800K .......... .......... .......... .......... .......... 90% 365M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 83850K .......... .......... .......... .......... .......... 90% 304M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 83900K .......... .......... .......... .......... .......... 90% 411M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 83950K .......... .......... .......... .......... .......... 90% 370M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84000K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84050K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84100K .......... .......... .......... .......... .......... 90% 404M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84150K .......... .......... .......... .......... .......... 90% 212M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84200K .......... .......... .......... .......... .......... 90% 406M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84250K .......... .......... .......... .......... .......... 90% 47.8M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84300K .......... .......... .......... .......... .......... 90% 363M 0s 2024-09-14T11:39:34.328 INFO:teuthology.orchestra.run.smithi094.stderr: 84350K .......... .......... .......... .......... .......... 90% 319M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84400K .......... .......... .......... .......... .......... 90% 364M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84450K .......... .......... .......... .......... .......... 90% 368M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84500K .......... .......... .......... .......... .......... 91% 374M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84550K .......... .......... .......... .......... .......... 91% 349M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84600K .......... .......... .......... .......... .......... 91% 401M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84650K .......... .......... .......... .......... .......... 91% 296M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84700K .......... .......... .......... .......... .......... 91% 400M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84750K .......... .......... .......... .......... .......... 91% 170M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84800K .......... .......... .......... .......... .......... 91% 124M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84850K .......... .......... .......... .......... .......... 91% 355M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84900K .......... .......... .......... .......... .......... 91% 404M 0s 2024-09-14T11:39:34.329 INFO:teuthology.orchestra.run.smithi094.stderr: 84950K .......... .......... .......... .......... .......... 91% 247M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85000K .......... .......... .......... .......... .......... 91% 151M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85050K .......... .......... .......... .......... .......... 91% 383M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85100K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85150K .......... .......... .......... .......... .......... 91% 398M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85200K .......... .......... .......... .......... .......... 91% 242M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85250K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85300K .......... .......... .......... .......... .......... 91% 186M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85350K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85400K .......... .......... .......... .......... .......... 91% 410M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85450K .......... .......... .......... .......... .......... 92% 378M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85500K .......... .......... .......... .......... .......... 92% 102M 0s 2024-09-14T11:39:34.330 INFO:teuthology.orchestra.run.smithi094.stderr: 85550K .......... .......... .......... .......... .......... 92% 406M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85600K .......... .......... .......... .......... .......... 92% 351M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85650K .......... .......... .......... .......... .......... 92% 412M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85700K .......... .......... .......... .......... .......... 92% 181M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85750K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85800K .......... .......... .......... .......... .......... 92% 134M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85850K .......... .......... .......... .......... .......... 92% 302M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85900K .......... .......... .......... .......... .......... 92% 402M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 85950K .......... .......... .......... .......... .......... 92% 385M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 86000K .......... .......... .......... .......... .......... 92% 436M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 86050K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 86100K .......... .......... .......... .......... .......... 92% 405M 0s 2024-09-14T11:39:34.331 INFO:teuthology.orchestra.run.smithi094.stderr: 86150K .......... .......... .......... .......... .......... 92% 406M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86200K .......... .......... .......... .......... .......... 92% 370M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86250K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86300K .......... .......... .......... .......... .......... 92% 352M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86350K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86400K .......... .......... .......... .......... .......... 93% 68.9M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86450K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86500K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86550K .......... .......... .......... .......... .......... 93% 418M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86600K .......... .......... .......... .......... .......... 93% 64.9M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86650K .......... .......... .......... .......... .......... 93% 160M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86700K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-14T11:39:34.332 INFO:teuthology.orchestra.run.smithi094.stderr: 86750K .......... .......... .......... .......... .......... 93% 327M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 86800K .......... .......... .......... .......... .......... 93% 391M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 86850K .......... .......... .......... .......... .......... 93% 339M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 86900K .......... .......... .......... .......... .......... 93% 410M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 86950K .......... .......... .......... .......... .......... 93% 337M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87000K .......... .......... .......... .......... .......... 93% 327M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87050K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87100K .......... .......... .......... .......... .......... 93% 386M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87150K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87200K .......... .......... .......... .......... .......... 93% 287M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87250K .......... .......... .......... .......... .......... 93% 420M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87300K .......... .......... .......... .......... .......... 94% 84.1M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87350K .......... .......... .......... .......... .......... 94% 270M 0s 2024-09-14T11:39:34.333 INFO:teuthology.orchestra.run.smithi094.stderr: 87400K .......... .......... .......... .......... .......... 94% 336M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87450K .......... .......... .......... .......... .......... 94% 366M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87500K .......... .......... .......... .......... .......... 94% 385M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87550K .......... .......... .......... .......... .......... 94% 117M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87600K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87650K .......... .......... .......... .......... .......... 94% 306M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87700K .......... .......... .......... .......... .......... 94% 370M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87750K .......... .......... .......... .......... .......... 94% 417M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87800K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87850K .......... .......... .......... .......... .......... 94% 358M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87900K .......... .......... .......... .......... .......... 94% 219M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 87950K .......... .......... .......... .......... .......... 94% 347M 0s 2024-09-14T11:39:34.334 INFO:teuthology.orchestra.run.smithi094.stderr: 88000K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88050K .......... .......... .......... .......... .......... 94% 172M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88100K .......... .......... .......... .......... .......... 94% 299M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88150K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88200K .......... .......... .......... .......... .......... 94% 104M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88250K .......... .......... .......... .......... .......... 95% 276M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88300K .......... .......... .......... .......... .......... 95% 401M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88350K .......... .......... .......... .......... .......... 95% 391M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88400K .......... .......... .......... .......... .......... 95% 310M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88450K .......... .......... .......... .......... .......... 95% 339M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88500K .......... .......... .......... .......... .......... 95% 119M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88550K .......... .......... .......... .......... .......... 95% 369M 0s 2024-09-14T11:39:34.335 INFO:teuthology.orchestra.run.smithi094.stderr: 88600K .......... .......... .......... .......... .......... 95% 375M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88650K .......... .......... .......... .......... .......... 95% 356M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88700K .......... .......... .......... .......... .......... 95% 351M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88750K .......... .......... .......... .......... .......... 95% 335M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88800K .......... .......... .......... .......... .......... 95% 377M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88850K .......... .......... .......... .......... .......... 95% 411M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88900K .......... .......... .......... .......... .......... 95% 143M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 88950K .......... .......... .......... .......... .......... 95% 186M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 89000K .......... .......... .......... .......... .......... 95% 337M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 89050K .......... .......... .......... .......... .......... 95% 424M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 89100K .......... .......... .......... .......... .......... 95% 429M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 89150K .......... .......... .......... .......... .......... 96% 355M 0s 2024-09-14T11:39:34.336 INFO:teuthology.orchestra.run.smithi094.stderr: 89200K .......... .......... .......... .......... .......... 96% 359M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89250K .......... .......... .......... .......... .......... 96% 392M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89300K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89350K .......... .......... .......... .......... .......... 96% 304M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89400K .......... .......... .......... .......... .......... 96% 341M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89450K .......... .......... .......... .......... .......... 96% 95.3M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89500K .......... .......... .......... .......... .......... 96% 298M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89550K .......... .......... .......... .......... .......... 96% 400M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89600K .......... .......... .......... .......... .......... 96% 55.5M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89650K .......... .......... .......... .......... .......... 96% 376M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89700K .......... .......... .......... .......... .......... 96% 203M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89750K .......... .......... .......... .......... .......... 96% 111M 0s 2024-09-14T11:39:34.337 INFO:teuthology.orchestra.run.smithi094.stderr: 89800K .......... .......... .......... .......... .......... 96% 346M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 89850K .......... .......... .......... .......... .......... 96% 469M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 89900K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 89950K .......... .......... .......... .......... .......... 96% 356M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90000K .......... .......... .......... .......... .......... 96% 384M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90050K .......... .......... .......... .......... .......... 96% 385M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90100K .......... .......... .......... .......... .......... 97% 330M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90150K .......... .......... .......... .......... .......... 97% 304M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90200K .......... .......... .......... .......... .......... 97% 104M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90250K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90300K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90350K .......... .......... .......... .......... .......... 97% 403M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90400K .......... .......... .......... .......... .......... 97% 401M 0s 2024-09-14T11:39:34.338 INFO:teuthology.orchestra.run.smithi094.stderr: 90450K .......... .......... .......... .......... .......... 97% 407M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90500K .......... .......... .......... .......... .......... 97% 319M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90550K .......... .......... .......... .......... .......... 97% 404M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90600K .......... .......... .......... .......... .......... 97% 144M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90650K .......... .......... .......... .......... .......... 97% 226M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90700K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90750K .......... .......... .......... .......... .......... 97% 345M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90800K .......... .......... .......... .......... .......... 97% 397M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90850K .......... .......... .......... .......... .......... 97% 403M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90900K .......... .......... .......... .......... .......... 97% 416M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 90950K .......... .......... .......... .......... .......... 97% 138M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 91000K .......... .......... .......... .......... .......... 98% 423M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 91050K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-14T11:39:34.339 INFO:teuthology.orchestra.run.smithi094.stderr: 91100K .......... .......... .......... .......... .......... 98% 400M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91150K .......... .......... .......... .......... .......... 98% 315M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91200K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91250K .......... .......... .......... .......... .......... 98% 113M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91300K .......... .......... .......... .......... .......... 98% 115M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91350K .......... .......... .......... .......... .......... 98% 400M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91400K .......... .......... .......... .......... .......... 98% 412M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91450K .......... .......... .......... .......... .......... 98% 301M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91500K .......... .......... .......... .......... .......... 98% 267M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91550K .......... .......... .......... .......... .......... 98% 232M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91600K .......... .......... .......... .......... .......... 98% 406M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91650K .......... .......... .......... .......... .......... 98% 276M 0s 2024-09-14T11:39:34.340 INFO:teuthology.orchestra.run.smithi094.stderr: 91700K .......... .......... .......... .......... .......... 98% 285M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 91750K .......... .......... .......... .......... .......... 98% 400M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 91800K .......... .......... .......... .......... .......... 98% 411M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 91850K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 91900K .......... .......... .......... .......... .......... 98% 332M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 91950K .......... .......... .......... .......... .......... 99% 393M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92000K .......... .......... .......... .......... .......... 99% 142M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92050K .......... .......... .......... .......... .......... 99% 131M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92100K .......... .......... .......... .......... .......... 99% 304M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92150K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92200K .......... .......... .......... .......... .......... 99% 429M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92250K .......... .......... .......... .......... .......... 99% 406M 0s 2024-09-14T11:39:34.341 INFO:teuthology.orchestra.run.smithi094.stderr: 92300K .......... .......... .......... .......... .......... 99% 299M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92350K .......... .......... .......... .......... .......... 99% 420M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92400K .......... .......... .......... .......... .......... 99% 226M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92450K .......... .......... .......... .......... .......... 99% 396M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92500K .......... .......... .......... .......... .......... 99% 251M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92550K .......... .......... .......... .......... .......... 99% 241M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92600K .......... .......... .......... .......... .......... 99% 373M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92650K .......... .......... .......... .......... .......... 99% 60.2M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92700K .......... .......... .......... .......... .......... 99% 341M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92750K .......... .......... .......... .......... .......... 99% 147M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92800K .......... .......... .......... .......... .......... 99% 121M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92850K .......... .......... .......... .......... .......... 99% 365M 0s 2024-09-14T11:39:34.342 INFO:teuthology.orchestra.run.smithi094.stderr: 92900K 100% 134G=0.4s 2024-09-14T11:39:34.343 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:39:34.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14 11:39:33 (208 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:39:34.343 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:39:34.380 INFO:teuthology.orchestra.run.smithi094.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:39:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:39:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:39:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:39:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:39:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:39:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:39:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:39:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:39:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:39:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:39:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:39:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:39:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:39:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:39:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:39:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:39:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:39:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:39:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:39:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout:Here are the highlights of this release: 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: - Advanced control of transitive versions 2024-09-14T11:39:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for optional features and dependencies 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - Rules to tweak published metadata 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Java 13 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - New Zinc compiler for Scala 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - VS2019 support 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.401 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Gradle 6.0.1 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Kotlin: 1.3.50 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Groovy: 2.5.8 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:39:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.403 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:39:34.403 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:39:34.403 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:39:34.403 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:39:34.403 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:39:34.403 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:39:34.612 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:39:34.612 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:39:34.612 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'QUATNZLEYELSNFBDPUZI', 'access_secret': 'BEms0co0NBInL/yMKCAgUX0MMvti8NXi6Z/H+l9xITACDheIgXvDLw==', 'region': 'mexico', 'endpoint': 'smithi094.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi094.front.sepia.ceph.com'} 2024-09-14T11:39:34.613 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:39:34.613 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'QUATNZLEYELSNFBDPUZI', '--secret', 'BEms0co0NBInL/yMKCAgUX0MMvti8NXi6Z/H+l9xITACDheIgXvDLw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:39:34.613 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key QUATNZLEYELSNFBDPUZI --secret BEms0co0NBInL/yMKCAgUX0MMvti8NXi6Z/H+l9xITACDheIgXvDLw== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:39:34.677 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:34.677 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:34.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.712+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 realm 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.714+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.715+0000 7f993d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:34.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.715+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.715+0000 7f993d087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:34.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.715+0000 7f993d087800 20 searching for the correct realm 2024-09-14T11:39:34.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.718+0000 7f993b379640 0 -- 172.21.15.94:0/3989955016 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f992407a070 msgr2=0x7f99240af930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:34.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.722+0000 7f993ab78640 0 -- 172.21.15.94:0/3989955016 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f99240eb1e0 msgr2=0x7f99240b4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:34.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:34.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.727+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:34.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 zone default found 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 4 Realm: () 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 zonegroup default 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.728+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.729+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.729+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.729+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.729+0000 7f993d087800 20 started sync module instance, tier type = 2024-09-14T11:39:34.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.729+0000 7f993d087800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=0 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=1 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=2 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=3 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=4 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=5 2024-09-14T11:39:34.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.738+0000 7f993d087800 20 add_watcher() i=6 2024-09-14T11:39:34.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.739+0000 7f993d087800 20 add_watcher() i=7 2024-09-14T11:39:34.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.739+0000 7f993d087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.740+0000 7f97f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 5 note: GC not initialized 2024-09-14T11:39:34.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f976bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:34.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:34.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 20 Filter name: none 2024-09-14T11:39:34.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f9769ffb640 20 reqs_thread_entry: start 2024-09-14T11:39:34.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:39:34.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.741+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:39:34.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 10 cache get: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI : miss 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.742+0000 7f993d087800 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.743+0000 7f993d087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.743+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI info.flags=0x0 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.743+0000 7f993d087800 10 adding default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI to cache LRU end 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.743+0000 7f993d087800 10 cache get: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI : hit (negative entry) 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.743+0000 7f993d087800 10 cache get: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI : hit (negative entry) 2024-09-14T11:39:34.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f993d087800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f993d087800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f981e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94680030916752 notifier 8760 bl.length()=670 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f981e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.744+0000 7f981e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:39:34.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f993d087800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:39:34.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f993d087800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:39:34.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f981dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94680030909104 notifier 8760 bl.length()=200 2024-09-14T11:39:34.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f981dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:39:34.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.746+0000 7f981dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.747+0000 7f993d087800 10 cache put: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI info.flags=0x7 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.748+0000 7f993d087800 10 moving default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI to cache LRU end 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.748+0000 7f993d087800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QUATNZLEYELSNFBDPUZI, ofs0, ns] 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.748+0000 7f981e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94680030895840 notifier 8760 bl.length()=189 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.748+0000 7f981e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI info.flags=0x7 2024-09-14T11:39:34.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.748+0000 7f981e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QUATNZLEYELSNFBDPUZI to cache LRU end 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "tester.client.0", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "tester.client.0", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "QUATNZLEYELSNFBDPUZI", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "BEms0co0NBInL/yMKCAgUX0MMvti8NXi6Z/H+l9xITACDheIgXvDLw==", 2024-09-14T11:39:34.747 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:39:34.743848Z" 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:39:34.748 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:39:34.749 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:39:34.743833Z", 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:34.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.749+0000 7f97f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:34.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.751+0000 7f993d087800 20 remove_watcher() i=0 2024-09-14T11:39:34.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.751+0000 7f993d087800 2 removed watcher, disabling cache 2024-09-14T11:39:34.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.752+0000 7f993d087800 20 remove_watcher() i=1 2024-09-14T11:39:34.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.753+0000 7f993d087800 20 remove_watcher() i=2 2024-09-14T11:39:34.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.754+0000 7f993d087800 20 remove_watcher() i=3 2024-09-14T11:39:34.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.755+0000 7f993d087800 20 remove_watcher() i=4 2024-09-14T11:39:34.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.756+0000 7f993d087800 20 remove_watcher() i=5 2024-09-14T11:39:34.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.757+0000 7f993d087800 20 remove_watcher() i=6 2024-09-14T11:39:34.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:34.758+0000 7f993d087800 20 remove_watcher() i=7 2024-09-14T11:39:34.768 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:39:34.768 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:39:34.799 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:39:34.799 DEBUG:teuthology.orchestra.run.smithi094:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:39:34.867 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:39:34.959 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:34.960 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:35.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.201+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 realm 2024-09-14T11:39:35.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.203+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.204+0000 7f6f55a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.204+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.204+0000 7f6f55a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:35.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.204+0000 7f6f55a13800 20 searching for the correct realm 2024-09-14T11:39:35.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.207+0000 7f6f48947640 0 -- 172.21.15.94:0/4184065100 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f6f4403df60 msgr2=0x7f6f4403c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:35.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.212+0000 7f6f51148640 0 -- 172.21.15.94:0/4184065100 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f6f3c0a5410 msgr2=0x7f6f3c0a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.419+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 zone default found 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 4 Realm: () 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 zonegroup default 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.420+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.421+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.421+0000 7f6f55a13800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.421+0000 7f6f55a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.421+0000 7f6f55a13800 20 started sync module instance, tier type = 2024-09-14T11:39:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.421+0000 7f6f55a13800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:35.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=0 2024-09-14T11:39:35.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=1 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=2 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=3 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=4 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=5 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.430+0000 7f6f55a13800 20 add_watcher() i=6 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.431+0000 7f6f55a13800 20 add_watcher() i=7 2024-09-14T11:39:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.431+0000 7f6f55a13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:35.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.433+0000 7f6e07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:35.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.433+0000 7f6f55a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:35.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.433+0000 7f6f55a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:35.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.472+0000 7f6e06fe5640 20 reqs_thread_entry: start 2024-09-14T11:39:35.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.472+0000 7f6f55a13800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:35.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.472+0000 7f6f55a13800 20 Filter name: none 2024-09-14T11:39:35.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.472+0000 7f6e04fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:35.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.472+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:39:35.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.474+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8743978898548448580', time=2024-09-14T13:30:57.068641+0000, chain.objs.size()=1 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.9vT-ymdVTOh1THSxqWkkHEwelh1243p_0 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15979738385048852850', time=2024-09-14T13:32:25.372515+0000, chain.objs.size()=1 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.6wK9DBe0BEsGK7l3I1p-JgjZ-s0Dw4G_0 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17076154896924785057', time=2024-09-14T13:32:58.246980+0000, chain.objs.size()=1 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.zOE1Wyx7ajLBakmP-LvuaE2xuPFv6Zi_0 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13176960151368459282', time=2024-09-14T13:33:31.040526+0000, chain.objs.size()=1 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.wUQEm-O4aKMyzoGC4LPsmPwZew2Vnbv_0 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6681781314533687139', time=2024-09-14T13:34:42.715199+0000, chain.objs.size()=1 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.3iL3KvckQ4Y0IU26_pFr2hceDytsoHc_0 2024-09-14T11:39:35.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4037641241446603055', time=2024-09-14T13:35:49.685373+0000, chain.objs.size()=1 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.ZPILkHxwn2LbdZkFmo6HWc0bFrItrOK_0 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6230678507524118165', time=2024-09-14T13:36:21.393019+0000, chain.objs.size()=1 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.tmdSeU-d9Mp0F1aBqdrlxrPB4Elrlvx_0 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12516029312101797487', time=2024-09-14T13:36:23.380678+0000, chain.objs.size()=1 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.HgDslefcUftjBFCLIh_cDlMwrPBuyrh_0 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12647924303804694856', time=2024-09-14T13:36:24.243014+0000, chain.objs.size()=1 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.lQfiVGwWv7eS_XoRopPEjXz00KwlTji_0 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13382307765382653928', time=2024-09-14T13:36:55.780294+0000, chain.objs.size()=1 2024-09-14T11:39:35.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.475+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.-KDd72DrVO79IlvFiM7j-mHHo_egpSI_0 2024-09-14T11:39:35.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.479+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.481+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:39:35.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.483+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.483+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17810905561752736664', time=2024-09-14T13:32:59.317526+0000, chain.objs.size()=1 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.K-MTKVuumNxCyNUYyDuxr37E85irGjN_0 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.700647028329447256', time=2024-09-14T13:32:59.320828+0000, chain.objs.size()=1 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.C2XUm039ZLJp1ndokX004rXqigfb_Z4_0 2024-09-14T11:39:35.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3251585175873014876', time=2024-09-14T13:34:08.924959+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.eWlnOS5ItF4n9uuqJpW_NneP6sRaNAz_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16264281413398615780', time=2024-09-14T13:34:39.838033+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.1uYW0j-ONh75khbJAMv-MbSHPmTg6zi_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10372575778476694808', time=2024-09-14T13:35:14.343125+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.hrg6CTgKNex6QLUjTr8b9ope2ehaoCN_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10766249915766063675', time=2024-09-14T13:35:16.366822+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.M5LkNS6eAsqC5VDxthBUONDQvo_KLlP_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8533816238475751587', time=2024-09-14T13:35:16.379627+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.tOhbCY2UoPPM7Sm1dDEfXQQMEjyXXxR_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3563411005617055185', time=2024-09-14T13:35:48.520667+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.8qkTycXWqwORM5YcsH-98ie39YyMyQo_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17385904052928148117', time=2024-09-14T13:35:49.689302+0000, chain.objs.size()=1 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.ZkWRJHAyzOEoz0ixewEO_RzDqNZo0Sr_0 2024-09-14T11:39:35.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15475635273298484871', time=2024-09-14T13:36:23.388705+0000, chain.objs.size()=1 2024-09-14T11:39:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.PEogs1vay2tCTj4gWnQmloFk3VOU5RY_0 2024-09-14T11:39:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9242345242013349830', time=2024-09-14T13:36:24.882224+0000, chain.objs.size()=1 2024-09-14T11:39:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.yipXpwXHLRqX71dSLiu4LieaJt_Y4wY_0 2024-09-14T11:39:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12390513219237386961', time=2024-09-14T13:39:01.763385+0000, chain.objs.size()=1 2024-09-14T11:39:35.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.484+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.Est0a8a9cr6_UKW6CBtAVo0SPyh--vz_0 2024-09-14T11:39:35.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.489+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.491+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:39:35.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2867076263425023022', time=2024-09-14T13:32:22.892671+0000, chain.objs.size()=1 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.k09onwAzw_fPJmYRBIn36lion3lHRh0_0 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8050419987524643194', time=2024-09-14T13:32:22.898435+0000, chain.objs.size()=1 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.04rR54g0uptvSIlPvxGOb3q_4tAshjz_0 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1612802499430542051', time=2024-09-14T13:32:24.153416+0000, chain.objs.size()=1 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.AcsNAfKCbpX-pKgPjn_A9PRFqH6d6Tg_0 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.495604825387193717', time=2024-09-14T13:32:56.271720+0000, chain.objs.size()=1 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.c5QTpvAECE3-ReWxJ9HowTvMZAdmSMe_0 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1696773484471268830', time=2024-09-14T13:32:56.275434+0000, chain.objs.size()=1 2024-09-14T11:39:35.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.047f8_WeOepbFTFUsN-PYYgxy31I89r_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8982879304457434006', time=2024-09-14T13:32:56.276148+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.Tzqdh3qlEeafumU37zdZaN303PPziLk_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1518119694082077265', time=2024-09-14T13:32:58.247241+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.1RG3sTAaeSA39mzFfZtg_GsWtBgEsOo_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8080049815786660510', time=2024-09-14T13:32:58.258251+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.xvn-L_eGVoJaC1OcIUjc-K3jj8YjbyV_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15909861978062134521', time=2024-09-14T13:33:31.043858+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.Uo6MGhuPBbb4IbzEYoQ1n_mHfxqvz1X_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12885870528017335192', time=2024-09-14T13:33:32.843607+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.K4AmC88Vcgma_1QCh7qPOZi-gZmoDnf_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2627268663129620952', time=2024-09-14T13:33:32.847342+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.K8rbDP0cDOyldKo2iacdeu0T3AEWEOS_0 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8134398128036879369', time=2024-09-14T13:34:41.634802+0000, chain.objs.size()=1 2024-09-14T11:39:35.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.493+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.MC6-_hX6UVGThyyE4s18Clrjutuenmi_0 2024-09-14T11:39:35.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.496+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15453785259353051619', time=2024-09-14T13:34:41.638443+0000, chain.objs.size()=1 2024-09-14T11:39:35.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.496+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.ndBgc9NHe6G3RQikf9fgHbQLS1dHQUr_0 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12015813208384118393', time=2024-09-14T13:34:41.639168+0000, chain.objs.size()=1 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.rKYCXshU88l-3l-QsYqf0Z_CTVrhNDN_0 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2659420539546314511', time=2024-09-14T13:34:42.718856+0000, chain.objs.size()=1 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.M58jubRJtJV71ujTsQpZf246wVfYLHy_0 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18358158750150446024', time=2024-09-14T13:34:42.722020+0000, chain.objs.size()=1 2024-09-14T11:39:35.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.497+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.mQUybCt97mp3TgzMu9UCanFF83CEz17_0 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1425177085660795523', time=2024-09-14T13:35:15.437298+0000, chain.objs.size()=1 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.81mrMrWhUaKdxMyNX4x9IjhTasUq3q4_0 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5912861067763320457', time=2024-09-14T13:35:48.521212+0000, chain.objs.size()=1 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.aGYb78OETgEVj1rRlZkmPQmEZyaEuhL_0 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3458124193073594804', time=2024-09-14T13:36:24.244442+0000, chain.objs.size()=1 2024-09-14T11:39:35.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.498+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.zarKMcyyueAAV1USVAqAs2isVu7-Cdk_0 2024-09-14T11:39:35.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.501+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.503+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:39:35.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.505+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.505+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1586181546938410619', time=2024-09-14T13:30:56.836427+0000, chain.objs.size()=1 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.YItx1ffB0gl8AY3DRD5mUdeTtpIHYA-_0 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.341665548257866098', time=2024-09-14T13:30:56.911502+0000, chain.objs.size()=3 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.1 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.2 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.3 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7107760359122030345', time=2024-09-14T13:32:24.161056+0000, chain.objs.size()=1 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.s5_ZfGxEdmtUgd1jsrBL134bNRNUq6K_0 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6533642081790690701', time=2024-09-14T13:32:58.245766+0000, chain.objs.size()=1 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.AloKlYUtfx7eQ6CPxTP0urz6Et5h8BK_0 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4565724975356975436', time=2024-09-14T13:33:32.846571+0000, chain.objs.size()=1 2024-09-14T11:39:35.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.T2AcmJAL27C50OSKxcfepdkR-qRWlaE_0 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.752553918182014110', time=2024-09-14T13:33:34.110546+0000, chain.objs.size()=1 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.QNrGEAkEX-MGM6PLbZXZxc3GAWAW5ti_0 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2174309771478423242', time=2024-09-14T13:34:06.245764+0000, chain.objs.size()=1 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.jgIZT2KvwAltJg9WCHobSiVfvjOEKuK_0 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3835611519927495987', time=2024-09-14T13:34:07.883174+0000, chain.objs.size()=1 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.4VUd6WAIcpjUCwga8DqzNd6PtaAGY_l_0 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6982283468878389334', time=2024-09-14T13:34:41.632370+0000, chain.objs.size()=1 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.DqeT3qKR3ItEMUguUxuipp4_UfsT4VF_0 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14269358475146564712', time=2024-09-14T13:34:41.633915+0000, chain.objs.size()=1 2024-09-14T11:39:35.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.506+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.xaew4xit0XUrMhBna9WRPWfVh4vt7d2_0 2024-09-14T11:39:35.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.508+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5445766129824333255', time=2024-09-14T13:34:42.712363+0000, chain.objs.size()=1 2024-09-14T11:39:35.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.508+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.2lre-6lfJOCNMCUbD_IDuVuAAsEG_1n_0 2024-09-14T11:39:35.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6569414512973816299', time=2024-09-14T13:34:42.713895+0000, chain.objs.size()=1 2024-09-14T11:39:35.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.DHdCCkuiKmKbTcaUJqqqmfcmSkWp1AM_0 2024-09-14T11:39:35.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13832506899906549178', time=2024-09-14T13:34:42.715177+0000, chain.objs.size()=1 2024-09-14T11:39:35.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.GVi3I0BvyU_sWI3UFNJoBtkklOaHKbz_0 2024-09-14T11:39:35.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8961570671081217954', time=2024-09-14T13:35:48.518605+0000, chain.objs.size()=1 2024-09-14T11:39:35.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.G8b94aVHjPtfRgRC5JnjsHzAZALJ1JY_0 2024-09-14T11:39:35.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9655438573060253211', time=2024-09-14T13:36:21.390212+0000, chain.objs.size()=1 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.yqOlujuIp1-GRLeNATTAZ54KV4R_0Qf_0 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12366369052032867085', time=2024-09-14T13:36:21.396755+0000, chain.objs.size()=1 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.kVJcGH50Wc38PkH6G_7_-htJEN9D4E__0 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.509+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4939573188745512949', time=2024-09-14T13:36:21.403555+0000, chain.objs.size()=1 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.510+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.LYPmnvx2FOnysWDhsNzLIucThbCi9ka_0 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.510+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9504304277270284585', time=2024-09-14T13:36:24.242871+0000, chain.objs.size()=1 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.510+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_._YTf3aHpoTHTNj7j1e30Ko1wKMuwRDF_0 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.510+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16651309047523048568', time=2024-09-14T13:39:13.762690+0000, chain.objs.size()=1 2024-09-14T11:39:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.510+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:h-ykNpXo7eT0EJzcmp9n5YBpGmHAHSv_.7fO-Rfs7YCM5n_bNFOK72etqL9J03-4_0 2024-09-14T11:39:35.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.514+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.516+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:39:35.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.517+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:39:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7872150644814064948', time=2024-09-14T13:32:58.255479+0000, chain.objs.size()=1 2024-09-14T11:39:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.VIO1xAHGFZUbhA-uT4oQEk_WRy-VFsR_0 2024-09-14T11:39:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9917214557526074699', time=2024-09-14T13:32:59.320159+0000, chain.objs.size()=1 2024-09-14T11:39:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.fVIBAzNlVK410Ah6noz3nLlbepXvt31_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12350841930114072824', time=2024-09-14T13:33:32.859179+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.nbiBT2sDQuJVYLHY6hZgA-BVYy4p83b_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1549083315548032834', time=2024-09-14T13:34:07.884553+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.JXis8hMjn8bYmjlAzPZH0MiMev1JKpv_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.518+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15827567037667558317', time=2024-09-14T13:34:39.836859+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.0-U630yceBftI4D_uc2rced3aiCw93g_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3903330608089008752', time=2024-09-14T13:34:39.837671+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.mjBYTpryShsDS0hC5HZnCSQ0fd1U5Ug_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8702690872299011175', time=2024-09-14T13:34:41.632747+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.iFQRJSHRSlzH6iyw8zzlMdCFN6gt1o0_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1758121552973473615', time=2024-09-14T13:34:41.637079+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.uj0DavqUz2c2KbNbtgpvS7V0axSaSc1_0 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7589843112895998594', time=2024-09-14T13:35:14.348362+0000, chain.objs.size()=1 2024-09-14T11:39:35.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.3nUOXsoRuXlioR0XrOA3G8LbIFsW2GE_0 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10650870302067993408', time=2024-09-14T13:35:49.688412+0000, chain.objs.size()=1 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.yw3ICTul2YLc9w9mGH3lM_3pJaFv15i_0 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2761274813135486650', time=2024-09-14T13:36:23.388700+0000, chain.objs.size()=1 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.-_W2EL3r26F6D_p9yiUdgRKgvOjmJ7A_0 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7817453099597661064', time=2024-09-14T13:36:55.779117+0000, chain.objs.size()=1 2024-09-14T11:39:35.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.519+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.GEHa6BCtfUp7H4UJ-8MDi3_aNOp-Lhb_0 2024-09-14T11:39:35.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.523+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6747843646898118175', time=2024-09-14T13:36:55.781553+0000, chain.objs.size()=1 2024-09-14T11:39:35.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.523+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.fVT1_1Q-51ApAXpJEhGswzLOuRS_mAE_0 2024-09-14T11:39:35.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.525+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.527+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:39:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.528+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11820451183711918061', time=2024-09-14T13:30:56.760801+0000, chain.objs.size()=4 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.1 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.2 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.3 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13__multipart_foo.2~o94LYUoh9dmX6YuP12PqjoHS6m4eLw7.4 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8701808936812922717', time=2024-09-14T13:30:56.848170+0000, chain.objs.size()=1 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.7lazgQEBsMVODjIDiDmoi5fw3VcZ3LW_0 2024-09-14T11:39:35.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11222963587404557701', time=2024-09-14T13:32:22.894263+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.mCMLgJSh_4blaNm64FYuOMqXhJbJLkz_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12379707613289865538', time=2024-09-14T13:32:24.152317+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.xn07olrgr7opWtBvy2OioehzhXBOQkn_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16971325489092844570', time=2024-09-14T13:32:24.153223+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.BKrY8Akzm-hJFCojA-c2gWLhqut7Xf3_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1756869515111781072', time=2024-09-14T13:32:24.160617+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.cAe_SALnq-TMjNmUMOzTTzrQ31TOVH8_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5211779061069600792', time=2024-09-14T13:32:56.274431+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.6krPJvdWnD1FmPfKvItLGbnCkfG0iyf_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1160958867042167602', time=2024-09-14T13:32:59.320902+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.3YnrGaKq19XS3f5nFsQ7JbkW7z2hctI_0 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6655961029668001286', time=2024-09-14T13:33:32.850149+0000, chain.objs.size()=1 2024-09-14T11:39:35.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.529+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.Rg_hGIJBW5hRTRrpGQp8RGY4uvn-5p8_0 2024-09-14T11:39:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.531+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10195141420449801081', time=2024-09-14T13:33:32.850783+0000, chain.objs.size()=1 2024-09-14T11:39:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.531+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.a_thQuo8gaJWBlBSF96liiqSiURrzhH_0 2024-09-14T11:39:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.532+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8204731574660023776', time=2024-09-14T13:33:32.856824+0000, chain.objs.size()=1 2024-09-14T11:39:35.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.532+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.2hMo1Nb3CUl0T3l0pGb0k2DS65jwgIg_0 2024-09-14T11:39:35.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.532+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11469814149513559604', time=2024-09-14T13:33:34.104959+0000, chain.objs.size()=1 2024-09-14T11:39:35.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.532+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.tVpNFj9PK__hNqjOSnRbBiiJ4h-NGnG_0 2024-09-14T11:39:35.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18429355343778215592', time=2024-09-14T13:34:41.642879+0000, chain.objs.size()=1 2024-09-14T11:39:35.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.Px73iLNS59iZuFj-hTlgI2NguXxcvpM_0 2024-09-14T11:39:35.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8160700092959205828', time=2024-09-14T13:35:16.368279+0000, chain.objs.size()=1 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.BfDdeDqZQ5cIxAmeGzj0p70SOj9c4uU_0 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15432092676518327344', time=2024-09-14T13:35:48.517089+0000, chain.objs.size()=1 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.ZHc78jUqNcPgskaJ6_tRsRaX9n7N2gg_0 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8279675324648464704', time=2024-09-14T13:35:48.525263+0000, chain.objs.size()=1 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.HBG2pMe1S8TgxdFASR547ylQXTxo0Xr_0 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14405024273632622330', time=2024-09-14T13:35:49.685912+0000, chain.objs.size()=1 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.y88aZkQrDZSeBLX5E6L2Jg7mJUlcZNz_0 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17588969262658251308', time=2024-09-14T13:36:23.395149+0000, chain.objs.size()=1 2024-09-14T11:39:35.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.534+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.M0_pptnwKg9F5oTaXv6zNo7c2k7WK2q_0 2024-09-14T11:39:35.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.537+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.540+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:39:35.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.541+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16433893767315025805', time=2024-09-14T13:32:24.153186+0000, chain.objs.size()=1 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.8Bbv20uOwCZQli48vvmJXe0IVgzqIpf_0 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8027928233871289081', time=2024-09-14T13:32:24.153969+0000, chain.objs.size()=1 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.WVELzTRMP4wKJ5v_RE6w4vS7K8ueRBM_0 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2034316718776793121', time=2024-09-14T13:32:24.161506+0000, chain.objs.size()=1 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.pgR080Ypx0fDh_TQ3nesATS_wobO6yA_0 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13858194945989357004', time=2024-09-14T13:32:59.317497+0000, chain.objs.size()=1 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.0aEx6u3SHI5YcRR5KLMVRDBtVgjisUu_0 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2221097718188366007', time=2024-09-14T13:32:59.329130+0000, chain.objs.size()=1 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.LPclbdY9gCsVAKynrNEFaTqb66DSDb8_0 2024-09-14T11:39:35.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4038965658663563510', time=2024-09-14T13:33:00.349021+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.x2QslZnldeR2IlJfabF1ygc6RAYp0sf_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.205102554147501004', time=2024-09-14T13:33:32.844183+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.BykO_Zat034blXtirm4KhmciV4idDpG_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16435699733591082427', time=2024-09-14T13:34:39.837905+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.1XPnkCUtvMAIsYZN2yVsjGAmJzlbvC9_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1840030495194092628', time=2024-09-14T13:35:16.373722+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.FQO_0SPRN7NgQBKeP4h78vABKWhk_rp_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17062830066785699892', time=2024-09-14T13:35:16.377581+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.6Xq0k_0isCeJ31vdcUJLfdg1D2C9OoF_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14492264619805699340', time=2024-09-14T13:35:17.408299+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.xxE94dSfRVwFNFaPUlYUBP333vT32tN_0 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15504386864070193795', time=2024-09-14T13:35:48.525598+0000, chain.objs.size()=1 2024-09-14T11:39:35.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.542+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.J4VRE7ya8tdtZD0A1hFWBOdRq7NXKeF_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5861933246989831704', time=2024-09-14T13:35:49.689378+0000, chain.objs.size()=1 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.4Jk3TyISfQL6v71W34Y-4V-3skchoKc_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15780916743589152399', time=2024-09-14T13:36:21.390933+0000, chain.objs.size()=1 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.EKK1Np_IXgeoEV9VyRzZZ_y_bgdpl-B_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4226107972878869999', time=2024-09-14T13:36:21.391917+0000, chain.objs.size()=1 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.8ZKcpv41WgwlfJROOmAxY3fHsjrIrsA_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.761334338859719412', time=2024-09-14T13:36:21.394758+0000, chain.objs.size()=1 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.4s2-e6qSs56YxXq0XihCznHo5Cc36Ey_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2700427485903943299', time=2024-09-14T13:36:23.386347+0000, chain.objs.size()=1 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.atSc-hSnnDI0Mc7liw0jsiJKEoPOnp2_0 2024-09-14T11:39:35.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14089439822022992094', time=2024-09-14T13:36:24.244780+0000, chain.objs.size()=1 2024-09-14T11:39:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.546+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.9ev9WaYSpvVc1LKyee-1SZSrpQB0k4n_0 2024-09-14T11:39:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.547+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1617756289050811369', time=2024-09-14T13:39:01.763603+0000, chain.objs.size()=1 2024-09-14T11:39:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.547+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.qJAvyyvIkt30WSt48HvW02qgHinPLnt_0 2024-09-14T11:39:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.547+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12376674668334902430', time=2024-09-14T13:39:09.194547+0000, chain.objs.size()=1 2024-09-14T11:39:35.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.547+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:TKCXZ.jkxlPIK0uXbWto25HskOuciae_.y_c1kIynR6MoE_FiHffpS7z7z6yPRvS_0 2024-09-14T11:39:35.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.551+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.553+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:39:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14207390513458564241', time=2024-09-14T13:30:56.808775+0000, chain.objs.size()=4 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.1 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.2 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.3 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10__multipart_foo.2~1DG97kI-XUwbLcoB3USRCgrKiqwWKH_.4 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.384935773260551923', time=2024-09-14T13:30:56.964762+0000, chain.objs.size()=3 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.1 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.2 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-LUKEWARM.2~hd8JXKFkq8EPoTI3HHq1lRPpRNV5xvh.3 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6701904461087249118', time=2024-09-14T13:32:22.894447+0000, chain.objs.size()=1 2024-09-14T11:39:35.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.555+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.Z5juY_xbmYHoAJkOkylS9P9bllTufTB_0 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4935278928726917144', time=2024-09-14T13:32:22.895714+0000, chain.objs.size()=1 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.ymSrjv-A4c63x3wMLbmXFExMp3j3W4J_0 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14555958433117856815', time=2024-09-14T13:32:22.903758+0000, chain.objs.size()=1 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.eFkCxw4sGo7MOfRaXGONrciVPKaol9X_0 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18261935072424344295', time=2024-09-14T13:32:58.248648+0000, chain.objs.size()=1 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.U8nKKiykD1kic2ZU9m-rALHbHBq0c6A_0 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5749439433663168632', time=2024-09-14T13:33:34.103303+0000, chain.objs.size()=1 2024-09-14T11:39:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.556+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.XqBRg__PHlwp1C61PiY2lPItgJf-NTS_0 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14532233174531719549', time=2024-09-14T13:33:34.105296+0000, chain.objs.size()=1 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.D_2aGvcBt0ks_WZOSGoZYBITM3YaJQR_0 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5524156618040057661', time=2024-09-14T13:33:34.116085+0000, chain.objs.size()=1 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.HCiNatJKpGqxn3NPxIlPHkn-qAja7CH_0 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17651868926007854865', time=2024-09-14T13:34:06.236207+0000, chain.objs.size()=1 2024-09-14T11:39:35.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.559+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.Pp3uT9Huly08_W81qix-1Q-PruM8Fyi_0 2024-09-14T11:39:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3643780488515352135', time=2024-09-14T13:34:06.239762+0000, chain.objs.size()=1 2024-09-14T11:39:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.ho9gTHFBdrjljz3Em9_JTbd7LnvcHAv_0 2024-09-14T11:39:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8117047391683305732', time=2024-09-14T13:34:07.156723+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.XuX03cYHnV1RxSIuEmrfB4nw0mCk3ga_0 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16648977572853606063', time=2024-09-14T13:34:39.837770+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.bX4aquX37FFwTLj94KLcWpOjP58Lir2_0 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20874552667132997', time=2024-09-14T13:34:41.643820+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.560+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.mMa_zjLw_qg7HGcplZSOyu51I-avb3y_0 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18201844333224948245', time=2024-09-14T13:35:14.346377+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.xZoRIhJ0y9SgJNLdip-snIi__2cl6uo_0 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13931562795720272106', time=2024-09-14T13:36:21.404101+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.ETKfAl9r-E9M8sqQD67Sc9cvmPFf2A4_0 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9377800707862505657', time=2024-09-14T13:36:23.388277+0000, chain.objs.size()=1 2024-09-14T11:39:35.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.561+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.T8z3drlUlHrvQ8KtZWVsj89R51qRfBW_0 2024-09-14T11:39:35.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.564+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.567+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:39:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.568+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.568+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:39:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18022353528764144076', time=2024-09-14T13:30:56.899492+0000, chain.objs.size()=3 2024-09-14T11:39:35.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.1 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.2 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.3 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14727069055150399910', time=2024-09-14T13:30:56.960647+0000, chain.objs.size()=3 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.1 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.2 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-STANDARD.2~dDNH623S8FlfxQBTSWzBZ2ZH9Xyx9bf.3 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9566850532912805679', time=2024-09-14T13:32:22.896905+0000, chain.objs.size()=1 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.lRKBNU2LFokMnldtcozkrdIXAvPiLcb_0 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8122963089706533228', time=2024-09-14T13:32:24.152310+0000, chain.objs.size()=1 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.2vyhc6o4ZdwXvRtnTDeh1Vi5cVp_Oav_0 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11111252151442982007', time=2024-09-14T13:32:24.155897+0000, chain.objs.size()=1 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.m1GE_v-YnGfMC2Wqh47ekFjg91yP-g-_0 2024-09-14T11:39:35.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2964422987250590590', time=2024-09-14T13:32:24.156709+0000, chain.objs.size()=1 2024-09-14T11:39:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.8GfH3CIsY_rztTilqNXyTaFzeuEoUS7_0 2024-09-14T11:39:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15718034451370729965', time=2024-09-14T13:32:58.255897+0000, chain.objs.size()=1 2024-09-14T11:39:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.mQ_71GSuwYBw9IUdH--Oq15ORONG0sh_0 2024-09-14T11:39:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4974528412253720768', time=2024-09-14T13:33:31.038925+0000, chain.objs.size()=1 2024-09-14T11:39:35.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.569+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.lDenAbyQKU-01Q8j4XMEQajMlxoluvU_0 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14223763222270779482', time=2024-09-14T13:33:31.039758+0000, chain.objs.size()=1 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.2HIdFbwWoPw4M3hnKGTl8KyKqnOu3cG_0 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11831042623734262700', time=2024-09-14T13:33:34.111168+0000, chain.objs.size()=1 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.D5QMQ9Ayy26TCp2sfM1YkhHB145LET1_0 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8114996850875624234', time=2024-09-14T13:34:06.236963+0000, chain.objs.size()=1 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.-A2yIHm5XDs9u5MVyKXIMnmqm18IeJT_0 2024-09-14T11:39:35.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3171906518100476202', time=2024-09-14T13:34:06.241326+0000, chain.objs.size()=1 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.X-pITOWRxnEx7JfQeZvGOkL9bQGj1d8_0 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14475821713498676435', time=2024-09-14T13:34:39.837225+0000, chain.objs.size()=1 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.bzyWSyPJ_jiFrzlFowtB7adKFQBmjr7_0 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6280960040183726603', time=2024-09-14T13:34:39.840970+0000, chain.objs.size()=1 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.byHp5_VW96Ib7AHqjjowWrtTrG-J4SI_0 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14436035893881202902', time=2024-09-14T13:34:41.642793+0000, chain.objs.size()=1 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.asrizmj2WIqysvnlAfNR74pnmTJlDUT_0 2024-09-14T11:39:35.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9719119613039716242', time=2024-09-14T13:35:48.519354+0000, chain.objs.size()=1 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.XGThnXrUWkyL0AoO0D-0Hl9ntmSRA-2_0 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9442181354097096087', time=2024-09-14T13:35:49.694130+0000, chain.objs.size()=1 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.zhUSNGRlHqSGJQxzlae_hKPAkKSgjF7_0 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11394541943625799620', time=2024-09-14T13:35:49.694861+0000, chain.objs.size()=1 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.xxBLINYTVAXOtKYS1t3LxYl90_VM3s8_0 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5920296949144820694', time=2024-09-14T13:35:49.695793+0000, chain.objs.size()=1 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.573+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.-aESS_UlIez0nqLJPD6JPIUDFEZiSJR_0 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.575+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2877559132266965340', time=2024-09-14T13:36:21.389458+0000, chain.objs.size()=1 2024-09-14T11:39:35.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.575+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.y71lfXAu-hP1SmmtMdc5q4LIc35NFUJ_0 2024-09-14T11:39:35.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.575+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18023892945136457079', time=2024-09-14T13:36:21.394998+0000, chain.objs.size()=1 2024-09-14T11:39:35.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.575+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.wTiNFeGor01o45mHfTIB4ErmYdyLTDB_0 2024-09-14T11:39:35.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.576+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16653867008327783524', time=2024-09-14T13:36:21.395696+0000, chain.objs.size()=1 2024-09-14T11:39:35.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.576+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.nEBEQAjTxnihaA27K0mMtlMe6RcP7BG_0 2024-09-14T11:39:35.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.578+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18076088974450049465', time=2024-09-14T13:39:01.762835+0000, chain.objs.size()=1 2024-09-14T11:39:35.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.578+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.E6MkOZ9tXi4YrRub5p9jQjIVeURaVPk_0 2024-09-14T11:39:35.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.580+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.583+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:39:35.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.584+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_p5vDblHp041tuq1X2byOd6lnG_Q6lvb', time=2024-09-14T13:30:56.828115+0000, chain.objs.size()=1 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.lRstEWY9XrtRP8XuGHXi8LVyCbekqXu_0 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_Uvg_f7fY4r18HGlH8N1wq6DXOhEZA7B', time=2024-09-14T13:30:56.903644+0000, chain.objs.size()=2 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.58lMfxOpkKE-NNzNfn1HcKOcbPwOmqz_0 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.58lMfxOpkKE-NNzNfn1HcKOcbPwOmqz_1 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13712338768223072473', time=2024-09-14T13:32:56.277316+0000, chain.objs.size()=1 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.DtI0o1dn6klFkgVOOLjC5EC1oQPPYvs_0 2024-09-14T11:39:35.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10972093095574844831', time=2024-09-14T13:32:59.329439+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.RgQqfhxkhnRu6ckhcVA2QLV4tGf3zHW_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1117797889682509987', time=2024-09-14T13:33:32.849899+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.xWlWIEaNFqtLDsTWU1i1K-7PV3V44mC_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2030662690920783365', time=2024-09-14T13:33:34.108574+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.T3lVbnOQ46p518O2R9pFednEa4CWkIB_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2826929335163859374', time=2024-09-14T13:33:34.109782+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_._aeEkm3zaJY_HWhUFQJEKgVdOURCvPG_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4145386669276342159', time=2024-09-14T13:34:07.888418+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.satkje-agAKDppM9nGEXVnpuMOKGu72_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6996885707449518784', time=2024-09-14T13:34:39.841935+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.i2L74JPt5LcEB17qvhE5sR8nuXcInKV_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16569896134957080301', time=2024-09-14T13:34:41.104684+0000, chain.objs.size()=1 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.585+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.4Epi9-0_sZz3yxYuiFtPyWJUI8Yf46F_0 2024-09-14T11:39:35.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.586+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11884719859272889071', time=2024-09-14T13:34:41.636873+0000, chain.objs.size()=1 2024-09-14T11:39:35.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.586+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.Q2fiEeZmoZxdUmdfu6O28lkWxeqT1u1_0 2024-09-14T11:39:35.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.589+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5259248158415761068', time=2024-09-14T13:35:14.350191+0000, chain.objs.size()=1 2024-09-14T11:39:35.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.589+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.-eHZ3fubdTlynpEIjB-qFfhe7KxVzQt_0 2024-09-14T11:39:35.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.589+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.927274226481230223', time=2024-09-14T13:35:16.369846+0000, chain.objs.size()=1 2024-09-14T11:39:35.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.589+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.DQqJMyNwmID6wBrbN_dtiLCL3_CZvyP_0 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4427983018530349289', time=2024-09-14T13:35:48.518556+0000, chain.objs.size()=1 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.itcumVhEqEfRAfGiX0a_DqmaAZmXiIM_0 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8891962738158665938', time=2024-09-14T13:35:49.685581+0000, chain.objs.size()=1 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.0Ot6G3me-UKFtJxsfFQQ9NRgnGW2TVX_0 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8020096935378844795', time=2024-09-14T13:36:55.776678+0000, chain.objs.size()=1 2024-09-14T11:39:35.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.590+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.7xGtrhxukhYOcwfVIrwyRpk-hAf44Pm_0 2024-09-14T11:39:35.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.592+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.594+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:39:35.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.595+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12332320204713420123', time=2024-09-14T13:30:56.711345+0000, chain.objs.size()=1 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.ArX_8Zb60aI3UKery6d15RqV7KIj5Fb_0 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_31C-jMbRNbMx4kCBsXydRUxTowS3KEH', time=2024-09-14T13:30:56.891446+0000, chain.objs.size()=1 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.yXwqsBWIpsNX06_qWYQQfn_0xjAwWLu_0 2024-09-14T11:39:35.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_iJ9YZ5MpH-vpSVB-Q6WDOyo9HudASIM', time=2024-09-14T13:30:56.931448+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.XA1hEmiMyw7X_NJ6F-g5dZf7AsZ3-0y_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5241559177855820407', time=2024-09-14T13:32:24.148719+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.ue--MnnA4MsBdXGDGqcGYnxhbJsxFvC_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11192573934827210413', time=2024-09-14T13:32:24.150202+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.isCbUo3-Mt_re-7I3Ov3olwuxhY9jHp_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16695824096933405309', time=2024-09-14T13:32:58.251309+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.CBKAqoA8o9nwgKmubnVgCAtdOW0wN73_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8443326326829516906', time=2024-09-14T13:32:59.327613+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.OBK2ZsY7u-BR62WPlWw6LVW77Js1qxM_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15417978539030176164', time=2024-09-14T13:33:31.044358+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.y34exojeo9KwPIjABlYTs2GcxBigR54_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4761087195451733798', time=2024-09-14T13:33:32.846577+0000, chain.objs.size()=1 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.jqGDJs32zF7WCfRdHYWwsArKbIEMVHd_0 2024-09-14T11:39:35.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9331154964337559646', time=2024-09-14T13:34:39.839400+0000, chain.objs.size()=1 2024-09-14T11:39:35.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.jejZ1GhejChA60w29Hy9tFPDsKY50Un_0 2024-09-14T11:39:35.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2294814768672976145', time=2024-09-14T13:35:14.350855+0000, chain.objs.size()=1 2024-09-14T11:39:35.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.OntPD7lMQLG0OB8Of21r-wsEpVFse4i_0 2024-09-14T11:39:35.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8272200159041177738', time=2024-09-14T13:35:16.369484+0000, chain.objs.size()=1 2024-09-14T11:39:35.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.596+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.PcFXztXC3q0dWja4iI3_sfHGwdawIuD_0 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6386092608507133453', time=2024-09-14T13:35:16.371266+0000, chain.objs.size()=1 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.oqEgrWXl_VOTvOH6YtZRj0jM5cYFwn8_0 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12852562297769166570', time=2024-09-14T13:35:16.380028+0000, chain.objs.size()=1 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.AWaGKiMBCJTsWB1k9L9cZIzmGhKAwz2_0 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6894745509207516060', time=2024-09-14T13:35:49.683909+0000, chain.objs.size()=1 2024-09-14T11:39:35.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.qHC50n5a3jb7rKwd1CyQmKt7HBUg7DA_0 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2485151436124793675', time=2024-09-14T13:35:49.688906+0000, chain.objs.size()=1 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.sZAxn6m9rG1GEncdT-SL2YsWy0p29Qx_0 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6489852866058477042', time=2024-09-14T13:36:23.385625+0000, chain.objs.size()=1 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.0JZ3mXDg4I2c6XuP_1zueL95jO7DtJb_0 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.313359600337695987', time=2024-09-14T13:36:23.386357+0000, chain.objs.size()=1 2024-09-14T11:39:35.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.600+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.P0-iBL6vPMqUlxlanCWX4eAPAV1j1gC_0 2024-09-14T11:39:35.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.603+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.605+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:39:35.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.606+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.607+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_4-7W-P5uNYXThhQQpPp9NbzqHYV-_lT', time=2024-09-14T13:30:56.840382+0000, chain.objs.size()=1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.1cNQPxYHlJNg-VS8H3uM4bbpQLDNNvR_0 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='__XJJnEQltXwyAVzQKdKmtM2d4_Kgbu6', time=2024-09-14T13:30:56.907387+0000, chain.objs.size()=2 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.KuANZ7qpa8E5IoKiE3iAYIflfenN989_0 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.KuANZ7qpa8E5IoKiE3iAYIflfenN989_1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11287630581349567957', time=2024-09-14T13:32:22.897468+0000, chain.objs.size()=1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.XpUdLouYzQG4iGTWd2vzlIIsUdlzPS__0 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17187500100306589778', time=2024-09-14T13:32:22.905072+0000, chain.objs.size()=1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.LaEtlucf40t8FoPPq9Gk1qarRn0UssH_0 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3565803980404487510', time=2024-09-14T13:32:24.152624+0000, chain.objs.size()=1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.mLdcZ-gI9OodQnQTb7UoGWQys_O5wBh_0 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11331979755677417719', time=2024-09-14T13:32:59.316317+0000, chain.objs.size()=1 2024-09-14T11:39:35.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.utd9oiuhl-g4Zg_WR936hOGQu7enKui_0 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3992368001968761075', time=2024-09-14T13:33:31.046041+0000, chain.objs.size()=1 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.2xO29NZraBqDD_OQEYg6DIvR7RLojwP_0 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4932931055743998725', time=2024-09-14T13:34:06.243207+0000, chain.objs.size()=1 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.QTPaziDITBpmalJGEvW3-NBq4s7QBpt_0 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12206918711063183489', time=2024-09-14T13:34:39.835566+0000, chain.objs.size()=1 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.RF_7P7fD0DBp-upGtUO3WPEbd22HVLn_0 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16358941807432353058', time=2024-09-14T13:35:14.357120+0000, chain.objs.size()=1 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.49LR_Q3upfsXHVJkDBvAJwPM3RwNnCz_0 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11666177141326957278', time=2024-09-14T13:35:16.368862+0000, chain.objs.size()=1 2024-09-14T11:39:35.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.608+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.uaav-byk6_LjqBMMnG1NUv68jZaj2V7_0 2024-09-14T11:39:35.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.612+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3013916672861474665', time=2024-09-14T13:35:49.685529+0000, chain.objs.size()=1 2024-09-14T11:39:35.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.612+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.YhLCb9d6qWOFOq8Qo-NbCHAKu8jn2li_0 2024-09-14T11:39:35.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.612+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10496650417496956832', time=2024-09-14T13:36:24.243067+0000, chain.objs.size()=1 2024-09-14T11:39:35.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.612+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.FLFn_BZVhE6DsNv6fNEjcuAS1N7UoVg_0 2024-09-14T11:39:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.613+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15154490305208066974', time=2024-09-14T13:39:13.762562+0000, chain.objs.size()=1 2024-09-14T11:39:35.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.613+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:RtvUV.K4AJkANwjhmRtlScVfem13L0T_.KEJ0su96zpPzDsvolU0-U0gtQXeab4R_0 2024-09-14T11:39:35.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.615+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.617+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:39:35.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.618+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.618+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:39:35.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11604008661079158838', time=2024-09-14T13:30:56.785450+0000, chain.objs.size()=4 2024-09-14T11:39:35.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.2 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.3 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11__multipart_foo.2~--NYhEFp-KCu_aMEUAg7PgMKaXmM1-K.4 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17968043484971997677', time=2024-09-14T13:30:56.864246+0000, chain.objs.size()=1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pa6iv4RFgvPgheyRWwjhw2RbvrnD-zt_0 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13462349065114206159', time=2024-09-14T13:32:24.154051+0000, chain.objs.size()=1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.89bU9g2_hpAJ6TLCgFbA1tVvo_4p-Nb_0 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15427661483280829641', time=2024-09-14T13:32:56.270011+0000, chain.objs.size()=1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.wSKD_UvonPhPM6KMMcJrb-IURIRviCh_0 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12551589804317716062', time=2024-09-14T13:32:56.274918+0000, chain.objs.size()=1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.jfxt5msjX-BQtd0QwDzQBbErNQcj8QT_0 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4754924272881339230', time=2024-09-14T13:33:34.108497+0000, chain.objs.size()=1 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.Fo17npG144irhEqLX8P2mpUIzL_22X8_0 2024-09-14T11:39:35.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12869006881274043268', time=2024-09-14T13:35:14.342955+0000, chain.objs.size()=1 2024-09-14T11:39:35.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.gdD7s0G48HD8pRfCShFbW-wJkG9WBCV_0 2024-09-14T11:39:35.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5092993969070450536', time=2024-09-14T13:35:50.720281+0000, chain.objs.size()=1 2024-09-14T11:39:35.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.wd-2FGJzLTq2CklHTb9gqTLEH8CDH3J_0 2024-09-14T11:39:35.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1354955375633737965', time=2024-09-14T13:36:23.385933+0000, chain.objs.size()=1 2024-09-14T11:39:35.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.619+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.bYdBetqqQqcTJr9pCPlZi75c952VBuc_0 2024-09-14T11:39:35.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.623+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.625+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:39:35.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.626+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3421872134844261668', time=2024-09-14T13:30:56.856143+0000, chain.objs.size()=1 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pa6iv4RFgvPgheyRWwjhw2RbvrnD-zt_0 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10333258511245575886', time=2024-09-14T13:30:56.923252+0000, chain.objs.size()=3 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.1 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.2 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-STANDARD.2~vCXie13N7-ehS6LIxFd3dvCS5fMeWbh.3 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9665438902845373723', time=2024-09-14T13:33:32.849593+0000, chain.objs.size()=1 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.xd1JR7nQ3XEKrpZ3lYBXRnpkdhYkARI_0 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6510861674011430240', time=2024-09-14T13:34:06.240172+0000, chain.objs.size()=1 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.hgRqhafK0DdKB_Xc4dOp-sgfTm24ac-_0 2024-09-14T11:39:35.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14824299850459013179', time=2024-09-14T13:34:07.884169+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.OMyYZOLbVZ_2fzgQ_zdStAqKH15Negx_0 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10389300743935732898', time=2024-09-14T13:34:07.888411+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.g3EMyJImf2G13mhf9MR5UVFVFDQLlw7_0 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12299396379193855760', time=2024-09-14T13:34:07.894407+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.dUwhPi0qSOTOih2F_bC3AToTzWTEEeD_0 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10746421303194648358', time=2024-09-14T13:34:39.838125+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.7jOMdSNEyLiI7ujxwvY3xHrDZuFFhCK_0 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.888406147624898017', time=2024-09-14T13:34:41.635934+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.HD3ByoDCT5GFoz9DqewcV82WtVjT136_0 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1677106707534008399', time=2024-09-14T13:35:13.594175+0000, chain.objs.size()=1 2024-09-14T11:39:35.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.627+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.nuCWTMJkE2-g3wol7Jsc7CJEy7nexqH_0 2024-09-14T11:39:35.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16935148170321793999', time=2024-09-14T13:35:14.350007+0000, chain.objs.size()=1 2024-09-14T11:39:35.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.UaRUEHvZ5-axvkk_bO0wp_mvHP83_r6_0 2024-09-14T11:39:35.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16619282791292870503', time=2024-09-14T13:35:16.368120+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.csM1oIgC43eeyqt_E8iaBIhsQCq9Ahu_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15472810805540015356', time=2024-09-14T13:35:16.368763+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.ZcidxPYNY3_BwxRxlpvqfVYE4_Y0kL5_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2229782164923326286', time=2024-09-14T13:35:16.369648+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.630+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.h8iYCogASXmNWEr5BOJ7qVv-oUZN8jh_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3863332926814327698', time=2024-09-14T13:35:48.514401+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.g5VgFTa6vFoaVqaa9GaEl-tfn3Q2Adp_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2155896286543103100', time=2024-09-14T13:35:49.689330+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.86MCukSSk79PiPnhxfeWKvs0f2xos1L_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3821009710856457137', time=2024-09-14T13:36:24.249595+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.XGgyhJPQjIOU24P_ycPRWHBe21ANUGy_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13921827712306137048', time=2024-09-14T13:36:55.779253+0000, chain.objs.size()=1 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.cLYmIgJEAwNMd4xwk0UcAFWcW58MHlt_0 2024-09-14T11:39:35.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9392560987434489542', time=2024-09-14T13:36:55.779995+0000, chain.objs.size()=1 2024-09-14T11:39:35.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.631+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.BYdKxsO-SELOnK4xD9dW8pg8LvqBnvG_0 2024-09-14T11:39:35.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.632+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6242832741608707165', time=2024-09-14T13:39:01.762586+0000, chain.objs.size()=1 2024-09-14T11:39:35.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.632+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.IVfjtyuuFA1FOf8LOS63XNlDhdseSXU_0 2024-09-14T11:39:35.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.635+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.637+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:39:35.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.638+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5664474445825196784', time=2024-09-14T13:30:56.719710+0000, chain.objs.size()=1 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.q7AkZchysgIBRhcZ6DK0XW7uOT4dGYX_0 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_C2tnharcgui9RTyWAJweyq602Zyml90', time=2024-09-14T13:30:56.852039+0000, chain.objs.size()=1 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.Pl8my19GPILagsKvz0x7VD4V80dzfZ1_0 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4961232178230650945', time=2024-09-14T13:30:56.872339+0000, chain.objs.size()=1 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.YItx1ffB0gl8AY3DRD5mUdeTtpIHYA-_0 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15698392873203768230', time=2024-09-14T13:30:57.036766+0000, chain.objs.size()=1 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.8R3hP436MrZS1E-fqEOeLeSQLBsEmlX_0 2024-09-14T11:39:35.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10941210132078403489', time=2024-09-14T13:32:22.159288+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.jj-aLlfI0Y2kKuHiWOQC3JRwbAYpO51_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1087367561299082426', time=2024-09-14T13:32:22.892660+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.Ibp8Q5FG4lDzdIEXJyUtbE5T7bM8m8y_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17694771670733006524', time=2024-09-14T13:32:22.894362+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.zrDWkLtBgKjPusTrk610qKVR3lLl2Aw_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12162520767000029291', time=2024-09-14T13:32:59.317907+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.OXNDtjVc5zcJEf5VU3L0Qqr_XU1d_lX_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4427707541467222549', time=2024-09-14T13:33:31.053460+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.w1pmKg-mF4PgdIMRSsr0nenJpdl_IE5_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4978842369146488295', time=2024-09-14T13:34:39.837365+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.eGQ2sItI9chwEQHQfUWOjzv5cq4l0k1_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10716649121422602578', time=2024-09-14T13:35:14.351787+0000, chain.objs.size()=1 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.JByzsGlKM1gP2mW6Gnj6izQwLHxZY1p_0 2024-09-14T11:39:35.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1537068473570347611', time=2024-09-14T13:35:48.519390+0000, chain.objs.size()=1 2024-09-14T11:39:35.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.639+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.vGNDIalOm3VwWDhImpstKSh_d0iZNiO_0 2024-09-14T11:39:35.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.642+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14232058148931039650', time=2024-09-14T13:36:21.395242+0000, chain.objs.size()=1 2024-09-14T11:39:35.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.642+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_._i7V9bNYVXdvXk3dv-eKhzfCMP9nkcc_0 2024-09-14T11:39:35.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.642+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1805291308083989768', time=2024-09-14T13:36:21.401937+0000, chain.objs.size()=1 2024-09-14T11:39:35.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.642+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.xGvq6hEeZh-dORupk4aiSrVpKgxvx2L_0 2024-09-14T11:39:35.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.643+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11174578115107527400', time=2024-09-14T13:36:24.249889+0000, chain.objs.size()=1 2024-09-14T11:39:35.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.643+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.obpBrDIyrQ0AF4fCdkC70rZ4T5eGCea_0 2024-09-14T11:39:35.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.643+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7609835938384570268', time=2024-09-14T13:36:24.255096+0000, chain.objs.size()=1 2024-09-14T11:39:35.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.643+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.axz25oBhsLgUSJN6TnPnF0EQViihIyD_0 2024-09-14T11:39:35.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.646+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.648+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:39:35.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.649+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.649+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:39:35.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16622485588501179546', time=2024-09-14T13:30:56.689999+0000, chain.objs.size()=1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.OlVsF8ml0nRlgVsPbsfwDnxA9Az4orS_0 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17168079802733822422', time=2024-09-14T13:30:56.741437+0000, chain.objs.size()=4 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.2 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.3 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12__multipart_foo.2~j6WtCOxjeQXNhTjid6mc0K6YBdccVvq.4 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7455521943901181873', time=2024-09-14T13:30:57.077471+0000, chain.objs.size()=1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.3L_uUDGZBy2oEWWmsWcza9XR09TuDSV_0 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6175557331335818718', time=2024-09-14T13:32:56.276233+0000, chain.objs.size()=1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.LckeyA4ZHc_qca1Y3wv8TAfJhyWBXjx_0 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4528250128222119617', time=2024-09-14T13:33:32.856499+0000, chain.objs.size()=1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.OfeNGw_NjS_GQ-pa5-HCWe8vLjlv4LU_0 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10884894376550548773', time=2024-09-14T13:34:06.238140+0000, chain.objs.size()=1 2024-09-14T11:39:35.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.xMXc9zjpJYDJhWtKImkCYmb83BWw4hc_0 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18095536044910964372', time=2024-09-14T13:34:07.883414+0000, chain.objs.size()=1 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.j-S9BupYGbasAme5TfQC2DQg5I6lPPS_0 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10515082235643644235', time=2024-09-14T13:34:07.888554+0000, chain.objs.size()=1 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.8sZz7lyLLlHomTnpMajnxlGg0UvjV_Y_0 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18286776369815969261', time=2024-09-14T13:34:42.713146+0000, chain.objs.size()=1 2024-09-14T11:39:35.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.650+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.icy-dfmo1TCxy7WGVdStn1hXKSzrUO1_0 2024-09-14T11:39:35.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.653+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9876681038380828832', time=2024-09-14T13:35:14.357241+0000, chain.objs.size()=1 2024-09-14T11:39:35.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.653+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.gh5sDVT0OyhZR4TFOuz0udjJL1hDsJz_0 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14144375761264700314', time=2024-09-14T13:35:48.514692+0000, chain.objs.size()=1 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.TTnQABAcHKpVUXXSdZ0bfyXr8-t0Sem_0 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16403836118307729123', time=2024-09-14T13:35:48.518849+0000, chain.objs.size()=1 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.Gf6umakw1SCdoRHGa6FA487Nl20mDgY_0 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1831977920402471675', time=2024-09-14T13:36:23.385785+0000, chain.objs.size()=1 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.Sb1z8a_1nb6n1xG4hRBt_jaVBDuFYb6_0 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10164473211293677451', time=2024-09-14T13:36:24.247610+0000, chain.objs.size()=1 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.iEV6H9EdFL9KbW8M_YjrgaBQZSsAurv_0 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14128587288540759147', time=2024-09-14T13:39:01.763509+0000, chain.objs.size()=1 2024-09-14T11:39:35.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.654+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.X2UGNg_c1Ap0V89Czaj1hzJi96meYEv_0 2024-09-14T11:39:35.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.657+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.659+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:39:35.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_jd6si1HAM92cxTBY7S5rK_Nr3Jc-joi', time=2024-09-14T13:30:56.895664+0000, chain.objs.size()=2 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_._yuZEGGNCIYg4h5OW5hgoyf_kevWuuJ_0 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_._yuZEGGNCIYg4h5OW5hgoyf_kevWuuJ_1 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6245505711800219342', time=2024-09-14T13:32:58.250505+0000, chain.objs.size()=1 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.u528zzP_wFyWZeKPi-kzCdN3uL6DazN_0 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8840906889850670684', time=2024-09-14T13:32:58.252347+0000, chain.objs.size()=1 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.8dLpoOgMEZePGJNcMsxV7a_ypi_mLAB_0 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6151548965617445203', time=2024-09-14T13:32:58.257413+0000, chain.objs.size()=1 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.iT_-eLZcbUpfi9jrEwxeRQDZcO-wxQQ_0 2024-09-14T11:39:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.558366286345110847', time=2024-09-14T13:32:59.331968+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.oc_uEXf54vo9Sv16w8erWD6zQ1K72Mp_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11602458301044520541', time=2024-09-14T13:33:31.038474+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_._TKx31jfVq4ZV1nO2Rpjw594cfvEz0h_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10361334567094751894', time=2024-09-14T13:33:31.042460+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.cNnaUhNzTXq4SUz5B_jebjyknGX2YoM_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15287221540029914320', time=2024-09-14T13:33:32.843989+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.ySbwSFEyeCqCoH8n1mOKMcnS9BKO6NW_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10445772390816471790', time=2024-09-14T13:34:07.880658+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.XUv-Wjda8qZWqutdMCTpHZevUbDnB89_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2614853327349937594', time=2024-09-14T13:34:42.721965+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.GlqriB24rGnBB3dcSepdsUbXifytV8C_0 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13481326032693422583', time=2024-09-14T13:35:14.348371+0000, chain.objs.size()=1 2024-09-14T11:39:35.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.661+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.sVYbdJv7prb312r99y5NCSbL22MkSl4_0 2024-09-14T11:39:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.664+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5139473730137866918', time=2024-09-14T13:35:48.516736+0000, chain.objs.size()=1 2024-09-14T11:39:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.664+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.LaIj0j5n7h1ZnZbdiPmWQlCIjPAEujg_0 2024-09-14T11:39:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.664+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11536044596803453292', time=2024-09-14T13:36:23.385877+0000, chain.objs.size()=1 2024-09-14T11:39:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.664+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.MKVGs9rptsmNayQawxEmpGOkkcoMzMg_0 2024-09-14T11:39:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.667+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.669+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:39:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.670+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17517003949768275442', time=2024-09-14T13:30:56.685760+0000, chain.objs.size()=1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.iZEw4msvapaRtJgoNcrJAq6S0FWw8s__0 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13996604251466789231', time=2024-09-14T13:30:56.694469+0000, chain.objs.size()=1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.BbZV9p0H_2iSWs6m3Xd_zDohFfJaDqz_0 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_U1Jr3Rpw1wm51xnuG7Y2L7qdWuh9DoJ', time=2024-09-14T13:30:56.868388+0000, chain.objs.size()=1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.tHtR2G_GdaUw3P-x-zLAOnGRT8hal8c_0 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10873774505386701718', time=2024-09-14T13:30:56.956829+0000, chain.objs.size()=3 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.2 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15__multipart_foo-FROZEN.2~pG_fB2JqNFUO7xfNLx3qYN66K5RdxqP.3 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5718409460875716722', time=2024-09-14T13:32:22.894506+0000, chain.objs.size()=1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.77KKN77X9jnvVUm6_2HN0Tk31pG71JU_0 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16111174576164935875', time=2024-09-14T13:32:24.150547+0000, chain.objs.size()=1 2024-09-14T11:39:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.kxO-3ce_YvR1Jgx4-uiFtydG9esyX0S_0 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13003848844898751537', time=2024-09-14T13:32:58.252349+0000, chain.objs.size()=1 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.nElpksIPOLjdxfCbqJBgQ1UVEH-CKWr_0 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4868885627887653848', time=2024-09-14T13:33:32.847289+0000, chain.objs.size()=1 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.kzH2r6N2jXxsE92IXSA6k_D9iPK1ViA_0 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4921638678016262633', time=2024-09-14T13:34:39.839889+0000, chain.objs.size()=1 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.mrM9yEEVGTms0yI57E6PjZHSZ-lsK1b_0 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2848849082744019248', time=2024-09-14T13:34:42.714539+0000, chain.objs.size()=1 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.671+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.HkNlL5mhDMfqdLBNqr0k2nHuy4GJPu5_0 2024-09-14T11:39:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9813679944289845985', time=2024-09-14T13:34:42.715951+0000, chain.objs.size()=1 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.DVvRL5pIv5JzhJ2t3NazTLISHMIO6b5_0 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9884008372204431731', time=2024-09-14T13:34:42.723552+0000, chain.objs.size()=1 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.9S0MHi9FVlVnmvJHBBZtsL_w5cyR1ob_0 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4069537002664254122', time=2024-09-14T13:35:16.373159+0000, chain.objs.size()=1 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.673+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.yN3LpnVqzgH8mzbEYahH4vL1HOFYr16_0 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.674+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13661656705253958199', time=2024-09-14T13:35:49.683993+0000, chain.objs.size()=1 2024-09-14T11:39:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.674+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.jlF2c3ccMp4iV9lx08tbkwjGi36pA-k_0 2024-09-14T11:39:35.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.676+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2743760463017383043', time=2024-09-14T13:36:23.392864+0000, chain.objs.size()=1 2024-09-14T11:39:35.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.676+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.bCC1dA-bgec1qDh5eSn_f1nd1M1sHFg_0 2024-09-14T11:39:35.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.676+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10423609342172489281', time=2024-09-14T13:39:01.764827+0000, chain.objs.size()=1 2024-09-14T11:39:35.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.676+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.NtbYDZ8-U3UVm-XdJ7jS87U_okxXg_o_0 2024-09-14T11:39:35.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.679+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.681+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:39:35.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.682+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15826512973577643744', time=2024-09-14T13:30:56.919438+0000, chain.objs.size()=3 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.1 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.2 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.3 2024-09-14T11:39:35.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11235599325450750161', time=2024-09-14T13:30:56.983475+0000, chain.objs.size()=2 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.H8RyccuXPRKa6ODNlqvSsA103ZSLqKA_0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.H8RyccuXPRKa6ODNlqvSsA103ZSLqKA_1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4899973486549816373', time=2024-09-14T13:30:57.048690+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.1zsbjc0eYm9Rx8AWY3yXB7Gz1uup-kL_0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5752485499845899570', time=2024-09-14T13:32:59.318298+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.hLKdwNjiI5mBAm7KoQ6Wc_hZsXYNBRc_0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17143745547379204798', time=2024-09-14T13:33:34.113542+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.uyJ1iRD1bTpST30ROZA9raY31OcEb6__0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14781037208280410091', time=2024-09-14T13:34:41.635924+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.BIsKTS2jdTb4Kie-QgqWZwZXat_vJr-_0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5931318007370307054', time=2024-09-14T13:34:41.639191+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.APknC6FE35koEl1gFo935IweY4-jkqC_0 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13058707068246566140', time=2024-09-14T13:35:14.345671+0000, chain.objs.size()=1 2024-09-14T11:39:35.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.5Iu92gK_RUwO03pRxYxtbwXsoKdAE3y_0 2024-09-14T11:39:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2850764193583115948', time=2024-09-14T13:35:48.519226+0000, chain.objs.size()=1 2024-09-14T11:39:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.683+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.VAnT_ayZPcPjjY18TN16tiXhcFu37AH_0 2024-09-14T11:39:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.685+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4881350190820221325', time=2024-09-14T13:39:01.767648+0000, chain.objs.size()=1 2024-09-14T11:39:35.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.685+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.cvd689WI5ZrU2ak_ExkD1R24QY1jvUS_0 2024-09-14T11:39:35.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.687+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.690+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:39:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.691+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.691+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:39:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15307705166009533685', time=2024-09-14T13:30:56.927407+0000, chain.objs.size()=3 2024-09-14T11:39:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.1 2024-09-14T11:39:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.2 2024-09-14T11:39:35.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-LUKEWARM.2~bqK2FBplC3pChj4w0YiWfV79gjSW2Ra.3 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9288781292856545850', time=2024-09-14T13:32:56.281599+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_._56MSS2WRmNCaGd0x5Do7euhLv27DJz_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7277103745049186673', time=2024-09-14T13:32:56.282257+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.Dwf8G7FbJJBgjeNHU_4ElP4V7HMVKFc_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6030613727444619209', time=2024-09-14T13:32:58.246999+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.62-6S-q-CxfeFuU2oKiYbiZ-rQUJ0HF_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7106811685764364006', time=2024-09-14T13:32:59.320856+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.p3w0zhJnoGADThs768BjpivqdnygoBt_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.410745623421536649', time=2024-09-14T13:33:31.041746+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.dJIhLw3sMsEnTjP2JFUa4h-3V1-pB86_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6761950379804690605', time=2024-09-14T13:33:32.113433+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.lLWtjhYtuT4IO4jV1fsNjIkZxWPJ87H_0 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16222339889876277339', time=2024-09-14T13:33:34.104335+0000, chain.objs.size()=1 2024-09-14T11:39:35.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.4VJytLfesLf_D8tPB_O07Ie6RsUQIa2_0 2024-09-14T11:39:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9585003332768119345', time=2024-09-14T13:33:34.110122+0000, chain.objs.size()=1 2024-09-14T11:39:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.HUclriuQ1k5Gb_fBtmMFUmArSGCzd2h_0 2024-09-14T11:39:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9150561250889020612', time=2024-09-14T13:34:07.882740+0000, chain.objs.size()=1 2024-09-14T11:39:35.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.692+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.ENcQAPNQpQ0-__zIff1wJCcoiEpWpOH_0 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4810987540338416571', time=2024-09-14T13:34:07.894736+0000, chain.objs.size()=1 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.wh3nMfAW3ywFhNEk95vgovKUBnmCbS9_0 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11896905180574035699', time=2024-09-14T13:35:48.518046+0000, chain.objs.size()=1 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.KGVHj8MtNq4gf7HLNTHeh0aekFPEKTt_0 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3497165429186470112', time=2024-09-14T13:35:49.159749+0000, chain.objs.size()=1 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.QHOql2cjJcFAp-7o8f-RtPvJJ9Zfh-9_0 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6674133571494979381', time=2024-09-14T13:36:21.392739+0000, chain.objs.size()=1 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.695+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.mzdas1AMU1ZvcDxIDAes2LzEZMRYOi7_0 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.696+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11167561634122013510', time=2024-09-14T13:36:24.253058+0000, chain.objs.size()=1 2024-09-14T11:39:35.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.696+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.PT9ZD1M45ViZKRVDmUegAMyVyIpJ-7f_0 2024-09-14T11:39:35.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.698+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.700+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:39:35.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.702+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16337497076214911325', time=2024-09-14T13:30:56.860305+0000, chain.objs.size()=1 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.7lazgQEBsMVODjIDiDmoi5fw3VcZ3LW_0 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12315890095361596645', time=2024-09-14T13:30:56.991044+0000, chain.objs.size()=2 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.tO3r74v_f47xnqdE8dfFWnLdJORNOD-_0 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.tO3r74v_f47xnqdE8dfFWnLdJORNOD-_1 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17050268054577559375', time=2024-09-14T13:32:24.152273+0000, chain.objs.size()=1 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.GMKash0zZULlcfEzEEBjIOlFpJQSdX4_0 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16525454755549763725', time=2024-09-14T13:32:24.160768+0000, chain.objs.size()=1 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.ZskvekX7dKRSJTuUFpiEw7Dw3jfPL2g_0 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16549254369191585663', time=2024-09-14T13:32:58.250419+0000, chain.objs.size()=1 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.aqbV63wtCNIm25zDu-d_Th4k3t7UU3U_0 2024-09-14T11:39:35.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8814348055956642730', time=2024-09-14T13:32:59.318113+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.EFNy91AAMpb-iQZ-SoY-DT7HikM_XcZ_0 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16323207515857255934', time=2024-09-14T13:33:31.043709+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.Tsm_qV_K1fTwtiwV6_mVSSxAneXNu4c_0 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4126956685095041618', time=2024-09-14T13:33:32.846758+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.0mVZ4dsouP6X90r08yOIjFJ94UFNyKk_0 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4755777968736470738', time=2024-09-14T13:33:34.115891+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.FTNpdPvp41wllZv8jdCr3tapODBf1pw_0 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12204700551402643982', time=2024-09-14T13:34:06.237778+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.D9fAZS8f3f7g-YDkjoxi_RQEdpJQUz0_0 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14925795184379952733', time=2024-09-14T13:34:39.836272+0000, chain.objs.size()=1 2024-09-14T11:39:35.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.703+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.ZjqZWuQJvlgAvfWqNbaRts_pp1dhNCW_0 2024-09-14T11:39:35.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.706+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13310238287983205297', time=2024-09-14T13:34:39.839104+0000, chain.objs.size()=1 2024-09-14T11:39:35.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.706+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.SlxZeWwg0nqTKcYygIHqTTVQ9X8ue1j_0 2024-09-14T11:39:35.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.706+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9904259537702515205', time=2024-09-14T13:34:42.715961+0000, chain.objs.size()=1 2024-09-14T11:39:35.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.706+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.XXuNGfMsEBi2djs1Gt0ir9FPu-FMICR_0 2024-09-14T11:39:35.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16004083244760707388', time=2024-09-14T13:35:14.348571+0000, chain.objs.size()=1 2024-09-14T11:39:35.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.BMJd3GN-4c-EGCVbQVEvAql3eoku6lP_0 2024-09-14T11:39:35.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16296206292574892268', time=2024-09-14T13:36:22.245378+0000, chain.objs.size()=1 2024-09-14T11:39:35.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.TnH-wNXGxBlBoP8Cif1lmyrsO1iaWoy_0 2024-09-14T11:39:35.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17147167703168785979', time=2024-09-14T13:36:23.384488+0000, chain.objs.size()=1 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_._nXq8krLwKiLCi1YKeHWrMXXUjVZ4uu_0 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4978292456557954520', time=2024-09-14T13:36:23.387827+0000, chain.objs.size()=1 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.Ofcr7sQFCLMs-ByX81kd2onn_HvYcYT_0 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14645934179468115165', time=2024-09-14T13:36:24.247405+0000, chain.objs.size()=1 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.r31ogZEOJOR2B6qo_HaXNlbVQxJJXvi_0 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17169996191335688657', time=2024-09-14T13:39:01.763603+0000, chain.objs.size()=1 2024-09-14T11:39:35.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.707+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.-gl9yXxLVeLvw6KbQyYiwYDEQWkbg6l_0 2024-09-14T11:39:35.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.710+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.712+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:39:35.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13041919771586879725', time=2024-09-14T13:30:57.073486+0000, chain.objs.size()=1 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.yCVGriHZDf0cUqlUQjP0ix2oM43fpvi_0 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16516063879950753672', time=2024-09-14T13:32:22.895046+0000, chain.objs.size()=1 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.QmlJPREk9MPfLVO8UFsKULdXrohF3Nj_0 2024-09-14T11:39:35.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15137837201556687623', time=2024-09-14T13:32:22.897876+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.jNH_TibyykfxeXZgET2t8a00ao90ERw_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16782757249609165222', time=2024-09-14T13:33:31.042174+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.YxafuVRJO_UE21JVCn7jFfB5s3U1DnB_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17062443224644081478', time=2024-09-14T13:33:31.042961+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.erd58fvTuhFkFjXIm9m0Pks7ApYp5Ie_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13066466569356348471', time=2024-09-14T13:33:31.055909+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.IHVhGvgMNxxvLq_DOMuXsTY4Bz5De2W_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13446543496139175465', time=2024-09-14T13:33:34.104623+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.0-MHw96JfLKyudjhHfBVtIK3rEkx-Fm_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2615216787506623744', time=2024-09-14T13:33:34.114581+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.br_Trz68C-XUv4mJyt-GSBnjrpE3j5H_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2720844691842051827', time=2024-09-14T13:33:34.934826+0000, chain.objs.size()=1 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.OdRSWjxTbNYytzcyx4_w8BnvVsM2Ko8_0 2024-09-14T11:39:35.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11102854245693482324', time=2024-09-14T13:34:06.236236+0000, chain.objs.size()=1 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.LwGWizE1j7D1FGSQ9ERydXAME0B91c4_0 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7030558542472131811', time=2024-09-14T13:34:06.236902+0000, chain.objs.size()=1 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.hdi2ZNFu3Q6TkOYaHb0aGQxlqC_A2vR_0 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52781186679560797', time=2024-09-14T13:34:07.885227+0000, chain.objs.size()=1 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.714+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.kauTcnl_hXc9DYzvZYuo6j33SwtzeFU_0 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.717+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1346823491502870463', time=2024-09-14T13:34:41.634510+0000, chain.objs.size()=1 2024-09-14T11:39:35.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.717+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.TnPL_gtrTqX5TeFqUSb3MQAs37XAMFL_0 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6102814172306711304', time=2024-09-14T13:34:42.713352+0000, chain.objs.size()=1 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.Qs9A7-zWAhqaV3mzldflRdpsGSsKB64_0 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14037609917914164837', time=2024-09-14T13:35:16.371337+0000, chain.objs.size()=1 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.7jrnmZH1ciHWLFZdV-QDGl0MkVjdPnW_0 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2496059046196348951', time=2024-09-14T13:35:16.372177+0000, chain.objs.size()=1 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.6DgkSYoGvf1KL9ns19KoiP2qJ2OxsEU_0 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8140355352276383332', time=2024-09-14T13:35:48.516138+0000, chain.objs.size()=1 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.tpdhi_yMy2NqDpxsUCbnNa9WqI52ANF_0 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10828637187655048273', time=2024-09-14T13:36:23.384114+0000, chain.objs.size()=1 2024-09-14T11:39:35.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.HKgk96eu8-CNWTtExaO-MNdPV3-mJ8s_0 2024-09-14T11:39:35.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13769775503954974048', time=2024-09-14T13:36:24.248020+0000, chain.objs.size()=1 2024-09-14T11:39:35.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.718+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.gTdOcz8ZltkxI9XAcF8Kdh30KWCyUYd_0 2024-09-14T11:39:35.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.722+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.725+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:39:35.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.726+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.724 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.726+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:39:35.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5744016537601411023', time=2024-09-14T13:30:56.715574+0000, chain.objs.size()=1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.qZDDMgT5I5KwlBSNaCWueM_9q9XOmdV_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_gZAgOUUK1ZxPsDXteoqOXc2AajI5xVF', time=2024-09-14T13:30:56.915339+0000, chain.objs.size()=2 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.lBpOkJqi8rUt1lB1vkPL4DHGmjQTf68_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__shadow_.lBpOkJqi8rUt1lB1vkPL4DHGmjQTf68_1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16407430533698664052', time=2024-09-14T13:32:22.900714+0000, chain.objs.size()=1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.MaxNQK1vQvq4uIn6ch0bMMa6tdgm0za_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4814583282884631454', time=2024-09-14T13:32:24.150343+0000, chain.objs.size()=1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.NM66HvivRi816ujzjiJShQDTAtb0Wpx_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8062096711998471314', time=2024-09-14T13:32:56.271390+0000, chain.objs.size()=1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.niFGgJ-zhx0WMQ-frIGnSRB8-LOEspk_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7590432633982887501', time=2024-09-14T13:32:56.273536+0000, chain.objs.size()=1 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.em_u2GAiL1jNqcZshco77delVDnjeMz_0 2024-09-14T11:39:35.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11466079397115504772', time=2024-09-14T13:32:56.274325+0000, chain.objs.size()=1 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.HG7pEzPLUaZ0RwnPoBwfnx0eFKA4u_L_0 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10359844635575360564', time=2024-09-14T13:32:56.275879+0000, chain.objs.size()=1 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.Ey5JyKymHsiw3V9aKWv_V_FPhjqL_u8_0 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1552795993788931279', time=2024-09-14T13:32:59.319757+0000, chain.objs.size()=1 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.22lJFLQRIiEKsnpSNpxlO8H8kggLYnh_0 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2087117673198023783', time=2024-09-14T13:33:32.845708+0000, chain.objs.size()=1 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.4jaQzb-A4P5OKFD_bM8NZwwfWmqQ0Lb_0 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11698655304667495557', time=2024-09-14T13:33:32.852069+0000, chain.objs.size()=1 2024-09-14T11:39:35.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.727+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.CItFHLvGdhqOJnTCoirbRbZzzcsQmNQ_0 2024-09-14T11:39:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.730+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14678786158212507154', time=2024-09-14T13:33:34.107165+0000, chain.objs.size()=1 2024-09-14T11:39:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.730+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.R2gaF3t-hrY6eL4h_Vw0Shl26GO_Jc8_0 2024-09-14T11:39:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.730+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10277173083731324038', time=2024-09-14T13:34:06.238061+0000, chain.objs.size()=1 2024-09-14T11:39:35.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.730+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.Szrq5rxI2Ogj0LmXOjQ23Wj5frG74_r_0 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8023964177817347462', time=2024-09-14T13:35:14.347125+0000, chain.objs.size()=1 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.LCCe3EA2E7_Y2fqPsv4rYWjCEqdBDIA_0 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.286614314011820408', time=2024-09-14T13:36:21.389236+0000, chain.objs.size()=1 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.h1-j63FUUwmHWaRJmCbeoWVAwjgYEZ8_0 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5596519617948956397', time=2024-09-14T13:36:23.394608+0000, chain.objs.size()=1 2024-09-14T11:39:35.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.6F7UUOpmaUDuHnqP6cNZfS3MCgTDc9e_0 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3016599781402608649', time=2024-09-14T13:36:55.778484+0000, chain.objs.size()=1 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.o_RNmI9eF01CBgalgEMoeatqhlSbp3r_0 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10238053459556913324', time=2024-09-14T13:39:01.762112+0000, chain.objs.size()=1 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.wNVLkNFKSdwLSOR6Z6pu2tY9LM5F5Pc_0 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4248176355407900168', time=2024-09-14T13:39:01.765247+0000, chain.objs.size()=1 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.OqGujHAgHgetZePjSwCEU9xX7WTtjFD_0 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12572447241406221843', time=2024-09-14T13:39:13.762589+0000, chain.objs.size()=1 2024-09-14T11:39:35.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.731+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19__shadow:FQcLrvmJMYq7ahAsWhIqzGfTuvwjCv0_.RNBZBhoce9WUBgNNA1m7LFCPXvytGS0_0 2024-09-14T11:39:35.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.735+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.737+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:39:35.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8894746188658483153', time=2024-09-14T13:30:56.987215+0000, chain.objs.size()=2 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.WdBVM0Gx9tgcLZxVTdrAhAggJvpFrfS_0 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14__shadow_.WdBVM0Gx9tgcLZxVTdrAhAggJvpFrfS_1 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13506113159386120624', time=2024-09-14T13:32:56.270479+0000, chain.objs.size()=1 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.FVJZTlwvumZ3OrTIjEci3sn3xa_wCdk_0 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13984403171807318489', time=2024-09-14T13:32:59.317143+0000, chain.objs.size()=1 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.S70_-qjAd0Jy2VhcP2J1_86x-cVMpvT_0 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12751749205414674651', time=2024-09-14T13:34:06.240546+0000, chain.objs.size()=1 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.v2ZN8c9J4liQTdvRbjJoKZhRUhigIAi_0 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15935680830545018223', time=2024-09-14T13:35:16.378428+0000, chain.objs.size()=1 2024-09-14T11:39:35.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.lZ68hWhyQmxE-C_o-FgVkG8VsPOYyg2_0 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18171283391716468771', time=2024-09-14T13:35:49.683753+0000, chain.objs.size()=1 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.WWZEJSjX2rXnVhG9Bt3vTfwZQDY8d11_0 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3219279065973786857', time=2024-09-14T13:36:21.391397+0000, chain.objs.size()=1 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.WL4QwwaTHbAsvgVafnJT31Wfq-xrQ4S_0 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1045806738067083625', time=2024-09-14T13:36:23.389880+0000, chain.objs.size()=1 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.xksBfPmWfszcyv6xzrY_mS583HXDLvS_0 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16367079728186977137', time=2024-09-14T13:36:24.254627+0000, chain.objs.size()=1 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.jJ56mYqODq_rUtK26nKofm8Alkk9IC-_0 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5517100154891109817', time=2024-09-14T13:36:55.787658+0000, chain.objs.size()=1 2024-09-14T11:39:35.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.739+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.K53Jm_B4TWl7EUqPQLeKfN7wRQU8XHv_0 2024-09-14T11:39:35.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.744+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.746+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:39:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.747+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17621463197242116419', time=2024-09-14T13:32:58.253979+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.98syfAjZq64iNd5wieooPEEerZut0YY_0 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13090977789485829172', time=2024-09-14T13:32:59.317787+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.8kTxZm3-4UjIYcN0c3AOsaB5FNPTQfV_0 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14997617817339814473', time=2024-09-14T13:33:32.847451+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.tD-J1HJsPhh4ujnlW2zcxfZrFCys35g_0 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1788320937010668297', time=2024-09-14T13:33:34.106487+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.bQzI-Fnz3tFKhd5Aw-sUawstTkV-aAk_0 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13756153455458159165', time=2024-09-14T13:34:06.239862+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.7N7BP6J6Fh4s5RCOi9L4XCBd6_yvn5U_0 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9981379830940216953', time=2024-09-14T13:34:06.245748+0000, chain.objs.size()=1 2024-09-14T11:39:35.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.fVctieZ_qwNG-DhoSFUcgOGXyHKsDQV_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15008782633540642365', time=2024-09-14T13:34:07.892123+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.jtpRsBDUVVv-i9_6suTfjpEGM79ueRg_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3408919260373654721', time=2024-09-14T13:34:41.634783+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.W_FA4yFtP4c6pcLp2d5Xgw2y56j-0pN_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14937793254379083220', time=2024-09-14T13:34:42.713339+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.nQaqxbCxc8eYABgbPpyO1Pj2ck-xEA2_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3730903866781255594', time=2024-09-14T13:34:42.714497+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.Ipad4BX0X2BAW6pwU14onnQXV2l1m_m_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8090274016051504913', time=2024-09-14T13:35:16.376553+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.gFG4A7yYMh47QjZnvjZ-q2dJxQggkOo_0 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9722480784111433129', time=2024-09-14T13:36:21.393016+0000, chain.objs.size()=1 2024-09-14T11:39:35.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.748+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.21A9H_FL-19B1IFm5ZhYYo1QQDBxklq_0 2024-09-14T11:39:35.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.751+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3277256209457200423', time=2024-09-14T13:36:55.780794+0000, chain.objs.size()=1 2024-09-14T11:39:35.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.751+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.4QWF0e4ZxqNbJ7y1JX_kGR8rvXki1GP_0 2024-09-14T11:39:35.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.754+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.757+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:39:35.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.758+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.758+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3803479202944945158', time=2024-09-14T13:30:57.081464+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9__shadow_.gGqbSn0Agi-8aN8mjd8_DW2JfHFNMuy_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.266175109079071348', time=2024-09-14T13:33:31.039256+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.B1bCLJgefF006npBd5zVHALrgNR_CBP_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12893379173156701234', time=2024-09-14T13:34:06.245769+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.8grwEpxUqT7ObBCbxoSYUeCoIs16jet_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4127565748436052825', time=2024-09-14T13:34:07.881534+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.A8gMIFMae7ajvFpAMPcVjkvmIpRpUHa_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6905909466408162752', time=2024-09-14T13:34:39.845291+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.C9D9M2miczm88uuSRSNoLuT0mGpaVZJ_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1321793942074035064', time=2024-09-14T13:34:42.723460+0000, chain.objs.size()=1 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.duS07AL-OCiXM1o46e5uew_xki7xyXP_0 2024-09-14T11:39:35.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4080592034346906942', time=2024-09-14T13:35:14.345671+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.X_QzjDBeH6QSAsI1rwN9aJjYPhdCX_H_0 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5601988455487905035', time=2024-09-14T13:36:23.387937+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.tLbR4FZ9PRhZdaLiEtzDlg_V9nkgzJY_0 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3173188994633589567', time=2024-09-14T13:36:24.244630+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.e9gobPeQ4ZXWuqBlBFkOEXZ7kgssK2F_0 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8535197817859769996', time=2024-09-14T13:36:24.248721+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.2C7Opjzw6WAM8d2XBvHyfrhZZo8SDbQ_0 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17726528366263805864', time=2024-09-14T13:36:55.776321+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.PokvtozM-c1cSWwzuTcYUs-Nct5Bsal_0 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14740546390034171676', time=2024-09-14T13:36:55.778491+0000, chain.objs.size()=1 2024-09-14T11:39:35.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.759+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.HwsJN2uB1mIUMD5DMr6Oqj86lYINybT_0 2024-09-14T11:39:35.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.763+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.765+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:39:35.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13098424056179520117', time=2024-09-14T13:30:56.935588+0000, chain.objs.size()=3 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.1 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.2 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17__multipart_foo-FROZEN.2~5MgrfbcOqKqfNuVOKd-HFkbWoZkL568.3 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11053072870184412104', time=2024-09-14T13:32:57.722765+0000, chain.objs.size()=1 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.As-yWHRVNtxZmSqDPawkyaAgQckfBdN_0 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8656517331911206681', time=2024-09-14T13:32:59.320269+0000, chain.objs.size()=1 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.EvxefEzZWhawDe2gE1VeHmMFR_GKdZ9_0 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16148829252840225461', time=2024-09-14T13:33:31.045978+0000, chain.objs.size()=1 2024-09-14T11:39:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.80JG87v4bqWh-EX18LdiFNE-y8wO6J9_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10210769702524934360', time=2024-09-14T13:33:31.056500+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.GOLlviLBmTgrFTmt1yRJxemiPx8Jm3C_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8992686685621836568', time=2024-09-14T13:34:06.240915+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.R0ovoavNp_dHuppmwCrhZQBz1agb2sY_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2887387889650860258', time=2024-09-14T13:34:07.880778+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.VKXoiDcbR0NfaT_p1-NV1yP1D93n4h1_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15484105725908287800', time=2024-09-14T13:34:41.636299+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.oG-q2qEYVzp6cg5vfVd3C2DPELWd1qg_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1617600964638046785', time=2024-09-14T13:35:49.684252+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.nh7UlePEX-LVCeZab1Zi7-LoxE9xDHP_0 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.909289200098807182', time=2024-09-14T13:35:49.688620+0000, chain.objs.size()=1 2024-09-14T11:39:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.767+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.ZjlcBMjFOjina4qkeEg1hWd_vWUtciy_0 2024-09-14T11:39:35.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.772+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4472643803763964775', time=2024-09-14T13:36:24.253195+0000, chain.objs.size()=1 2024-09-14T11:39:35.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.772+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.zLxvKsZT4VAzFAQBTlKGXXV6homrpL4_0 2024-09-14T11:39:35.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.772+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5985481774169080552', time=2024-09-14T13:36:55.780976+0000, chain.objs.size()=1 2024-09-14T11:39:35.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.772+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.f15-M2jWJd9QqHxiyIg_w14YFETBkMj_0 2024-09-14T11:39:35.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.773+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.775+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:39:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16707366916163987067', time=2024-09-14T13:30:56.702856+0000, chain.objs.size()=1 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.9z6nXFSwc8zpUCdHgv7Ren50QAae1Vz_0 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_GjVP5wtIP1cxIII5sIi5PzFCHnAYLoO', time=2024-09-14T13:30:56.844295+0000, chain.objs.size()=1 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.ha42TcDXZEN7-YsFKE7m0y98XeYcbZ5_0 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14067540327519604463', time=2024-09-14T13:30:57.040613+0000, chain.objs.size()=1 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.OuDVyyI-T6739NAaDU41k5MB3my-cXa_0 2024-09-14T11:39:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10591660302196933495', time=2024-09-14T13:32:22.901774+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.aktsA6Vr2LtMP7kUTi3UlwwHZMxO6tE_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8887748558431945697', time=2024-09-14T13:32:58.245352+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.hw1-XSiRzxBb_YT_xtVv6gwhWaCTcsU_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4489835552068984204', time=2024-09-14T13:32:58.253397+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.JPJLJsiX6m7M2Hc257Ksu_V59_7BqEO_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13356220013630531025', time=2024-09-14T13:32:59.313942+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.7HllKUnMq4RrV_-E5sVX08MFMSzdPkE_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2714772662228330484', time=2024-09-14T13:33:34.106655+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.7KbfZN4s2p_UTBHBfVVScdMaSYB-1Vu_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1378651655848745643', time=2024-09-14T13:33:34.107799+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.tz5EzyD5poF_5lGUdpUXZ-l-wmZGXGm_0 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9916911122154550352', time=2024-09-14T13:34:07.885051+0000, chain.objs.size()=1 2024-09-14T11:39:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.YmjGqk-ZEcMk7pPMdu5mT-7n8_qt4xM_0 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5258349491753643287', time=2024-09-14T13:34:07.888310+0000, chain.objs.size()=1 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.777+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.xiT8F9-HZA-4dX3wRhjd7DLDBGaTJvn_0 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.778+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14611766289756040248', time=2024-09-14T13:35:48.524484+0000, chain.objs.size()=1 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.778+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.jsXHrtD737dDbhiMUfFV-7UGejv447u_0 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.780+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13699943953957717983', time=2024-09-14T13:36:21.391916+0000, chain.objs.size()=1 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.780+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.Q3ioWk3acP7hHF5sjw9twFcMeOfU3eu_0 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1269274000972098976', time=2024-09-14T13:36:21.395678+0000, chain.objs.size()=1 2024-09-14T11:39:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37__shadow_.BZytueug6pdq7ZoA9Pj27AemtyZBwA9_0 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13379348973618349716', time=2024-09-14T13:36:23.386562+0000, chain.objs.size()=1 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.38__shadow_.SKHLx0oDNkijAvdaROx_QmZYwAmgel-_0 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3769523984497748543', time=2024-09-14T13:36:24.244295+0000, chain.objs.size()=1 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.r1bjLbZnzbfmvgecoJ4swS5tNLx2iYH_0 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2230831646247274157', time=2024-09-14T13:36:24.247833+0000, chain.objs.size()=1 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.781+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.4FhAvktv9yitbtObN7TzhSTd6NXnPuZ_0 2024-09-14T11:39:35.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10793346999173665161', time=2024-09-14T13:36:55.776936+0000, chain.objs.size()=1 2024-09-14T11:39:35.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.RecF2SbQAZ9QuS0yQTJl4B-JzXwv9B9_0 2024-09-14T11:39:35.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8366196015502201913', time=2024-09-14T13:36:55.779767+0000, chain.objs.size()=1 2024-09-14T11:39:35.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.uUOGwpu_yBkahZtMYlWcCE7IHT-cK-J_0 2024-09-14T11:39:35.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.434151750555338591', time=2024-09-14T13:36:55.782946+0000, chain.objs.size()=1 2024-09-14T11:39:35.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.782+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.hflIGXQIlZMR_Mz1RcCI8XMdzzUZgaS_0 2024-09-14T11:39:35.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.785+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.787+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:39:35.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.788+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.789+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.789+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.789+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16638292869034088087', time=2024-09-14T13:32:58.248832+0000, chain.objs.size()=1 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.789+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.6p5JZwnpK6D_GS-hZwsLhrbPgtFFiFZ_0 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15337194176224346432', time=2024-09-14T13:33:31.041724+0000, chain.objs.size()=1 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.lIFz3qc8ozonLbU7FrPEsS25221-OQU_0 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4536375011501510339', time=2024-09-14T13:33:32.848971+0000, chain.objs.size()=1 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.26__shadow_.WrG-FMegNzD4-LWCfP0Sedv7T9n1hSX_0 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16396756640396426478', time=2024-09-14T13:34:39.835952+0000, chain.objs.size()=1 2024-09-14T11:39:35.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.M4pBMUrZ4vkDN3tz8cu3poQtImU1VAj_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6283294212113754882', time=2024-09-14T13:34:39.845703+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_._zySJDjE1F12ee2SlOSlHqeaCGqekLG_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1646846815524033183', time=2024-09-14T13:34:41.635383+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.QIpvdO2GaIb7ym6f-wH-sYB4W30gHFJ_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13542303822725002943', time=2024-09-14T13:35:16.371746+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.34__shadow_.e-2rQpTBOmn122df7A1vXWbSxgipCb3_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2035650086775641680', time=2024-09-14T13:35:48.519919+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.hD-cjbPvAdQHjPOo1wPye2mE7fIRr-b_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3981357247450448209', time=2024-09-14T13:36:24.248793+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.jhxz3RbM76XZkeS3D8yxxLiUg6vPdQS_0 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14231886467007324565', time=2024-09-14T13:39:01.762539+0000, chain.objs.size()=1 2024-09-14T11:39:35.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.790+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.HQy7VFIIlTG9xgZQaBHbwicfLvHbCwQ_0 2024-09-14T11:39:35.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.793+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.795+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:39:35.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.797+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.797+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13339475860254945380', time=2024-09-14T13:30:56.706953+0000, chain.objs.size()=1 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.gdP6kQU1Mzrdd0cGrpww_5o0qcNwaCi_0 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='_9689E98gPNhE6E1Ezy_sQMn09GJxoXS', time=2024-09-14T13:30:56.832363+0000, chain.objs.size()=1 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16__shadow_.osf9N01oCBdOOZVioZDa5NF16a5W9pD_0 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2268494932251879820', time=2024-09-14T13:30:57.044658+0000, chain.objs.size()=1 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8__shadow_.iJ542GiO9pV4fnhIOXBxZo6wTWHmglZ_0 2024-09-14T11:39:35.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4528402452576768166', time=2024-09-14T13:32:22.896535+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.thLRhTtlfOi5SZww2Hm7NycJ3y3jYDy_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5311925719608445997', time=2024-09-14T13:32:22.904745+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.e1VAvTrCn1BINHBkVHu1KnJy8MoFo_K_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13651945641632373140', time=2024-09-14T13:32:56.274565+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.ZGAzOEZIafYIdGi0bNxUFZ_UkZd-sJv_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16277862968626872089', time=2024-09-14T13:32:56.281285+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.NPQNcI5feT2dqNTtWljR4Dip_mfzXBq_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9081759423064044365', time=2024-09-14T13:34:07.887800+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.xyU98AtbTVMmzMvdlOrPolP7EqFdjMD_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13458680082065041711', time=2024-09-14T13:34:42.713469+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.06gfE67lgzDZV6AvnIt2RFHocCx6izz_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16083168496618037678', time=2024-09-14T13:34:42.718045+0000, chain.objs.size()=1 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.RuHBNdJESYTtgE2scEW1sX9Xf_rUb2j_0 2024-09-14T11:39:35.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17933019322404247652', time=2024-09-14T13:35:14.344197+0000, chain.objs.size()=1 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.bk6XaEy_3rYdwphVvLwOwlcMmdtYnox_0 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16331668893130144485', time=2024-09-14T13:35:14.345619+0000, chain.objs.size()=1 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.798+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.F48oy3YYoOHUFxwXdhFI6X0ZjmlZFrV_0 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.800+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2405085261895511151', time=2024-09-14T13:35:48.516135+0000, chain.objs.size()=1 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.800+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.35__shadow_.XP7s9EnmwZ0XLFdkAqyGy-L-BJIUOth_0 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.800+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17479824562188278334', time=2024-09-14T13:35:49.686558+0000, chain.objs.size()=1 2024-09-14T11:39:35.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.800+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.dhtQCu43nx8taVENiXz5jHwKawqvg59_0 2024-09-14T11:39:35.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.801+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14578194389402235480', time=2024-09-14T13:36:55.786486+0000, chain.objs.size()=1 2024-09-14T11:39:35.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.801+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.glj50Vja-X8eSE7YGQ-tWwObldw1XXi_0 2024-09-14T11:39:35.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.802+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9145047618638122847', time=2024-09-14T13:39:01.766620+0000, chain.objs.size()=1 2024-09-14T11:39:35.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.802+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18__shadow_.MePJfhIaS72CaNmZxerqgfInD3BiP5O_0 2024-09-14T11:39:35.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.804+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.806+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:39:35.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11306290942936981785', time=2024-09-14T13:30:56.698706+0000, chain.objs.size()=1 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5__shadow_.corBMEnIZoCxhUAWK5AvvjwfekG1C4S_0 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7031837078341913921', time=2024-09-14T13:32:24.156367+0000, chain.objs.size()=1 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.21__shadow_.tlhkRRlL-9h5V_AMWAAthJHgksyvXOl_0 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1386943434273341713', time=2024-09-14T13:32:56.274525+0000, chain.objs.size()=1 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.A05qR4tE6Ab4PQVI0gAvI_n4PGSO8ND_0 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.991048558175372480', time=2024-09-14T13:32:58.246987+0000, chain.objs.size()=1 2024-09-14T11:39:35.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23__shadow_.daT4WNe1hFSNr_RzW0JWJw8mANZlJK6_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5544992936609108640', time=2024-09-14T13:33:34.111102+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.27__shadow_.RdSiVKeBt-bXwitkmnUUZzCQPFMERE-_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12489577041475265105', time=2024-09-14T13:34:06.236162+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.EjrWqrdEA3apoytfrBTpFVh0ymIFNdQ_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14626770235466940584', time=2024-09-14T13:34:06.238336+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.28__shadow_.VNOxYwnOqwnwraLobbzF14xAaNMF9wI_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11710482102915497482', time=2024-09-14T13:34:41.634085+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31__shadow_.fRmacgawRNIZacNDlnoDOCknmXFYg0u_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17590343149695647071', time=2024-09-14T13:35:14.358779+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.808+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.zjpra9vMj0zOTHoaAmqIeSdXjPYXUAU_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.809+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11403582787388456132', time=2024-09-14T13:35:49.689090+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.809+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.36__shadow_.wAFRoEsNN_nBxCj0D2lxL3mVPQWrx35_0 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.809+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4593137013328531161', time=2024-09-14T13:36:55.776580+0000, chain.objs.size()=1 2024-09-14T11:39:35.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.809+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.KLKZeRYnDKJz5zORkvSDOMTdnnaXafu_0 2024-09-14T11:39:35.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.813+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.815+0000 7f6f55a13800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:39:35.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.816+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:35.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:39:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.356185670706673734', time=2024-09-14T13:32:22.893616+0000, chain.objs.size()=1 2024-09-14T11:39:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.20__shadow_.7kQLrVx4bzXr-SCtVz82Ext69kjoYdx_0 2024-09-14T11:39:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12407581664508896489', time=2024-09-14T13:32:56.275629+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.22__shadow_.lsA_dmY0GSPbuJ2XZ64UAu1XMtP49Ud_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10629975144134030682', time=2024-09-14T13:32:59.322164+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.24__shadow_.bE-arh0HEo6QvgONgYWEo1VnMy694En_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14259707575897687707', time=2024-09-14T13:33:31.046026+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.25__shadow_.QmiRDF1XobyYgD-ZH8GhTdmcTXAUBS__0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8048728109357652650', time=2024-09-14T13:34:07.887514+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.29__shadow_.JI5MH19s8d272UBWCqBRrAtgcHzk-Ji_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3265688206488806334', time=2024-09-14T13:34:39.844787+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.30__shadow_.JcVoL93EK7DepSACwu5lErHAE-Sn67S_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2438988667599261429', time=2024-09-14T13:34:42.713591+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.DIzGozXItYPe92wAlB5SPcrmKUysOCE_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16616614867727439682', time=2024-09-14T13:34:42.715049+0000, chain.objs.size()=1 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.32__shadow_.EHmtSMKjqVrjCVfIdTm3QsM3kA4iCao_0 2024-09-14T11:39:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11672404787413521619', time=2024-09-14T13:35:14.344337+0000, chain.objs.size()=1 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.33__shadow_.LGgoVcIXDOoksUE9dH7DN3Hd4AxbvSC_0 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4809648842243443666', time=2024-09-14T13:36:24.243030+0000, chain.objs.size()=1 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39__shadow_.IoHCtlGBINS_dMjSLilvuyEzeJi7v9m_0 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12825872507150014223', time=2024-09-14T13:36:55.780943+0000, chain.objs.size()=1 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.vyfGZnNnVOFCuuixtq6E_SLaKImYR4A_0 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1275481928709503871', time=2024-09-14T13:36:55.786922+0000, chain.objs.size()=1 2024-09-14T11:39:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.817+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.40__shadow_.joNbcMwwK0RO3Lzm94dTvLPzEX7L4Ta_0 2024-09-14T11:39:35.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.821+0000 7f6f55a13800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:39:35.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.824+0000 7f6e07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:35.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.826+0000 7f6f55a13800 20 remove_watcher() i=0 2024-09-14T11:39:35.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.826+0000 7f6f55a13800 2 removed watcher, disabling cache 2024-09-14T11:39:35.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.827+0000 7f6f55a13800 20 remove_watcher() i=1 2024-09-14T11:39:35.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.828+0000 7f6f55a13800 20 remove_watcher() i=2 2024-09-14T11:39:35.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.829+0000 7f6f55a13800 20 remove_watcher() i=3 2024-09-14T11:39:35.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.830+0000 7f6f55a13800 20 remove_watcher() i=4 2024-09-14T11:39:35.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.831+0000 7f6f55a13800 20 remove_watcher() i=5 2024-09-14T11:39:35.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.832+0000 7f6f55a13800 20 remove_watcher() i=6 2024-09-14T11:39:35.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.833+0000 7f6f55a13800 20 remove_watcher() i=7 2024-09-14T11:39:35.842 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:39:35.934 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:35.934 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:35.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.973+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 realm 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.975+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.976+0000 7f52d5f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.976+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.976+0000 7f52d5f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:35.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.976+0000 7f52d5f0c800 20 searching for the correct realm 2024-09-14T11:39:35.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.979+0000 7f52cb1f5640 0 -- 172.21.15.94:0/4200682352 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f52c402dba0 msgr2=0x7f52c4069490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:35.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:35.982+0000 7f52d39f6640 0 -- 172.21.15.94:0/4200682352 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f52bc05fb30 msgr2=0x7f52bc0176f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 zone default found 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 4 Realm: () 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 zonegroup default 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.187+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 started sync module instance, tier type = 2024-09-14T11:39:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.188+0000 7f52d5f0c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=0 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=1 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=2 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=3 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=4 2024-09-14T11:39:36.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=5 2024-09-14T11:39:36.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.196+0000 7f52d5f0c800 20 add_watcher() i=6 2024-09-14T11:39:36.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.197+0000 7f52d5f0c800 20 add_watcher() i=7 2024-09-14T11:39:36.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.197+0000 7f52d5f0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.199+0000 7f5189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.199+0000 7f52d5f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.199+0000 7f52d5f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.232+0000 7f5188fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:36.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.232+0000 7f52d5f0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.232+0000 7f52d5f0c800 20 Filter name: none 2024-09-14T11:39:36.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.232+0000 7f51027fc640 20 reqs_thread_entry: start 2024-09-14T11:39:36.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.232+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:39:36.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.233+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.234+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.234+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.235+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:39:36.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.236+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.237+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.237+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.238+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:39:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.239+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.239+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.240+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.240+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:39:36.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.242+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.242+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.242+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.243+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:39:36.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.245+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.245+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.245+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.247+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:39:36.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.248+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.248+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.249+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.249+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:39:36.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.251+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.252+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.252+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.253+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:39:36.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.254+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.255+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.255+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.256+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:39:36.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.257+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.258+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.258+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.259+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:39:36.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.260+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.261+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.261+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.262+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:39:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.263+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.264+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.264+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.265+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:39:36.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.266+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.266+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.266+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.267+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:39:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.269+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.269+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.270+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.270+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:39:36.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.272+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.272+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.272+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.273+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:39:36.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.274+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.275+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.275+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.276+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:39:36.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.277+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.278+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.278+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.279+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:39:36.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.280+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.281+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.281+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.282+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:39:36.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.283+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.284+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.284+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.285+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:39:36.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.287+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.287+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.287+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.288+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:39:36.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.289+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.290+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.290+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.291+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:39:36.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.292+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.293+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.293+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.294+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:39:36.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.295+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.295+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.296+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.297+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:39:36.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.298+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.298+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.299+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.300+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:39:36.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.301+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.301+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.302+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.302+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:39:36.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.304+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.305+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.305+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.306+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:39:36.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.308+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.308+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.308+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.309+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:39:36.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.311+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.311+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.312+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.313+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:39:36.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.314+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.314+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.315+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.316+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:39:36.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.317+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.317+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.318+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.319+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:39:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.320+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.320+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.321+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.322+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:39:36.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.323+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.324+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.324+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.325+0000 7f52d5f0c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:39:36.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.326+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.327+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:39:36.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.327+0000 7f52d5f0c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:39:36.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.328+0000 7f5189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.330+0000 7f52d5f0c800 20 remove_watcher() i=0 2024-09-14T11:39:36.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.330+0000 7f52d5f0c800 2 removed watcher, disabling cache 2024-09-14T11:39:36.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.331+0000 7f52d5f0c800 20 remove_watcher() i=1 2024-09-14T11:39:36.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.332+0000 7f52d5f0c800 20 remove_watcher() i=2 2024-09-14T11:39:36.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.333+0000 7f52d5f0c800 20 remove_watcher() i=3 2024-09-14T11:39:36.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.334+0000 7f52d5f0c800 20 remove_watcher() i=4 2024-09-14T11:39:36.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.335+0000 7f52d5f0c800 20 remove_watcher() i=5 2024-09-14T11:39:36.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.336+0000 7f52d5f0c800 20 remove_watcher() i=6 2024-09-14T11:39:36.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:39:36.337+0000 7f52d5f0c800 20 remove_watcher() i=7 2024-09-14T11:39:36.346 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:39:36.823 INFO:teuthology.orchestra.run.smithi094.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:39:40.424 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:39:58.023 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-14T11:39:58.023 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-14T11:39:58.023 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:39:58.823 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:04.623 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:40:05.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:05.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:40:06.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:06.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:40:06.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:06.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:40:06.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:06.322 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:40:06.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:06.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:40:07.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:40:07.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:40:07.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:40:07.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.322 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:40:07.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:07.722 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:40:08.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:08.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:40:08.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:08.222 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:40:08.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14 11:40:08,185 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:40:12.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:12.422 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:40:12.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:12.722 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:40:12.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:12.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:40:13.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:13.322 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:40:13.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:13.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:40:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:14.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:40:14.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:14.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:40:14.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:14.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:40:16.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:16.422 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:40:16.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:16.622 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:40:17.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:17.422 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:40:17.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:17.722 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:40:17.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:17.922 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:40:18.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:18.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:40:22.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:40:22.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:22.322 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:40:23.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:23.222 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:40:23.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:23.422 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:40:23.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:23.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:40:24.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:40:24.322 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.322 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:40:24.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.622 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:40:24.622 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.622 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:40:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:40:24.822 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:24.822 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:40:25.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:40:25.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.022 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:40:25.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.222 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:40:25.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.222 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:40:25.422 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.422 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:40:25.522 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.522 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:40:25.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.722 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:40:25.722 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.722 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:40:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.922 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:40:25.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:25.922 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:40:26.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:26.222 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:40:26.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:26.922 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:27.204 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 50s 2024-09-14T11:40:27.205 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:40:27.522 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:27.574 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:27.575 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:27.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.613+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 realm 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.615+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.616+0000 7fcabe93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:27.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.616+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.616+0000 7fcabe93c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:27.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.616+0000 7fcabe93c800 20 searching for the correct realm 2024-09-14T11:40:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.619+0000 7fcabae82640 0 -- 172.21.15.94:0/1530788657 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fcaa4038bd0 msgr2=0x7fcaa4042410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:27.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.623+0000 7fcaba681640 0 -- 172.21.15.94:0/1530788657 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fcaa4060920 msgr2=0x7fcaa402d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.830+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 zone default found 2024-09-14T11:40:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 4 Realm: () 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 zonegroup default 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.831+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.832+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.832+0000 7fcabe93c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.832+0000 7fcabe93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.832+0000 7fcabe93c800 20 started sync module instance, tier type = 2024-09-14T11:40:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.832+0000 7fcabe93c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:27.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=0 2024-09-14T11:40:27.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=1 2024-09-14T11:40:27.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=2 2024-09-14T11:40:27.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=3 2024-09-14T11:40:27.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=4 2024-09-14T11:40:27.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=5 2024-09-14T11:40:27.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.842+0000 7fcabe93c800 20 add_watcher() i=6 2024-09-14T11:40:27.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.843+0000 7fcabe93c800 20 add_watcher() i=7 2024-09-14T11:40:27.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.843+0000 7fcabe93c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:27.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.845+0000 7fc970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:27.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.846+0000 7fcabe93c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:27.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.846+0000 7fcabe93c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:27.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.880+0000 7fc8eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:27.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.880+0000 7fcabe93c800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:27.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.881+0000 7fcabe93c800 20 Filter name: none 2024-09-14T11:40:27.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.881+0000 7fc8e97fa640 20 reqs_thread_entry: start 2024-09-14T11:40:27.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.881+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:27.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.882+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.882+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9340815877381065796', time=2024-09-14T13:40:11.378845+0000, chain.objs.size()=5 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~tufUBj2FIFRRjHCeRv73nFWMbV33N0f.1 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~tufUBj2FIFRRjHCeRv73nFWMbV33N0f.1_1 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~tufUBj2FIFRRjHCeRv73nFWMbV33N0f.2 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~tufUBj2FIFRRjHCeRv73nFWMbV33N0f.2_1 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~tufUBj2FIFRRjHCeRv73nFWMbV33N0f.3 2024-09-14T11:40:27.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.476698491245376916', time=2024-09-14T13:40:16.499201+0000, chain.objs.size()=5 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.53__multipart_key1.2~CoAfyK8nMosLsaXLTyXJoSyE7Fxr5B3.1 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.53__multipart_key1.2~CoAfyK8nMosLsaXLTyXJoSyE7Fxr5B3.2 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.53__multipart_key1.2~CoAfyK8nMosLsaXLTyXJoSyE7Fxr5B3.3 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.53__multipart_key1.2~CoAfyK8nMosLsaXLTyXJoSyE7Fxr5B3.4 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.53__multipart_key1.2~CoAfyK8nMosLsaXLTyXJoSyE7Fxr5B3.5 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj', time=2024-09-14T13:40:24.458677+0000, chain.objs.size()=92 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.1 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.883+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.2 2024-09-14T11:40:27.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.885+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.3 2024-09-14T11:40:27.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.887+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.4 2024-09-14T11:40:27.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.887+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.5 2024-09-14T11:40:27.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.887+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.6 2024-09-14T11:40:27.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.7 2024-09-14T11:40:27.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.8 2024-09-14T11:40:27.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.9 2024-09-14T11:40:27.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.10 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.11 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.12 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.13 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.14 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.15 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.16 2024-09-14T11:40:27.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.891+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.17 2024-09-14T11:40:27.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.895+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.18 2024-09-14T11:40:27.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.895+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.19 2024-09-14T11:40:27.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.895+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.20 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.21 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.22 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.23 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.24 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.25 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.26 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.27 2024-09-14T11:40:27.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.896+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.28 2024-09-14T11:40:27.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.898+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.29 2024-09-14T11:40:27.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.898+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.30 2024-09-14T11:40:27.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.899+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.31 2024-09-14T11:40:27.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.899+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.32 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.33 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.34 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.35 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.36 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.37 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.38 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.39 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.40 2024-09-14T11:40:27.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.901+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.41 2024-09-14T11:40:27.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.902+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.42 2024-09-14T11:40:27.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.902+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.43 2024-09-14T11:40:27.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.44 2024-09-14T11:40:27.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.45 2024-09-14T11:40:27.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.46 2024-09-14T11:40:27.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.47 2024-09-14T11:40:27.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.48 2024-09-14T11:40:27.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.905+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.49 2024-09-14T11:40:27.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.906+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.50 2024-09-14T11:40:27.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.907+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.51 2024-09-14T11:40:27.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.907+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.52 2024-09-14T11:40:27.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.908+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.53 2024-09-14T11:40:27.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.910+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.54 2024-09-14T11:40:27.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.910+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.55 2024-09-14T11:40:27.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.910+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.56 2024-09-14T11:40:27.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.910+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.57 2024-09-14T11:40:27.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.911+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.58 2024-09-14T11:40:27.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.911+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.59 2024-09-14T11:40:27.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.911+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.60 2024-09-14T11:40:27.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.911+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.61 2024-09-14T11:40:27.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.913+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.62 2024-09-14T11:40:27.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.913+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.63 2024-09-14T11:40:27.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.913+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.64 2024-09-14T11:40:27.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.914+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.65 2024-09-14T11:40:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.914+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.66 2024-09-14T11:40:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.914+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.67 2024-09-14T11:40:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.914+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.68 2024-09-14T11:40:27.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.915+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.69 2024-09-14T11:40:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.915+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.70 2024-09-14T11:40:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.915+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.71 2024-09-14T11:40:27.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.915+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.72 2024-09-14T11:40:27.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.917+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.73 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.917+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.74 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.917+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.75 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.917+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.76 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.917+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.77 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.918+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.78 2024-09-14T11:40:27.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.918+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.79 2024-09-14T11:40:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.920+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.80 2024-09-14T11:40:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.81 2024-09-14T11:40:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.82 2024-09-14T11:40:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.83 2024-09-14T11:40:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.84 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.85 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.86 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.87 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.88 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.921+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.89 2024-09-14T11:40:27.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.922+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.90 2024-09-14T11:40:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.924+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.91 2024-09-14T11:40:27.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.924+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59__multipart_key1.2~pE8TNYSlGwKBdyYY1l2aElQps8XvoSj.92 2024-09-14T11:40:27.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.927+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:27.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.929+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:27.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17879640795588665381', time=2024-09-14T13:40:22.156129+0000, chain.objs.size()=11 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.1 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.1_1 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.2 2024-09-14T11:40:27.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.2_1 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.3 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.3_1 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.4 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.4_1 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.931+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.5 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.932+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.5_1 2024-09-14T11:40:27.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.932+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~V3mJgbOWQx916e6T5bJSWxY2MS429RO.6 2024-09-14T11:40:27.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.937+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.939+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.940+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.941+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.941+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.942+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:27.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.943+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15956569223852553999', time=2024-09-14T13:40:07.892245+0000, chain.objs.size()=5 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.1 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.2 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.3 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.4 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.5 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4525398773757978542', time=2024-09-14T13:40:12.475464+0000, chain.objs.size()=4 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47__shadow_.E-l6_nnDwVaSTozKJhb83Ks-XyFDN8D_0 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47__shadow_.E-l6_nnDwVaSTozKJhb83Ks-XyFDN8D_1 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47__shadow_.E-l6_nnDwVaSTozKJhb83Ks-XyFDN8D_2 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47__shadow_.E-l6_nnDwVaSTozKJhb83Ks-XyFDN8D_3 2024-09-14T11:40:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4022441609051924000', time=2024-09-14T13:40:23.229225+0000, chain.objs.size()=5 2024-09-14T11:40:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__multipart_key1.2~q7Fj4pL04XOAv2YELcvr4cryzyt4KJy.1 2024-09-14T11:40:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__multipart_key1.2~q7Fj4pL04XOAv2YELcvr4cryzyt4KJy.2 2024-09-14T11:40:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.944+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__multipart_key1.2~q7Fj4pL04XOAv2YELcvr4cryzyt4KJy.3 2024-09-14T11:40:27.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.948+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__multipart_key1.2~q7Fj4pL04XOAv2YELcvr4cryzyt4KJy.4 2024-09-14T11:40:27.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.948+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__multipart_key1.2~q7Fj4pL04XOAv2YELcvr4cryzyt4KJy.5 2024-09-14T11:40:27.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.951+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:27.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.953+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:27.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.955+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.955+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.956+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.957+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:27.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.959+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.959+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.960+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.961+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:27.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.962+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.962+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2727829767780941045', time=2024-09-14T13:40:07.765299+0000, chain.objs.size()=5 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.1 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.2 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.3 2024-09-14T11:40:27.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.4 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.45__multipart_key1.2~6BbvZd2M9ZgpduTTH91FiiC506uN0Hb.5 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14493532312945677447', time=2024-09-14T13:40:19.533430+0000, chain.objs.size()=11 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.1 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.2 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.3 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.4 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.5 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.6 2024-09-14T11:40:27.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.963+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.7 2024-09-14T11:40:27.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.966+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.8 2024-09-14T11:40:27.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.967+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.9 2024-09-14T11:40:27.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.967+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.10 2024-09-14T11:40:27.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.967+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~gqfST0pKM30-xGYACRJyBbjVg3HmIsH.11 2024-09-14T11:40:27.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.970+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:27.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.972+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:27.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.974+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.974+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.974+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.975+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:27.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.977+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.977+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12550790702219100720', time=2024-09-14T13:40:17.496139+0000, chain.objs.size()=1 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__shadow_.ja9iqBYvGI2Qi1Ks87t_HSWdXw-7UHC_0 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.445135730038003453', time=2024-09-14T13:40:20.230962+0000, chain.objs.size()=11 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.1 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.2 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.3 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.4 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.5 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.6 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.7 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.8 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.9 2024-09-14T11:40:27.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.10 2024-09-14T11:40:27.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.978+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~pMQC4b8aDCj-kiEibH194epuPOk7ePH.11 2024-09-14T11:40:27.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.982+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16382083399017819489', time=2024-09-14T13:40:20.829677+0000, chain.objs.size()=10 2024-09-14T11:40:27.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.982+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.1 2024-09-14T11:40:27.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.982+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.2 2024-09-14T11:40:27.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.982+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.3 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.982+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.4 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.5 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.6 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.7 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.8 2024-09-14T11:40:27.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.9 2024-09-14T11:40:27.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.983+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~zFmNGp__tVhShbSTYTatnqXGa7sYzK4.10 2024-09-14T11:40:27.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.988+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:27.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.991+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:27.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.992+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.993+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.993+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.994+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:27.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.996+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.996+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.996+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.997+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:27.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:27.999+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:27.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:27.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:27.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks', time=2024-09-14T13:40:05.778652+0000, chain.objs.size()=5 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.41__multipart_key1.2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks.1 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.41__multipart_key1.2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks.2 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.41__multipart_key1.2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks.3 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.41__multipart_key1.2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks.4 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.41__multipart_key1.2~NG5CSwIqdZQjQ9eA_cQQXbH6k_sJ5Ks.5 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9636235450060814098', time=2024-09-14T13:40:22.681538+0000, chain.objs.size()=1 2024-09-14T11:40:27.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.000+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57__shadow_.-uq41poTUnVBqOSY99WcWBP7O7YlZIJ_0 2024-09-14T11:40:28.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.002+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.005+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:28.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.006+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17767911754418375993', time=2024-09-14T13:40:12.335573+0000, chain.objs.size()=5 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~JFznecQKDTLPZHn_u09UKHhDEFDxezO.1 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~JFznecQKDTLPZHn_u09UKHhDEFDxezO.1_1 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~JFznecQKDTLPZHn_u09UKHhDEFDxezO.2 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~JFznecQKDTLPZHn_u09UKHhDEFDxezO.2_1 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~JFznecQKDTLPZHn_u09UKHhDEFDxezO.3 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18184825544606413436', time=2024-09-14T13:40:25.304837+0000, chain.objs.size()=1 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.63__shadow_.eReEBi5bwNa7zIrWDpVq7OsWokzQb_l_0 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17496387803683185094', time=2024-09-14T13:40:25.748852+0000, chain.objs.size()=1 2024-09-14T11:40:28.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.007+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.65__shadow_.wfwL-fkAEE30fSrgJU9vFAbagK7Up_E_0 2024-09-14T11:40:28.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.010+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.012+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:28.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.014+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.014+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.014+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.015+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:28.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.016+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.017+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.017+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.018+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:28.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.019+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5252809097352100236', time=2024-09-14T13:40:09.927008+0000, chain.objs.size()=5 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~wOV8fe8fEvu_ohAY85k4eqRveo8ZEo2.1 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~wOV8fe8fEvu_ohAY85k4eqRveo8ZEo2.2 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~wOV8fe8fEvu_ohAY85k4eqRveo8ZEo2.3 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~wOV8fe8fEvu_ohAY85k4eqRveo8ZEo2.4 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~wOV8fe8fEvu_ohAY85k4eqRveo8ZEo2.5 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10977716104318814792', time=2024-09-14T13:40:10.498161+0000, chain.objs.size()=5 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~lWV8jNuwdq0snHdwyIC_FAQefBIKfUV.1 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~lWV8jNuwdq0snHdwyIC_FAQefBIKfUV.2 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~lWV8jNuwdq0snHdwyIC_FAQefBIKfUV.3 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~lWV8jNuwdq0snHdwyIC_FAQefBIKfUV.4 2024-09-14T11:40:28.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~lWV8jNuwdq0snHdwyIC_FAQefBIKfUV.5 2024-09-14T11:40:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13375910986455412213', time=2024-09-14T13:40:22.017227+0000, chain.objs.size()=11 2024-09-14T11:40:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.1 2024-09-14T11:40:28.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.020+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.1_1 2024-09-14T11:40:28.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.2 2024-09-14T11:40:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.2_1 2024-09-14T11:40:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.3 2024-09-14T11:40:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.3_1 2024-09-14T11:40:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.4 2024-09-14T11:40:28.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.024+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.4_1 2024-09-14T11:40:28.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.027+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.5 2024-09-14T11:40:28.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.027+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.5_1 2024-09-14T11:40:28.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.027+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~S67qyGgVsbxV2S1fyKx5vU5woMHob0A.6 2024-09-14T11:40:28.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.030+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.033+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.034+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.034+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.035+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.035+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4443578879791143627', time=2024-09-14T13:40:25.527476+0000, chain.objs.size()=1 2024-09-14T11:40:28.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.035+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.64__shadow_.bwBrG_ZenW_AAdnLM1dPSntBnn2PGJ4_0 2024-09-14T11:40:28.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.036+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.038+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:28.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.039+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.040+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.040+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:28.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.040+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6747924390767650522', time=2024-09-14T13:40:24.634220+0000, chain.objs.size()=1 2024-09-14T11:40:28.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.040+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.60__shadow_.O1pi3ld89EkUYyE6JtJ8SELdxauE7_s_0 2024-09-14T11:40:28.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.041+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.043+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:28.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.044+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.045+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.045+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.046+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:28.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.047+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13866199902105933135', time=2024-09-14T13:40:13.856781+0000, chain.objs.size()=5 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52__multipart_key1.2~LrJey2whXK6Ci80RKBDFj_R5bTbKz81.1 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52__multipart_key1.2~LrJey2whXK6Ci80RKBDFj_R5bTbKz81.2 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52__multipart_key1.2~LrJey2whXK6Ci80RKBDFj_R5bTbKz81.3 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52__multipart_key1.2~LrJey2whXK6Ci80RKBDFj_R5bTbKz81.4 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52__multipart_key1.2~LrJey2whXK6Ci80RKBDFj_R5bTbKz81.5 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3316834842525952616', time=2024-09-14T13:40:17.489401+0000, chain.objs.size()=5 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file2.mpg.2~757FUere4K1n0vV93g5dsNCPa-FOzBA.1 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file2.mpg.2~757FUere4K1n0vV93g5dsNCPa-FOzBA.2 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file2.mpg.2~757FUere4K1n0vV93g5dsNCPa-FOzBA.3 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file2.mpg.2~757FUere4K1n0vV93g5dsNCPa-FOzBA.4 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file2.mpg.2~757FUere4K1n0vV93g5dsNCPa-FOzBA.5 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='2~uW75yxfk__oi1Aj2oMASP5uYgOZ5v1H', time=2024-09-14T13:40:17.999660+0000, chain.objs.size()=3 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.55__multipart_key1.2~uW75yxfk__oi1Aj2oMASP5uYgOZ5v1H.7 2024-09-14T11:40:28.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.048+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.55__multipart_key1.2~uW75yxfk__oi1Aj2oMASP5uYgOZ5v1H.10 2024-09-14T11:40:28.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.053+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.55__multipart_key1.2~uW75yxfk__oi1Aj2oMASP5uYgOZ5v1H.13 2024-09-14T11:40:28.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.053+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10808562164439137571', time=2024-09-14T13:40:24.857191+0000, chain.objs.size()=1 2024-09-14T11:40:28.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.053+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.61__shadow_.UQhMd6uLFrPseF1tT9mDDEYDvHuGqlR_0 2024-09-14T11:40:28.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.056+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.058+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:28.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16346302852430482004', time=2024-09-14T13:40:10.941841+0000, chain.objs.size()=5 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~BxmQVW9rKr1YGMKzaHyabQjhxobRF4j.1 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~BxmQVW9rKr1YGMKzaHyabQjhxobRF4j.2 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~BxmQVW9rKr1YGMKzaHyabQjhxobRF4j.3 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~BxmQVW9rKr1YGMKzaHyabQjhxobRF4j.4 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~BxmQVW9rKr1YGMKzaHyabQjhxobRF4j.5 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10143447103077091691', time=2024-09-14T13:40:21.415776+0000, chain.objs.size()=11 2024-09-14T11:40:28.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.1 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.060+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.1_1 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.061+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.2 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.061+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.2_1 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.061+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.3 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.061+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.3_1 2024-09-14T11:40:28.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.061+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.4 2024-09-14T11:40:28.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.066+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.4_1 2024-09-14T11:40:28.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.066+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.5 2024-09-14T11:40:28.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.067+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__shadow_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.5_1 2024-09-14T11:40:28.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.067+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56__multipart_key1.2~kFdGrQ4ivOg2_A02eIB7smuU2pEyBoR.6 2024-09-14T11:40:28.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.070+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.072+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:28.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.073+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.074+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.074+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.076+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:28.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.077+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.077+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11667860354329619967', time=2024-09-14T13:40:12.596367+0000, chain.objs.size()=5 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~nYnnr0Hx6rQi-M45FED8QpdNl8RSZKF.1 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~nYnnr0Hx6rQi-M45FED8QpdNl8RSZKF.1_1 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~nYnnr0Hx6rQi-M45FED8QpdNl8RSZKF.2 2024-09-14T11:40:28.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__shadow_key1.2~nYnnr0Hx6rQi-M45FED8QpdNl8RSZKF.2_1 2024-09-14T11:40:28.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.078+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.48__multipart_key1.2~nYnnr0Hx6rQi-M45FED8QpdNl8RSZKF.3 2024-09-14T11:40:28.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.080+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.083+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:28.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.084+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.084+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.085+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.085+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:28.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.087+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.087+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15413676118509858959', time=2024-09-14T13:40:06.852209+0000, chain.objs.size()=5 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.43__multipart_key1.2~Tj5OYfmBcTYgL8JnrBgPAxljGqdNmB_.1 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.43__multipart_key1.2~Tj5OYfmBcTYgL8JnrBgPAxljGqdNmB_.2 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.43__multipart_key1.2~Tj5OYfmBcTYgL8JnrBgPAxljGqdNmB_.3 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.43__multipart_key1.2~Tj5OYfmBcTYgL8JnrBgPAxljGqdNmB_.4 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.43__multipart_key1.2~Tj5OYfmBcTYgL8JnrBgPAxljGqdNmB_.5 2024-09-14T11:40:28.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12580682860546471510', time=2024-09-14T13:40:17.502464+0000, chain.objs.size()=1 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__shadow_.cJaDHTSbhVnITRbkcTrU7xFGfQBHBse_0 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8333713776205803840', time=2024-09-14T13:40:23.852324+0000, chain.objs.size()=5 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.58__multipart_key1.2~vegUztNsjRzfMN1N0o8Sndn1gp0rHgQ.1 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.58__multipart_key1.2~vegUztNsjRzfMN1N0o8Sndn1gp0rHgQ.2 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.58__multipart_key1.2~vegUztNsjRzfMN1N0o8Sndn1gp0rHgQ.3 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.58__multipart_key1.2~vegUztNsjRzfMN1N0o8Sndn1gp0rHgQ.4 2024-09-14T11:40:28.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.088+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.58__multipart_key1.2~vegUztNsjRzfMN1N0o8Sndn1gp0rHgQ.5 2024-09-14T11:40:28.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.094+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.096+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:28.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.097+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.098+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.098+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.099+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:28.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.101+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.101+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.101+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.103+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:28.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.104+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.104+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16480277013269583008', time=2024-09-14T13:40:17.476972+0000, chain.objs.size()=5 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file.mpg.2~I3-lh8ncLUDzC0GQwfNlT5CAlfxoQfh.1 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file.mpg.2~I3-lh8ncLUDzC0GQwfNlT5CAlfxoQfh.2 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file.mpg.2~I3-lh8ncLUDzC0GQwfNlT5CAlfxoQfh.3 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file.mpg.2~I3-lh8ncLUDzC0GQwfNlT5CAlfxoQfh.4 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__multipart_file.mpg.2~I3-lh8ncLUDzC0GQwfNlT5CAlfxoQfh.5 2024-09-14T11:40:28.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11353111628291330535', time=2024-09-14T13:40:25.082327+0000, chain.objs.size()=1 2024-09-14T11:40:28.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.105+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.62__shadow_.TaGwvFie_r6lpef7mNyciF3d3Bzx1vL_0 2024-09-14T11:40:28.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.108+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.110+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:28.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.111+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.112+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.112+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.113+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:28.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.114+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.114+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:28.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2187000184886149082', time=2024-09-14T13:40:26.987286+0000, chain.objs.size()=11 2024-09-14T11:40:28.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.1 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.2 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.3 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.4 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.5 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.6 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.7 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.8 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.9 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.10 2024-09-14T11:40:28.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.115+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.67__multipart_key1.2~e3KHiJ16GGDmfLG4g5kx5SypBwy3XL4.11 2024-09-14T11:40:28.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.119+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.122+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:28.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.123+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.124+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.124+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.125+0000 7fcabe93c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:28.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.126+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.127+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.127+0000 7fcabe93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:28.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.127+0000 7fcabe93c800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6355062579884669765', time=2024-09-14T13:40:17.483093+0000, chain.objs.size()=1 2024-09-14T11:40:28.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.127+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.54__shadow_.MMbrKCuFyZJwuwx-0XZOfscHCFbYnTd_0 2024-09-14T11:40:28.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.129+0000 7fcabe93c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:28.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.132+0000 7fc970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:28.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.134+0000 7fcabe93c800 20 remove_watcher() i=0 2024-09-14T11:40:28.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.134+0000 7fcabe93c800 2 removed watcher, disabling cache 2024-09-14T11:40:28.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.135+0000 7fcabe93c800 20 remove_watcher() i=1 2024-09-14T11:40:28.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.136+0000 7fcabe93c800 20 remove_watcher() i=2 2024-09-14T11:40:28.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.137+0000 7fcabe93c800 20 remove_watcher() i=3 2024-09-14T11:40:28.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.138+0000 7fcabe93c800 20 remove_watcher() i=4 2024-09-14T11:40:28.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.138+0000 7fcabe93c800 20 remove_watcher() i=5 2024-09-14T11:40:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.139+0000 7fcabe93c800 20 remove_watcher() i=6 2024-09-14T11:40:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.140+0000 7fcabe93c800 20 remove_watcher() i=7 2024-09-14T11:40:28.149 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:28.202 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:28.202 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:28.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.241+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 20 realm 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.243+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.244+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.244+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.244+0000 7f1a00612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:28.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.244+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.245+0000 7f1a00612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:28.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.245+0000 7f1a00612800 20 searching for the correct realm 2024-09-14T11:40:28.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.248+0000 7f19fc4cc640 0 -- 172.21.15.94:0/2282651301 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f19e4045030 msgr2=0x7f19e406f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:28.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.251+0000 7f19fbccb640 0 -- 172.21.15.94:0/2282651301 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f19e406e800 msgr2=0x7f19e4088050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:28.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.255+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:28.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 zone default found 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 4 Realm: () 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 zonegroup default 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 started sync module instance, tier type = 2024-09-14T11:40:28.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.256+0000 7f1a00612800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:28.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=0 2024-09-14T11:40:28.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=1 2024-09-14T11:40:28.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=2 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=3 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=4 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=5 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.264+0000 7f1a00612800 20 add_watcher() i=6 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.265+0000 7f1a00612800 20 add_watcher() i=7 2024-09-14T11:40:28.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.265+0000 7f1a00612800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:28.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.267+0000 7f18b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:28.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.267+0000 7f1a00612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:28.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.267+0000 7f1a00612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.300+0000 7f18b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.300+0000 7f1a00612800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:28.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.300+0000 7f1a00612800 20 Filter name: none 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.300+0000 7f182a7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.300+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.301+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.302+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.302+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.303+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.305+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.305+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.306+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.306+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.308+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.308+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.308+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.309+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:28.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.310+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.311+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.311+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.312+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:28.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.313+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.314+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.314+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.315+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:28.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.316+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.317+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.317+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.318+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:28.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.320+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.320+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.320+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.321+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:28.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.323+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.323+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.323+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.324+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:28.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.325+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.326+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.326+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.327+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:28.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.328+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.328+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.329+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.330+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:28.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.331+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.331+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.331+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.332+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:28.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.333+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.334+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.334+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.335+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:28.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.337+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.337+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.338+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.338+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:28.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.340+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.340+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.340+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.342+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:28.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.343+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.343+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.343+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.345+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:28.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.346+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.346+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.346+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.347+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:28.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.349+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.349+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.350+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.351+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:28.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.352+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.352+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.352+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.353+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:28.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.354+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.355+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.355+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.356+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:28.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.357+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.357+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.358+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.359+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:28.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.360+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.360+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.360+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.361+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:28.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.363+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.363+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.364+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.364+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:28.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.366+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.366+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.366+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.367+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:28.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.368+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.369+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.369+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.370+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:28.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.371+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.372+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.372+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.373+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:28.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.375+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.375+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.375+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.377+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:28.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.378+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.379+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.379+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.380+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:28.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.381+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.382+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.382+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.383+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:28.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.384+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.385+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.385+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.386+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:28.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.388+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.388+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.388+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.389+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:28.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.391+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.391+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.391+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.392+0000 7f1a00612800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:28.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.393+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.394+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.394+0000 7f1a00612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.396+0000 7f18b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:28.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.398+0000 7f1a00612800 20 remove_watcher() i=0 2024-09-14T11:40:28.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.398+0000 7f1a00612800 2 removed watcher, disabling cache 2024-09-14T11:40:28.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.399+0000 7f1a00612800 20 remove_watcher() i=1 2024-09-14T11:40:28.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.400+0000 7f1a00612800 20 remove_watcher() i=2 2024-09-14T11:40:28.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.401+0000 7f1a00612800 20 remove_watcher() i=3 2024-09-14T11:40:28.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.402+0000 7f1a00612800 20 remove_watcher() i=4 2024-09-14T11:40:28.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.403+0000 7f1a00612800 20 remove_watcher() i=5 2024-09-14T11:40:28.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.404+0000 7f1a00612800 20 remove_watcher() i=6 2024-09-14T11:40:28.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.404+0000 7f1a00612800 20 remove_watcher() i=7 2024-09-14T11:40:28.413 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:28.465 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:28.465 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:28.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.503+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 realm 2024-09-14T11:40:28.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:28.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.505+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.506+0000 7fbcfdf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:28.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.506+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.506+0000 7fbcfdf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:28.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.506+0000 7fbcfdf28800 20 searching for the correct realm 2024-09-14T11:40:28.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.509+0000 7fbcfa470640 0 -- 172.21.15.94:0/124514265 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fbcf0095060 msgr2=0x7fbcf00b7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:28.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.512+0000 7fbcf9c6f640 0 -- 172.21.15.94:0/124514265 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbcf00c4bd0 msgr2=0x7fbcf00b8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:28.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:28.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:28.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:28.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:28.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:28.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:28.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.717+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:28.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:28.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 zone default found 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 4 Realm: () 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 zonegroup default 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.718+0000 7fbcfdf28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.719+0000 7fbcfdf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.719+0000 7fbcfdf28800 20 started sync module instance, tier type = 2024-09-14T11:40:28.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.719+0000 7fbcfdf28800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=0 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=1 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=2 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=3 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=4 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=5 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=6 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 20 add_watcher() i=7 2024-09-14T11:40:28.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.728+0000 7fbcfdf28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.730+0000 7fbbab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.731+0000 7fbcfdf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.731+0000 7fbcfdf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:28.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.764+0000 7fbbaa7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:28.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.764+0000 7fbcfdf28800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:28.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.764+0000 7fbcfdf28800 20 Filter name: none 2024-09-14T11:40:28.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.764+0000 7fbb1ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:28.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.764+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:28.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.765+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.766+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.766+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.767+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:28.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.768+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.769+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.769+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.770+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:28.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.771+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.771+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.772+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.773+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:28.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.774+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.775+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.775+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.776+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:28.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.777+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.778+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.778+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.779+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:28.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.780+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.781+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.781+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.782+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:28.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.783+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.783+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.784+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.785+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:28.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.786+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.786+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.786+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.788+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:28.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.789+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.789+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.790+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.791+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:28.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.792+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.792+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.793+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.793+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:28.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.795+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.795+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.795+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.796+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:28.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.798+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.798+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.798+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.799+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:28.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.800+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.801+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.801+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.802+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:28.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.803+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.804+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.804+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.805+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:28.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.806+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.807+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.807+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.808+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:28.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.809+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.809+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.810+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.810+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:28.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.812+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.812+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.812+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.813+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:28.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.815+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.815+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.815+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.816+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:28.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.818+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.818+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.818+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.819+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:28.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.820+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.821+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.821+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.822+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.823+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.824+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.824+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.825+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.826+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.827+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.827+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.828+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:28.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.829+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.830+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.830+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.831+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:28.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.832+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.833+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.833+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.834+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:28.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.835+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.835+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.835+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.836+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:28.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.837+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.838+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.838+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.839+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:28.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.840+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.840+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.841+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.841+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:28.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.843+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.844+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.844+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.845+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:28.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.846+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.847+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.847+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.848+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:28.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.849+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.850+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.850+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.851+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:28.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.852+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.853+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.853+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.854+0000 7fbcfdf28800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:28.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.855+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.856+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:28.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.856+0000 7fbcfdf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:28.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.858+0000 7fbbab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:28.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.859+0000 7fbcfdf28800 20 remove_watcher() i=0 2024-09-14T11:40:28.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.859+0000 7fbcfdf28800 2 removed watcher, disabling cache 2024-09-14T11:40:28.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.860+0000 7fbcfdf28800 20 remove_watcher() i=1 2024-09-14T11:40:28.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.862+0000 7fbcfdf28800 20 remove_watcher() i=2 2024-09-14T11:40:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.863+0000 7fbcfdf28800 20 remove_watcher() i=3 2024-09-14T11:40:28.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.864+0000 7fbcfdf28800 20 remove_watcher() i=4 2024-09-14T11:40:28.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.864+0000 7fbcfdf28800 20 remove_watcher() i=5 2024-09-14T11:40:28.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.865+0000 7fbcfdf28800 20 remove_watcher() i=6 2024-09-14T11:40:28.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.866+0000 7fbcfdf28800 20 remove_watcher() i=7 2024-09-14T11:40:28.875 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:28.927 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:28.927 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:28.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.966+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 realm 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:28.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.968+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.969+0000 7fb09d925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:28.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.969+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:28.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.969+0000 7fb09d925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:28.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.969+0000 7fb09d925800 20 searching for the correct realm 2024-09-14T11:40:28.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:28.971+0000 7fb099533640 0 -- 172.21.15.94:0/2743845535 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55fe9acddb40 msgr2=0x7fb09405a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:29.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.175+0000 7fb099d34640 0 -- 172.21.15.94:0/2743845535 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7fb08405ff90 msgr2=0x7fb08406b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:29.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.383+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 zone default found 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 4 Realm: () 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 zonegroup default 2024-09-14T11:40:29.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.384+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.385+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.385+0000 7fb09d925800 20 rados->read ofs=0 len=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.385+0000 7fb09d925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.385+0000 7fb09d925800 20 started sync module instance, tier type = 2024-09-14T11:40:29.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.385+0000 7fb09d925800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=0 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=1 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=2 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=3 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=4 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=5 2024-09-14T11:40:29.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=6 2024-09-14T11:40:29.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 20 add_watcher() i=7 2024-09-14T11:40:29.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.394+0000 7fb09d925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.396+0000 7faf4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.397+0000 7fb09d925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.397+0000 7fb09d925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:29.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.431+0000 7faf4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:29.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.431+0000 7fb09d925800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:29.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.431+0000 7fb09d925800 20 Filter name: none 2024-09-14T11:40:29.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.431+0000 7faebffff640 20 reqs_thread_entry: start 2024-09-14T11:40:29.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.431+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:29.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.432+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.433+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.433+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.434+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:29.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.435+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.436+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.436+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.437+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:29.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.438+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.438+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.439+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.439+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:29.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.441+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.441+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.442+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.442+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:29.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.444+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.444+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.445+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.446+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:29.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.447+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.447+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.447+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.448+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:29.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.450+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.450+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.450+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.452+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:29.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.453+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.453+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.454+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.455+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:29.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.456+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.457+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.457+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.458+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.459+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.460+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.460+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.461+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:29.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.462+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.463+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.463+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.464+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.465+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.466+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.466+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.467+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:29.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.468+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.469+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.469+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.470+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.471+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.472+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.472+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.473+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:29.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.474+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.475+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.475+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.476+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:29.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.477+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.478+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.478+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.479+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:29.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.480+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.481+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.481+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.482+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:29.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.483+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.484+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.484+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.485+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:29.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.486+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.487+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.487+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.488+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:29.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.489+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.489+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.490+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.491+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:29.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.492+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.492+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.493+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.494+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:29.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.495+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.495+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.496+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.496+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.498+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.498+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.498+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.499+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:29.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.501+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.501+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.501+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.502+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:29.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.503+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.505+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.505+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.506+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:29.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.507+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.507+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.508+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.508+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:29.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.510+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.510+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.511+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.512+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:29.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.513+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.514+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.514+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.515+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:29.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.516+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.516+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.517+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.518+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:29.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.519+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.519+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.519+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.520+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:29.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.522+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.522+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.522+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.523+0000 7fb09d925800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:29.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.525+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.525+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:29.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.525+0000 7fb09d925800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.528+0000 7faf4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:29.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.530+0000 7fb09d925800 20 remove_watcher() i=0 2024-09-14T11:40:29.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.530+0000 7fb09d925800 2 removed watcher, disabling cache 2024-09-14T11:40:29.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.531+0000 7fb09d925800 20 remove_watcher() i=1 2024-09-14T11:40:29.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.532+0000 7fb09d925800 20 remove_watcher() i=2 2024-09-14T11:40:29.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.533+0000 7fb09d925800 20 remove_watcher() i=3 2024-09-14T11:40:29.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.534+0000 7fb09d925800 20 remove_watcher() i=4 2024-09-14T11:40:29.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.535+0000 7fb09d925800 20 remove_watcher() i=5 2024-09-14T11:40:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.536+0000 7fb09d925800 20 remove_watcher() i=6 2024-09-14T11:40:29.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:29.537+0000 7fb09d925800 20 remove_watcher() i=7 2024-09-14T11:40:29.546 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:40:30.137 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-14T11:40:30.934 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-14T11:40:30.935 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-14T11:40:30.935 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-14T11:40:31.334 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:31.334 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-14T11:40:31.335 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:40:31.335 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:40:31.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:31.336 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:40:31.336 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14 11:40:32,638 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:40:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.337 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:40:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.337 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:40:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.337 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:40:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.434 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:40:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.435 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:40:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.634 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:40:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.634 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:40:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.734 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:40:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:33.834 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:40:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.034 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:40:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.134 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:40:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.135 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:40:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.234 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:40:34.534 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.534 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:40:34.634 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.634 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:40:34.834 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.834 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:40:34.934 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.934 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:40:34.970 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:40:34.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 5s 2024-09-14T11:40:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-14T11:40:34.975 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:35.027 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:35.027 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:35.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.065+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.066+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.066+0000 7fc060a14800 20 realm 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.066+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.067+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.067+0000 7fc060a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.067+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.067+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.067+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.068+0000 7fc060a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:35.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.068+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.068+0000 7fc060a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:35.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.068+0000 7fc060a14800 20 searching for the correct realm 2024-09-14T11:40:35.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.071+0000 7fc05c8cc640 0 -- 172.21.15.94:0/1774151051 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fc044027040 msgr2=0x7fc044068580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:35.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.075+0000 7fc05c0cb640 0 -- 172.21.15.94:0/1774151051 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fc044083bd0 msgr2=0x7fc044072050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:35.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:35.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:35.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:35.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:35.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:35.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.282+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 zone default found 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 4 Realm: () 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 zonegroup default 2024-09-14T11:40:35.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.283+0000 7fc060a14800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.284+0000 7fc060a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.284+0000 7fc060a14800 20 started sync module instance, tier type = 2024-09-14T11:40:35.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.284+0000 7fc060a14800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=0 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=1 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=2 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=3 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=4 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=5 2024-09-14T11:40:35.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.293+0000 7fc060a14800 20 add_watcher() i=6 2024-09-14T11:40:35.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.294+0000 7fc060a14800 20 add_watcher() i=7 2024-09-14T11:40:35.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.294+0000 7fc060a14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:35.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.295+0000 7fbf127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:35.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.296+0000 7fc060a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:35.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.296+0000 7fc060a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.335+0000 7fbf117e2640 20 reqs_thread_entry: start 2024-09-14T11:40:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.335+0000 7fc060a14800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.335+0000 7fc060a14800 20 Filter name: none 2024-09-14T11:40:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.335+0000 7fbe82ffd640 20 reqs_thread_entry: start 2024-09-14T11:40:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.335+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.337+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.337+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.338+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.339+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.340+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.340+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.341+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.341+0000 7fc060a14800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10970063548731591861', time=2024-09-14T13:40:33.872694+0000, chain.objs.size()=1 2024-09-14T11:40:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.341+0000 7fc060a14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.72__shadow_.wjjYMIEsCGUtmeH_W5D-kTKNFrucl4H_0 2024-09-14T11:40:35.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.342+0000 7fc060a14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.344+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.346+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.346+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.346+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.347+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:35.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.349+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.349+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.349+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.350+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:35.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.351+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.352+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.352+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.353+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:35.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.354+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.355+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.355+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.356+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:35.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.357+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.358+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.358+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.359+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.360+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.361+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.361+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.362+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:35.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.364+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.364+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.364+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.365+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:35.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.367+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.367+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.368+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.369+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:35.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.370+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.371+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.371+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.372+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:35.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.374+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.375+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.375+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.376+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:35.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.378+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.378+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.378+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.379+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:35.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.381+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.382+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.382+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.383+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:35.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.385+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.386+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.386+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.387+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:35.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.389+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.390+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.390+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.391+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:35.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.392+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.393+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.393+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.394+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:35.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.395+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.396+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.396+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.397+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:35.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.399+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.399+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.399+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.400+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:35.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.401+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.402+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.402+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.403+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:35.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.404+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.405+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.405+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.406+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:35.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.407+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.408+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.408+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.409+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:35.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.411+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.411+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.411+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.413+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:35.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.415+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.415+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.415+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.416+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:35.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.418+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.418+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.418+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.419+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:35.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.420+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.421+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.421+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.421+0000 7fc060a14800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16012983667763743136', time=2024-09-14T13:40:34.291928+0000, chain.objs.size()=1 2024-09-14T11:40:35.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.421+0000 7fc060a14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.73__shadow_.y6FXCnf1i2TiO9UI-UolpSAkz2rqTaP_0 2024-09-14T11:40:35.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.422+0000 7fc060a14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:35.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.425+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:35.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.426+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.427+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.427+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.428+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:35.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.429+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.430+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.430+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.431+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:35.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.432+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.432+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.433+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.434+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:35.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.435+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.435+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.435+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.436+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:35.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.438+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.438+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.438+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.440+0000 7fc060a14800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:35.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.441+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.442+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.442+0000 7fc060a14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.443+0000 7fbf127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:35.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.445+0000 7fc060a14800 20 remove_watcher() i=0 2024-09-14T11:40:35.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.445+0000 7fc060a14800 2 removed watcher, disabling cache 2024-09-14T11:40:35.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.447+0000 7fc060a14800 20 remove_watcher() i=1 2024-09-14T11:40:35.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.448+0000 7fc060a14800 20 remove_watcher() i=2 2024-09-14T11:40:35.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.449+0000 7fc060a14800 20 remove_watcher() i=3 2024-09-14T11:40:35.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.450+0000 7fc060a14800 20 remove_watcher() i=4 2024-09-14T11:40:35.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.450+0000 7fc060a14800 20 remove_watcher() i=5 2024-09-14T11:40:35.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.451+0000 7fc060a14800 20 remove_watcher() i=6 2024-09-14T11:40:35.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.452+0000 7fc060a14800 20 remove_watcher() i=7 2024-09-14T11:40:35.461 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:35.512 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:35.513 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:35.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.551+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.552+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.552+0000 7fc785698800 20 realm 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.552+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.553+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.553+0000 7fc785698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.553+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.553+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.553+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.554+0000 7fc785698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.554+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.554+0000 7fc785698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:35.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.554+0000 7fc785698800 20 searching for the correct realm 2024-09-14T11:40:35.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.557+0000 7fc77a981640 0 -- 172.21.15.94:0/3370981185 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fc774055040 msgr2=0x7fc774046400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:35.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.560+0000 7fc783182640 0 -- 172.21.15.94:0/3370981185 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fc76c0c7010 msgr2=0x7fc76c0e5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:35.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.766+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 zone default found 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 4 Realm: () 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 zonegroup default 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.767+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 rados->read ofs=0 len=0 2024-09-14T11:40:35.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:35.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 started sync module instance, tier type = 2024-09-14T11:40:35.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.768+0000 7fc785698800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=0 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=1 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=2 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=3 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=4 2024-09-14T11:40:35.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=5 2024-09-14T11:40:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.777+0000 7fc785698800 20 add_watcher() i=6 2024-09-14T11:40:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.778+0000 7fc785698800 20 add_watcher() i=7 2024-09-14T11:40:35.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.778+0000 7fc785698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:35.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.779+0000 7fc639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.780+0000 7fc785698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:35.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.780+0000 7fc785698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.816+0000 7fc638fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.816+0000 7fc785698800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.816+0000 7fc785698800 20 Filter name: none 2024-09-14T11:40:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.817+0000 7fc5b27fc640 20 reqs_thread_entry: start 2024-09-14T11:40:35.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.817+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:35.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.818+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.819+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.819+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.820+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:35.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.821+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.822+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.822+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.823+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:35.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.824+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.825+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.825+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.826+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:35.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.827+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.828+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.828+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.829+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:35.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.830+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.831+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.831+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.832+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:35.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.833+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.834+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.834+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.835+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:35.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.836+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.836+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.837+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.838+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:35.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.839+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.839+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.839+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.840+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:35.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.842+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.842+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.842+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.843+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:35.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.844+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.845+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.845+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.846+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:35.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.848+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.848+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.848+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.849+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:35.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.851+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.852+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.852+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.853+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:35.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.854+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.855+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.855+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.856+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:35.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.857+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.858+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.858+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.859+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:35.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.860+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.861+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.861+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.862+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:35.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.864+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.864+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.864+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.866+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.867+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.867+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.868+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.869+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.870+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.870+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.871+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.872+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:35.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.873+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.874+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.874+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.875+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:35.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.877+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.877+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.877+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.878+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:35.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.879+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.880+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.880+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.881+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:35.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.882+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.883+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.883+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.884+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:35.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.885+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.886+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.886+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.887+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:35.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.888+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.889+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.889+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.890+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:35.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.892+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.892+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.893+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.894+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:35.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.895+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.895+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.895+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.896+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:35.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.898+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.898+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.898+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.899+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:35.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.900+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.901+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.901+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.902+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:35.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.903+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.904+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.904+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.905+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:35.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.906+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.906+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.906+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.907+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:35.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.909+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.909+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.909+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.910+0000 7fc785698800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:35.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.912+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.912+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:35.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.913+0000 7fc785698800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:35.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.914+0000 7fc639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:35.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.917+0000 7fc785698800 20 remove_watcher() i=0 2024-09-14T11:40:35.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.917+0000 7fc785698800 2 removed watcher, disabling cache 2024-09-14T11:40:35.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.918+0000 7fc785698800 20 remove_watcher() i=1 2024-09-14T11:40:35.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.919+0000 7fc785698800 20 remove_watcher() i=2 2024-09-14T11:40:35.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.920+0000 7fc785698800 20 remove_watcher() i=3 2024-09-14T11:40:35.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.921+0000 7fc785698800 20 remove_watcher() i=4 2024-09-14T11:40:35.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.922+0000 7fc785698800 20 remove_watcher() i=5 2024-09-14T11:40:35.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.923+0000 7fc785698800 20 remove_watcher() i=6 2024-09-14T11:40:35.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:35.924+0000 7fc785698800 20 remove_watcher() i=7 2024-09-14T11:40:35.932 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:35.984 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:35.984 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:36.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.022+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 realm 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:36.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.024+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.025+0000 7fcae2334800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.025+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.025+0000 7fcae2334800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:36.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.025+0000 7fcae2334800 20 searching for the correct realm 2024-09-14T11:40:36.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.028+0000 7fcadd8b6640 0 -- 172.21.15.94:0/1887322145 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x5611fe8c9630 msgr2=0x5611fe8cbaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.032+0000 7fcade0b7640 0 -- 172.21.15.94:0/1887322145 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fcac809d910 msgr2=0x7fcac80940c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:36.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 zone default found 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 4 Realm: () 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:36.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 zonegroup default 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.036+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 started sync module instance, tier type = 2024-09-14T11:40:36.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.037+0000 7fcae2334800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=0 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=1 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=2 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=3 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=4 2024-09-14T11:40:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=5 2024-09-14T11:40:36.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.045+0000 7fcae2334800 20 add_watcher() i=6 2024-09-14T11:40:36.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.046+0000 7fcae2334800 20 add_watcher() i=7 2024-09-14T11:40:36.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.046+0000 7fcae2334800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:36.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.048+0000 7fc994fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.048+0000 7fcae2334800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.048+0000 7fcae2334800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:36.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.082+0000 7fc90f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:36.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.082+0000 7fcae2334800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:36.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.082+0000 7fcae2334800 20 Filter name: none 2024-09-14T11:40:36.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.082+0000 7fc90d7fa640 20 reqs_thread_entry: start 2024-09-14T11:40:36.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.082+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:36.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.084+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.084+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.084+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.085+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:36.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.087+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.087+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.088+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.089+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:36.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.090+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.090+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.091+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.092+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:36.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.093+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.093+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.094+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.095+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:36.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.096+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.096+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.097+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.098+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:36.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.099+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.100+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.100+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.101+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:36.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.103+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.103+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.103+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.104+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:36.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.106+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.106+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.107+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.107+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.109+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.109+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.110+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.110+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:36.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.112+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.112+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.112+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.113+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:36.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.115+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.115+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.116+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.117+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:36.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.118+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.118+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.118+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.119+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:36.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.120+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.121+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.121+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.122+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:36.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.124+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.124+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.124+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.125+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:36.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.126+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.127+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.127+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.128+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:36.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.129+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.130+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.130+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.131+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:36.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.132+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.133+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.133+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.134+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:36.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.136+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.136+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.136+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.137+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:36.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.138+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.139+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.139+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.140+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:36.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.142+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.142+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.143+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.144+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:36.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.145+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.145+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.146+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.147+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:36.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.148+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.148+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.149+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.150+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:36.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.151+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.152+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.152+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.153+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:36.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.155+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.155+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.155+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.156+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:36.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.157+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.158+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.159+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.160+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:36.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.161+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.162+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.162+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.163+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:36.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.164+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.164+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.165+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.165+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:36.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.167+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.168+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.168+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.169+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:36.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.170+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.170+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.171+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.172+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:36.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.174+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.175+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.175+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.176+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:36.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.177+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.178+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.178+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.179+0000 7fcae2334800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:36.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.180+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.180+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.181+0000 7fcae2334800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.182+0000 7fc994fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.184+0000 7fcae2334800 20 remove_watcher() i=0 2024-09-14T11:40:36.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.184+0000 7fcae2334800 2 removed watcher, disabling cache 2024-09-14T11:40:36.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.185+0000 7fcae2334800 20 remove_watcher() i=1 2024-09-14T11:40:36.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.186+0000 7fcae2334800 20 remove_watcher() i=2 2024-09-14T11:40:36.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.187+0000 7fcae2334800 20 remove_watcher() i=3 2024-09-14T11:40:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.188+0000 7fcae2334800 20 remove_watcher() i=4 2024-09-14T11:40:36.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.189+0000 7fcae2334800 20 remove_watcher() i=5 2024-09-14T11:40:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.190+0000 7fcae2334800 20 remove_watcher() i=6 2024-09-14T11:40:36.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.191+0000 7fcae2334800 20 remove_watcher() i=7 2024-09-14T11:40:36.201 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:40:36.253 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:36.253 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:36.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.291+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 realm 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.293+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.294+0000 7fcbc4775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.294+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.294+0000 7fcbc4775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:36.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.294+0000 7fcbc4775800 20 searching for the correct realm 2024-09-14T11:40:36.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.497+0000 7fcbc225f640 0 -- 172.21.15.94:0/458893855 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fcbbc017020 msgr2=0x7fcbbc034940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.903+0000 7fcbc2a60640 0 -- 172.21.15.94:0/458893855 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fcbac06d060 msgr2=0x7fcbac0dba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:36.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.909+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 zone default found 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 4 Realm: () 2024-09-14T11:40:36.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 zonegroup default 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.910+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.911+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.911+0000 7fcbc4775800 20 rados->read ofs=0 len=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.911+0000 7fcbc4775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.911+0000 7fcbc4775800 20 started sync module instance, tier type = 2024-09-14T11:40:36.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.911+0000 7fcbc4775800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=0 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=1 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=2 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=3 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=4 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=5 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.920+0000 7fcbc4775800 20 add_watcher() i=6 2024-09-14T11:40:36.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.921+0000 7fcbc4775800 20 add_watcher() i=7 2024-09-14T11:40:36.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.921+0000 7fcbc4775800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:36.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.923+0000 7fca797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:36.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.923+0000 7fcbc4775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:36.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.924+0000 7fcbc4775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:36.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.961+0000 7fca737fe640 20 reqs_thread_entry: start 2024-09-14T11:40:36.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.961+0000 7fcbc4775800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:36.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.961+0000 7fcbc4775800 20 Filter name: none 2024-09-14T11:40:36.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.961+0000 7fca717fa640 20 reqs_thread_entry: start 2024-09-14T11:40:36.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.961+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:36.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.963+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.963+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.964+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.965+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:36.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.966+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.967+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.967+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.968+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:36.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.970+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.970+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.970+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.972+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.973+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.974+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.974+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.975+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:36.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.976+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.977+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.977+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.978+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:36.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.979+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.980+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.980+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.981+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:36.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.983+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.983+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.983+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.984+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:36.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.986+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.986+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.986+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.987+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.989+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.989+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.990+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.991+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:36.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.992+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.993+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.993+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.994+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:36.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.995+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.996+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.996+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.997+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.998+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.998+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.999+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:36.999+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:36.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.001+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.001+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:36.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.001+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.003+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.004+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.004+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.004+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.005+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:37.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.007+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.007+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.007+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.008+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:37.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.010+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.010+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.010+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.011+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:37.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.013+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.013+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.013+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.014+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:37.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.016+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.016+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.016+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.017+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:37.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.019+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.020+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.021+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.022+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:37.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.023+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.024+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.024+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.025+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.026+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.027+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.027+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.028+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.029+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.029+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.030+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.031+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.032+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.033+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.033+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.034+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:37.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.035+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.036+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.036+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.037+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:37.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.038+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.039+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.039+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.040+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.041+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.042+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.042+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.043+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.044+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.044+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.044+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.045+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:37.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.047+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.047+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.048+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.050+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:37.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.051+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.052+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.052+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.053+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:37.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.054+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.054+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.055+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.056+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:37.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.057+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.057+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.058+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.059+0000 7fcbc4775800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:37.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.060+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.060+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:37.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.061+0000 7fcbc4775800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:37.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.062+0000 7fca797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:37.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.064+0000 7fcbc4775800 20 remove_watcher() i=0 2024-09-14T11:40:37.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.064+0000 7fcbc4775800 2 removed watcher, disabling cache 2024-09-14T11:40:37.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.065+0000 7fcbc4775800 20 remove_watcher() i=1 2024-09-14T11:40:37.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.066+0000 7fcbc4775800 20 remove_watcher() i=2 2024-09-14T11:40:37.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.067+0000 7fcbc4775800 20 remove_watcher() i=3 2024-09-14T11:40:37.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.068+0000 7fcbc4775800 20 remove_watcher() i=4 2024-09-14T11:40:37.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.069+0000 7fcbc4775800 20 remove_watcher() i=5 2024-09-14T11:40:37.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.070+0000 7fcbc4775800 20 remove_watcher() i=6 2024-09-14T11:40:37.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:40:37.071+0000 7fcbc4775800 20 remove_watcher() i=7 2024-09-14T11:40:37.080 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:40:37.587 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-14T11:40:38.283 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-14T11:40:38.283 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-14T11:40:38.283 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-14T11:40:38.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:38.783 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-14T11:40:38.784 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:40:38.784 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:40:38.785 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:38.785 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:40:38.785 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-14T11:40:40.785 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.785 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-14T11:40:40.785 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.785 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14 11:40:40,006 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:40:40.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:40:40.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:40.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:40:41.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:41.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:40:41.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:41.783 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:40:41.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:41.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:40:42.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:40:42.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:40:42.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:40:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:40:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:40:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.584 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:40:42.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:40:42.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:42.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:40:43.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:40:43.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:40:43.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:40:43.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:40:43.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:40:43.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:40:43.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:43.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:40:44.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:40:44.083 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:40:44.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:40:44.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:40:44.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:40:44.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:40:44.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.783 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:40:44.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:44.982 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:40:45.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:45.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:40:45.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:45.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:40:46.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:46.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:40:49.883 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:49.883 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:40:50.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:50.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:40:50.183 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:50.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:40:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:50.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:40:50.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:50.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:40:50.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:50.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:40:51.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:51.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:40:51.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:51.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:40:51.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:40:51.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:51.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:40:52.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:52.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:40:52.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:52.683 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:40:53.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:53.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:40:53.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:53.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:40:53.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:53.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:40:54.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:54.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:40:56.683 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:56.683 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:40:56.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:56.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:40:57.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:57.783 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:40:57.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:57.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:40:58.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:58.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:40:58.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:58.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:40:59.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:59.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:40:59.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:59.883 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:40:59.883 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:59.883 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:40:59.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:59.982 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:40:59.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:40:59.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:41:00.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:41:00.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:41:00.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:41:00.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:41:00.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.683 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:41:00.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.783 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:41:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:41:00.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:00.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:41:01.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.183 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:41:01.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.282 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:41:01.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:41:01.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:41:01.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:41:01.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:01.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:41:02.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:41:02.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.282 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:41:02.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:41:02.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:41:02.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:41:02.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:02.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:41:03.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:41:03.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:41:03.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.382 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:41:03.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:41:03.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:41:03.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:41:03.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:03.982 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:41:04.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:41:04.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.282 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:41:04.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.382 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:41:04.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:41:04.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:41:04.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:41:04.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:04.982 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:41:05.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:41:05.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.282 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:41:05.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:41:05.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:41:05.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:41:05.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:05.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:41:06.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.083 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:41:06.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:41:06.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:41:06.483 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.483 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:41:06.682 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.682 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:41:06.683 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.683 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:41:06.982 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:41:06.983 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:06.983 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:41:07.282 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:41:07.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.283 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:41:07.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:41:07.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:41:07.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:41:07.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:07.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:41:08.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:41:08.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:41:08.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.382 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:41:08.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:41:08.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:41:08.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.583 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:41:08.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:41:08.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:08.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:41:09.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:41:09.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:41:09.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.382 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:41:09.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.482 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:41:09.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:41:09.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:41:09.782 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.782 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:41:09.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:09.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:41:10.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:41:10.182 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.182 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:41:10.382 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.382 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:41:10.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.383 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:41:10.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:41:10.882 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:10.882 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:41:11.082 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:11.082 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:41:11.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:11.582 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:11.783 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 34s 2024-09-14T11:41:11.784 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-14T11:41:11.790 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:41:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:11.845 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:11.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.883+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 realm 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.885+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.886+0000 7fcb4e732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:11.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.886+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.886+0000 7fcb4e732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:11.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.886+0000 7fcb4e732800 20 searching for the correct realm 2024-09-14T11:41:11.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.890+0000 7fcb43fff640 0 -- 172.21.15.94:0/3687426533 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fcb3c092040 msgr2=0x7fcb3c083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:11.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.893+0000 7fcb4abbd640 0 -- 172.21.15.94:0/3687426533 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7fcb34073830 msgr2=0x7fcb340687b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:11.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.896+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 zone default found 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 4 Realm: () 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 zonegroup default 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.897+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 rados->read ofs=0 len=0 2024-09-14T11:41:11.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:11.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 started sync module instance, tier type = 2024-09-14T11:41:11.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.898+0000 7fcb4e732800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:11.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=0 2024-09-14T11:41:11.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=1 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=2 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=3 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=4 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=5 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=6 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 20 add_watcher() i=7 2024-09-14T11:41:11.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.907+0000 7fcb4e732800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:11.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.909+0000 7fca00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:11.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.909+0000 7fcb4e732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:11.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.909+0000 7fcb4e732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:11.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.942+0000 7fc97b7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:11.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.942+0000 7fcb4e732800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:11.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.942+0000 7fcb4e732800 20 Filter name: none 2024-09-14T11:41:11.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.942+0000 7fc9797fa640 20 reqs_thread_entry: start 2024-09-14T11:41:11.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.942+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:11.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS', time=2024-09-14T13:40:53.924966+0000, chain.objs.size()=5 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.102__multipart_key1.2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS.7 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.102__multipart_key1.2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS.8 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.102__multipart_key1.2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS.9 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.102__multipart_key1.2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS.10 2024-09-14T11:41:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.944+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.102__multipart_key1.2~L_f1KYV9byL_MdAyECLdSfcY9NGjozS.11 2024-09-14T11:41:11.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.947+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.949+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:11.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.950+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.951+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.951+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:11.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.951+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15036264813171993976', time=2024-09-14T13:41:05.889455+0000, chain.objs.size()=1 2024-09-14T11:41:11.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.951+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.127__shadow_.WLBsbQt_GXfcqQxZDbSif35cLDjpjTG_0 2024-09-14T11:41:11.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.952+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.954+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:11.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.956+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.956+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16843995713983232987', time=2024-09-14T13:40:43.095316+0000, chain.objs.size()=2 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.84__shadow_.5S66bunQ2K5-wQKCi1AIdG_Q61eA7_I_0 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.84__shadow_.5S66bunQ2K5-wQKCi1AIdG_Q61eA7_I_1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11732088774994582686', time=2024-09-14T13:41:02.638115+0000, chain.objs.size()=1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.116__shadow_.pA1TVheH6hQd-h_VrUVcIpB6joksJY0_0 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11490222303737258737', time=2024-09-14T13:41:03.246053+0000, chain.objs.size()=1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.118__shadow_.78FCb8qGYQs2hOmbnWcFC1jFMJ4ot81_0 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5108894124702950421', time=2024-09-14T13:41:03.523454+0000, chain.objs.size()=1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.119__shadow_.uKjZdCvvx4wLUqy3lXuSWe5YMmGa8bU_0 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.748906478857394158', time=2024-09-14T13:41:04.405400+0000, chain.objs.size()=1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.122__shadow_.aj7WrSqFHVs_VVJAgvgtpzX5kAabsVU_0 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15287491680554415355', time=2024-09-14T13:41:05.286934+0000, chain.objs.size()=1 2024-09-14T11:41:11.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.125__shadow_.Ovcf_idzvav2K3-9X964HtAOn_ysh_L_0 2024-09-14T11:41:11.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.883449022936425190', time=2024-09-14T13:41:06.773885+0000, chain.objs.size()=1 2024-09-14T11:41:11.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.130__shadow_.bGfUgMszH1fuG2NSs09UMNlqL7fgcEs_0 2024-09-14T11:41:11.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10618325974238498199', time=2024-09-14T13:41:07.073625+0000, chain.objs.size()=1 2024-09-14T11:41:11.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.131__shadow_.QcE-LfPZx3pJ-5rh7WoaPilhBZi5ZdS_0 2024-09-14T11:41:11.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15603763852004148829', time=2024-09-14T13:41:07.631607+0000, chain.objs.size()=1 2024-09-14T11:41:11.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.133__shadow_.DF_h8cptN7u1Sy6oqM4oknJCQYhdC1n_0 2024-09-14T11:41:11.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9684051415975177452', time=2024-09-14T13:41:09.634092+0000, chain.objs.size()=1 2024-09-14T11:41:11.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.957+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.140__shadow_.bewxsOwwWzFeqZjKIzLe9cPtqzJSTUs_0 2024-09-14T11:41:11.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.961+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.963+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:11.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.965+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.965+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16056344092080472673', time=2024-09-14T13:41:03.534007+0000, chain.objs.size()=1 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.119__shadow_.ohAVZrZ1tbyeKk9Hl--cSSGUP3RnS4v_0 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4718497517637638191', time=2024-09-14T13:41:04.416050+0000, chain.objs.size()=1 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.122__shadow_.A1LFZ3Tb4xP1xZNYehQdjJjkSnP3umu_0 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17752059354900949922', time=2024-09-14T13:41:06.197478+0000, chain.objs.size()=1 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.128__shadow_.fkuITEQCAHsJMs6hNSsvPkS-EtKXqhG_0 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11537634030608833924', time=2024-09-14T13:41:06.784235+0000, chain.objs.size()=1 2024-09-14T11:41:11.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.966+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.130__shadow_.CNeGgKDt9nXJhzJRuCkhnlPO13Y1mgx_0 2024-09-14T11:41:11.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.968+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.970+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:11.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.971+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:11.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1062146933722423640', time=2024-09-14T13:40:45.746404+0000, chain.objs.size()=5 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.1 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.2 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.3 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.4 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.5 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16351888640696600569', time=2024-09-14T13:40:48.897548+0000, chain.objs.size()=5 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~-YqOOePhJ-fwYquHUuUY9yD4qVmcssk.1 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~-YqOOePhJ-fwYquHUuUY9yD4qVmcssk.2 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~-YqOOePhJ-fwYquHUuUY9yD4qVmcssk.3 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~-YqOOePhJ-fwYquHUuUY9yD4qVmcssk.4 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~-YqOOePhJ-fwYquHUuUY9yD4qVmcssk.5 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15832627865152923320', time=2024-09-14T13:40:53.251841+0000, chain.objs.size()=1 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__shadow_.-9m6lnJLPggzU9mwCmI6-IRjhZkEI7R_0 2024-09-14T11:41:11.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3449384708049541394', time=2024-09-14T13:41:06.486923+0000, chain.objs.size()=1 2024-09-14T11:41:11.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.972+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.129__shadow_.ApT8IvUKXx2OUTpS2lpEh8Jh5lHP7d9_0 2024-09-14T11:41:11.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.975+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7944553577493887219', time=2024-09-14T13:41:07.642490+0000, chain.objs.size()=1 2024-09-14T11:41:11.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.975+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.133__shadow_.uAzqWqaH8_4pQxr6GZkavr_IMwZImXm_0 2024-09-14T11:41:11.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.977+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.980+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:11.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.981+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9002306209889095243', time=2024-09-14T13:40:53.245779+0000, chain.objs.size()=5 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file.mpg.2~Gs3wZnFdS0mwcbuR0HLbI5D-Kj54BUR.1 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file.mpg.2~Gs3wZnFdS0mwcbuR0HLbI5D-Kj54BUR.2 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file.mpg.2~Gs3wZnFdS0mwcbuR0HLbI5D-Kj54BUR.3 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file.mpg.2~Gs3wZnFdS0mwcbuR0HLbI5D-Kj54BUR.4 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file.mpg.2~Gs3wZnFdS0mwcbuR0HLbI5D-Kj54BUR.5 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7616761820620956188', time=2024-09-14T13:40:58.464974+0000, chain.objs.size()=5 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.105__multipart_key1.2~KkbkPfZ9CQ1Ecc-SFN7x13Q_YHrKWbQ.1 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.105__multipart_key1.2~KkbkPfZ9CQ1Ecc-SFN7x13Q_YHrKWbQ.2 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.105__multipart_key1.2~KkbkPfZ9CQ1Ecc-SFN7x13Q_YHrKWbQ.3 2024-09-14T11:41:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.105__multipart_key1.2~KkbkPfZ9CQ1Ecc-SFN7x13Q_YHrKWbQ.4 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.105__multipart_key1.2~KkbkPfZ9CQ1Ecc-SFN7x13Q_YHrKWbQ.5 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5374155337046657700', time=2024-09-14T13:41:03.539423+0000, chain.objs.size()=1 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.119__shadow_.MenRioNvjnc45KCmEzUgafe_2eNgkZu_0 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16811497213813421604', time=2024-09-14T13:41:04.126454+0000, chain.objs.size()=1 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.982+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.121__shadow_.Qrc2TSe_VgEQcajXvdPLvmVgVFWdUtG_0 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.984+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5883936925330196177', time=2024-09-14T13:41:06.491665+0000, chain.objs.size()=1 2024-09-14T11:41:11.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.984+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.129__shadow_.NS0SUEy0WDAUyqKJ-IOVD7ieZS4ot9W_0 2024-09-14T11:41:11.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.989+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.991+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:11.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10504028301333722898', time=2024-09-14T13:40:43.635889+0000, chain.objs.size()=1 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.86__shadow_.Ur3aCNfS8KegaKYjIPxE_L1XR62QA8j_0 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14229921175525142614', time=2024-09-14T13:40:48.458918+0000, chain.objs.size()=5 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~9tOOgczqRAwjMV4TAndKlcGViIrsM15.1 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~9tOOgczqRAwjMV4TAndKlcGViIrsM15.2 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~9tOOgczqRAwjMV4TAndKlcGViIrsM15.3 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~9tOOgczqRAwjMV4TAndKlcGViIrsM15.4 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~9tOOgczqRAwjMV4TAndKlcGViIrsM15.5 2024-09-14T11:41:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11624227364960377958', time=2024-09-14T13:41:02.947936+0000, chain.objs.size()=1 2024-09-14T11:41:11.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.117__shadow_.L1l6clknbtVAioeOdkdnOd36_5nl_Q2_0 2024-09-14T11:41:11.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4928949929208973015', time=2024-09-14T13:41:04.410983+0000, chain.objs.size()=1 2024-09-14T11:41:11.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.993+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.122__shadow_.1gZHl3dviairQZGx6dv81VnMXAhDlZV_0 2024-09-14T11:41:11.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.997+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:11.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:11.999+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:11.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.001+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.001+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.001+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.001+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14083441649244850327', time=2024-09-14T13:41:04.714851+0000, chain.objs.size()=1 2024-09-14T11:41:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.001+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.123__shadow_.jvykitN_2R4PldqTGdFd0k_OwtLQyBg_0 2024-09-14T11:41:12.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.003+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.004+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.006+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.006+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.006+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.007+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.008+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2520684062374834122', time=2024-09-14T13:40:53.262753+0000, chain.objs.size()=1 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__shadow_.G3fwLhuRIxm7y7AMlwaimm5D37xCa6-_0 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11362329000886241359', time=2024-09-14T13:41:02.349198+0000, chain.objs.size()=1 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.115__shadow_.EZEBMZMoxjtfimYa3AisrAPJ8KQL1pJ_0 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9196996636007076202', time=2024-09-14T13:41:09.113793+0000, chain.objs.size()=1 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.139__shadow_.q0JbFivzq9T_ALShmoZvOFs683Db_Ez_0 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16581322228948039697', time=2024-09-14T13:41:09.895834+0000, chain.objs.size()=1 2024-09-14T11:41:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.009+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.141__shadow_.fS8RXvAMsIZ9jBLjxDgSMGLKMuPWLBg_0 2024-09-14T11:41:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.011+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.013+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:12.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16389147125013299379', time=2024-09-14T13:40:52.525448+0000, chain.objs.size()=5 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.100__multipart_key1.2~lTKNuTev5hDBcJ4Pa9EI9uOR9dnu6zN.1 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.015+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.100__multipart_key1.2~lTKNuTev5hDBcJ4Pa9EI9uOR9dnu6zN.2 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.100__multipart_key1.2~lTKNuTev5hDBcJ4Pa9EI9uOR9dnu6zN.3 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.100__multipart_key1.2~lTKNuTev5hDBcJ4Pa9EI9uOR9dnu6zN.4 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.100__multipart_key1.2~lTKNuTev5hDBcJ4Pa9EI9uOR9dnu6zN.5 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9614703581865008243', time=2024-09-14T13:41:01.753379+0000, chain.objs.size()=1 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.113__shadow_.cgqbrWS26C8HXlMwS1kA7A8rK-bhrkU_0 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3255127832208031599', time=2024-09-14T13:41:04.709343+0000, chain.objs.size()=1 2024-09-14T11:41:12.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.016+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.123__shadow_.AMGzfHViRDM88kxTuFysW9MlaiQCX6J_0 2024-09-14T11:41:12.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.020+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.022+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:12.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9930422112665421534', time=2024-09-14T13:41:02.058203+0000, chain.objs.size()=1 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.114__shadow_.igTGuYppqnTM8_8Hw27Mhyg_QtgeLbQ_0 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16843359738166544784', time=2024-09-14T13:41:04.996698+0000, chain.objs.size()=1 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.124__shadow_.Dzd-G0w7pw9Mho-Zvi-bb9Ffr8X0Gp5_0 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5305168542860164110', time=2024-09-14T13:41:06.496758+0000, chain.objs.size()=1 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.129__shadow_.7BxDDAv8eygxvkYpLcrRhzFL1ur0H4B_0 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9872025122105910591', time=2024-09-14T13:41:08.656065+0000, chain.objs.size()=1 2024-09-14T11:41:12.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.024+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.137__shadow_.qYjNFk5UD3l-7_QpiCyiJ1zhPWpiCys_0 2024-09-14T11:41:12.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.026+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.029+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:12.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.030+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.030+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:12.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17525771622883291736', time=2024-09-14T13:40:57.803057+0000, chain.objs.size()=5 2024-09-14T11:41:12.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__multipart_key1.2~4owlxAtXrcqpyJaJK2NW6WtHWmW61vQ.1 2024-09-14T11:41:12.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__multipart_key1.2~4owlxAtXrcqpyJaJK2NW6WtHWmW61vQ.2 2024-09-14T11:41:12.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__multipart_key1.2~4owlxAtXrcqpyJaJK2NW6WtHWmW61vQ.3 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__multipart_key1.2~4owlxAtXrcqpyJaJK2NW6WtHWmW61vQ.4 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__multipart_key1.2~4owlxAtXrcqpyJaJK2NW6WtHWmW61vQ.5 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9949940628318907298', time=2024-09-14T13:41:02.643972+0000, chain.objs.size()=1 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.116__shadow_.IONisttls328uOly_SH1_e9BeL1pP56_0 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5227002477031796822', time=2024-09-14T13:41:03.832302+0000, chain.objs.size()=1 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.120__shadow_.WMYJOYkHhVNtXmPzb_MoZKaQHG3F313_0 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4344380417864847389', time=2024-09-14T13:41:04.698602+0000, chain.objs.size()=1 2024-09-14T11:41:12.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.031+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.123__shadow_.e3aBeWPkbX_uYGrOfPYrIBsnOy-bFT__0 2024-09-14T11:41:12.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.034+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.036+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:12.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.038+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.038+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:41:12.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8430151415844556124', time=2024-09-14T13:40:40.774596+0000, chain.objs.size()=1 2024-09-14T11:41:12.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.78__shadow_.qxgfNyK8S_bA51nciFoDoILB5VIvEp-_0 2024-09-14T11:41:12.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9627877300987217610', time=2024-09-14T13:41:00.042181+0000, chain.objs.size()=1 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.107__shadow_.1ZgRzCdS6sIjVglzuYXBNnCc1kFgVQU_0 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14794323327576329478', time=2024-09-14T13:41:02.649485+0000, chain.objs.size()=1 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.116__shadow_.aZLYVAKRjxyH9uxxI7bNGO4NOYijtiy_0 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11736843405422840784', time=2024-09-14T13:41:03.529103+0000, chain.objs.size()=1 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.119__shadow_.WFqTGFuQ-eSStuD90TzUyv9aZEcP6eb_0 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7427753798814474264', time=2024-09-14T13:41:03.827446+0000, chain.objs.size()=1 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.120__shadow_.PW3Ty2uea5NH3ig-Bo7eMoA_4gRRT9r_0 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.868585158680090850', time=2024-09-14T13:41:04.116052+0000, chain.objs.size()=1 2024-09-14T11:41:12.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.039+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.121__shadow_.KAr82NfSUrEqQKaPsWljo-1TPCR4hib_0 2024-09-14T11:41:12.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.042+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.044+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:12.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.045+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.046+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.046+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.047+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:12.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.049+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.049+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3728679251734337563', time=2024-09-14T13:41:02.052395+0000, chain.objs.size()=1 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.114__shadow_.Vlrmkcc0rrp07ozFTqRsQMzUOuibMFk_0 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5205943662383295066', time=2024-09-14T13:41:02.359745+0000, chain.objs.size()=1 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.115__shadow_.Q5TRHPqB1pJ3mZUFKumPj_CSzNf-AXf_0 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6284976203188659814', time=2024-09-14T13:41:04.421034+0000, chain.objs.size()=1 2024-09-14T11:41:12.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.050+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.122__shadow_.M0pV-3GGFYAf_ldTDAJ8I027t1bstOb_0 2024-09-14T11:41:12.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.051+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.053+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:12.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.054+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16021528307924195403', time=2024-09-14T13:41:01.764881+0000, chain.objs.size()=1 2024-09-14T11:41:12.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.113__shadow_.8fVfPLEaeHXt2bOQyOCAG-622t1ilyr_0 2024-09-14T11:41:12.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7269605345634498700', time=2024-09-14T13:41:05.001639+0000, chain.objs.size()=1 2024-09-14T11:41:12.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.124__shadow_.Fnbhe8TSiibBsTpXl9_-QJoZUvHxSRY_0 2024-09-14T11:41:12.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4183390608982839918', time=2024-09-14T13:41:11.634504+0000, chain.objs.size()=1 2024-09-14T11:41:12.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.055+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__shadow_.f-e2a87SvsFRypmF4F_AiwhEOYdgo1R_0 2024-09-14T11:41:12.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.057+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.059+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:12.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.060+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16225072747412922327', time=2024-09-14T13:41:04.991301+0000, chain.objs.size()=1 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.124__shadow_.peO16f7Vovngjr1t3merQSU-P3eHE0A_0 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4478644177730070867', time=2024-09-14T13:41:06.790354+0000, chain.objs.size()=1 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.130__shadow_.389ZNGipBKCWtl0Ga5sZ8VjmG7ecDf7_0 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4429260826397477832', time=2024-09-14T13:41:07.068086+0000, chain.objs.size()=1 2024-09-14T11:41:12.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.061+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.131__shadow_.o9CJXsJroTW2P6w2zPKN2s_hgtJoZ7q_0 2024-09-14T11:41:12.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.062+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.065+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:12.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.066+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.066+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3391218030471130148', time=2024-09-14T13:40:51.328237+0000, chain.objs.size()=5 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.99__multipart_key1.2~iREZpZUhG3xhAMGfBB_Q4utjT8JkN2W.1 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.99__multipart_key1.2~iREZpZUhG3xhAMGfBB_Q4utjT8JkN2W.2 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.99__multipart_key1.2~iREZpZUhG3xhAMGfBB_Q4utjT8JkN2W.3 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.99__multipart_key1.2~iREZpZUhG3xhAMGfBB_Q4utjT8JkN2W.4 2024-09-14T11:41:12.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.99__multipart_key1.2~iREZpZUhG3xhAMGfBB_Q4utjT8JkN2W.5 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3313615921884259255', time=2024-09-14T13:41:02.654811+0000, chain.objs.size()=1 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.116__shadow_.24nLiCxArswGiAAnCmNt5ZOL7gUmNez_0 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15185843592778736652', time=2024-09-14T13:41:05.275634+0000, chain.objs.size()=1 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.125__shadow_.ORq7nPOQmEPkFw1EWg8Th5G8tAYGOue_0 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11453203639386165055', time=2024-09-14T13:41:05.573804+0000, chain.objs.size()=1 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.126__shadow_.gt5rv1DCGZ7Gjmg7LghEdNkWhF09O_Y_0 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9193551340900113946', time=2024-09-14T13:41:05.583743+0000, chain.objs.size()=1 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.126__shadow_._SOuZPhusbQmlox1X4OjSMODH0-cxqX_0 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9782581307322909853', time=2024-09-14T13:41:09.065238+0000, chain.objs.size()=1 2024-09-14T11:41:12.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.067+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.139__shadow_.H1aSvNEavJvT9WVf8uGDlxLbYtH1nUm_0 2024-09-14T11:41:12.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.071+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.074+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:12.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.075+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.075+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6217851871720140370', time=2024-09-14T13:40:56.692166+0000, chain.objs.size()=5 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~IghvtP3XF6YCAojkFrwtYXJN-IKrUqS.1 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~IghvtP3XF6YCAojkFrwtYXJN-IKrUqS.1_1 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~IghvtP3XF6YCAojkFrwtYXJN-IKrUqS.2 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~IghvtP3XF6YCAojkFrwtYXJN-IKrUqS.2_1 2024-09-14T11:41:12.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.076+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~IghvtP3XF6YCAojkFrwtYXJN-IKrUqS.3 2024-09-14T11:41:12.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.078+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.081+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:12.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.082+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11788993020809125675', time=2024-09-14T13:40:49.338278+0000, chain.objs.size()=5 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~3HBVm8y94FZODW62XorrcFSRatbVZdi.1 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~3HBVm8y94FZODW62XorrcFSRatbVZdi.1_1 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~3HBVm8y94FZODW62XorrcFSRatbVZdi.2 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~3HBVm8y94FZODW62XorrcFSRatbVZdi.2_1 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~3HBVm8y94FZODW62XorrcFSRatbVZdi.3 2024-09-14T11:41:12.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15276837061068743456', time=2024-09-14T13:40:54.710582+0000, chain.objs.size()=5 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~_l5lMFfTl01etgIy50IRdvbOQT5nVtK.1 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~_l5lMFfTl01etgIy50IRdvbOQT5nVtK.2 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~_l5lMFfTl01etgIy50IRdvbOQT5nVtK.3 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~_l5lMFfTl01etgIy50IRdvbOQT5nVtK.4 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~_l5lMFfTl01etgIy50IRdvbOQT5nVtK.5 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92657787583683999', time=2024-09-14T13:41:02.343770+0000, chain.objs.size()=1 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.115__shadow_.f8qhtNjEDj17gLiK7mikBCSMmrGTdBc_0 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7741458594817503636', time=2024-09-14T13:41:07.346841+0000, chain.objs.size()=1 2024-09-14T11:41:12.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.083+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.132__shadow_.d7TkYYtNOOHQIzyOS-X79U9sbUuI7Zs_0 2024-09-14T11:41:12.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.087+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15176439222286879947', time=2024-09-14T13:41:07.919962+0000, chain.objs.size()=1 2024-09-14T11:41:12.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.087+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.134__shadow_.U8GQb-LPKQ0zPvIdCAZWVyfQf6qU-GT_0 2024-09-14T11:41:12.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.090+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.092+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:12.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16286432101029990821', time=2024-09-14T13:40:55.378275+0000, chain.objs.size()=5 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~xO1x_RgqNSOtSweJQHDcwhZZ4WuaM4P.1 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~xO1x_RgqNSOtSweJQHDcwhZZ4WuaM4P.2 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~xO1x_RgqNSOtSweJQHDcwhZZ4WuaM4P.3 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~xO1x_RgqNSOtSweJQHDcwhZZ4WuaM4P.4 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~xO1x_RgqNSOtSweJQHDcwhZZ4WuaM4P.5 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14806672000646950810', time=2024-09-14T13:41:03.822562+0000, chain.objs.size()=1 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.094+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.120__shadow_.tQGSF3Etdi5sKAgLaeImLlWAnzBEXUM_0 2024-09-14T11:41:12.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.095+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9191950188184761293', time=2024-09-14T13:41:05.905952+0000, chain.objs.size()=1 2024-09-14T11:41:12.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.095+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.127__shadow_.dvMoZT2g1EEbdzQ5dgXZ0H69dU7r7s7_0 2024-09-14T11:41:12.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.098+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.100+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:12.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.101+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.269265720863698865', time=2024-09-14T13:40:44.798562+0000, chain.objs.size()=1 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.91__shadow_.er7TFfqMc57NRl9XneATqAsOtAB1BYI_0 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5844264182349092165', time=2024-09-14T13:41:02.932343+0000, chain.objs.size()=1 2024-09-14T11:41:12.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.117__shadow_.fvDnsVoGpKPHFc_9Y0E43VMkbsqzYp3_0 2024-09-14T11:41:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11186607940195856398', time=2024-09-14T13:41:07.925459+0000, chain.objs.size()=1 2024-09-14T11:41:12.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.102+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.134__shadow_.AJFk1ct0EK7x-ii0gR0RyyzEXnznQ9w_0 2024-09-14T11:41:12.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.104+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.107+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:12.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.108+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17072563442936974815', time=2024-09-14T13:40:50.016400+0000, chain.objs.size()=5 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~jinqGrS2PTjDB5rV61MIIkZYNbxtSwa.1 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~jinqGrS2PTjDB5rV61MIIkZYNbxtSwa.1_1 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~jinqGrS2PTjDB5rV61MIIkZYNbxtSwa.2 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~jinqGrS2PTjDB5rV61MIIkZYNbxtSwa.2_1 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~jinqGrS2PTjDB5rV61MIIkZYNbxtSwa.3 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1366592105059129413', time=2024-09-14T13:40:53.257244+0000, chain.objs.size()=5 2024-09-14T11:41:12.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file2.mpg.2~fh-eC9RITt0TGbUgNEm5rQ-Lb28AfON.1 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file2.mpg.2~fh-eC9RITt0TGbUgNEm5rQ-Lb28AfON.2 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file2.mpg.2~fh-eC9RITt0TGbUgNEm5rQ-Lb28AfON.3 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file2.mpg.2~fh-eC9RITt0TGbUgNEm5rQ-Lb28AfON.4 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__multipart_file2.mpg.2~fh-eC9RITt0TGbUgNEm5rQ-Lb28AfON.5 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10089807730118952163', time=2024-09-14T13:40:53.268295+0000, chain.objs.size()=1 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.101__shadow_.bNMNccBQ2YAJAquTTCFoOu7pDGjnLAL_0 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17104285696855508941', time=2024-09-14T13:41:06.481550+0000, chain.objs.size()=1 2024-09-14T11:41:12.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.109+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.129__shadow_.reNEp7ptRA3hnkFWxTj7dnvYQli2cHO_0 2024-09-14T11:41:12.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.112+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9747679157140897476', time=2024-09-14T13:41:07.352166+0000, chain.objs.size()=1 2024-09-14T11:41:12.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.112+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.132__shadow_.BHbG0uxuBZBYLzC6qcpSkFaFYLTd4qe_0 2024-09-14T11:41:12.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.115+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.118+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:12.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.119+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.119+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2359170637047323055', time=2024-09-14T13:40:49.757332+0000, chain.objs.size()=5 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~lsK_BeT2LAcq9iAwnMHtT0B3AKT9oB2.1 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~lsK_BeT2LAcq9iAwnMHtT0B3AKT9oB2.1_1 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~lsK_BeT2LAcq9iAwnMHtT0B3AKT9oB2.2 2024-09-14T11:41:12.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__shadow_key1.2~lsK_BeT2LAcq9iAwnMHtT0B3AKT9oB2.2_1 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~lsK_BeT2LAcq9iAwnMHtT0B3AKT9oB2.3 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7500628996908951189', time=2024-09-14T13:41:02.046954+0000, chain.objs.size()=1 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.114__shadow_.MZcdtNxi90fQN_a7rjWW2V8sNPMRaF9_0 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10667098454034698601', time=2024-09-14T13:41:02.354447+0000, chain.objs.size()=1 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.115__shadow_.HMs6dNl1G02DgOfyg_ojoKFaKTJu80H_0 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12695605423870613434', time=2024-09-14T13:41:04.111007+0000, chain.objs.size()=1 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.121__shadow_.UU7xRIXrM0acqCXF1cJZFH-8d5UYuSv_0 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1852518925446711553', time=2024-09-14T13:41:05.568153+0000, chain.objs.size()=1 2024-09-14T11:41:12.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.120+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.126__shadow_.x-qtRvrAknAAShgLfDykQs03pwdyExF_0 2024-09-14T11:41:12.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.123+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.125+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:12.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.127+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.127+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.128+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:12.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.128+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15121820861854679532', time=2024-09-14T13:40:43.366814+0000, chain.objs.size()=1 2024-09-14T11:41:12.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.128+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.85__shadow_.YTuJVJUp1J4PvJ0Y1Mbyu5g_9_PD3EK_0 2024-09-14T11:41:12.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.129+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.131+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:12.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.132+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7470941381557244096', time=2024-09-14T13:40:47.895825+0000, chain.objs.size()=5 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~Ls2yf2PH2fJ8nv0zrvWQkWfiNbttVku.1 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~Ls2yf2PH2fJ8nv0zrvWQkWfiNbttVku.2 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~Ls2yf2PH2fJ8nv0zrvWQkWfiNbttVku.3 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~Ls2yf2PH2fJ8nv0zrvWQkWfiNbttVku.4 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95__multipart_key1.2~Ls2yf2PH2fJ8nv0zrvWQkWfiNbttVku.5 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4128546024410402318', time=2024-09-14T13:40:49.896160+0000, chain.objs.size()=4 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.94__shadow_.FhDAInnB-nAV23WYzyw5oQPitJAdcwc_0 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.94__shadow_.FhDAInnB-nAV23WYzyw5oQPitJAdcwc_1 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.94__shadow_.FhDAInnB-nAV23WYzyw5oQPitJAdcwc_2 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.94__shadow_.FhDAInnB-nAV23WYzyw5oQPitJAdcwc_3 2024-09-14T11:41:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15376057079604586908', time=2024-09-14T13:41:04.121228+0000, chain.objs.size()=1 2024-09-14T11:41:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.121__shadow_.xlZ5Cj9mDEKoo6XNNpKzmeT6H6vxmPE_0 2024-09-14T11:41:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11018568948191436753', time=2024-09-14T13:41:05.578751+0000, chain.objs.size()=1 2024-09-14T11:41:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.126__shadow_.EEI6fpQEbb5Effuoc5xMw3JaNdCL7tg_0 2024-09-14T11:41:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16751735362160918857', time=2024-09-14T13:41:08.885507+0000, chain.objs.size()=1 2024-09-14T11:41:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.133+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.138__shadow_.GxEL5ju48xDBXhKaBnWI34e8_TDfz10_0 2024-09-14T11:41:12.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.139+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.141+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:12.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.143+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.143+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2445330208519851078', time=2024-09-14T13:40:45.867441+0000, chain.objs.size()=5 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.1 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.2 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.3 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.4 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.92__multipart_key1.2~_8YduQWlWHFhrGsgNQGV4GUw-0A-bhA.5 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18053558391841004659', time=2024-09-14T13:40:55.061762+0000, chain.objs.size()=5 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~TTmsnncNUC2daxe_wMQGeMr2iLChQsM.1 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~TTmsnncNUC2daxe_wMQGeMr2iLChQsM.2 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~TTmsnncNUC2daxe_wMQGeMr2iLChQsM.3 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~TTmsnncNUC2daxe_wMQGeMr2iLChQsM.4 2024-09-14T11:41:12.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~TTmsnncNUC2daxe_wMQGeMr2iLChQsM.5 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7962342674524963546', time=2024-09-14T13:41:02.942855+0000, chain.objs.size()=1 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.117__shadow_.49t9Z9TS4gNl4F-YsfLPcyoY_uPXkub_0 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1084008653692843001', time=2024-09-14T13:41:04.703948+0000, chain.objs.size()=1 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.144+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.123__shadow_.6NqdVil-VgV_3FTc3ZdGt3KTK59LaVp_0 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.147+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1847118638269723128', time=2024-09-14T13:41:05.894987+0000, chain.objs.size()=1 2024-09-14T11:41:12.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.147+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.127__shadow_.rZRL7h0ubjWq8p3045ZriOjD2n7VJCO_0 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6535419660258259116', time=2024-09-14T13:41:07.357553+0000, chain.objs.size()=1 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.132__shadow_.cyH52y72EPI31yk96xWR-s_5lAbNjCp_0 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13013740871941009547', time=2024-09-14T13:41:07.636967+0000, chain.objs.size()=1 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.133__shadow_.wi-Z015W5vfvODiqnPQXy_S8NPd-yt7_0 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14560411737020018606', time=2024-09-14T13:41:11.629356+0000, chain.objs.size()=5 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__multipart_key1/data/file.mpg.2~lvulaYfU8wKDD5R9c6YHZpj8Ctev0Wg.1 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__multipart_key1/data/file.mpg.2~lvulaYfU8wKDD5R9c6YHZpj8Ctev0Wg.2 2024-09-14T11:41:12.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__multipart_key1/data/file.mpg.2~lvulaYfU8wKDD5R9c6YHZpj8Ctev0Wg.3 2024-09-14T11:41:12.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__multipart_key1/data/file.mpg.2~lvulaYfU8wKDD5R9c6YHZpj8Ctev0Wg.4 2024-09-14T11:41:12.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.150+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.145__multipart_key1/data/file.mpg.2~lvulaYfU8wKDD5R9c6YHZpj8Ctev0Wg.5 2024-09-14T11:41:12.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.153+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.155+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:12.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11575053674097028119', time=2024-09-14T13:41:01.747840+0000, chain.objs.size()=1 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.113__shadow_.eL-9-teA3vYmcYpk2nniCz60mn7P29Q_0 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12053338255489563540', time=2024-09-14T13:41:02.063682+0000, chain.objs.size()=1 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.114__shadow_.Ul0h50w4gHI4BV76JJzAD9Esy2LS_iL_0 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1894743573281289867', time=2024-09-14T13:41:03.230559+0000, chain.objs.size()=1 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.118__shadow_.NahotC7r-LfEgfF5HkMC8VXH2sRLrlX_0 2024-09-14T11:41:12.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13730969998966841356', time=2024-09-14T13:41:05.281199+0000, chain.objs.size()=1 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.125__shadow_.lwioDHAcTV5jPtxbEcKhZnOrmIiVZsK_0 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.654513109325000612', time=2024-09-14T13:41:06.191055+0000, chain.objs.size()=1 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.128__shadow_.-GbrgpSpY4GPbzqwGQequal_9eQsBat_0 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3975575892760559487', time=2024-09-14T13:41:06.779255+0000, chain.objs.size()=1 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.130__shadow_.93K2mfvmQ231E2AaclDsGnaIfakaaEX_0 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4536638438939595296', time=2024-09-14T13:41:07.913708+0000, chain.objs.size()=1 2024-09-14T11:41:12.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.157+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.134__shadow_.jzU6SqWynvqZv0jG0voTimBk0_xd4F8_0 2024-09-14T11:41:12.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.161+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.163+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:12.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.164+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.165+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~6u48_skTO1Pfy1m6yjeI06x2naKNEql', time=2024-09-14T13:40:41.722354+0000, chain.objs.size()=5 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.80__multipart_key1.2~6u48_skTO1Pfy1m6yjeI06x2naKNEql.1 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.80__multipart_key1.2~6u48_skTO1Pfy1m6yjeI06x2naKNEql.2 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.80__multipart_key1.2~6u48_skTO1Pfy1m6yjeI06x2naKNEql.3 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.80__multipart_key1.2~6u48_skTO1Pfy1m6yjeI06x2naKNEql.4 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.80__multipart_key1.2~6u48_skTO1Pfy1m6yjeI06x2naKNEql.5 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1034604344903329139', time=2024-09-14T13:40:42.371194+0000, chain.objs.size()=1 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.82__shadow_.bEoDKZFE3_teT8aHrOhMpxltD0_CjFb_0 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.268866+0000, chain.objs.size()=96 2024-09-14T11:41:12.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.1 2024-09-14T11:41:12.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.2 2024-09-14T11:41:12.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.3 2024-09-14T11:41:12.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.4 2024-09-14T11:41:12.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.5 2024-09-14T11:41:12.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.166+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.6 2024-09-14T11:41:12.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.169+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.7 2024-09-14T11:41:12.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.169+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.8 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.9 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.10 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.11 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.12 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.13 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.14 2024-09-14T11:41:12.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.15 2024-09-14T11:41:12.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.16 2024-09-14T11:41:12.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.170+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.17 2024-09-14T11:41:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.173+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.18 2024-09-14T11:41:12.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.173+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.19 2024-09-14T11:41:12.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.20 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.21 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.22 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.23 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.24 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.25 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.174+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.26 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.175+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.27 2024-09-14T11:41:12.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.175+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.28 2024-09-14T11:41:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.177+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.29 2024-09-14T11:41:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.177+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.30 2024-09-14T11:41:12.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.177+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.31 2024-09-14T11:41:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.178+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.32 2024-09-14T11:41:12.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.178+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.33 2024-09-14T11:41:12.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.179+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.34 2024-09-14T11:41:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.180+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.35 2024-09-14T11:41:12.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.180+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.36 2024-09-14T11:41:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.181+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.37 2024-09-14T11:41:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.181+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.38 2024-09-14T11:41:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.181+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.39 2024-09-14T11:41:12.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.181+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.40 2024-09-14T11:41:12.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.182+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.41 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.182+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.42 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.182+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.43 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.182+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.44 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.183+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.45 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.183+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.46 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.183+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.47 2024-09-14T11:41:12.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.183+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.48 2024-09-14T11:41:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.185+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.49 2024-09-14T11:41:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.185+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.50 2024-09-14T11:41:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.185+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.51 2024-09-14T11:41:12.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.185+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.52 2024-09-14T11:41:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.187+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.53 2024-09-14T11:41:12.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.187+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.54 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.55 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.56 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.57 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.58 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.59 2024-09-14T11:41:12.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.188+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.60 2024-09-14T11:41:12.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.189+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.61 2024-09-14T11:41:12.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.189+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.62 2024-09-14T11:41:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.189+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.63 2024-09-14T11:41:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.190+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.64 2024-09-14T11:41:12.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.190+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.65 2024-09-14T11:41:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.193+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.66 2024-09-14T11:41:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.193+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.67 2024-09-14T11:41:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.193+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.68 2024-09-14T11:41:12.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.193+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.69 2024-09-14T11:41:12.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.193+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.70 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.71 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.72 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.73 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.74 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.75 2024-09-14T11:41:12.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.195+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.76 2024-09-14T11:41:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.77 2024-09-14T11:41:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.78 2024-09-14T11:41:12.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.79 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.80 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.81 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.82 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.83 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.84 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.85 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.198+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.86 2024-09-14T11:41:12.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.199+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.87 2024-09-14T11:41:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.201+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.88 2024-09-14T11:41:12.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.201+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.89 2024-09-14T11:41:12.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.90 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.91 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.92 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.93 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.94 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.95 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.96 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.298226+0000, chain.objs.size()=10 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.202+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.97 2024-09-14T11:41:12.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.203+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.98 2024-09-14T11:41:12.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.205+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.99 2024-09-14T11:41:12.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.205+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.100 2024-09-14T11:41:12.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.206+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.101 2024-09-14T11:41:12.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.206+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.102 2024-09-14T11:41:12.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.206+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.103 2024-09-14T11:41:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.104 2024-09-14T11:41:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.105 2024-09-14T11:41:12.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.106 2024-09-14T11:41:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.325243+0000, chain.objs.size()=9 2024-09-14T11:41:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.107 2024-09-14T11:41:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.108 2024-09-14T11:41:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.207+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.109 2024-09-14T11:41:12.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.208+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.110 2024-09-14T11:41:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.209+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.111 2024-09-14T11:41:12.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.209+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.112 2024-09-14T11:41:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.209+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.113 2024-09-14T11:41:12.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.210+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.114 2024-09-14T11:41:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.115 2024-09-14T11:41:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.345666+0000, chain.objs.size()=5 2024-09-14T11:41:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.116 2024-09-14T11:41:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.117 2024-09-14T11:41:12.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.118 2024-09-14T11:41:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.119 2024-09-14T11:41:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.120 2024-09-14T11:41:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.376753+0000, chain.objs.size()=8 2024-09-14T11:41:12.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.211+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.121 2024-09-14T11:41:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.213+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.122 2024-09-14T11:41:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.213+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.123 2024-09-14T11:41:12.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.213+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.124 2024-09-14T11:41:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.125 2024-09-14T11:41:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.126 2024-09-14T11:41:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.127 2024-09-14T11:41:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.128 2024-09-14T11:41:12.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.404536+0000, chain.objs.size()=10 2024-09-14T11:41:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.129 2024-09-14T11:41:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.130 2024-09-14T11:41:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.131 2024-09-14T11:41:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.132 2024-09-14T11:41:12.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.215+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.133 2024-09-14T11:41:12.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.219+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.134 2024-09-14T11:41:12.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.220+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.135 2024-09-14T11:41:12.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.220+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.136 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.220+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.137 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.138 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.419220+0000, chain.objs.size()=1 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.139 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.445973+0000, chain.objs.size()=10 2024-09-14T11:41:12.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.140 2024-09-14T11:41:12.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.141 2024-09-14T11:41:12.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.142 2024-09-14T11:41:12.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.143 2024-09-14T11:41:12.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.221+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.144 2024-09-14T11:41:12.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.224+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.145 2024-09-14T11:41:12.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.225+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.146 2024-09-14T11:41:12.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.147 2024-09-14T11:41:12.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.148 2024-09-14T11:41:12.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.149 2024-09-14T11:41:12.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.469758+0000, chain.objs.size()=5 2024-09-14T11:41:12.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.150 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.151 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.152 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.153 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.154 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.488254+0000, chain.objs.size()=5 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.155 2024-09-14T11:41:12.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.226+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.156 2024-09-14T11:41:12.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.229+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.157 2024-09-14T11:41:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.229+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.158 2024-09-14T11:41:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.229+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.159 2024-09-14T11:41:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.229+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.514537+0000, chain.objs.size()=10 2024-09-14T11:41:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.229+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.160 2024-09-14T11:41:12.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.161 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.162 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.163 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.164 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.165 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.166 2024-09-14T11:41:12.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.230+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.167 2024-09-14T11:41:12.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.232+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.168 2024-09-14T11:41:12.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.232+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.169 2024-09-14T11:41:12.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.232+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.532332+0000, chain.objs.size()=2 2024-09-14T11:41:12.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.232+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.170 2024-09-14T11:41:12.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.232+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.171 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.234+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.571087+0000, chain.objs.size()=13 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.234+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.172 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.235+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.173 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.235+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.174 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.235+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.175 2024-09-14T11:41:12.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.235+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.176 2024-09-14T11:41:12.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.236+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.177 2024-09-14T11:41:12.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.236+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.178 2024-09-14T11:41:12.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.236+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.179 2024-09-14T11:41:12.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.237+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.180 2024-09-14T11:41:12.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.237+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.181 2024-09-14T11:41:12.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.237+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.182 2024-09-14T11:41:12.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.238+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.183 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.184 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.593127+0000, chain.objs.size()=8 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.185 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.186 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.187 2024-09-14T11:41:12.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.188 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.189 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.190 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.191 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.192 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.623163+0000, chain.objs.size()=10 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.240+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.193 2024-09-14T11:41:12.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.241+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.194 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.195 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.196 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.197 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.198 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.199 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.200 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.201 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.202 2024-09-14T11:41:12.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='2~GFsNbqIawBHbbBxCo69bb9rw6niJqei', time=2024-09-14T13:40:59.782047+0000, chain.objs.size()=212 2024-09-14T11:41:12.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.1 2024-09-14T11:41:12.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.2 2024-09-14T11:41:12.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.244+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.3 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.4 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.5 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.6 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.7 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.8 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.9 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.10 2024-09-14T11:41:12.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.11 2024-09-14T11:41:12.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.12 2024-09-14T11:41:12.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.13 2024-09-14T11:41:12.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.248+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.14 2024-09-14T11:41:12.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.250+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.15 2024-09-14T11:41:12.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.16 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.17 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.18 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.19 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.20 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.21 2024-09-14T11:41:12.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.22 2024-09-14T11:41:12.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.23 2024-09-14T11:41:12.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.24 2024-09-14T11:41:12.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.251+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.25 2024-09-14T11:41:12.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.253+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.26 2024-09-14T11:41:12.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.253+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.27 2024-09-14T11:41:12.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.28 2024-09-14T11:41:12.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.29 2024-09-14T11:41:12.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.30 2024-09-14T11:41:12.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.31 2024-09-14T11:41:12.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.32 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.33 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.34 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.35 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.36 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.37 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.254+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.38 2024-09-14T11:41:12.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.256+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.39 2024-09-14T11:41:12.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.256+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.40 2024-09-14T11:41:12.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.256+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.41 2024-09-14T11:41:12.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.42 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.43 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.44 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.45 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.46 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.47 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.48 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.49 2024-09-14T11:41:12.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.257+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.50 2024-09-14T11:41:12.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.258+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.51 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.258+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.52 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.53 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.54 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.55 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.56 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.57 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.58 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.59 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.60 2024-09-14T11:41:12.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.259+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.61 2024-09-14T11:41:12.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.260+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.62 2024-09-14T11:41:12.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.260+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.63 2024-09-14T11:41:12.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.261+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.64 2024-09-14T11:41:12.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.261+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.65 2024-09-14T11:41:12.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.262+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.66 2024-09-14T11:41:12.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.262+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.67 2024-09-14T11:41:12.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.262+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.68 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.69 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.70 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.71 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.72 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.73 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.74 2024-09-14T11:41:12.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.75 2024-09-14T11:41:12.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.263+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.76 2024-09-14T11:41:12.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.77 2024-09-14T11:41:12.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.78 2024-09-14T11:41:12.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.79 2024-09-14T11:41:12.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.80 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.81 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.82 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.83 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.84 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.85 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.86 2024-09-14T11:41:12.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.265+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.87 2024-09-14T11:41:12.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.88 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.89 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.90 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.91 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.92 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.93 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.94 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.95 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.96 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.97 2024-09-14T11:41:12.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.267+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.98 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.269+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.99 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.269+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.100 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.269+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.101 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.269+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.102 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.103 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.104 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.105 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.106 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.107 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.108 2024-09-14T11:41:12.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.270+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.109 2024-09-14T11:41:12.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.271+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.110 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.271+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.111 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.271+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.112 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.271+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.113 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.114 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.115 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.116 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.117 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.118 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.119 2024-09-14T11:41:12.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.272+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.120 2024-09-14T11:41:12.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.273+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.121 2024-09-14T11:41:12.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.122 2024-09-14T11:41:12.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.123 2024-09-14T11:41:12.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.124 2024-09-14T11:41:12.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.125 2024-09-14T11:41:12.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.126 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.127 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.128 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.129 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.130 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.274+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.131 2024-09-14T11:41:12.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.275+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.132 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.276+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.133 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.134 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.135 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.136 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.137 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.138 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.139 2024-09-14T11:41:12.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.277+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.140 2024-09-14T11:41:12.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.278+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.141 2024-09-14T11:41:12.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.278+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.142 2024-09-14T11:41:12.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.278+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.143 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.144 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.145 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.146 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.147 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.148 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.149 2024-09-14T11:41:12.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.150 2024-09-14T11:41:12.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.279+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.151 2024-09-14T11:41:12.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.280+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.152 2024-09-14T11:41:12.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.280+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.153 2024-09-14T11:41:12.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.280+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.154 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.155 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.156 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.157 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.158 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.159 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.160 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.161 2024-09-14T11:41:12.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.162 2024-09-14T11:41:12.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.163 2024-09-14T11:41:12.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.164 2024-09-14T11:41:12.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.282+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.165 2024-09-14T11:41:12.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.284+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.166 2024-09-14T11:41:12.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.284+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.167 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.284+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.168 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.169 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.170 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.171 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.172 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.173 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.174 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.175 2024-09-14T11:41:12.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.285+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.176 2024-09-14T11:41:12.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.286+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.177 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.178 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.179 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.180 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.181 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.182 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.183 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.184 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.185 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.186 2024-09-14T11:41:12.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.287+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.187 2024-09-14T11:41:12.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.288+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.188 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.289+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.189 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.289+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.190 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.289+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.191 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.289+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.192 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.193 2024-09-14T11:41:12.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.194 2024-09-14T11:41:12.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.195 2024-09-14T11:41:12.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.196 2024-09-14T11:41:12.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.197 2024-09-14T11:41:12.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.198 2024-09-14T11:41:12.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.290+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.199 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.200 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.201 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.202 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.203 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.204 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.205 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.292+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.206 2024-09-14T11:41:12.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.293+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.207 2024-09-14T11:41:12.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.293+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.208 2024-09-14T11:41:12.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.293+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.209 2024-09-14T11:41:12.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.293+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.210 2024-09-14T11:41:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.294+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.211 2024-09-14T11:41:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.294+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.106__multipart_key1.2~GFsNbqIawBHbbBxCo69bb9rw6niJqei.212 2024-09-14T11:41:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.294+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6119338535453416952', time=2024-09-14T13:41:03.235976+0000, chain.objs.size()=1 2024-09-14T11:41:12.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.294+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.118__shadow_.hDbgVttrS93f6cLDb9VQ4GfJFXok6b3_0 2024-09-14T11:41:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.295+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2895732676976654986', time=2024-09-14T13:41:05.900809+0000, chain.objs.size()=1 2024-09-14T11:41:12.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.295+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.127__shadow_.IFbIJQCNifYZ3bb5hWLUMQKajvIifD2_0 2024-09-14T11:41:12.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.296+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1742402906226778549', time=2024-09-14T13:41:06.185603+0000, chain.objs.size()=1 2024-09-14T11:41:12.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.296+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.128__shadow_.eocQW-jwFNG0cw5jYsGmmsC0jizL3It_0 2024-09-14T11:41:12.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.296+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3963401654709250792', time=2024-09-14T13:41:07.062211+0000, chain.objs.size()=1 2024-09-14T11:41:12.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.296+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.131__shadow_.EfPWf5T4MFCGY6vomXE0WMYhkKUKihq_0 2024-09-14T11:41:12.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.298+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.301+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:12.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.302+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:41:12.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.652376387176639771', time=2024-09-14T13:40:55.697783+0000, chain.objs.size()=5 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~ST5Nt_pllWn6rjfsFeQn4evFIbvkjRM.1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~ST5Nt_pllWn6rjfsFeQn4evFIbvkjRM.1_1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~ST5Nt_pllWn6rjfsFeQn4evFIbvkjRM.2 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~ST5Nt_pllWn6rjfsFeQn4evFIbvkjRM.2_1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~ST5Nt_pllWn6rjfsFeQn4evFIbvkjRM.3 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.231420146430623944', time=2024-09-14T13:40:57.232913+0000, chain.objs.size()=1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.104__shadow_.crzTEtqxhNxidQYIEFRsUF1yEAmavrI_0 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7683319078824821934', time=2024-09-14T13:41:03.817556+0000, chain.objs.size()=1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.120__shadow_.ZEzNjLfrF8ylI2xwViVd6yAlTty3UzL_0 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1833564691307290587', time=2024-09-14T13:41:06.203334+0000, chain.objs.size()=1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.128__shadow_.aaMGkKi7RXSyq2lwhYYeC5gmapmLLus_0 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7012122996264658000', time=2024-09-14T13:41:10.934984+0000, chain.objs.size()=5 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.144__multipart_key1.2~UvvC6tRYwSeTRAbkYdaGgrwxwkk1I5m.1 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.144__multipart_key1.2~UvvC6tRYwSeTRAbkYdaGgrwxwkk1I5m.2 2024-09-14T11:41:12.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.144__multipart_key1.2~UvvC6tRYwSeTRAbkYdaGgrwxwkk1I5m.3 2024-09-14T11:41:12.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.303+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.144__multipart_key1.2~UvvC6tRYwSeTRAbkYdaGgrwxwkk1I5m.4 2024-09-14T11:41:12.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.306+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.144__multipart_key1.2~UvvC6tRYwSeTRAbkYdaGgrwxwkk1I5m.5 2024-09-14T11:41:12.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.310+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.312+0000 7fcb4e732800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:12.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2695967348655340062', time=2024-09-14T13:40:56.548124+0000, chain.objs.size()=5 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~u4KDFib4SzRKnb4zGe7R8X2NMAoIDIO.1 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~u4KDFib4SzRKnb4zGe7R8X2NMAoIDIO.1_1 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~u4KDFib4SzRKnb4zGe7R8X2NMAoIDIO.2 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__shadow_key1.2~u4KDFib4SzRKnb4zGe7R8X2NMAoIDIO.2_1 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.103__multipart_key1.2~u4KDFib4SzRKnb4zGe7R8X2NMAoIDIO.3 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17052373378121796903', time=2024-09-14T13:41:01.759160+0000, chain.objs.size()=1 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.113__shadow_.C_2CwZkHVc28cy1f4CfUnceFJYwXDZK_0 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16828823719919384042', time=2024-09-14T13:41:02.937715+0000, chain.objs.size()=1 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.117__shadow_.U5x9QjB1eD3LhgOyzz8wBU4GKT_C-b2_0 2024-09-14T11:41:12.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12326672087394136880', time=2024-09-14T13:41:03.240815+0000, chain.objs.size()=1 2024-09-14T11:41:12.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.314+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.118__shadow_.wDnYETxl8_MHGAl4iZg5gpUkfcKzBCc_0 2024-09-14T11:41:12.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.318+0000 7fcb4e732800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:12.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.322+0000 7fca00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:12.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.324+0000 7fcb4e732800 20 remove_watcher() i=0 2024-09-14T11:41:12.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.324+0000 7fcb4e732800 2 removed watcher, disabling cache 2024-09-14T11:41:12.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.325+0000 7fcb4e732800 20 remove_watcher() i=1 2024-09-14T11:41:12.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.326+0000 7fcb4e732800 20 remove_watcher() i=2 2024-09-14T11:41:12.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.327+0000 7fcb4e732800 20 remove_watcher() i=3 2024-09-14T11:41:12.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.328+0000 7fcb4e732800 20 remove_watcher() i=4 2024-09-14T11:41:12.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.329+0000 7fcb4e732800 20 remove_watcher() i=5 2024-09-14T11:41:12.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.330+0000 7fcb4e732800 20 remove_watcher() i=6 2024-09-14T11:41:12.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.330+0000 7fcb4e732800 20 remove_watcher() i=7 2024-09-14T11:41:12.339 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-14T11:41:12.391 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:12.391 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:12.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.430+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 realm 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.431+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.432+0000 7faf6872a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:12.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.432+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.433+0000 7faf6872a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:12.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.433+0000 7faf6872a800 20 searching for the correct realm 2024-09-14T11:41:12.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.436+0000 7faf63c4e640 0 -- 172.21.15.94:0/3590929453 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x557c4bbd0d10 msgr2=0x557c4bbd3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:12.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.439+0000 7faf6444f640 0 -- 172.21.15.94:0/3590929453 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7faf4c083dd0 msgr2=0x7faf4c072780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 zone default found 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 4 Realm: () 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 zonegroup default 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.443+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.444+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.444+0000 7faf6872a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.444+0000 7faf6872a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.444+0000 7faf6872a800 20 started sync module instance, tier type = 2024-09-14T11:41:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.444+0000 7faf6872a800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=0 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=1 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=2 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=3 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=4 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=5 2024-09-14T11:41:12.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.452+0000 7faf6872a800 20 add_watcher() i=6 2024-09-14T11:41:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.453+0000 7faf6872a800 20 add_watcher() i=7 2024-09-14T11:41:12.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.453+0000 7faf6872a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:12.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.454+0000 7fae1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:12.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.455+0000 7faf6872a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:12.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.455+0000 7faf6872a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:12.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.488+0000 7fae19fdb640 20 reqs_thread_entry: start 2024-09-14T11:41:12.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.488+0000 7faf6872a800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:12.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.488+0000 7faf6872a800 20 Filter name: none 2024-09-14T11:41:12.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.488+0000 7fad8b7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:12.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.488+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:12.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.490+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.490+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.490+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.491+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:12.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.493+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.493+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.494+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.495+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:12.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.496+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.496+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.497+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.498+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:12.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.500+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.500+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.500+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.501+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:12.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.503+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.503+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.504+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.505+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:12.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.506+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.507+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.507+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.508+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:12.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.509+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.510+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.510+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.511+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:12.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.512+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.513+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.513+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.514+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:12.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.516+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.516+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.516+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.517+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:12.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.519+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.519+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.519+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.520+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:12.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.521+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.522+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.522+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.523+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:12.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.524+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.525+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.525+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.526+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:12.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.527+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.528+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.528+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.529+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:12.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.530+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.530+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.531+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.531+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:12.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.533+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.533+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.533+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.534+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:12.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.535+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.536+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.536+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.537+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:12.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.538+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.538+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.539+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.540+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:12.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.541+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.542+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.542+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.543+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:12.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.544+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.545+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.545+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.546+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:12.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.548+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.548+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.548+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.550+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:12.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.551+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.551+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.551+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.552+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:12.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.554+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.554+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.554+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.555+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:12.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.557+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.558+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.558+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.559+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:12.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.561+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.561+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.561+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.562+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:12.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.564+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.564+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.564+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.565+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:12.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.566+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.567+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.567+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.568+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:12.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.569+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.569+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.570+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.571+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:12.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.572+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.572+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.573+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.574+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:12.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.575+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.575+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.575+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.576+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.578+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.578+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.578+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.580+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.581+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.581+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.581+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.582+0000 7faf6872a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.584+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.585+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:12.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.585+0000 7faf6872a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:12.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.587+0000 7fae1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:12.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.589+0000 7faf6872a800 20 remove_watcher() i=0 2024-09-14T11:41:12.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.589+0000 7faf6872a800 2 removed watcher, disabling cache 2024-09-14T11:41:12.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.590+0000 7faf6872a800 20 remove_watcher() i=1 2024-09-14T11:41:12.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.591+0000 7faf6872a800 20 remove_watcher() i=2 2024-09-14T11:41:12.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.592+0000 7faf6872a800 20 remove_watcher() i=3 2024-09-14T11:41:12.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.593+0000 7faf6872a800 20 remove_watcher() i=4 2024-09-14T11:41:12.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.594+0000 7faf6872a800 20 remove_watcher() i=5 2024-09-14T11:41:12.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.594+0000 7faf6872a800 20 remove_watcher() i=6 2024-09-14T11:41:12.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:12.595+0000 7faf6872a800 20 remove_watcher() i=7 2024-09-14T11:41:12.604 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:41:12.622 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:41:12.622 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:41:12.622 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:41:12.622 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:41:12.650 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:41:13.467 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:41:13.467 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T11:41:13.468 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key NMBWJXSRYKJUVJMTPBYH --secret jWV0x4G6mquc47AQ5nKIytii4LJTjwb2gnYoF2L0lczNGDe2VgxA1g== --cluster ceph 2024-09-14T11:41:13.571 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:13.571 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:13.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.606+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 20 realm 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.608+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.609+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.609+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.610+0000 7fb777523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.610+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.610+0000 7fb777523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.610+0000 7fb777523800 20 searching for the correct realm 2024-09-14T11:41:13.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.613+0000 7fb76bfff640 0 -- 172.21.15.94:0/4020212516 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb7640bea40 msgr2=0x7fb7640a3bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:13.819+0000 7fb7731ae640 0 -- 172.21.15.94:0/4020212516 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb75c057930 msgr2=0x7fb75c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:14.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.026+0000 7fb777523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 zone default found 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 4 Realm: () 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 zonegroup default 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.027+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.028+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.028+0000 7fb777523800 20 started sync module instance, tier type = 2024-09-14T11:41:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.028+0000 7fb777523800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:14.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=0 2024-09-14T11:41:14.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=1 2024-09-14T11:41:14.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=2 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=3 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=4 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=5 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.037+0000 7fb777523800 20 add_watcher() i=6 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.038+0000 7fb777523800 20 add_watcher() i=7 2024-09-14T11:41:14.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.038+0000 7fb777523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 5 note: GC not initialized 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb628fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 20 Filter name: none 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb5a27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.040+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:41:14.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 10 cache get: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH : miss 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.041+0000 7fb777523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.042+0000 7fb777523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.042+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH info.flags=0x0 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.042+0000 7fb777523800 10 adding default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH to cache LRU end 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.042+0000 7fb777523800 10 cache get: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH : hit (negative entry) 2024-09-14T11:41:14.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.042+0000 7fb777523800 10 cache get: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH : hit (negative entry) 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb777523800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb777523800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb656ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497135 cookie 93861198208272 notifier 8459 bl.length()=645 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb656ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.043+0000 7fb656ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:41:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb777523800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:41:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb777523800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:41:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb6567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497136 cookie 93861198215872 notifier 8459 bl.length()=185 2024-09-14T11:41:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb6567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:41:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.045+0000 7fb6567fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb777523800 10 cache put: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH info.flags=0x7 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb777523800 10 moving default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH to cache LRU end 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb777523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:NMBWJXSRYKJUVJMTPBYH, ofs0, ns] 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb656ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497144 cookie 93861198210560 notifier 8459 bl.length()=186 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb656ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH info.flags=0x7 2024-09-14T11:41:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.047+0000 7fb656ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NMBWJXSRYKJUVJMTPBYH to cache LRU end 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foo.client.0", 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foo+test@test.test", 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foo.client.0", 2024-09-14T11:41:14.046 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "NMBWJXSRYKJUVJMTPBYH", 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "jWV0x4G6mquc47AQ5nKIytii4LJTjwb2gnYoF2L0lczNGDe2VgxA1g==", 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:14.042856Z" 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:14.047 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:14.048 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:14.042845Z", 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.049+0000 7fb629fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.051+0000 7fb777523800 20 remove_watcher() i=0 2024-09-14T11:41:14.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.051+0000 7fb777523800 2 removed watcher, disabling cache 2024-09-14T11:41:14.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.052+0000 7fb777523800 20 remove_watcher() i=1 2024-09-14T11:41:14.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.053+0000 7fb777523800 20 remove_watcher() i=2 2024-09-14T11:41:14.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.055+0000 7fb777523800 20 remove_watcher() i=3 2024-09-14T11:41:14.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.056+0000 7fb777523800 20 remove_watcher() i=4 2024-09-14T11:41:14.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.057+0000 7fb777523800 20 remove_watcher() i=5 2024-09-14T11:41:14.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.057+0000 7fb777523800 20 remove_watcher() i=6 2024-09-14T11:41:14.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.058+0000 7fb777523800 20 remove_watcher() i=7 2024-09-14T11:41:14.067 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 0312350055 --totp-seed MUKIWWG45JCBJNIY4XJMJHCAXQHHJZUDU6W7MVACOZ36MAENHMVGTAQHEB6XF4PF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.167+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 realm 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.169+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.170+0000 7f13e9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.170+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.170+0000 7f13e9922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.170+0000 7f13e9922800 20 searching for the correct realm 2024-09-14T11:41:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.172+0000 7f13e5502640 0 -- 172.21.15.94:0/3212559197 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f13d8028070 msgr2=0x7f13d80843c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:14.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.379+0000 7f13e5d03640 0 -- 172.21.15.94:0/3212559197 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f13d002e040 msgr2=0x7f13d001eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:14.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 zone default found 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 4 Realm: () 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 zonegroup default 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.385+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:14.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 started sync module instance, tier type = 2024-09-14T11:41:14.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.386+0000 7f13e9922800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=0 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=1 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=2 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=3 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=4 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=5 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=6 2024-09-14T11:41:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 20 add_watcher() i=7 2024-09-14T11:41:14.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.396+0000 7f13e9922800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.398+0000 7f129b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.398+0000 7f13e9922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.398+0000 7f13e9922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.398+0000 7f13e9922800 5 note: GC not initialized 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f129a7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 20 Filter name: none 2024-09-14T11:41:14.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f120bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 20 rados->read ofs=0 len=0 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:14.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:14.399+0000 7f13e9922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:15.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f13e9922800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:41:15.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f13e9922800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:15.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f13e9922800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:41:15.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f12b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431729 cookie 93910052532464 notifier 8474 bl.length()=659 2024-09-14T11:41:15.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f12b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:41:15.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.879+0000 7f12b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:41:15.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.881+0000 7f129b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:15.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.883+0000 7f13e9922800 20 remove_watcher() i=0 2024-09-14T11:41:15.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.883+0000 7f13e9922800 2 removed watcher, disabling cache 2024-09-14T11:41:15.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.885+0000 7f13e9922800 20 remove_watcher() i=1 2024-09-14T11:41:15.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.886+0000 7f13e9922800 20 remove_watcher() i=2 2024-09-14T11:41:15.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.887+0000 7f13e9922800 20 remove_watcher() i=3 2024-09-14T11:41:15.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.888+0000 7f13e9922800 20 remove_watcher() i=4 2024-09-14T11:41:15.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.889+0000 7f13e9922800 20 remove_watcher() i=5 2024-09-14T11:41:15.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.890+0000 7f13e9922800 20 remove_watcher() i=6 2024-09-14T11:41:15.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:15.892+0000 7f13e9922800 20 remove_watcher() i=7 2024-09-14T11:41:15.902 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:41:15.902 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key XHCDMEBMMCBWDKRRPDEY --secret r3ugnozdBfee2NaTGnZms4ZzMe21b0tweC32BzKXnHkZCRhgS0C+ZA== --cluster ceph 2024-09-14T11:41:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.006+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 20 realm 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.007+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.008+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.008+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.008+0000 7fa18a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.008+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.009+0000 7fa18a324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.009+0000 7fa18a324800 20 searching for the correct realm 2024-09-14T11:41:16.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.011+0000 7fa186068640 0 -- 172.21.15.94:0/2399916063 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7fa180027040 msgr2=0x7fa180007580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.015+0000 7fa186869640 0 -- 172.21.15.94:0/2399916063 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7fa1700dcac0 msgr2=0x7fa1700a4eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.020+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 zone default found 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 4 Realm: () 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 zonegroup default 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.021+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.022+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.022+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.022+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.022+0000 7fa18a324800 20 started sync module instance, tier type = 2024-09-14T11:41:16.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.022+0000 7fa18a324800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=0 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=1 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=2 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=3 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=4 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=5 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.031+0000 7fa18a324800 20 add_watcher() i=6 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.032+0000 7fa18a324800 20 add_watcher() i=7 2024-09-14T11:41:16.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.032+0000 7fa18a324800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.033+0000 7fa03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.033+0000 7fa18a324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.033+0000 7fa18a324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 5 note: GC not initialized 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7f9fb77fe640 20 reqs_thread_entry: start 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:16.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 20 Filter name: none 2024-09-14T11:41:16.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7f9fb57fa640 20 reqs_thread_entry: start 2024-09-14T11:41:16.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:41:16.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.034+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 cache get: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY : miss 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY info.flags=0x0 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 adding default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY to cache LRU end 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 cache get: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY : hit (negative entry) 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.035+0000 7fa18a324800 10 cache get: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY : hit (negative entry) 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.036+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.036+0000 7fa18a324800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.036+0000 7fa18a324800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.037+0000 7fa069ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431737 cookie 94261320128608 notifier 9042 bl.length()=645 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.037+0000 7fa069ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:41:16.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.037+0000 7fa069ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:41:16.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa18a324800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:41:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa18a324800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:41:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa0697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431789 cookie 94261320147264 notifier 9042 bl.length()=185 2024-09-14T11:41:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa0697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:41:16.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.038+0000 7fa0697fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:41:16.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.040+0000 7fa18a324800 10 cache put: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY info.flags=0x7 2024-09-14T11:41:16.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.040+0000 7fa18a324800 10 moving default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY to cache LRU end 2024-09-14T11:41:16.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.040+0000 7fa18a324800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:XHCDMEBMMCBWDKRRPDEY, ofs0, ns] 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.041+0000 7fa069ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431738 cookie 94261320128608 notifier 9042 bl.length()=186 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.041+0000 7fa069ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY info.flags=0x7 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.041+0000 7fa069ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XHCDMEBMMCBWDKRRPDEY to cache LRU end 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "bar.client.0", 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "bar+test@test.test", 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:16.039 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "bar.client.0", 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "XHCDMEBMMCBWDKRRPDEY", 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "r3ugnozdBfee2NaTGnZms4ZzMe21b0tweC32BzKXnHkZCRhgS0C+ZA==", 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:16.036242Z" 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:16.040 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:16.041 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:16.036232Z", 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:16.042 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:16.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.042+0000 7fa03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.044+0000 7fa18a324800 20 remove_watcher() i=0 2024-09-14T11:41:16.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.044+0000 7fa18a324800 2 removed watcher, disabling cache 2024-09-14T11:41:16.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.045+0000 7fa18a324800 20 remove_watcher() i=1 2024-09-14T11:41:16.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.046+0000 7fa18a324800 20 remove_watcher() i=2 2024-09-14T11:41:16.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.047+0000 7fa18a324800 20 remove_watcher() i=3 2024-09-14T11:41:16.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.048+0000 7fa18a324800 20 remove_watcher() i=4 2024-09-14T11:41:16.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.049+0000 7fa18a324800 20 remove_watcher() i=5 2024-09-14T11:41:16.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.050+0000 7fa18a324800 20 remove_watcher() i=6 2024-09-14T11:41:16.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.051+0000 7fa18a324800 20 remove_watcher() i=7 2024-09-14T11:41:16.060 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0361470703 --totp-seed GFEJJVEQHVS5RDNX7D5PDBLCADDO3APZ3BSQURVBNI7IPIIEVB2VQXZ3X6ENDH7L --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:16.125 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:16.126 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.161+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 realm 2024-09-14T11:41:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.163+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.164+0000 7f28ced2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.164+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.164+0000 7f28ced2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.164+0000 7f28ced2e800 20 searching for the correct realm 2024-09-14T11:41:16.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.168+0000 7f28cb165640 0 -- 172.21.15.94:0/2007952818 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f28c0038070 msgr2=0x7f28c0039460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.171+0000 7f28ca964640 0 -- 172.21.15.94:0/2007952818 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f28c0055410 msgr2=0x7f28c0055890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:16.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.378+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 zone default found 2024-09-14T11:41:16.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 4 Realm: () 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 zonegroup default 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.379+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.380+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.380+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.380+0000 7f28ced2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.380+0000 7f28ced2e800 20 started sync module instance, tier type = 2024-09-14T11:41:16.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.380+0000 7f28ced2e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:16.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=0 2024-09-14T11:41:16.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=1 2024-09-14T11:41:16.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=2 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=3 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=4 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=5 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.389+0000 7f28ced2e800 20 add_watcher() i=6 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.390+0000 7f28ced2e800 20 add_watcher() i=7 2024-09-14T11:41:16.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.390+0000 7f28ced2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:16.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.392+0000 7f27817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.392+0000 7f28ced2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.392+0000 7f28ced2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.392+0000 7f28ced2e800 5 note: GC not initialized 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.392+0000 7f26fbfff640 20 reqs_thread_entry: start 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 20 Filter name: none 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f26f9ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:41:16.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:41:16.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:41:16.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.393+0000 7f28ced2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:16.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.396+0000 7f28ced2e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:41:16.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.396+0000 7f28ced2e800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.396+0000 7f28ced2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:41:16.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.397+0000 7f27ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431739 cookie 94345753854656 notifier 8507 bl.length()=659 2024-09-14T11:41:16.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.397+0000 7f27ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:41:16.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.397+0000 7f27ae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:41:16.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.398+0000 7f27817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.400+0000 7f28ced2e800 20 remove_watcher() i=0 2024-09-14T11:41:16.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.400+0000 7f28ced2e800 2 removed watcher, disabling cache 2024-09-14T11:41:16.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.401+0000 7f28ced2e800 20 remove_watcher() i=1 2024-09-14T11:41:16.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.402+0000 7f28ced2e800 20 remove_watcher() i=2 2024-09-14T11:41:16.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.403+0000 7f28ced2e800 20 remove_watcher() i=3 2024-09-14T11:41:16.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.404+0000 7f28ced2e800 20 remove_watcher() i=4 2024-09-14T11:41:16.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.405+0000 7f28ced2e800 20 remove_watcher() i=5 2024-09-14T11:41:16.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.406+0000 7f28ced2e800 20 remove_watcher() i=6 2024-09-14T11:41:16.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.407+0000 7f28ced2e800 20 remove_watcher() i=7 2024-09-14T11:41:16.416 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T11:41:16.416 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key VYSZLQZPWWFJMGGNVTUW --secret 268upi6R4VFiHxsHZBQbRDMbx7HUln1Bv0lpTZ1mzTA9EYFYA7J6Nw== --cluster ceph 2024-09-14T11:41:16.479 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:16.480 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.515+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.516+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.516+0000 7fb331d26800 20 realm 2024-09-14T11:41:16.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.516+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.516+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.517+0000 7fb331d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.517+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.517+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.517+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.518+0000 7fb331d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.518+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.518+0000 7fb331d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.518+0000 7fb331d26800 20 searching for the correct realm 2024-09-14T11:41:16.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.521+0000 7fb3251d8640 0 -- 172.21.15.94:0/824168751 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fb320075020 msgr2=0x7fb32006a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.524+0000 7fb32d9d9640 0 -- 172.21.15.94:0/824168751 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fb3180743c0 msgr2=0x7fb318071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:16.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.730+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 zone default found 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 4 Realm: () 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 zonegroup default 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.731+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.732+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.732+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.732+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.732+0000 7fb331d26800 20 started sync module instance, tier type = 2024-09-14T11:41:16.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.732+0000 7fb331d26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:16.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=0 2024-09-14T11:41:16.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=1 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=2 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=3 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=4 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=5 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.741+0000 7fb331d26800 20 add_watcher() i=6 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.742+0000 7fb331d26800 20 add_watcher() i=7 2024-09-14T11:41:16.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.742+0000 7fb331d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.744+0000 7fb1dffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.744+0000 7fb331d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.744+0000 7fb331d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.744+0000 7fb331d26800 5 note: GC not initialized 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.744+0000 7fb1deffd640 20 reqs_thread_entry: start 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 Filter name: none 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb1dcff9640 20 reqs_thread_entry: start 2024-09-14T11:41:16.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:41:16.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 10 cache get: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW : miss 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.745+0000 7fb331d26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.746+0000 7fb331d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.746+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW info.flags=0x0 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.746+0000 7fb331d26800 10 adding default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW to cache LRU end 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.746+0000 7fb331d26800 10 cache get: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW : hit (negative entry) 2024-09-14T11:41:16.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.746+0000 7fb331d26800 10 cache get: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW : hit (negative entry) 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb331d26800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb331d26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb2117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431790 cookie 94653291992880 notifier 9078 bl.length()=719 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb2117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:41:16.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.747+0000 7fb2117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb331d26800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb331d26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb210ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94653292000208 notifier 9078 bl.length()=215 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb210ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:41:16.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.749+0000 7fb210ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb331d26800 10 cache put: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW info.flags=0x7 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb331d26800 10 moving default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW to cache LRU end 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb331d26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:VYSZLQZPWWFJMGGNVTUW, ofs0, ns] 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb2117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431730 cookie 94653291977456 notifier 9078 bl.length()=201 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb2117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW info.flags=0x7 2024-09-14T11:41:16.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.751+0000 7fb2117fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VYSZLQZPWWFJMGGNVTUW to cache LRU end 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:16.750 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "VYSZLQZPWWFJMGGNVTUW", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "268upi6R4VFiHxsHZBQbRDMbx7HUln1Bv0lpTZ1mzTA9EYFYA7J6Nw==", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:16.746972Z" 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:16.751 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:16.752 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:16.746952Z", 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:16.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.753+0000 7fb1dffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.755+0000 7fb331d26800 20 remove_watcher() i=0 2024-09-14T11:41:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.755+0000 7fb331d26800 2 removed watcher, disabling cache 2024-09-14T11:41:16.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.756+0000 7fb331d26800 20 remove_watcher() i=1 2024-09-14T11:41:16.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.757+0000 7fb331d26800 20 remove_watcher() i=2 2024-09-14T11:41:16.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.758+0000 7fb331d26800 20 remove_watcher() i=3 2024-09-14T11:41:16.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.759+0000 7fb331d26800 20 remove_watcher() i=4 2024-09-14T11:41:16.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.760+0000 7fb331d26800 20 remove_watcher() i=5 2024-09-14T11:41:16.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.761+0000 7fb331d26800 20 remove_watcher() i=6 2024-09-14T11:41:16.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.762+0000 7fb331d26800 20 remove_watcher() i=7 2024-09-14T11:41:16.771 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0685830005 --totp-seed A7FCB47TRT6FEA5F62ZVMBCXITVWTA2B2SSYPYJT7DNDQ2ZWHTF6QTIEDC3CP5JF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:16.837 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:16.837 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:16.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.889+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 20 realm 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.890+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.891+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.891+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.892+0000 7f1cb18bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.892+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.892+0000 7f1cb18bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:16.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.892+0000 7f1cb18bb800 20 searching for the correct realm 2024-09-14T11:41:16.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.894+0000 7f1caf3a5640 0 -- 172.21.15.94:0/2895360025 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x7f1c9c003c60 msgr2=0x7f1ca80648b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.898+0000 7f1caf3a5640 0 -- 172.21.15.94:0/2895360025 >> [v2:172.21.15.131:6826/3170580125,v1:172.21.15.131:6827/3170580125] conn(0x564958d8bb90 msgr2=0x564958d8df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.903+0000 7f1cb18bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 zone default found 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 4 Realm: () 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 zonegroup default 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 started sync module instance, tier type = 2024-09-14T11:41:16.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.904+0000 7f1cb18bb800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=0 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=1 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=2 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=3 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=4 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=5 2024-09-14T11:41:16.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.914+0000 7f1cb18bb800 20 add_watcher() i=6 2024-09-14T11:41:16.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.915+0000 7f1cb18bb800 20 add_watcher() i=7 2024-09-14T11:41:16.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.915+0000 7f1cb18bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.916+0000 7f1b667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.916+0000 7f1cb18bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.916+0000 7f1cb18bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.916+0000 7f1cb18bb800 5 note: GC not initialized 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1b657e2640 20 reqs_thread_entry: start 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 20 Filter name: none 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1b5effd640 20 reqs_thread_entry: start 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:41:16.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 20 rados->read ofs=0 len=0 2024-09-14T11:41:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T11:41:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:41:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.917+0000 7f1cb18bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1cb18bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1cb18bb800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1cb18bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1b92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399087 cookie 94873023250320 notifier 9096 bl.length()=733 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1b92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:41:16.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.920+0000 7f1b92ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:41:16.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.921+0000 7f1b667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:16.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.924+0000 7f1cb18bb800 20 remove_watcher() i=0 2024-09-14T11:41:16.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.924+0000 7f1cb18bb800 2 removed watcher, disabling cache 2024-09-14T11:41:16.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.925+0000 7f1cb18bb800 20 remove_watcher() i=1 2024-09-14T11:41:16.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.926+0000 7f1cb18bb800 20 remove_watcher() i=2 2024-09-14T11:41:16.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.927+0000 7f1cb18bb800 20 remove_watcher() i=3 2024-09-14T11:41:16.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.928+0000 7f1cb18bb800 20 remove_watcher() i=4 2024-09-14T11:41:16.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.929+0000 7f1cb18bb800 20 remove_watcher() i=5 2024-09-14T11:41:16.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.930+0000 7f1cb18bb800 20 remove_watcher() i=6 2024-09-14T11:41:16.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:16.931+0000 7f1cb18bb800 20 remove_watcher() i=7 2024-09-14T11:41:16.940 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:41:16.940 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key TWCSASTZPNUKTWIGUJZK --secret Nxqz7/rUnuXDv1j29tYkrH6104tj+Q75AkCfVnUseYdInk22rYbxcw== --cluster ceph 2024-09-14T11:41:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.041+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 realm 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.042+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.043+0000 7ff94c90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.043+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.043+0000 7ff94c90c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.043+0000 7ff94c90c800 20 searching for the correct realm 2024-09-14T11:41:17.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.046+0000 7ff949bf5640 0 -- 172.21.15.94:0/1251137837 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff93c0a8040 msgr2=0x7ff93c0a8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.050+0000 7ff94a3f6640 0 -- 172.21.15.94:0/1251137837 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7ff940075b30 msgr2=0x7ff94006b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.255+0000 7ff94c90c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 zone default found 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 4 Realm: () 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 zonegroup default 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.256+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 started sync module instance, tier type = 2024-09-14T11:41:17.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.257+0000 7ff94c90c800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=0 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=1 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=2 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=3 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=4 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=5 2024-09-14T11:41:17.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.267+0000 7ff94c90c800 20 add_watcher() i=6 2024-09-14T11:41:17.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.268+0000 7ff94c90c800 20 add_watcher() i=7 2024-09-14T11:41:17.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.268+0000 7ff94c90c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.269+0000 7ff800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.269+0000 7ff94c90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.269+0000 7ff94c90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.269+0000 7ff94c90c800 5 note: GC not initialized 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff77b7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 20 Filter name: none 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff7797fa640 20 reqs_thread_entry: start 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:41:17.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.270+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:41:17.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 cache get: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK : miss 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK info.flags=0x0 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 adding default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK to cache LRU end 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 cache get: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK : hit (negative entry) 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.271+0000 7ff94c90c800 10 cache get: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK : hit (negative entry) 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff94c90c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff94c90c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94135786647424 notifier 9111 bl.length()=660 2024-09-14T11:41:17.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.272+0000 7ff82dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff94c90c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff94c90c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399036 cookie 94135786632544 notifier 9111 bl.length()=191 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:41:17.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.275+0000 7ff82dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff94c90c800 10 cache put: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK info.flags=0x7 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff94c90c800 10 moving default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK to cache LRU end 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff94c90c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:TWCSASTZPNUKTWIGUJZK, ofs0, ns] 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff82dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 94135786638912 notifier 9111 bl.length()=189 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff82dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK info.flags=0x7 2024-09-14T11:41:17.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.277+0000 7ff82dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TWCSASTZPNUKTWIGUJZK to cache LRU end 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "TWCSASTZPNUKTWIGUJZK", 2024-09-14T11:41:17.276 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "Nxqz7/rUnuXDv1j29tYkrH6104tj+Q75AkCfVnUseYdInk22rYbxcw==", 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:17.272220Z" 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:41:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:17.272207Z", 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:17.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.278+0000 7ff800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.280+0000 7ff94c90c800 20 remove_watcher() i=0 2024-09-14T11:41:17.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.280+0000 7ff94c90c800 2 removed watcher, disabling cache 2024-09-14T11:41:17.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.282+0000 7ff94c90c800 20 remove_watcher() i=1 2024-09-14T11:41:17.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.283+0000 7ff94c90c800 20 remove_watcher() i=2 2024-09-14T11:41:17.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.284+0000 7ff94c90c800 20 remove_watcher() i=3 2024-09-14T11:41:17.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.285+0000 7ff94c90c800 20 remove_watcher() i=4 2024-09-14T11:41:17.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.286+0000 7ff94c90c800 20 remove_watcher() i=5 2024-09-14T11:41:17.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.287+0000 7ff94c90c800 20 remove_watcher() i=6 2024-09-14T11:41:17.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.288+0000 7ff94c90c800 20 remove_watcher() i=7 2024-09-14T11:41:17.297 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9133291166 --totp-seed YJ66EQSL53ANUUO3L3BREYCWKDWP2BKTHYHGF7OLOY4OVIERPQKXROOKWY74ZAO7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:17.363 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.363 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.399+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 realm 2024-09-14T11:41:17.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.401+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.402+0000 7f7617f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.402+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.402+0000 7f7617f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.403+0000 7f7617f46800 20 searching for the correct realm 2024-09-14T11:41:17.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.406+0000 7f7616238640 0 -- 172.21.15.94:0/3583937015 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f760c06a290 msgr2=0x7f760c072e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.409+0000 7f7615a37640 0 -- 172.21.15.94:0/3583937015 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f760c08c050 msgr2=0x7f760c068400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 zone default found 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 4 Realm: () 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 zonegroup default 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.616+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 started sync module instance, tier type = 2024-09-14T11:41:17.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.617+0000 7f7617f46800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=0 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=1 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=2 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=3 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=4 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=5 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.626+0000 7f7617f46800 20 add_watcher() i=6 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.627+0000 7f7617f46800 20 add_watcher() i=7 2024-09-14T11:41:17.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.627+0000 7f7617f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.629+0000 7f74c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.629+0000 7f7617f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.629+0000 7f7617f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.629+0000 7f7617f46800 5 note: GC not initialized 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f74c67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 20 Filter name: none 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7437fff640 20 reqs_thread_entry: start 2024-09-14T11:41:17.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:41:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:41:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:41:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.630+0000 7f7617f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:17.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.633+0000 7f7617f46800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.633+0000 7f7617f46800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.633+0000 7f7617f46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.634+0000 7f74f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94635528542288 notifier 9126 bl.length()=674 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.634+0000 7f74f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.634+0000 7f74f97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.635+0000 7f74c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.637+0000 7f7617f46800 20 remove_watcher() i=0 2024-09-14T11:41:17.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.637+0000 7f7617f46800 2 removed watcher, disabling cache 2024-09-14T11:41:17.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.638+0000 7f7617f46800 20 remove_watcher() i=1 2024-09-14T11:41:17.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.639+0000 7f7617f46800 20 remove_watcher() i=2 2024-09-14T11:41:17.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.640+0000 7f7617f46800 20 remove_watcher() i=3 2024-09-14T11:41:17.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.641+0000 7f7617f46800 20 remove_watcher() i=4 2024-09-14T11:41:17.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.642+0000 7f7617f46800 20 remove_watcher() i=5 2024-09-14T11:41:17.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.643+0000 7f7617f46800 20 remove_watcher() i=6 2024-09-14T11:41:17.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.644+0000 7f7617f46800 20 remove_watcher() i=7 2024-09-14T11:41:17.653 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:41:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.712 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.746+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 realm 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.748+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.749+0000 7f3fbef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.749+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.749+0000 7f3fbef25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.749+0000 7f3fbef25800 20 searching for the correct realm 2024-09-14T11:41:17.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.752+0000 7f3fb23ad640 0 -- 172.21.15.94:0/3821495946 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x563df8d02670 msgr2=0x563df8d04ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.756+0000 7f3fbabae640 0 -- 172.21.15.94:0/3821495946 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f3fa40700c0 msgr2=0x7f3fa4081a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 zone default found 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 4 Realm: () 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 zonegroup default 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.760+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 started sync module instance, tier type = 2024-09-14T11:41:17.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.761+0000 7f3fbef25800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=0 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=1 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=2 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=3 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=4 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=5 2024-09-14T11:41:17.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.770+0000 7f3fbef25800 20 add_watcher() i=6 2024-09-14T11:41:17.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.771+0000 7f3fbef25800 20 add_watcher() i=7 2024-09-14T11:41:17.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.771+0000 7f3fbef25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.772+0000 7f3e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.772+0000 7f3fbef25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.772+0000 7f3fbef25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.772+0000 7f3fbef25800 5 note: GC not initialized 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.772+0000 7f3debfff640 20 reqs_thread_entry: start 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 20 Filter name: none 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3de9ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:17.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:41:17.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:41:17.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:41:17.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.773+0000 7f3fbef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.774+0000 7f3fbef25800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.774+0000 7f3fbef25800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.774+0000 7f3fbef25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.775+0000 7f3e9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94824167390592 notifier 8588 bl.length()=727 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.775+0000 7f3e9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:41:17.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.775+0000 7f3e9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "TWCSASTZPNUKTWIGUJZK", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "Nxqz7/rUnuXDv1j29tYkrH6104tj+Q75AkCfVnUseYdInk22rYbxcw==", 2024-09-14T11:41:17.774 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:17.272220Z" 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [ 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "oidc-provider", 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "roles", 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.775 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "user-policy", 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [ 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "9133291166" 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-14T11:41:17.777 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:17.272207Z", 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.776+0000 7f3e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.778+0000 7f3fbef25800 20 remove_watcher() i=0 2024-09-14T11:41:17.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.778+0000 7f3fbef25800 2 removed watcher, disabling cache 2024-09-14T11:41:17.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.779+0000 7f3fbef25800 20 remove_watcher() i=1 2024-09-14T11:41:17.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.780+0000 7f3fbef25800 20 remove_watcher() i=2 2024-09-14T11:41:17.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.781+0000 7f3fbef25800 20 remove_watcher() i=3 2024-09-14T11:41:17.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.782+0000 7f3fbef25800 20 remove_watcher() i=4 2024-09-14T11:41:17.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.783+0000 7f3fbef25800 20 remove_watcher() i=5 2024-09-14T11:41:17.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.784+0000 7f3fbef25800 20 remove_watcher() i=6 2024-09-14T11:41:17.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.785+0000 7f3fbef25800 20 remove_watcher() i=7 2024-09-14T11:41:17.793 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:41:17.853 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:17.853 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:17.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.889+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 20 realm 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.890+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.891+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.891+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.891+0000 7f7d98f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.891+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.892+0000 7f7d98f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:17.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.892+0000 7f7d98f26800 20 searching for the correct realm 2024-09-14T11:41:17.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.894+0000 7f7d9535e640 0 -- 172.21.15.94:0/3939298850 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f7d80074c20 msgr2=0x7f7d80093a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.898+0000 7f7d94b5d640 0 -- 172.21.15.94:0/3939298850 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f7d8006f1c0 msgr2=0x7f7d800660d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:17.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:17.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.902+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 zone default found 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 4 Realm: () 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:17.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 zonegroup default 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.903+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.904+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.904+0000 7f7d98f26800 20 started sync module instance, tier type = 2024-09-14T11:41:17.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.904+0000 7f7d98f26800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:17.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=0 2024-09-14T11:41:17.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=1 2024-09-14T11:41:17.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=2 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=3 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=4 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=5 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.912+0000 7f7d98f26800 20 add_watcher() i=6 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.913+0000 7f7d98f26800 20 add_watcher() i=7 2024-09-14T11:41:17.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.913+0000 7f7d98f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7c4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 5 note: GC not initialized 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7c4a7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 20 Filter name: none 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7c43fff640 20 reqs_thread_entry: start 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.915+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:41:17.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:17.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:41:17.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:41:17.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 20 rados->read ofs=0 len=0 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.916+0000 7f7d98f26800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7d98f26800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7d98f26800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7d98f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399037 cookie 94594411219856 notifier 8606 bl.length()=384 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.917+0000 7f7c6bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:17.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7d98f26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7d98f26800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7d98f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399027 cookie 94594411228032 notifier 8606 bl.length()=225 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.919+0000 7f7c6bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:17.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7d98f26800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7d98f26800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7d98f26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7c6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398939 cookie 94594411225296 notifier 8606 bl.length()=234 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7c6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.921+0000 7f7c6bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:41:17.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.922+0000 7f7c4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:17.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.924+0000 7f7d98f26800 20 remove_watcher() i=0 2024-09-14T11:41:17.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.924+0000 7f7d98f26800 2 removed watcher, disabling cache 2024-09-14T11:41:17.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.925+0000 7f7d98f26800 20 remove_watcher() i=1 2024-09-14T11:41:17.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.926+0000 7f7d98f26800 20 remove_watcher() i=2 2024-09-14T11:41:17.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.927+0000 7f7d98f26800 20 remove_watcher() i=3 2024-09-14T11:41:17.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.929+0000 7f7d98f26800 20 remove_watcher() i=4 2024-09-14T11:41:17.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.930+0000 7f7d98f26800 20 remove_watcher() i=5 2024-09-14T11:41:17.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.930+0000 7f7d98f26800 20 remove_watcher() i=6 2024-09-14T11:41:17.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:17.931+0000 7f7d98f26800 20 remove_watcher() i=7 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW88888888888888888", 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.938 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:17.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-14T11:41:17.940 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:17.940 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:41:17.941 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key LKNFQWTTBESAEYKAGXKD --secret 52A54C7BCSxBo2Q6Z0wXWMAb3Ic7uDiIgDCGPONt7m9uobqmllP9ZA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:41:18.008 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:18.009 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:18.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.043+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.044+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.044+0000 7f2087e98800 20 realm 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.044+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.045+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.045+0000 7f2087e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.045+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.045+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.045+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.046+0000 7f2087e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.046+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.046+0000 7f2087e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:18.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.046+0000 7f2087e98800 20 searching for the correct realm 2024-09-14T11:41:18.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.048+0000 7f2085181640 0 -- 172.21.15.94:0/575833623 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f207804e040 msgr2=0x7f2078050950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.052+0000 7f2085982640 0 -- 172.21.15.94:0/575833623 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f207c09f360 msgr2=0x7f207c06adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.257+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 zone default found 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 4 Realm: () 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 zonegroup default 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.258+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.259+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.259+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.259+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.259+0000 7f2087e98800 20 started sync module instance, tier type = 2024-09-14T11:41:18.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.259+0000 7f2087e98800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=0 2024-09-14T11:41:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=1 2024-09-14T11:41:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=2 2024-09-14T11:41:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=3 2024-09-14T11:41:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=4 2024-09-14T11:41:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=5 2024-09-14T11:41:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.267+0000 7f2087e98800 20 add_watcher() i=6 2024-09-14T11:41:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.268+0000 7f2087e98800 20 add_watcher() i=7 2024-09-14T11:41:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.268+0000 7f2087e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:18.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.270+0000 7f1f377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.270+0000 7f2087e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.270+0000 7f2087e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.270+0000 7f2087e98800 5 note: GC not initialized 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.270+0000 7f1f367fc640 20 reqs_thread_entry: start 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 Filter name: none 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f1ea7fff640 20 reqs_thread_entry: start 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:41:18.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 10 cache get: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD : miss 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.271+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD info.flags=0x0 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 adding default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD to cache LRU end 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:41:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:41:18.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:41:18.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:41:18.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:18.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 cache get: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD : hit (negative entry) 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.272+0000 7f2087e98800 10 cache get: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD : hit (negative entry) 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f2087e98800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f2087e98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f1f697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399038 cookie 94065795544096 notifier 8621 bl.length()=681 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f1f697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:41:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.274+0000 7f1f697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f2087e98800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f2087e98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f1f697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399088 cookie 94065795563040 notifier 8621 bl.length()=189 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f1f697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:41:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.276+0000 7f1f697fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:41:18.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f2087e98800 10 cache put: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD info.flags=0x7 2024-09-14T11:41:18.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f2087e98800 10 moving default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD to cache LRU end 2024-09-14T11:41:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f2087e98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:LKNFQWTTBESAEYKAGXKD, ofs0, ns] 2024-09-14T11:41:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f1f68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399028 cookie 94065795552656 notifier 8621 bl.length()=188 2024-09-14T11:41:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f1f68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD info.flags=0x7 2024-09-14T11:41:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.277+0000 7f1f68ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LKNFQWTTBESAEYKAGXKD to cache LRU end 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.279+0000 7f2087e98800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root1.client.0", 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root1+test@test.test", 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:18.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root1.client.0", 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "LKNFQWTTBESAEYKAGXKD", 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "52A54C7BCSxBo2Q6Z0wXWMAb3Ic7uDiIgDCGPONt7m9uobqmllP9ZA==", 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:18.273503Z" 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:18.278 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:18.279 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:18.273490Z", 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:18.280 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.280+0000 7f1f377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.282+0000 7f2087e98800 20 remove_watcher() i=0 2024-09-14T11:41:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.282+0000 7f2087e98800 2 removed watcher, disabling cache 2024-09-14T11:41:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.283+0000 7f2087e98800 20 remove_watcher() i=1 2024-09-14T11:41:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.283+0000 7f2087e98800 20 remove_watcher() i=2 2024-09-14T11:41:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.284+0000 7f2087e98800 20 remove_watcher() i=3 2024-09-14T11:41:18.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.285+0000 7f2087e98800 20 remove_watcher() i=4 2024-09-14T11:41:18.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.286+0000 7f2087e98800 20 remove_watcher() i=5 2024-09-14T11:41:18.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.287+0000 7f2087e98800 20 remove_watcher() i=6 2024-09-14T11:41:18.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.288+0000 7f2087e98800 20 remove_watcher() i=7 2024-09-14T11:41:18.297 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8374840933 --totp-seed 3ACUDPUD3V6SZADYY3CKDGSDULPB7Y3AF4CHSRIOHARTH74A2RUT3PVFK3NDE5GY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:18.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.398+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 realm 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.400+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.401+0000 7f4f0ff73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.401+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.401+0000 7f4f0ff73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:18.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.401+0000 7f4f0ff73800 20 searching for the correct realm 2024-09-14T11:41:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.404+0000 7f4f0525c640 0 -- 172.21.15.94:0/112161643 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f4f00034060 msgr2=0x7f4f00070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.407+0000 7f4f0da5d640 0 -- 172.21.15.94:0/112161643 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f4ef8017040 msgr2=0x7f4ef8083310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:18.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:18.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.613+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 zone default found 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 4 Realm: () 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:18.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 zonegroup default 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.614+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.615+0000 7f4f0ff73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.615+0000 7f4f0ff73800 20 started sync module instance, tier type = 2024-09-14T11:41:18.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.615+0000 7f4f0ff73800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=0 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=1 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=2 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=3 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=4 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=5 2024-09-14T11:41:18.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.623+0000 7f4f0ff73800 20 add_watcher() i=6 2024-09-14T11:41:18.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.624+0000 7f4f0ff73800 20 add_watcher() i=7 2024-09-14T11:41:18.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.624+0000 7f4f0ff73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:18.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.625+0000 7f4dbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 5 note: GC not initialized 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4dbe7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 20 Filter name: none 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4d2ffff640 20 reqs_thread_entry: start 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.626+0000 7f4f0ff73800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.627+0000 7f4f0ff73800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.627+0000 7f4f0ff73800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.627+0000 7f4f0ff73800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.627+0000 7f4f0ff73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:18.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4f0ff73800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:41:18.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4f0ff73800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4f0ff73800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:41:18.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4df17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399039 cookie 94096755080208 notifier 9198 bl.length()=695 2024-09-14T11:41:18.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4df17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:41:18.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.629+0000 7f4df17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:41:18.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.630+0000 7f4dbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.633+0000 7f4f0ff73800 20 remove_watcher() i=0 2024-09-14T11:41:18.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.633+0000 7f4f0ff73800 2 removed watcher, disabling cache 2024-09-14T11:41:18.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.634+0000 7f4f0ff73800 20 remove_watcher() i=1 2024-09-14T11:41:18.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.635+0000 7f4f0ff73800 20 remove_watcher() i=2 2024-09-14T11:41:18.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.636+0000 7f4f0ff73800 20 remove_watcher() i=3 2024-09-14T11:41:18.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.637+0000 7f4f0ff73800 20 remove_watcher() i=4 2024-09-14T11:41:18.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.638+0000 7f4f0ff73800 20 remove_watcher() i=5 2024-09-14T11:41:18.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.638+0000 7f4f0ff73800 20 remove_watcher() i=6 2024-09-14T11:41:18.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.639+0000 7f4f0ff73800 20 remove_watcher() i=7 2024-09-14T11:41:18.648 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:41:18.708 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:18.708 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:18.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.743+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 realm 2024-09-14T11:41:18.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.745+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.746+0000 7f8e97523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.746+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.746+0000 7f8e97523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:18.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.746+0000 7f8e97523800 20 searching for the correct realm 2024-09-14T11:41:18.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.749+0000 7f8e92a0b640 0 -- 172.21.15.94:0/174313069 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f8e8400c000 msgr2=0x7f8e8406d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.753+0000 7f8e9320c640 0 -- 172.21.15.94:0/174313069 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f8e880a93d0 msgr2=0x7f8e880a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.959+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:18.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 zone default found 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 4 Realm: () 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 zonegroup default 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.960+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 started sync module instance, tier type = 2024-09-14T11:41:18.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.961+0000 7f8e97523800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=0 2024-09-14T11:41:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=1 2024-09-14T11:41:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=2 2024-09-14T11:41:18.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=3 2024-09-14T11:41:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=4 2024-09-14T11:41:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=5 2024-09-14T11:41:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.970+0000 7f8e97523800 20 add_watcher() i=6 2024-09-14T11:41:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.971+0000 7f8e97523800 20 add_watcher() i=7 2024-09-14T11:41:18.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.971+0000 7f8e97523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:18.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.973+0000 7f8d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.973+0000 7f8e97523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.973+0000 7f8e97523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.973+0000 7f8e97523800 5 note: GC not initialized 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.973+0000 7f8d48fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 Filter name: none 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8cc27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:41:18.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 rados->read ofs=0 len=0 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:41:18.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.974+0000 7f8e97523800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8e97523800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8e97523800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8e97523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8d76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399040 cookie 93869237643120 notifier 9219 bl.length()=384 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8d76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.976+0000 7f8d76ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:18.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8e97523800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:41:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8e97523800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8e97523800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:41:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8d76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399029 cookie 93869237649472 notifier 9219 bl.length()=225 2024-09-14T11:41:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8d76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:41:18.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.978+0000 7f8d76ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8e97523800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8e97523800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8e97523800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8d767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398940 cookie 93869237656720 notifier 9219 bl.length()=234 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8d767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:41:18.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.980+0000 7f8d767fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:41:18.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.981+0000 7f8d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:18.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.983+0000 7f8e97523800 20 remove_watcher() i=0 2024-09-14T11:41:18.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.983+0000 7f8e97523800 2 removed watcher, disabling cache 2024-09-14T11:41:18.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.984+0000 7f8e97523800 20 remove_watcher() i=1 2024-09-14T11:41:18.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.985+0000 7f8e97523800 20 remove_watcher() i=2 2024-09-14T11:41:18.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.986+0000 7f8e97523800 20 remove_watcher() i=3 2024-09-14T11:41:18.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.987+0000 7f8e97523800 20 remove_watcher() i=4 2024-09-14T11:41:18.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.988+0000 7f8e97523800 20 remove_watcher() i=5 2024-09-14T11:41:18.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.989+0000 7f8e97523800 20 remove_watcher() i=6 2024-09-14T11:41:18.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:18.990+0000 7f8e97523800 20 remove_watcher() i=7 2024-09-14T11:41:18.996 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:18.996 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW99999999999999999", 2024-09-14T11:41:18.996 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:18.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-14T11:41:18.998 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:18.999 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:41:18.999 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key PSORYHBJMOFPPZUJHNLJ --secret oN5wM0IvazYlxQhqi6dC/dpydKxpXCdQgtrG7kMeoAIWUitiWJ+sGA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:41:19.065 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:19.065 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:19.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.101+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 20 realm 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.102+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.103+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.103+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.103+0000 7fadfcb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.103+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.104+0000 7fadfcb1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:19.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.104+0000 7fadfcb1f800 20 searching for the correct realm 2024-09-14T11:41:19.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.107+0000 7fadf00a1640 0 -- 172.21.15.94:0/772445763 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x55a4939b2920 msgr2=0x55a4939b4db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.110+0000 7fadf88a2640 0 -- 172.21.15.94:0/772445763 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fade00a6430 msgr2=0x7fade00a6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:19.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.114+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 zone default found 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 4 Realm: () 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 zonegroup default 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.115+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.116+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.116+0000 7fadfcb1f800 20 started sync module instance, tier type = 2024-09-14T11:41:19.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.116+0000 7fadfcb1f800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=0 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=1 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=2 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=3 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=4 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=5 2024-09-14T11:41:19.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.124+0000 7fadfcb1f800 20 add_watcher() i=6 2024-09-14T11:41:19.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.125+0000 7fadfcb1f800 20 add_watcher() i=7 2024-09-14T11:41:19.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.125+0000 7fadfcb1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:19.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7facaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:19.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:19.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 5 note: GC not initialized 2024-09-14T11:41:19.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7facae7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 20 Filter name: none 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7faca77fe640 20 reqs_thread_entry: start 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.127+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:41:19.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ : miss 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ info.flags=0x0 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 adding default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ to cache LRU end 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:41:19.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.128+0000 7fadfcb1f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ : hit (negative entry) 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.129+0000 7fadfcb1f800 10 cache get: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ : hit (negative entry) 2024-09-14T11:41:19.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:41:19.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7fadfcb1f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7fadfcb1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:41:19.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7faccffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399041 cookie 94165339432848 notifier 9240 bl.length()=681 2024-09-14T11:41:19.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7faccffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:41:19.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.131+0000 7faccffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7fadfcb1f800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7fadfcb1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7faccf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399089 cookie 94165339444800 notifier 9240 bl.length()=189 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7faccf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:41:19.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.133+0000 7faccf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:41:19.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.134+0000 7fadfcb1f800 10 cache put: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ info.flags=0x7 2024-09-14T11:41:19.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.134+0000 7fadfcb1f800 10 moving default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ to cache LRU end 2024-09-14T11:41:19.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.134+0000 7fadfcb1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:PSORYHBJMOFPPZUJHNLJ, ofs0, ns] 2024-09-14T11:41:19.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.135+0000 7faccf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399090 cookie 94165339444800 notifier 9240 bl.length()=188 2024-09-14T11:41:19.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.135+0000 7faccf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ info.flags=0x7 2024-09-14T11:41:19.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.135+0000 7faccf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PSORYHBJMOFPPZUJHNLJ to cache LRU end 2024-09-14T11:41:19.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.136+0000 7fadfcb1f800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:41:19.134 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root2.client.0", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root2+test@test.test", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root2.client.0", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "PSORYHBJMOFPPZUJHNLJ", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "oN5wM0IvazYlxQhqi6dC/dpydKxpXCdQgtrG7kMeoAIWUitiWJ+sGA==", 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-14T11:41:19.135 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:19.130402Z" 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:19.136 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-14T11:41:19.137 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-14T11:41:19.139 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-14T11:41:19.130372Z", 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:41:19.140 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.137+0000 7facaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.139+0000 7fadfcb1f800 20 remove_watcher() i=0 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.139+0000 7fadfcb1f800 2 removed watcher, disabling cache 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.140+0000 7fadfcb1f800 20 remove_watcher() i=1 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.141+0000 7fadfcb1f800 20 remove_watcher() i=2 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.142+0000 7fadfcb1f800 20 remove_watcher() i=3 2024-09-14T11:41:19.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.143+0000 7fadfcb1f800 20 remove_watcher() i=4 2024-09-14T11:41:19.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.144+0000 7fadfcb1f800 20 remove_watcher() i=5 2024-09-14T11:41:19.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.145+0000 7fadfcb1f800 20 remove_watcher() i=6 2024-09-14T11:41:19.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.146+0000 7fadfcb1f800 20 remove_watcher() i=7 2024-09-14T11:41:19.154 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 2311527506 --totp-seed 3PN7UATWIGAJYLYHX4XYHCFB5SQCEPORFGGOT24IJR7EWLLTOWLVGB2USAAISAP7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:41:19.220 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:19.220 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:19.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.255+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 realm 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.257+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.258+0000 7fbb24332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.258+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.258+0000 7fbb24332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:19.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.258+0000 7fbb24332800 20 searching for the correct realm 2024-09-14T11:41:19.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.261+0000 7fbb1f7bb640 0 -- 172.21.15.94:0/3004328415 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fbb1007a390 msgr2=0x7fbb10071b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.264+0000 7fbb1ffbc640 0 -- 172.21.15.94:0/3004328415 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7fbb14089bd0 msgr2=0x7fbb14065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.469+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:19.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 zone default found 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 4 Realm: () 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:19.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 zonegroup default 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.470+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 started sync module instance, tier type = 2024-09-14T11:41:19.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.471+0000 7fbb24332800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=0 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=1 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=2 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=3 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=4 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=5 2024-09-14T11:41:19.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=6 2024-09-14T11:41:19.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 20 add_watcher() i=7 2024-09-14T11:41:19.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.480+0000 7fbb24332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.482+0000 7fb9d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.482+0000 7fbb24332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.482+0000 7fbb24332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.482+0000 7fbb24332800 5 note: GC not initialized 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.482+0000 7fb9d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 20 Filter name: none 2024-09-14T11:41:19.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fb94e7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.483+0000 7fbb24332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:19.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.485+0000 7fbb24332800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:41:19.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.485+0000 7fbb24332800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.485+0000 7fbb24332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:41:19.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.486+0000 7fb9feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399042 cookie 94618494450288 notifier 8687 bl.length()=695 2024-09-14T11:41:19.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.486+0000 7fb9feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:41:19.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.486+0000 7fb9feffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:41:19.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.487+0000 7fb9d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:19.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.489+0000 7fbb24332800 20 remove_watcher() i=0 2024-09-14T11:41:19.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.489+0000 7fbb24332800 2 removed watcher, disabling cache 2024-09-14T11:41:19.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.490+0000 7fbb24332800 20 remove_watcher() i=1 2024-09-14T11:41:19.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.491+0000 7fbb24332800 20 remove_watcher() i=2 2024-09-14T11:41:19.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.492+0000 7fbb24332800 20 remove_watcher() i=3 2024-09-14T11:41:19.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.493+0000 7fbb24332800 20 remove_watcher() i=4 2024-09-14T11:41:19.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.494+0000 7fbb24332800 20 remove_watcher() i=5 2024-09-14T11:41:19.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.496+0000 7fbb24332800 20 remove_watcher() i=6 2024-09-14T11:41:19.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:41:19.497+0000 7fbb24332800 20 remove_watcher() i=7 2024-09-14T11:41:19.506 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:41:19.507 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:41:19.507 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:41:19.536 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:41:19.536 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:41:19.536 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:41:19.605 DEBUG:teuthology.orchestra.run.smithi094:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:41:19.786 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:41:19.965 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:41:20.227 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:43:10.404 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:43:11.796 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=bad43e5c4fd9482aae413c09232a9888b5c788b19368d7761a043ac8de940af0,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:43:11.796 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='1255538748' 2024-09-14T11:43:11.796 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:43:11.929 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-14T11:43:11.929 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:43:11.929 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:43:11.929 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:43:11.930 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-14T11:43:13.668 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:43:13.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:43:14.000 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:43:14.175 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:43:14.349 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:43:14.524 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:43:14.698 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:43:14.824 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:43:15.007 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:43:15.129 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:43:15.216 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:43:15.303 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:43:15.481 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:43:15.655 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:43:15.828 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:43:16.003 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:43:16.090 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:43:16.178 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:43:16.224 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.269 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.316 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.363 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.409 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.455 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:43:16.502 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.548 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.594 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.640 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.686 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.732 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.778 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:43:16.824 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:43:16.870 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:43:16.916 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:43:16.962 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:43:17.008 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:43:17.054 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:43:17.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:43:17.147 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:43:17.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.239 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.285 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.331 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.425 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.471 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:43:17.517 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.563 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.609 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.656 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.748 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.795 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.841 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:43:17.888 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:43:18.311 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:43:18.888 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:43:19.959 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:43:20.932 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:43:22.593 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:43:23.157 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:43:23.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:43:24.199 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:43:24.333 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:43:24.545 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:43:24.761 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:43:25.102 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:43:25.302 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:43:25.547 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:43:25.548 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:43:25.548 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:43:25.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:43:25.550 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:43:25.551 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:43:25.552 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:43:25.553 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:43:25.553 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.555 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.556 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:43:25.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.558 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.559 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:43:25.560 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:43:25.561 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:43:25.561 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:43:25.562 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:43:25.563 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:43:25.564 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:43:25.565 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:43:25.565 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:43:25.566 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:43:25.567 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:43:25.568 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:43:25.568 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:43:25.651 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:43:25.663 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:43:26.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:43:38.323 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:43:38.713 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:43:39.159 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:43:39.604 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:43:40.035 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:43:40.523 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:43:40.863 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:43:41.380 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:43:41.845 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:43:42.315 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:43:42.710 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:43:43.055 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:43:43.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:43:43.680 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:43:44.093 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:43:44.527 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:43:44.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:43:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:43:45.748 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:43:46.128 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:43:46.510 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:43:46.923 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:43:47.290 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:43:47.661 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:43:47.954 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:43:48.290 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:43:48.593 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:43:48.895 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:43:49.186 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:43:49.681 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:43:49.974 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:43:50.285 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:43:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:43:51.087 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:43:51.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:43:51.823 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:43:52.225 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:43:52.717 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:43:53.066 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:43:53.459 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:43:53.846 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:43:54.437 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:43:54.896 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:43:55.305 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:43:55.735 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:56.352 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:56.851 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:57.394 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:57.897 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:58.412 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:43:58.861 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:43:59.427 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:43:59.911 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:44:00.891 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:44:01.608 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:44:02.470 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:44:04.158 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:44:06.426 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:44:07.686 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:44:08.866 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:44:09.779 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:44:10.367 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:44:11.401 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:44:12.175 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:44:13.178 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:44:13.904 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:44:15.176 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:44:16.132 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:44:17.569 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:44:18.903 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:44:19.804 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:44:20.647 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:44:21.363 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:44:23.018 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:44:24.212 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:44:25.637 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:44:27.014 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:44:28.218 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:44:29.422 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:44:30.393 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:44:31.110 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:44:31.921 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:44:33.424 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:44:35.398 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:44:36.303 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:44:37.584 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:44:39.053 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:44:40.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:44:41.421 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:44:42.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:44:43.965 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:44:45.149 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:44:45.951 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:44:46.647 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:44:47.353 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:44:48.055 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:44:49.118 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:44:50.317 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:44:51.413 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:44:52.482 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:44:53.619 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:44:54.716 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:44:55.838 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:44:57.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:44:58.119 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:44:59.238 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:45:00.304 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:45:01.418 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:45:02.126 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:45:02.875 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:45:03.581 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:45:04.288 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:45:04.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:45:05.462 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:45:06.002 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:45:06.510 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:45:06.967 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:45:07.468 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:45:07.956 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:45:08.446 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:45:08.976 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:45:09.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:45:10.632 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:45:11.108 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:45:11.547 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:45:12.019 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:45:12.475 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:45:13.355 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:45:14.195 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:45:14.687 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:45:15.185 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:45:15.671 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:45:16.168 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:45:16.676 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:45:17.132 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:45:17.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:45:18.089 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:45:18.575 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:45:19.035 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:45:19.526 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:45:19.992 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:45:20.451 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:45:20.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:45:21.390 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:45:21.885 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:45:22.382 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:45:32.000 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:45:32.559 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:45:33.047 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:45:33.532 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:45:34.034 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:45:34.498 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:45:34.953 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:45:35.439 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:45:35.978 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:45:36.439 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:45:36.922 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:45:37.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:45:37.883 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:45:38.372 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:45:38.862 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:45:39.563 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:45:40.056 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:45:40.552 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:45:41.048 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:45:41.544 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:45:42.044 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:45:42.535 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:45:43.061 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:45:43.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:45:44.130 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:45:44.585 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:45:45.073 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:45:45.528 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:45:46.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:45:46.320 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:45:46.782 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:45:47.592 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:45:48.440 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:45:48.931 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:45:49.462 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:45:49.917 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:45:50.378 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:45:50.909 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:45:51.411 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:45:51.901 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:45:52.357 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:45:52.885 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:45:53.349 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:45:53.839 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:45:54.326 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:45:54.982 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:45:55.777 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:45:56.240 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:45:56.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:45:57.026 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:45:57.439 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:45:57.741 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:45:58.036 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:45:58.338 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:45:58.810 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:45:59.229 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:45:59.571 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:46:00.012 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:46:00.383 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:46:00.769 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:46:01.156 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:46:01.856 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:46:02.466 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:46:03.083 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:46:12.905 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:46:22.571 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:46:23.036 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:46:23.475 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:46:23.913 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:46:24.323 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:46:24.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:46:25.277 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:46:25.766 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:46:26.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:46:26.707 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:46:27.174 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:46:27.655 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:46:28.172 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:46:28.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:46:29.056 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:46:29.518 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:46:29.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:46:30.418 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:46:30.899 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:46:31.362 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:46:31.828 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:46:32.317 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:46:32.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:46:33.246 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:46:33.651 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:46:34.073 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:46:34.531 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:46:34.954 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:46:35.347 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:46:35.789 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:46:36.196 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:46:36.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:46:37.012 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:46:37.432 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:46:37.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:46:38.372 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:46:38.793 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:46:39.229 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:46:39.661 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:46:40.052 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:46:40.442 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:46:40.867 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:46:41.327 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:46:41.762 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:46:42.278 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:46:42.786 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:46:43.180 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:46:43.641 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:46:44.105 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:46:45.568 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:46:46.084 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:46:46.519 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:46:47.115 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:46:47.683 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:46:48.214 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:46:48.678 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:46:49.207 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:46:49.731 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:46:50.166 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:46:50.745 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:46:51.260 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:46:51.653 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:46:52.084 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:46:52.518 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:46:52.927 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:46:53.217 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:46:53.720 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:46:54.107 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:46:54.576 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:46:57.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:46:57.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:46:58.282 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:46:58.705 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:46:59.106 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:46:59.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:46:59.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:47:00.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:47:01.150 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:47:01.624 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:47:02.095 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:47:02.568 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:47:03.052 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:47:03.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:47:03.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:47:04.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:47:04.905 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:47:05.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:47:05.682 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:47:05.977 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:47:06.282 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:47:06.613 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:47:06.948 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:47:07.311 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:47:07.643 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:47:08.066 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:47:08.372 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:47:08.664 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:47:09.047 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:47:09.341 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:47:09.634 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:47:09.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:47:10.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:47:10.615 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:47:11.035 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:47:11.452 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:47:11.834 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:47:12.227 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:47:12.691 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:47:13.081 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:47:13.507 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:47:13.897 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:47:14.311 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:47:14.816 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:47:15.286 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:47:15.804 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:47:16.285 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:47:16.721 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:47:17.245 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:47:17.734 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:47:18.218 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:47:18.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:47:19.125 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:47:19.698 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:47:20.210 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:47:20.723 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:47:21.245 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:47:21.803 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:47:22.481 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:47:23.153 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:47:23.854 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:47:24.453 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:47:25.123 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:47:25.629 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:47:26.064 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:47:26.541 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:47:27.030 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:47:27.494 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:47:28.053 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:47:28.800 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:47:29.547 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:47:30.285 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:47:31.011 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:47:31.732 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:47:32.456 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:47:33.256 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:47:33.957 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:47:34.689 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:47:35.304 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:47:35.915 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:47:36.521 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:47:37.298 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:47:38.071 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:47:38.362 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:47:38.650 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:47:38.950 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:47:39.408 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:47:39.866 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:47:40.231 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:47:40.592 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:47:41.222 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:47:42.363 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:47:42.910 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:47:43.399 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:47:43.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:47:44.450 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:47:45.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:47:45.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:47:46.042 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:47:46.730 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:47:47.283 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:47:47.952 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:47:48.525 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:47:49.224 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:47:49.955 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:47:50.345 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:47:50.729 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:47:52.017 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:47:52.600 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:47:54.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:47:54.982 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:47:55.525 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:47:56.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:47:56.843 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:47:57.688 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:47:59.621 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:48:01.359 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:48:03.798 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:48:12.872 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:48:14.243 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:48:17.066 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:48:17.597 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:48:18.374 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:48:19.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:48:19.660 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:48:20.092 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:48:20.856 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:48:21.391 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:48:21.869 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:48:22.396 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:48:36.783 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:48:38.892 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:48:39.387 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:48:39.737 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:48:40.220 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:48:45.393 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:48:48.904 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:48:52.450 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:48:52.994 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:48:53.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:48:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:48:54.493 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:48:54.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:48:55.483 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:48:55.962 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:48:56.528 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:48:57.160 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:48:57.860 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:48:58.394 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:48:59.179 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:48:59.986 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:49:00.577 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:49:01.178 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:49:01.896 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:49:02.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:49:02.998 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:49:03.750 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:49:04.230 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:49:09.043 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:49:09.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:49:10.058 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:49:10.512 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:49:11.016 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:49:11.723 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:49:18.235 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:49:18.844 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:49:19.403 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:49:20.139 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:49:20.924 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:49:23.814 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:49:24.519 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:49:28.030 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:49:41.134 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:49:43.523 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:49:44.639 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:49:45.999 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:49:46.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:49:47.358 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:49:47.920 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:49:48.580 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:49:49.220 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:49:49.968 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:49:50.317 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:49:50.744 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:49:51.202 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:49:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:49:52.036 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:49:52.505 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:49:52.864 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:49:53.278 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:49:53.720 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:49:54.113 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:49:54.503 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:49:54.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:49:55.269 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:49:55.724 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:49:56.193 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:49:56.671 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:49:57.111 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:49:57.552 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:49:57.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:49:58.421 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:49:58.894 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:49:59.330 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:49:59.721 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:50:00.107 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:50:00.532 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:50:03.148 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:50:05.724 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:50:06.712 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:50:07.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:51:08.780 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:52:10.102 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:52:10.522 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:52:10.958 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:52:11.373 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:52:11.756 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:52:13.533 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:52:14.342 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:52:15.164 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:52:15.611 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:52:16.076 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:52:16.540 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:52:17.029 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:52:17.492 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:52:17.972 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:52:18.415 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:52:18.967 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:52:19.420 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:52:19.921 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:52:20.442 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:52:20.912 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:52:21.650 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:52:22.405 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:52:22.972 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:52:23.460 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:52:24.032 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:52:24.615 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:52:25.189 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:52:25.807 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:52:26.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:52:27.115 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:52:27.705 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:52:28.211 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:52:28.690 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:52:29.200 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:52:29.772 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:52:30.352 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:52:30.939 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:52:31.855 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:52:34.034 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:52:34.594 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:52:35.281 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:52:35.889 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:52:36.734 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:52:37.452 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:52:38.006 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:52:38.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:52:39.093 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:52:39.504 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:52:39.915 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:52:40.369 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:52:40.885 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:52:41.301 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:52:41.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:52:42.313 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:52:42.733 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:52:43.139 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:52:43.550 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:52:43.927 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:52:44.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:52:44.813 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:52:45.191 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:52:45.574 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:52:45.963 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:52:46.427 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:52:46.869 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:52:47.349 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:52:47.809 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:52:48.215 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:52:48.684 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:52:49.158 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:52:49.573 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:52:50.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:52:50.443 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:52:50.870 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:52:51.322 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:52:51.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:52:52.334 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:52:52.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:52:53.228 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:52:53.696 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:52:54.139 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:52:54.629 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:52:55.096 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:52:55.573 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:52:56.142 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:52:56.514 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:52:56.930 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:52:57.545 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:53:07.852 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:53:08.333 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:53:18.283 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:53:18.809 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:53:19.364 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:53:19.774 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:20.198 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:20.631 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:21.141 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:21.608 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:53:22.002 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:53:22.392 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:53:22.820 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:53:23.323 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:53:23.778 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:53:24.371 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:53:24.870 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:53:25.335 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:53:25.724 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:53:26.301 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:53:27.302 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:53:27.711 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:28.180 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:29.259 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:29.738 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:53:30.267 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:53:30.752 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:53:31.491 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:53:32.264 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:53:32.784 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:53:38.289 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:53:43.535 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:53:44.046 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:53:44.762 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:53:46.031 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:53:47.335 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:53:48.606 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:53:49.469 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:53:50.326 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:53:51.082 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:53:51.700 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:53:52.735 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:53:53.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:53:55.754 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:53:56.909 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:53:57.796 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:53:58.447 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:53:59.046 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:53:59.965 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:54:00.767 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:54:01.576 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:54:02.323 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:54:03.124 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:54:03.917 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:54:04.733 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:54:05.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:54:05.794 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:54:06.916 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:54:07.975 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:54:08.739 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:54:09.454 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:54:10.137 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:54:24.666 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:54:24.922 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:54:25.699 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:54:26.305 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:54:26.744 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:54:27.355 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:54:27.375 INFO:teuthology.orchestra.run.smithi094.stdout: if boto_type is 'S3Connection': 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: if k is 'BucketName': 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.376 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.timeout(10) 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.377 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.378 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:54:27.379 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:54:27.380 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi094.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout: warnings.warn( 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:54:27.381 INFO:teuthology.orchestra.run.smithi094.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 675.45s (0:11:15) = 2024-09-14T11:54:27.509 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:54:27.509 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-14T11:54:27.509 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-14T11:54:27.527 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:54:27.528 DEBUG:teuthology.orchestra.run.smithi094:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:54:27.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:27.646 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:54:27.646 DEBUG:teuthology.orchestra.run.smithi094:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:54:27.675 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:54:27.675 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:54:27.866 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:54:27.877 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:54:27.877 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:54:27.877 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:54:27.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:27.906 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:54:27.907 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:54:27.975 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:54:27.976 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:54:28.044 INFO:tasks.workunit:timeout=3h 2024-09-14T11:54:28.044 INFO:tasks.workunit:cleanup=True 2024-09-14T11:54:28.045 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:54:28.114 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:55:25.178 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-14T11:55:25.179 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:25.180 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:55:25.180 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:55:25.248 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:55:25.250 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:55:25.250 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:55:25.432 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:55:25.480 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:55:25.518 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:55:25.520 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:55:25.521 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:55:25.558 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:55:25.562 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-14T11:55:25.562 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:55:25.631 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:55:25.632 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:55:25.632 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:55:25.704 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:55:25.705 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:55:25.705 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:55:28.016 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:55:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:55:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:55:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-14T11:55:28.017 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:55:28.018 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-14T11:55:28.019 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-14T11:55:28.242 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:55:28.425 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-14T11:55:28.430 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:55:28.475 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-14T11:55:28.475 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-14T11:55:28.475 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:55:28.624 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:55:28.629 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:55:29.360 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-14T11:55:29.407 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-14T11:55:30.174 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-14T11:55:30.176 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:55:30.750 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:55:30.752 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:55:30.798 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:55:30.799 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:55:30.845 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:55:30.846 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:55:30.904 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:55:30.906 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:55:30.981 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:55:30.982 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:55:31.169 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:55:31.170 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:55:31.174 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:55:31.176 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:55:31.185 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:55:31.186 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:55:31.188 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:55:31.189 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:55:31.190 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:55:31.263 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:55:32.332 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:55:32.451 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:55:32.572 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:55:32.606 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:32.606 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:32.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.644+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 realm 2024-09-14T11:55:32.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:32.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.646+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.648+0000 7f72e2f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:32.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.648+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.648+0000 7f72e2f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:32.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.648+0000 7f72e2f2e800 20 searching for the correct realm 2024-09-14T11:55:32.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.855+0000 7f72d6363640 0 -- 172.21.15.94:0/2870419826 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f72d0085060 msgr2=0x7f72d00ab320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:32.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.860+0000 7f72df365640 0 -- 172.21.15.94:0/2870419826 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f72c8098bb0 msgr2=0x7f72c806a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:32.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.864+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:55:32.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.864+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.864+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.864+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.864+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:32.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.865+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 zone default found 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 4 Realm: () 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 zonegroup default 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.866+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.867+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.867+0000 7f72e2f2e800 20 started sync module instance, tier type = 2024-09-14T11:55:32.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.867+0000 7f72e2f2e800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:55:32.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=0 2024-09-14T11:55:32.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=1 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=2 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=3 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=4 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=5 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.881+0000 7f72e2f2e800 20 add_watcher() i=6 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.882+0000 7f72e2f2e800 20 add_watcher() i=7 2024-09-14T11:55:32.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.882+0000 7f72e2f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:32.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.884+0000 7f7195fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:32.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:32.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:32.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 5 note: GC not initialized 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f7194fe1640 20 reqs_thread_entry: start 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 20 Filter name: none 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f718dffb640 20 reqs_thread_entry: start 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.885+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:55:32.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.886+0000 7f72e2f2e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f72e2f2e800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f72e2f2e800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f72e2f2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:55:32.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f71c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399966 cookie 94332008399280 notifier 9279 bl.length()=613 2024-09-14T11:55:32.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f71c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:55:32.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.887+0000 7f71c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f72e2f2e800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f72e2f2e800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f72e2f2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f71c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399449 cookie 94332008384880 notifier 9279 bl.length()=191 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f71c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:55:32.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.889+0000 7f71c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:55:32.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.890+0000 7f7195fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:32.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.893+0000 7f72e2f2e800 20 remove_watcher() i=0 2024-09-14T11:55:32.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.893+0000 7f72e2f2e800 2 removed watcher, disabling cache 2024-09-14T11:55:32.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.894+0000 7f72e2f2e800 20 remove_watcher() i=1 2024-09-14T11:55:32.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.895+0000 7f72e2f2e800 20 remove_watcher() i=2 2024-09-14T11:55:32.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.897+0000 7f72e2f2e800 20 remove_watcher() i=3 2024-09-14T11:55:32.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.898+0000 7f72e2f2e800 20 remove_watcher() i=4 2024-09-14T11:55:32.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.899+0000 7f72e2f2e800 20 remove_watcher() i=5 2024-09-14T11:55:32.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.899+0000 7f72e2f2e800 20 remove_watcher() i=6 2024-09-14T11:55:32.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:32.900+0000 7f72e2f2e800 20 remove_watcher() i=7 2024-09-14T11:55:33.036 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.036 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.082 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.083 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.128 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.128 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.142 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.142 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.145 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:55:33.146 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:33.148 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.148 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.158 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.158 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.165 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:33.165 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:33.177 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:55:33.205 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:33.205 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:33.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.243+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 realm 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.245+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.246+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:33.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.246+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.246+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:33.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.246+0000 7fcd6f33b800 20 searching for the correct realm 2024-09-14T11:55:33.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.250+0000 7fcd62824640 0 -- 172.21.15.94:0/3951228461 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x5577862155d0 msgr2=0x557786217a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:33.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.254+0000 7fcd62824640 0 -- 172.21.15.94:0/3951228461 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7fcd5c0dd440 msgr2=0x7fcd5c0b28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:33.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 zone default found 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 4 Realm: () 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 zonegroup default 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.258+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:33.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 started sync module instance, tier type = 2024-09-14T11:55:33.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.259+0000 7fcd6f33b800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=0 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=1 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=2 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=3 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=4 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=5 2024-09-14T11:55:33.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.268+0000 7fcd6f33b800 20 add_watcher() i=6 2024-09-14T11:55:33.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.269+0000 7fcd6f33b800 20 add_watcher() i=7 2024-09-14T11:55:33.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.269+0000 7fcd6f33b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:33.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcc21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:33.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcd6f33b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:33.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcd6f33b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:33.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcd6f33b800 5 note: GC not initialized 2024-09-14T11:55:33.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcc20fe1640 20 reqs_thread_entry: start 2024-09-14T11:55:33.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcd6f33b800 20 init_complete bucket index max shards: 11 2024-09-14T11:55:33.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.271+0000 7fcd6f33b800 20 Filter name: none 2024-09-14T11:55:33.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcb9a7fc640 20 reqs_thread_entry: start 2024-09-14T11:55:33.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 rados->read ofs=0 len=0 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 INFO: main: starting shard=0 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.272+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.0 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 INFO: main: starting shard=1 2024-09-14T11:55:33.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.1 2024-09-14T11:55:33.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 INFO: main: starting shard=2 2024-09-14T11:55:33.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.273+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.2 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 INFO: main: starting shard=3 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.3 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 INFO: main: starting shard=4 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.274+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.4 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 INFO: main: starting shard=5 2024-09-14T11:55:33.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.5 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 INFO: main: starting shard=6 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.275+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.6 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 INFO: main: starting shard=7 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.7 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 INFO: main: starting shard=8 2024-09-14T11:55:33.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.276+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.8 2024-09-14T11:55:33.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 INFO: main: starting shard=9 2024-09-14T11:55:33.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.9 2024-09-14T11:55:33.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 INFO: main: starting shard=10 2024-09-14T11:55:33.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.277+0000 7fcd6f33b800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.10 2024-09-14T11:55:33.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.278+0000 7fcd6f33b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:33.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.278+0000 7fcd6f33b800 20 INFO: main: done 2024-09-14T11:55:33.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.278+0000 7fcc21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:33.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.280+0000 7fcd6f33b800 20 remove_watcher() i=0 2024-09-14T11:55:33.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.280+0000 7fcd6f33b800 2 removed watcher, disabling cache 2024-09-14T11:55:33.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.281+0000 7fcd6f33b800 20 remove_watcher() i=1 2024-09-14T11:55:33.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.282+0000 7fcd6f33b800 20 remove_watcher() i=2 2024-09-14T11:55:33.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.283+0000 7fcd6f33b800 20 remove_watcher() i=3 2024-09-14T11:55:33.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.284+0000 7fcd6f33b800 20 remove_watcher() i=4 2024-09-14T11:55:33.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.285+0000 7fcd6f33b800 20 remove_watcher() i=5 2024-09-14T11:55:33.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.286+0000 7fcd6f33b800 20 remove_watcher() i=6 2024-09-14T11:55:33.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.287+0000 7fcd6f33b800 20 remove_watcher() i=7 2024-09-14T11:55:33.297 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep 1a4aa307-46ec-4ff1-b190-4082820a02be 2024-09-14T11:55:33.320 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:33.320 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:33.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:33.397+0000 7fbe056b9640 0 -- 172.21.15.94:0/3634287962 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55d076174060 msgr2=0x55d076176450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:33.407 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:55:33.407 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:33.409 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:55:34.803 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:34.803 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:34.813 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:55:35.208 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:55:35.237 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:35.237 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:35.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.274+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.275+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.275+0000 7ff34ce87800 20 realm 2024-09-14T11:55:35.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.275+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.276+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.276+0000 7ff34ce87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:35.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.276+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.276+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.276+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.277+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:35.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.277+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.277+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:35.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.277+0000 7ff34ce87800 20 searching for the correct realm 2024-09-14T11:55:35.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.280+0000 7ff342177640 0 -- 172.21.15.94:0/1940134216 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7ff33c0bb020 msgr2=0x7ff33c0bfa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:35.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.284+0000 7ff34a978640 0 -- 172.21.15.94:0/1940134216 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7ff33401a040 msgr2=0x7ff3340a01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:35.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.489+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 zone default found 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 4 Realm: () 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:55:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:35.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 zonegroup default 2024-09-14T11:55:35.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.490+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 started sync module instance, tier type = 2024-09-14T11:55:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.491+0000 7ff34ce87800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:55:35.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=0 2024-09-14T11:55:35.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=1 2024-09-14T11:55:35.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=2 2024-09-14T11:55:35.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=3 2024-09-14T11:55:35.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=4 2024-09-14T11:55:35.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=5 2024-09-14T11:55:35.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.500+0000 7ff34ce87800 20 add_watcher() i=6 2024-09-14T11:55:35.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.501+0000 7ff34ce87800 20 add_watcher() i=7 2024-09-14T11:55:35.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.501+0000 7ff34ce87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.503+0000 7ff2017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.503+0000 7ff34ce87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.503+0000 7ff34ce87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.503+0000 7ff34ce87800 5 note: GC not initialized 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.503+0000 7ff17bfff640 20 reqs_thread_entry: start 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 init_complete bucket index max shards: 11 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 Filter name: none 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff179ffb640 20 reqs_thread_entry: start 2024-09-14T11:55:35.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 rados->read ofs=0 len=0 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.504+0000 7ff34ce87800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: starting shard=0 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.0 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: starting shard=1 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.1 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 INFO: main: starting shard=2 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.505+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.2 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 INFO: main: starting shard=3 2024-09-14T11:55:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.3 2024-09-14T11:55:35.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 INFO: main: starting shard=4 2024-09-14T11:55:35.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.506+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.4 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 INFO: main: starting shard=5 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.5 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 INFO: main: starting shard=6 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.507+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.6 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 INFO: main: starting shard=7 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.7 2024-09-14T11:55:35.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 INFO: main: starting shard=8 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.508+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.8 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.509+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.509+0000 7ff34ce87800 20 INFO: main: starting shard=9 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.509+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.9 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.510+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.510+0000 7ff34ce87800 20 INFO: main: starting shard=10 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.510+0000 7ff34ce87800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.10 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.510+0000 7ff34ce87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:55:35.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.510+0000 7ff34ce87800 20 INFO: main: done 2024-09-14T11:55:35.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.511+0000 7ff2017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:35.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.513+0000 7ff34ce87800 20 remove_watcher() i=0 2024-09-14T11:55:35.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.513+0000 7ff34ce87800 2 removed watcher, disabling cache 2024-09-14T11:55:35.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.514+0000 7ff34ce87800 20 remove_watcher() i=1 2024-09-14T11:55:35.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.516+0000 7ff34ce87800 20 remove_watcher() i=2 2024-09-14T11:55:35.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.517+0000 7ff34ce87800 20 remove_watcher() i=3 2024-09-14T11:55:35.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.518+0000 7ff34ce87800 20 remove_watcher() i=4 2024-09-14T11:55:35.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.519+0000 7ff34ce87800 20 remove_watcher() i=5 2024-09-14T11:55:35.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.520+0000 7ff34ce87800 20 remove_watcher() i=6 2024-09-14T11:55:35.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.521+0000 7ff34ce87800 20 remove_watcher() i=7 2024-09-14T11:55:35.531 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep 82031437-0f29-49d6-8ce7-ec69e8a08878 2024-09-14T11:55:35.553 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:35.553 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:35.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:35.631+0000 7f13b27d2640 0 -- 172.21.15.94:0/1970340985 >> [v2:172.21.15.94:6816/3920654385,v1:172.21.15.94:6817/3920654385] conn(0x7f13a8021330 msgr2=0x7f13a8021730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:35.645 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:55:35.646 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:35.648 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:35.648 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:35.654 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:35.654 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:35.662 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:35.663 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:35.667 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:55:37.056 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.056 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.112 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:55:37.114 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:55:37.510 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.510 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.518 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.518 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.561 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:55:37.561 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-14T11:55:37.562 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.562 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.607 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.608 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.652 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:37.652 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:37.661 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:55:39.056 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:39.056 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:39.060 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:39.060 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:41.077 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:55:41.475 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:55:41.504 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:41.505 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:41.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.543+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 realm 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.545+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.546+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:41.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.546+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.546+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:41.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.546+0000 7f748fd46800 20 searching for the correct realm 2024-09-14T11:55:41.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.550+0000 7f7485036640 0 -- 172.21.15.94:0/1482322648 >> [v2:172.21.15.131:6816/3011823175,v1:172.21.15.131:6817/3011823175] conn(0x7f748004b070 msgr2=0x7f748006f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:41.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.554+0000 7f748e038640 0 -- 172.21.15.94:0/1482322648 >> [v2:172.21.15.131:6808/340730180,v1:172.21.15.131:6809/340730180] conn(0x7f74780db2f0 msgr2=0x7f74780ad890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:41.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:55:41.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:55:41.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:41.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:41.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.557+0000 7f748fd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 zone default found 2024-09-14T11:55:41.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 4 Realm: () 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 zonegroup default 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.558+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:41.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 started sync module instance, tier type = 2024-09-14T11:55:41.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.559+0000 7f748fd46800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:55:41.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=0 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=1 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=2 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=3 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=4 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=5 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.568+0000 7f748fd46800 20 add_watcher() i=6 2024-09-14T11:55:41.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.569+0000 7f748fd46800 20 add_watcher() i=7 2024-09-14T11:55:41.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.569+0000 7f748fd46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:41.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f733f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:41.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f748fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f748fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f748fd46800 5 note: GC not initialized 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f733e7fc640 20 reqs_thread_entry: start 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f748fd46800 20 init_complete bucket index max shards: 11 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f748fd46800 20 Filter name: none 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.571+0000 7f72affff640 20 reqs_thread_entry: start 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:55:41.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783 : miss 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 20 rados->read ofs=0 len=0 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783 info.flags=0x17 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783 to cache LRU end 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783 2024-09-14T11:55:41.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.572+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.0 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.573+0000 7f748fd46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.573+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.1 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.573+0000 7f748fd46800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.573+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.2 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.574+0000 7f748fd46800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.574+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.3 2024-09-14T11:55:41.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.574+0000 7f748fd46800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.574+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.4 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.575+0000 7f748fd46800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.575+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.5 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.575+0000 7f748fd46800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.575+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.6 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.576+0000 7f748fd46800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:55:41.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.576+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.7 2024-09-14T11:55:41.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.576+0000 7f748fd46800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.576+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.8 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.577+0000 7f748fd46800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.577+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.9 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.578+0000 7f748fd46800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.578+0000 7f748fd46800 20 bucket index object: :.dir.3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783.10 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.578+0000 7f748fd46800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.578+0000 7f748fd46800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:55:41.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.579+0000 7f733f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.581+0000 7f748fd46800 20 remove_watcher() i=0 2024-09-14T11:55:41.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.581+0000 7f748fd46800 2 removed watcher, disabling cache 2024-09-14T11:55:41.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.582+0000 7f748fd46800 20 remove_watcher() i=1 2024-09-14T11:55:41.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.583+0000 7f748fd46800 20 remove_watcher() i=2 2024-09-14T11:55:41.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.584+0000 7f748fd46800 20 remove_watcher() i=3 2024-09-14T11:55:41.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.585+0000 7f748fd46800 20 remove_watcher() i=4 2024-09-14T11:55:41.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.586+0000 7f748fd46800 20 remove_watcher() i=5 2024-09-14T11:55:41.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.587+0000 7f748fd46800 20 remove_watcher() i=6 2024-09-14T11:55:41.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-14T11:55:41.588+0000 7f748fd46800 20 remove_watcher() i=7 2024-09-14T11:55:41.596 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket versioning-bucket 2024-09-14T11:55:41.598 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:41.598 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:41.603 INFO:tasks.workunit.client.0.smithi094.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:55:41.603 INFO:tasks.workunit.client.0.smithi094.stderr: warnings.warn( 2024-09-14T11:55:41.631 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket versioning tests 2024-09-14T11:55:41.631 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:55:41.631 INFO:tasks.workunit.client.0.smithi094.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:55:41.631 INFO:tasks.workunit.client.0.smithi094.stdout:connected to https://localhost:443 2024-09-14T11:55:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-14T11:55:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:55:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:55:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-14T11:55:41.691 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-14T11:55:41.692 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-14T11:55:41.693 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-14T11:55:41.694 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:55:41.694 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:55:41.774 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:55:41.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:55:42.144 DEBUG:teuthology.parallel:result is None 2024-09-14T11:55:42.145 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:55:42.183 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:55:42.184 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:55:42.252 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:55:42.252 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:55:42.263 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:55:42.311 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:55:42.311 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:55:42.311 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:55:42.375 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:55:42.376 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:55:42.433 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:55:42.433 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:55:42.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.469+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 realm 2024-09-14T11:55:42.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:55:42.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.471+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.472+0000 7ffb6f121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:42.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.472+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.472+0000 7ffb6f121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:55:42.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.472+0000 7ffb6f121800 20 searching for the correct realm 2024-09-14T11:55:42.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.474+0000 7ffb6ae44640 0 -- 172.21.15.94:0/4237554621 >> [v2:172.21.15.94:6800/3451614010,v1:172.21.15.94:6801/3451614010] conn(0x55866c86fa80 msgr2=0x7ffb6402f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:42.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.680+0000 7ffb6b645640 0 -- 172.21.15.94:0/4237554621 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7ffb6008b410 msgr2=0x7ffb6008b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.685+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 zone default found 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 4 Realm: () 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 zonegroup default 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.686+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:55:42.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 started sync module instance, tier type = 2024-09-14T11:55:42.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.687+0000 7ffb6f121800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:55:42.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=0 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=1 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=2 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=3 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=4 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=5 2024-09-14T11:55:42.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=6 2024-09-14T11:55:42.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 20 add_watcher() i=7 2024-09-14T11:55:42.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.697+0000 7ffb6f121800 2 all 8 watchers are set, enabling cache 2024-09-14T11:55:42.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.700+0000 7ffa217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:42.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.700+0000 7ffb6f121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:55:42.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.700+0000 7ffb6f121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:55:42.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ff99bfff640 20 reqs_thread_entry: start 2024-09-14T11:55:42.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ffb6f121800 20 init_complete bucket index max shards: 11 2024-09-14T11:55:42.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ffb6f121800 20 Filter name: none 2024-09-14T11:55:42.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ff999ffb640 20 reqs_thread_entry: start 2024-09-14T11:55:42.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ffb6f121800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:55:42.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.736+0000 7ffb6f121800 20 rados->read ofs=0 len=0 2024-09-14T11:55:42.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.737+0000 7ffb6f121800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:55:42.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.737+0000 7ffb6f121800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:55:42.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.737+0000 7ffb6f121800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:55:42.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.737+0000 7ffb6f121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:55:42.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.737+0000 7ffb6f121800 10 removing key index: QUATNZLEYELSNFBDPUZI 2024-09-14T11:55:42.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.739+0000 7ffb6f121800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:QUATNZLEYELSNFBDPUZI, ofs0, ns] 2024-09-14T11:55:42.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.739+0000 7ffa4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399163 cookie 94035836166544 notifier 9408 bl.length()=170 2024-09-14T11:55:42.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.739+0000 7ffb6f121800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:55:42.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.740+0000 7ffb6f121800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:55:42.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.740+0000 7ffa4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399251 cookie 94035836176000 notifier 9408 bl.length()=181 2024-09-14T11:55:42.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.741+0000 7ffb6f121800 10 removing user buckets index 2024-09-14T11:55:42.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.742+0000 7ffb6f121800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:55:42.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.742+0000 7ffa4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399967 cookie 94035836190912 notifier 9408 bl.length()=172 2024-09-14T11:55:42.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.743+0000 7ffb6f121800 10 removing user index: tester.client.0 2024-09-14T11:55:42.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.744+0000 7ffb6f121800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:55:42.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.744+0000 7ffb6f121800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:55:42.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.744+0000 7ffa4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399452 cookie 94035836186000 notifier 9408 bl.length()=164 2024-09-14T11:55:42.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.745+0000 7ffa217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:55:42.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.747+0000 7ffb6f121800 20 remove_watcher() i=0 2024-09-14T11:55:42.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.747+0000 7ffb6f121800 2 removed watcher, disabling cache 2024-09-14T11:55:42.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.748+0000 7ffb6f121800 20 remove_watcher() i=1 2024-09-14T11:55:42.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.749+0000 7ffb6f121800 20 remove_watcher() i=2 2024-09-14T11:55:42.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.750+0000 7ffb6f121800 20 remove_watcher() i=3 2024-09-14T11:55:42.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.751+0000 7ffb6f121800 20 remove_watcher() i=4 2024-09-14T11:55:42.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.752+0000 7ffb6f121800 20 remove_watcher() i=5 2024-09-14T11:55:42.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.753+0000 7ffb6f121800 20 remove_watcher() i=6 2024-09-14T11:55:42.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:55:42.754+0000 7ffb6f121800 20 remove_watcher() i=7 2024-09-14T11:55:42.763 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:55:42.772 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:55:42.810 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:55:42.866 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:55:42.876 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:55:42.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:42.877 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-14T11:55:42.879+0000 7f7fa2a96640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44930) UID: 0 2024-09-14T11:55:42.877 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-14T11:55:42.879+0000 7f7fa62f1880 -1 shutting down 2024-09-14T11:56:13.385 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:56:13.385 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:56:13.420 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:56:13.503 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:56:13.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:56:13.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:56:13.586 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:56:13.685 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:56:13.685 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:56:13.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.721+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 20 realm 2024-09-14T11:56:13.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:56:13.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.722+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.723+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.723+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.724+0000 7f175db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:56:13.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.724+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.724+0000 7f175db25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:56:13.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.724+0000 7f175db25800 20 searching for the correct realm 2024-09-14T11:56:13.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.727+0000 7f1759f34640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.94:6824/3025939706,v1:172.21.15.94:6825/3025939706] conn(0x555eb783f730 msgr2=0x555eb7841bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:56:13.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.731+0000 7f1759733640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f174403c3c0 msgr2=0x7f174403c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:56:13.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got zonegroup_info.3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0 2024-09-14T11:56:13.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got zone_info.3aea5d71-db92-43f3-82b7-23225f4a0092 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.735+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:56:13.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:56:13.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 zone default found 2024-09-14T11:56:13.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 4 Realm: () 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 4 ZoneGroup: default (3e2cb980-1e3f-41a9-95ba-4eaf23dd62c0) 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 4 Zone: default (3aea5d71-db92-43f3-82b7-23225f4a0092) 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.736+0000 7f175db25800 20 zonegroup default 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados->read ofs=0 len=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 started sync module instance, tier type = 2024-09-14T11:56:13.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.737+0000 7f175db25800 20 started zone id=3aea5d71-db92-43f3-82b7-23225f4a0092 (name=default) with tier type = 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=0 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=1 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=2 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=3 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=4 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=5 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=6 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 20 add_watcher() i=7 2024-09-14T11:56:13.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.747+0000 7f175db25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:56:13.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.749+0000 7f160ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:56:13.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.749+0000 7f175db25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:56:13.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.749+0000 7f175db25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:56:13.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.787+0000 7f160efe5640 20 reqs_thread_entry: start 2024-09-14T11:56:13.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.787+0000 7f175db25800 20 init_complete bucket index max shards: 11 2024-09-14T11:56:13.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.787+0000 7f175db25800 20 Filter name: none 2024-09-14T11:56:13.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.787+0000 7f160cfe1640 20 reqs_thread_entry: start 2024-09-14T11:56:13.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.787+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:56:13.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.789+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:13.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.790+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42187' 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_iCZljjEfhb3OP7AmXXT4AcYMzUI-OVg', time=2024-09-14T13:43:20.901112+0000, chain.objs.size()=2 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.YUSQD32xhRH7Zm5mlUL1jBV2xk6k0HN_0 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.YUSQD32xhRH7Zm5mlUL1jBV2xk6k0HN_1 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8185246036023494280', time=2024-09-14T13:43:24.171516+0000, chain.objs.size()=1 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.167__shadow_.3DKGrrh7idTG8AgH9TW7G-hN-JnDOsR_0 2024-09-14T11:56:13.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17572540136861652110', time=2024-09-14T13:45:05.080899+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.229__shadow_.S0qpQkDe8OcOSRE6_zHort94VzpTySQ_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8104623848156874202', time=2024-09-14T13:45:07.705125+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.235__shadow_.Yte20L_DI12boblNRZT-71yZYeokRpc_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15379544240232880399', time=2024-09-14T13:45:10.377492+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239__shadow_.ixcKuTvzGKITVSmuRdAVj-zBl2vjyB-_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15526732692920266105', time=2024-09-14T13:45:10.379153+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239__shadow_.Ge31LdG2EIlPJ7gqvBnmU6VpwsSuDZu_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11262545231268945000', time=2024-09-14T13:45:16.883078+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.251__shadow_.iGLL8zfyYoDtGxyrjYcq1vzw7zv2tz1_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11724205393173668597', time=2024-09-14T13:45:16.885011+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.251__shadow_.w0WLmfaXWjEPhIdbwmtEmOJbpQk96XC_0 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.721813411275639782', time=2024-09-14T13:45:22.122486+0000, chain.objs.size()=1 2024-09-14T11:56:13.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.262__shadow_.G5Vc2p1K1XDnMiTd_r7jIZLxQjlHLHs_0 2024-09-14T11:56:13.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3937438588980929522', time=2024-09-14T13:45:30.270431+0000, chain.objs.size()=1 2024-09-14T11:56:13.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fVJee1DtHkX7uU69P9jjHoX9tLypFpO_0 2024-09-14T11:56:13.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12954291754337009443', time=2024-09-14T13:45:30.289729+0000, chain.objs.size()=1 2024-09-14T11:56:13.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TKJa9KS4tonL28XXQp-AIGKDKoQRmmV_0 2024-09-14T11:56:13.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10053023761797382751', time=2024-09-14T13:45:30.299779+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.smrQZwZpJu_bq6woTmYEd0fbfSh-YYE_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13440776858269891152', time=2024-09-14T13:45:30.310851+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qI1qQzTS3P-OWg2U5Eab2Vw6NGPaYKC_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14381242089104476940', time=2024-09-14T13:45:30.418870+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YFx8TBPrVeDIxFqMvOxrQEOmOHVsJr6_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15370145049512116330', time=2024-09-14T13:45:30.425630+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8r10HEyYk6xksSlFyzciaREk2yMCS1W_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8536347853744945945', time=2024-09-14T13:45:30.435875+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yVS3J7WzxoTmzPLfD5eMGSpfAfC1Iex_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10009300321856560835', time=2024-09-14T13:45:30.464856+0000, chain.objs.size()=1 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OHCNvTHhm6XQ6pm_FGVy-v4iNpVmJkh_0 2024-09-14T11:56:13.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6850261815451273572', time=2024-09-14T13:45:30.471414+0000, chain.objs.size()=1 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.z7lXbOJxDYF-4MxqxD8z-s5sN1sbN24_0 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6032132441912565292', time=2024-09-14T13:45:30.488068+0000, chain.objs.size()=1 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.xQsjgNeBn-hQBSY4gzmIRPPbkwtgpv__0 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8976370185486478149', time=2024-09-14T13:45:30.507264+0000, chain.objs.size()=1 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LXcZMD5W7JJc_-I9r2GMLbc_lEY_7e__0 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4528895538008314655', time=2024-09-14T13:45:30.589091+0000, chain.objs.size()=1 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.r05xVsX8383oLrhwxuwfDc1GsIaVArk_0 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13056684539434810380', time=2024-09-14T13:45:30.608750+0000, chain.objs.size()=1 2024-09-14T11:56:13.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vvstSIHJMoRR89KUulSnwUPU4bgc-xz_0 2024-09-14T11:56:13.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.799+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6989788312941936760', time=2024-09-14T13:45:30.636526+0000, chain.objs.size()=1 2024-09-14T11:56:13.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.799+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.O3l4ET_BFMvql_8Lnv3kFg3eQYOTr4n_0 2024-09-14T11:56:13.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11801731166709420346', time=2024-09-14T13:45:30.678761+0000, chain.objs.size()=1 2024-09-14T11:56:13.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.by0ZjFI5a4nznu1L5Nvki5v7R8K5Nrf_0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9943201653784465039', time=2024-09-14T13:45:30.779999+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QmckZNCuTbACKPuKVY2hxwzE9mRYFPe_0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14782937681756419143', time=2024-09-14T13:45:30.791109+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5bibVujne-pHGt7rnbPPqPDk0GPWyB__0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17223011008884549036', time=2024-09-14T13:45:30.875206+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VLLHZ1RUm0Obs_y0LT4yT0GsH91Vd3g_0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17918491926371405705', time=2024-09-14T13:45:30.977051+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9AASMkVr2DIWzM3RSl2f52zZVyt0gYW_0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12345759919684256235', time=2024-09-14T13:45:31.030528+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.i4SaD1VzZM99JCjj1I47Jfx-DC6D5pa_0 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12328703423105267199', time=2024-09-14T13:45:31.031211+0000, chain.objs.size()=1 2024-09-14T11:56:13.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EKxhXowAP9OPfiJnUE49wdt_eA9Ji_5_0 2024-09-14T11:56:13.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4285422530251985576', time=2024-09-14T13:45:31.145177+0000, chain.objs.size()=1 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jjOgkGNbw05wiYcaHXe12yhoJanw7yV_0 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15252206940281681504', time=2024-09-14T13:45:31.187832+0000, chain.objs.size()=1 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QlE3N-_0MatuQnJIwe6JtbMT83bxgG-_0 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2040718668885142466', time=2024-09-14T13:45:31.200476+0000, chain.objs.size()=1 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7KkqOPYOWB2k9AZJUqY_3GmWsr3SpuF_0 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6860355855713661645', time=2024-09-14T13:45:31.537179+0000, chain.objs.size()=1 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Bxah0dxPYaQUPEcM3HxZhg9FJtUYhVY_0 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3826035506166915545', time=2024-09-14T13:45:31.548594+0000, chain.objs.size()=1 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.smxJHJOFkRaZEkJGbEpRW9BKyGA1u8u_0 2024-09-14T11:56:13.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10282819448690237633', time=2024-09-14T13:45:31.562754+0000, chain.objs.size()=1 2024-09-14T11:56:13.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hK51dTSap1Gmc1PRkYgSYt6J7Uitx6l_0 2024-09-14T11:56:13.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2245595836417566149', time=2024-09-14T13:45:31.573781+0000, chain.objs.size()=1 2024-09-14T11:56:13.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.803+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Vp7PjaIAi9IRkIK2SEqKw8tfLtmPRP2_0 2024-09-14T11:56:13.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13666205903641348252', time=2024-09-14T13:45:31.577539+0000, chain.objs.size()=1 2024-09-14T11:56:13.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EOS7EgBMnr71fcXVDVHY0vdVN_nnStn_0 2024-09-14T11:56:13.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.807+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5477326646893733333', time=2024-09-14T13:45:31.589118+0000, chain.objs.size()=1 2024-09-14T11:56:13.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.807+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.543nCNij0F4VgZ2HWhiTH6jcDNaR4h__0 2024-09-14T11:56:13.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7754826767958231700', time=2024-09-14T13:45:31.682531+0000, chain.objs.size()=1 2024-09-14T11:56:13.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.43YCFjLCqgY8qH21URBJTAYM6h7FyBu_0 2024-09-14T11:56:13.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11609289929486024291', time=2024-09-14T13:45:31.696079+0000, chain.objs.size()=1 2024-09-14T11:56:13.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vKVaGlEFlsYZPizyal8o6zF0b4ywI87_0 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10373900955908815625', time=2024-09-14T13:45:31.729253+0000, chain.objs.size()=1 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.xKofS6RaSN751hTxlgUv0x1wkwKVxxW_0 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11172850682923020182', time=2024-09-14T13:45:31.771434+0000, chain.objs.size()=1 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.809+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CdGzRJOMlx-LGkgGEXqKWGxmHHzAIZV_0 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.809+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2380704672071102793', time=2024-09-14T13:45:34.234581+0000, chain.objs.size()=1 2024-09-14T11:56:13.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.809+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.268__shadow_.Dd8EPsFzhsfImCSWEyNQQpfYr4LdTd7_0 2024-09-14T11:56:13.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.809+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15976016418868495180', time=2024-09-14T13:45:34.697992+0000, chain.objs.size()=1 2024-09-14T11:56:13.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.809+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.269__shadow_.DXi1kNQHoZ5rKIr1Stxy0iYDIuJWl_8_0 2024-09-14T11:56:13.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.811+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12197844804383552589', time=2024-09-14T13:45:35.184086+0000, chain.objs.size()=1 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.811+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.270__shadow_.flI_FQ_o4q01RrdLaZsksHJCnuKFFdP_0 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.811+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4899160588908290959', time=2024-09-14T13:45:45.276367+0000, chain.objs.size()=1 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.811+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.290__shadow_.hhgte-OiGzzzguI4JvSuZAidFtnnVeM_0 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9143144812976621837', time=2024-09-14T13:45:45.733322+0000, chain.objs.size()=1 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.291__shadow_.3xiFmeJZXNiQXBhFaie6kNPF3k5Ukml_0 2024-09-14T11:56:13.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12271681754113454623', time=2024-09-14T13:45:47.347748+0000, chain.objs.size()=1 2024-09-14T11:56:13.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.NPafsPDcw7kAQJ4EbdjXzWNRIPoLnEl_0 2024-09-14T11:56:13.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9966976893296145427', time=2024-09-14T13:45:47.357917+0000, chain.objs.size()=1 2024-09-14T11:56:13.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.DquoFjHbd3y0WnaVhccjpH5sZ3Qq9Wr_0 2024-09-14T11:56:13.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7980510816123513444', time=2024-09-14T13:45:47.360197+0000, chain.objs.size()=1 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.ftP0IHwixpIRhAItp-f8zzWHFfxUoLk_0 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11644770463817559511', time=2024-09-14T13:45:48.187268+0000, chain.objs.size()=1 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.4yOJXY12WlNGvFQ6N2mtV_dzY3sC5bv_0 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3120085989978626743', time=2024-09-14T13:45:51.648930+0000, chain.objs.size()=1 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.301__shadow_.Z_HGm_d72DshJfx2PojBV_q-bN-pA9K_0 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8954054904830366570', time=2024-09-14T13:46:10.954536+0000, chain.objs.size()=1 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6y0r-7M4zF4aVAXw3_cl2NtqdWopQKE_0 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8604723520842492995', time=2024-09-14T13:46:10.989936+0000, chain.objs.size()=1 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.51pwyK9CqjJF9Q4Yp9TLC61ixzT5BRk_0 2024-09-14T11:56:13.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9458098752010733109', time=2024-09-14T13:46:10.999723+0000, chain.objs.size()=1 2024-09-14T11:56:13.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.812+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9yrgivHODCYoQkj8QxmCIkhd6hOiU7X_0 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.814+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5617170609376397123', time=2024-09-14T13:46:11.011338+0000, chain.objs.size()=1 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.89k3OkN9FUeXz-1CX8wZ9dAA7m0UUnT_0 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10994054010738688715', time=2024-09-14T13:46:11.024152+0000, chain.objs.size()=1 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.d4el2Fk-0R-lra46946NwZ6dXkyZIBv_0 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1587979445055282126', time=2024-09-14T13:46:11.130962+0000, chain.objs.size()=1 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9e7Xc5kwI6wSu1ZJw8AGG5ySN5Z2ejk_0 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14208437029084386519', time=2024-09-14T13:46:11.142110+0000, chain.objs.size()=1 2024-09-14T11:56:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9GO1kMdpJqS-93zZyAm9CJvxuCzfgli_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10151781700513220128', time=2024-09-14T13:46:11.144982+0000, chain.objs.size()=1 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rYUVg5coQ7kofpFsPkQeFNkFBRVJH7f_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15462850576030870519', time=2024-09-14T13:46:11.147036+0000, chain.objs.size()=1 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1QqUovyaDkCpQ8piWe2G5zSQFmlp-sF_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17258905239850867435', time=2024-09-14T13:46:11.184551+0000, chain.objs.size()=1 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.H_ns2xk9BglAVC98oubKy7txT4TsFGz_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2613845642827306462', time=2024-09-14T13:46:11.200847+0000, chain.objs.size()=1 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1Qj6Vsk7h1W8tXRr2zNWGno0XF1AZQd_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1072455311710041543', time=2024-09-14T13:46:11.308027+0000, chain.objs.size()=1 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ySINxIZrEMN8rREtuQgnufj7MxLl3ac_0 2024-09-14T11:56:13.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7367182850596264719', time=2024-09-14T13:46:11.329062+0000, chain.objs.size()=1 2024-09-14T11:56:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9DYx47tKal02b9jaDPinA2U20k8hywM_0 2024-09-14T11:56:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.817+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17891304504062247868', time=2024-09-14T13:46:11.336525+0000, chain.objs.size()=1 2024-09-14T11:56:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.817+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tljfbz8hTcB4_FB7CscYehfswGT18YS_0 2024-09-14T11:56:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.818+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3573629240125641154', time=2024-09-14T13:46:11.349142+0000, chain.objs.size()=1 2024-09-14T11:56:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.818+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ISjzozAcD9LUjji0nidMm_lqTHXccQe_0 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16156910902640479581', time=2024-09-14T13:46:11.362336+0000, chain.objs.size()=1 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8oW5gZz1VVxHCCwOhvHyhnMKKw85aFD_0 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14951767035532610420', time=2024-09-14T13:46:11.680879+0000, chain.objs.size()=1 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xEOhFUFIZ6Y9qcK8Y5YAsaDWivWxNs4_0 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15176916480640087826', time=2024-09-14T13:46:11.697997+0000, chain.objs.size()=1 2024-09-14T11:56:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wKUKn6m137guFkLOlDDkfmhtFS-3QPo_0 2024-09-14T11:56:13.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7743292525844459224', time=2024-09-14T13:46:11.716016+0000, chain.objs.size()=1 2024-09-14T11:56:13.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IygLKyMwR8b4TpQJKEfAeVSgecBlGHY_0 2024-09-14T11:56:13.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8920495764924253528', time=2024-09-14T13:46:11.758432+0000, chain.objs.size()=1 2024-09-14T11:56:13.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vYWVbfW1RXE7UXWfycN6L8LoCw0CPk3_0 2024-09-14T11:56:13.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16047412437978348946', time=2024-09-14T13:46:11.839828+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YbDCzf-uE9PFJxX4WuGgPaX63GClo_h_0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13348595083489152292', time=2024-09-14T13:46:11.870666+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ijjAhckkbcZ5ysT5gtpKCn8W4KjzPh7_0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5739929522114031983', time=2024-09-14T13:46:11.906813+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GxKaTCIU-q97902AUewLrYPZBrE3rXl_0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.300619120104392099', time=2024-09-14T13:46:11.931007+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.m9NeqUYjEkdnxVxwxGKcxqamaTXkdUm_0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13293063440506734172', time=2024-09-14T13:46:12.040535+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lUDLSVmlfzW-4xTltEunVM73Xbsyf5__0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8704809553296066363', time=2024-09-14T13:46:12.048173+0000, chain.objs.size()=1 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.821+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AWTPUIOl0C1CKV5jjZoFeZFq3t37CPH_0 2024-09-14T11:56:13.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.822+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2951779363582734714', time=2024-09-14T13:46:12.049803+0000, chain.objs.size()=1 2024-09-14T11:56:13.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.822+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SwYgFJRZ87xPgDPuY9L5JdFw_Q1T1_n_0 2024-09-14T11:56:13.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.822+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2963033902352488946', time=2024-09-14T13:46:12.101484+0000, chain.objs.size()=1 2024-09-14T11:56:13.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.822+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Wivr-eosEuU4hUApuYBzaAap_C1lTkR_0 2024-09-14T11:56:13.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.824+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17712201673475817650', time=2024-09-14T13:46:12.119853+0000, chain.objs.size()=1 2024-09-14T11:56:13.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.824+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MGykhAoBPZ2NitW76q0HP2eN7gowF3o_0 2024-09-14T11:56:13.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.825+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.763284295041166490', time=2024-09-14T13:46:12.214578+0000, chain.objs.size()=1 2024-09-14T11:56:13.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.825+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NIC5LRvq7WCe9n6PcsRwY64FrSk74-8_0 2024-09-14T11:56:13.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.827+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7222990607721093103', time=2024-09-14T13:46:12.242258+0000, chain.objs.size()=1 2024-09-14T11:56:13.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.827+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jdB6g_3rhqIi9Qr7t9c4pcbG6LlyNnF_0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9610306093647120375', time=2024-09-14T13:46:12.439631+0000, chain.objs.size()=1 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XTKG5iYh6lcd7_xDIESMDcOBFtUEW-v_0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1564416073643310618', time=2024-09-14T13:46:12.455263+0000, chain.objs.size()=1 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JW4WqNgfiBp2s6Cu4l1kaRjTy-a9xjb_0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1976732610826321227', time=2024-09-14T13:46:12.457034+0000, chain.objs.size()=1 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4ciBuw91An_5gWUjT36mwJCNsdf6PTv_0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6504120257768956114', time=2024-09-14T13:46:12.486804+0000, chain.objs.size()=1 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2hHBDmina1-uomzon61NFpXrtUkXg6i_0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12742246273242027058', time=2024-09-14T13:46:12.617092+0000, chain.objs.size()=1 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Xl5gYe4oSv3v01P5fDyvI6gTHEeqRK__0 2024-09-14T11:56:13.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5139866456430726552', time=2024-09-14T13:46:12.639423+0000, chain.objs.size()=1 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.E3BdlFrL3_QliSfpeeQHOm2CkE1YY1z_0 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5249965454562085884', time=2024-09-14T13:46:12.667456+0000, chain.objs.size()=1 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.N28i2yCjAksd3b4K-CARnsnnWZCiXvs_0 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1376660575033623615', time=2024-09-14T13:46:20.709317+0000, chain.objs.size()=1 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HxE0LUrErYVyv4TedR2LlsxF848_0eR_0 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17210160709773079634', time=2024-09-14T13:46:20.800938+0000, chain.objs.size()=1 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NCfF2Kv2HF8KvKmfoNCRycSZJJa3ATI_0 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13389444562228547596', time=2024-09-14T13:46:20.801652+0000, chain.objs.size()=1 2024-09-14T11:56:13.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.828+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.B82graRS2p6UkEJoN55GJ-Aer_Y77S5_0 2024-09-14T11:56:13.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.830+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2453224080880494878', time=2024-09-14T13:46:21.153513+0000, chain.objs.size()=1 2024-09-14T11:56:13.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.830+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tGX5rb3s-WS1QM2fax3M3GGGT2NA-hx_0 2024-09-14T11:56:13.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.830+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10368197059412766160', time=2024-09-14T13:46:21.189227+0000, chain.objs.size()=1 2024-09-14T11:56:13.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.830+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KkoT6-1VBad2wZbRdcRXktZCFWwjZe4_0 2024-09-14T11:56:13.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.832+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13591588122746685000', time=2024-09-14T13:46:21.319481+0000, chain.objs.size()=1 2024-09-14T11:56:13.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.832+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.X8BpBYzrtWjH1kQmH6nOAqT4Uy5gMvf_0 2024-09-14T11:56:13.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.832+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13267207511428529425', time=2024-09-14T13:46:21.348083+0000, chain.objs.size()=1 2024-09-14T11:56:13.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.832+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tVd9mM-Gsa0Utgagkqr_ZH5uPSslXLY_0 2024-09-14T11:56:13.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6376573544311082924', time=2024-09-14T13:46:21.363495+0000, chain.objs.size()=1 2024-09-14T11:56:13.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9qyjfA1NCN9CxFHWexYN6CUDpJTNkIi_0 2024-09-14T11:56:13.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9214811902478672787', time=2024-09-14T13:46:21.467957+0000, chain.objs.size()=1 2024-09-14T11:56:13.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4rJ0IerW-PML0Bnx2pXGl8eG1uO-FHf_0 2024-09-14T11:56:13.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.836+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/42187 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16875662843712639056', time=2024-09-14T13:46:21.480275+0000, chain.objs.size()=1 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VdO0tTIFqT535ON_amlXABNTSxdBq9u_0 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7968111500697209466', time=2024-09-14T13:46:21.487110+0000, chain.objs.size()=1 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QDeFQ04fOL-Ap3F5CEa3SxYjZzsgCR-_0 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2635605322166201075', time=2024-09-14T13:46:21.517019+0000, chain.objs.size()=1 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JuFtDXTXPdA379uX3IrtwxAZQ8qH67n_0 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9042632971985710370', time=2024-09-14T13:46:21.893128+0000, chain.objs.size()=1 2024-09-14T11:56:13.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sQSYoGUMk_Ghk0xbai6ogsiEMUOGT42_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13750114626201441202', time=2024-09-14T13:46:21.930131+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._gFbDPbxW-r1cRL54bs4YUJ80XngFmX_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12881878344002476985', time=2024-09-14T13:46:21.953888+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qQhwLeUC5MXQAfoQ-yjvEw0cisZuflL_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16732085060847133842', time=2024-09-14T13:46:22.080829+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jj0FNuLFIEsVIx48Eecftnp_YjeJa1a_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1202575669168474754', time=2024-09-14T13:46:22.086283+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KEaORWNK6Tr0MEKM91jkY1_IyFPhRWC_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8620192366041477389', time=2024-09-14T13:46:22.097900+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yLEfdRRyMkkk_k-8YvXgAKBSeFdeiXx_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1135544940802217027', time=2024-09-14T13:46:22.218034+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HGNgRXwFauoSPRLES0IRc48V9S0PfnR_0 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17067443219884097544', time=2024-09-14T13:46:22.285340+0000, chain.objs.size()=1 2024-09-14T11:56:13.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._KbpQMv8gBnDYn1JCdnz3SjIogGn8dZ_0 2024-09-14T11:56:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14327584851090068905', time=2024-09-14T13:46:22.286602+0000, chain.objs.size()=1 2024-09-14T11:56:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.gRoBs452-4DaJI96gE5kcyA9FBxyoFx_0 2024-09-14T11:56:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.841+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8474757764089171707', time=2024-09-14T13:46:22.330587+0000, chain.objs.size()=1 2024-09-14T11:56:13.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.841+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0SUgm7sBLZobIkKJZPqkzWn4dzDGhmd_0 2024-09-14T11:56:13.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11620570113706188249', time=2024-09-14T13:46:22.344748+0000, chain.objs.size()=1 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.InJ9L5uxIFW6iNyI3a5dgYvB8bE9UBJ_0 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8109624290077001298', time=2024-09-14T13:47:19.430916+0000, chain.objs.size()=1 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.440__shadow_.oBHvuh9lVvidJO3_aGvRlSMfaq58oLH_0 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13559119425588160351', time=2024-09-14T13:47:30.755615+0000, chain.objs.size()=1 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.459__shadow_.b2XMboO8FePMpw7_RZOvb-yjq_UpNnS_0 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1497326039904526037', time=2024-09-14T13:47:35.051696+0000, chain.objs.size()=1 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465__shadow_.MPxNMGWTvUGKuAT9WLHIWBYOn0H0SxK_0 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2953995365005318956', time=2024-09-14T13:48:56.902040+0000, chain.objs.size()=1 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.552__shadow_.dQdbi6icTU89gdwax3XQY_kKIPJLwK__0 2024-09-14T11:56:13.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13692345556184419259', time=2024-09-14T13:48:58.921037+0000, chain.objs.size()=1 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.555__shadow_.yySFamedyc_iOrYEBGcNzWCPuyMKTRj_0 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15501992678092522784', time=2024-09-14T13:49:13.234925+0000, chain.objs.size()=1 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:ZwjBHBc7SbyYdU731SEdM1Q--tBsKPJ_.sz57cI5Mxr2dyWNrMT1yZxsSVwo3bfz_0 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4161242236356936405', time=2024-09-14T13:49:18.984514+0000, chain.objs.size()=1 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.572__shadow_.lfBuaS3jsK7_HcTVBmv2Ds7kUYhpzMz_0 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2413157093323694155', time=2024-09-14T13:49:24.815332+0000, chain.objs.size()=1 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:gr68du4.-6ll04nRU7HgW7rGTYSR3cF_.ivTECXFITYllZMOSEPMDom6K7nGa2_6_0 2024-09-14T11:56:13.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1992391481897907038', time=2024-09-14T13:49:43.203971+0000, chain.objs.size()=4 2024-09-14T11:56:13.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.843+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~rYVMRAiZG4TrBETwJs2yOkpG7HH5LXC.1 2024-09-14T11:56:13.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.845+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~rYVMRAiZG4TrBETwJs2yOkpG7HH5LXC.2 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.846+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~rYVMRAiZG4TrBETwJs2yOkpG7HH5LXC.3 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~rYVMRAiZG4TrBETwJs2yOkpG7HH5LXC.4 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9278575058580491245', time=2024-09-14T13:49:44.390106+0000, chain.objs.size()=1 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:feFNb.ZV5CtkQTkyg5wCbso9axd-uSr_.xNKs-dU5HBwXFVZAdnzu3hHWuffd1dF_0 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5951789963832464817', time=2024-09-14T13:49:49.530615+0000, chain.objs.size()=1 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:tINayQlztjLDF3HVlzxfQDtcq.YTlSH_.mfrtH3sGhLyjpNRB7RMOFaSzRCYpALr_0 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15565051926495772871', time=2024-09-14T13:52:09.731492+0000, chain.objs.size()=1 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.847+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.619__shadow_.Y9uxyXTBaAOofMPf6WqJzP7RUlFZkoA_0 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.835257366850295851', time=2024-09-14T13:52:15.824672+0000, chain.objs.size()=1 2024-09-14T11:56:13.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.628__shadow_.EQcQxj-EYaugEQWkHLoQZMzCpTW2d-U_0 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15346789195363935924', time=2024-09-14T13:52:35.626193+0000, chain.objs.size()=1 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.666__shadow_.QHWuTdu7PKjV2QiPaCUy2Q0jrRpPG4Q_0 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6758894731474938381', time=2024-09-14T13:52:48.432040+0000, chain.objs.size()=1 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.696__shadow_.FO9MtH5WuCII0uXF_6RU5Grqr2AYm-P_0 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3526320361345777849', time=2024-09-14T13:52:53.433572+0000, chain.objs.size()=1 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.707__shadow_.I2QTO-IIN9dTed7_EiMe6i9oFLbWgQz_0 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13582848800932649212', time=2024-09-14T13:53:32.533621+0000, chain.objs.size()=1 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.848+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.745__shadow_.TTHlvzDhdYkG4M3cI9IuYLBaQsVVeCe_0 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.849+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12662307256809550764', time=2024-09-14T13:54:07.720061+0000, chain.objs.size()=1 2024-09-14T11:56:13.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.849+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.776__shadow_.1NYlaWBRn6i3Eennsx8vbZMk3TM_h_5_0 2024-09-14T11:56:13.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:13.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.855+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:56:13.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.857+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:13.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.857+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:13.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45897' 2024-09-14T11:56:13.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_WKCvbOk10HEqkP8MVxxQJ-gHsrwI9Hw', time=2024-09-14T13:43:23.891171+0000, chain.objs.size()=1 2024-09-14T11:56:13.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.166__shadow_.j6eEWJsrPOB0-v99TtEkCuQil07l_eh_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7165239645427907662', time=2024-09-14T13:45:06.246803+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.232__shadow_.Y3Fo0j68ITYD59UVSvnSyagsgcMSZ-I_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.909602995012516801', time=2024-09-14T13:45:16.416430+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.250__shadow_.uGwQMzqh6sAPqGMdvXnyJULpXhhullv_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9638891987578859919', time=2024-09-14T13:45:19.238271+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256__shadow_.qj5E4zBWhsAYc1w5U31X-T6f3-RNtwo_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5781649988382223157', time=2024-09-14T13:45:30.213830+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kFAlvq_OgZx3DIFXl_DBzn2TSkJBUJJ_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15265299627769297822', time=2024-09-14T13:45:30.228584+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dLpZ2VRNtneMqu6z__4gBCCtGEzya0Z_0 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11860285605559660696', time=2024-09-14T13:45:30.242416+0000, chain.objs.size()=1 2024-09-14T11:56:13.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m24JlxPqa4joYklaBQ_4fV8BEFYvwsG_0 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4751254001331886176', time=2024-09-14T13:45:30.254897+0000, chain.objs.size()=1 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m7tophJJqnLyILaNoxw-6iglXt_-sCv_0 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15077676582692550953', time=2024-09-14T13:45:30.262796+0000, chain.objs.size()=1 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZBGyD6uTBWV8DRhvzothm9rTY7MIauz_0 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9721304321085699368', time=2024-09-14T13:45:30.289116+0000, chain.objs.size()=1 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.y8hrnlDbtG_Xlrz9CDuTGnyBtZyHVn0_0 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3927216851899104710', time=2024-09-14T13:45:30.303981+0000, chain.objs.size()=1 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0J1VakAewwyMtffhwq3WqJozskcrrQO_0 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13906008195315647313', time=2024-09-14T13:45:30.309598+0000, chain.objs.size()=1 2024-09-14T11:56:13.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SVeINkYZ5zomo0JmIKRHrV4rMxmzDLa_0 2024-09-14T11:56:13.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2829844238461422431', time=2024-09-14T13:45:30.313456+0000, chain.objs.size()=1 2024-09-14T11:56:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DIPZdLXDX9ODG2jen7yNXdlFTPbtgJ1_0 2024-09-14T11:56:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5239347540154156661', time=2024-09-14T13:45:30.315383+0000, chain.objs.size()=1 2024-09-14T11:56:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wVL6q_6dg38jkkJHQ7RzE80V6L6SiD1_0 2024-09-14T11:56:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6997992346645523703', time=2024-09-14T13:45:30.316460+0000, chain.objs.size()=1 2024-09-14T11:56:13.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VKFwmPkHzTQdFnnuw7yTFOYFEzEI_zO_0 2024-09-14T11:56:13.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13053997655587863216', time=2024-09-14T13:45:30.406071+0000, chain.objs.size()=1 2024-09-14T11:56:13.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.X9CEzchK6bM8dS34s-EMWqxwfneO_V5_0 2024-09-14T11:56:13.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16483468984928091672', time=2024-09-14T13:45:30.456987+0000, chain.objs.size()=1 2024-09-14T11:56:13.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.IhK58rQQrZnYKVdaFNwxSrD6XTd4TH2_0 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14167643359586763779', time=2024-09-14T13:45:30.457921+0000, chain.objs.size()=1 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kiQ9poDdm6FjebHeagEe7bFIKGxOt1P_0 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8076519340074213203', time=2024-09-14T13:45:30.459065+0000, chain.objs.size()=1 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-so1uNkuk6IMmQyS53cGy7oAG5fK8QR_0 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5749940093328812852', time=2024-09-14T13:45:30.461876+0000, chain.objs.size()=1 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.863+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yCJn-51wD8R1OAPrknMZ10SQv0euhXZ_0 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15232857119378797508', time=2024-09-14T13:45:30.591706+0000, chain.objs.size()=1 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bgePPAP58K0atZiZf1cHUcKCNK0bhhR_0 2024-09-14T11:56:13.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4020268911975974503', time=2024-09-14T13:45:30.653057+0000, chain.objs.size()=1 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.H6JhgD83_tcqg7SNUiISBwfPWYDq2vW_0 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5826151527867246881', time=2024-09-14T13:45:30.666475+0000, chain.objs.size()=1 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.864+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V9Q8z26hlYrY5esdqspaNX5XWTQwrvl_0 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7507997229878681473', time=2024-09-14T13:45:30.698838+0000, chain.objs.size()=1 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cVyZ-gyiXGRmIDrxVog3HpvVWykTAXY_0 2024-09-14T11:56:13.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4481751808455788409', time=2024-09-14T13:45:30.784754+0000, chain.objs.size()=1 2024-09-14T11:56:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WJxwCCfmcQxm4ny-DIWVOQUwuwIKzam_0 2024-09-14T11:56:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6905950951821913806', time=2024-09-14T13:45:30.821063+0000, chain.objs.size()=1 2024-09-14T11:56:13.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6KOGK3vEzYuARvvNBzTyuQFvx0idaot_0 2024-09-14T11:56:13.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12315661240533304535', time=2024-09-14T13:45:30.976627+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TtyKlm9_3sA1TR1SYppI6hscCWNHQln_0 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1496133270907852647', time=2024-09-14T13:45:31.027228+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VmtC0lQGDHZgwzPIzUpWotY9NDrOvQy_0 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6138293310762952074', time=2024-09-14T13:45:31.034323+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KZ75f3sDBh3_uj3YitBpB-yGlFIiF7h_0 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14299226658778878210', time=2024-09-14T13:45:31.037867+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MRo7AozSwl6gqbGpN1TlIIw6XgMR6rk_0 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6240663667366021879', time=2024-09-14T13:45:31.045289+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8RxrBtwItIVOPKlJnefHYykIF25ztjj_0 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9055124657848999237', time=2024-09-14T13:45:31.055717+0000, chain.objs.size()=1 2024-09-14T11:56:13.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.R3MIJ9bmQlGxCSUpIAaa8X40vPinfRQ_0 2024-09-14T11:56:13.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12995921192355982047', time=2024-09-14T13:45:31.163523+0000, chain.objs.size()=1 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.AzCzBFfB_ULbvHRY39EzMWpvTw06nLA_0 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14941894239356909025', time=2024-09-14T13:45:31.176626+0000, chain.objs.size()=1 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V-wgSA5dnVwUT1mODxR4-7Ab-rYOWXR_0 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3999014902421297765', time=2024-09-14T13:45:31.187540+0000, chain.objs.size()=1 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WW_w8E_Uw8HgSReQmh5TP47uGZhhVaX_0 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13832689800372647541', time=2024-09-14T13:45:31.219071+0000, chain.objs.size()=1 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gF6El6woDGtcBO-DkcUyomIhusefrW8_0 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.869+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10941517463015749578', time=2024-09-14T13:45:31.244804+0000, chain.objs.size()=1 2024-09-14T11:56:13.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.869+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7Vu388w6V3aiiknPYTIhFVnI78l5DeM_0 2024-09-14T11:56:13.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.871+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1472652844553377811', time=2024-09-14T13:45:31.503906+0000, chain.objs.size()=1 2024-09-14T11:56:13.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.871+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rreMXpuiFHD0RpKBcOpcnOUPA8nJkSg_0 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8725776553710183751', time=2024-09-14T13:45:31.519834+0000, chain.objs.size()=1 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XhaXR3q4PGmen_2l_HTEJHTaWow2Ie4_0 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3291798032398085624', time=2024-09-14T13:45:31.578065+0000, chain.objs.size()=1 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GaExeMaRxHLlxvOZZRwAITOw-YT9OiD_0 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14039465156440615091', time=2024-09-14T13:45:31.583346+0000, chain.objs.size()=1 2024-09-14T11:56:13.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.872+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7O--nZgKEDBahkE1E76YQRQE9EOFaIC_0 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10539611509809416501', time=2024-09-14T13:45:31.584365+0000, chain.objs.size()=1 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Qk-E1iBrmLvZ4P8pDkMBsB33GhKUfYN_0 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9072262220422605376', time=2024-09-14T13:45:31.602784+0000, chain.objs.size()=1 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1kVKunH5vncNUje5KPEb_laO4pWNhmj_0 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5027115709707365201', time=2024-09-14T13:45:31.606395+0000, chain.objs.size()=1 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XZSszZDpIsK3PNOVFBPT633UMmSMDsg_0 2024-09-14T11:56:13.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9180455099299247913', time=2024-09-14T13:45:31.607376+0000, chain.objs.size()=1 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TuMJGW22YJPD0Nc42qcOfx898RcSU59_0 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10256385706697596929', time=2024-09-14T13:45:31.730434+0000, chain.objs.size()=1 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3xzdZkd7ZeKXWvDRYPFjU25Y0PvjPyW_0 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1075893560868034312', time=2024-09-14T13:45:39.802220+0000, chain.objs.size()=1 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.279__shadow_.ej6yh6mlHGpvlB8Ov2DN2egqMj3Qb0S_0 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17484809726790165982', time=2024-09-14T13:45:40.795299+0000, chain.objs.size()=1 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.281__shadow_.rEQrHD3JDVhjrNYh-dDL3zgjnNQ28XN_0 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5558568627013627806', time=2024-09-14T13:45:48.175630+0000, chain.objs.size()=1 2024-09-14T11:56:13.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.R8jYwIw_TS_mTI7qIIdBQnIqu5zwyHS_0 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9122648042146712853', time=2024-09-14T13:45:48.677694+0000, chain.objs.size()=1 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.295__shadow_.nANFBLeAKFfkEk5Ltc0H7KppqZPQFp9_0 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3756666068202172350', time=2024-09-14T13:45:50.659747+0000, chain.objs.size()=1 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.299__shadow_.Y-VlF6T-QmpWxUteoaTXhthcfJfEJu1_0 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7566410833501696824', time=2024-09-14T13:45:51.648731+0000, chain.objs.size()=1 2024-09-14T11:56:13.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.876+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.301__shadow_.vgpwQIsFSyVodLdyk42jC900R4BnUTs_0 2024-09-14T11:56:13.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.877+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18019276910092468307', time=2024-09-14T13:46:10.956074+0000, chain.objs.size()=1 2024-09-14T11:56:13.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.877+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.T0u6QCHvjVIbSS9JZZt8pvJfWIqUnqe_0 2024-09-14T11:56:13.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.877+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9145042262771993065', time=2024-09-14T13:46:10.960622+0000, chain.objs.size()=1 2024-09-14T11:56:13.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.877+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P8AKxw9Xuozl9NtHwsVIQtK9IyNFCTW_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16173507142627363945', time=2024-09-14T13:46:10.984325+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ECkThE5OhgXZlJUzLo9v_QB_-HEn3oF_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9933537004090187475', time=2024-09-14T13:46:11.024984+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fJBatoPGWw2jSR5lTVUt8jRJpDWzaiA_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2289771471233808981', time=2024-09-14T13:46:11.188021+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JxaopsiWVSniFiNPALCOFi3YEhrio29_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6243624469190766905', time=2024-09-14T13:46:11.203272+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2CX7Lyh39blmuP9nZTym3oLM54J5Xug_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4283899763450684682', time=2024-09-14T13:46:11.343188+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IVwPJDgtFCFljdHcUA74nHmgFNDqhLf_0 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14090205532637046933', time=2024-09-14T13:46:11.360556+0000, chain.objs.size()=1 2024-09-14T11:56:13.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.879+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.FX_UvRCWRqyCrysO9w71Lk0d7EQADIB_0 2024-09-14T11:56:13.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.850985524876497254', time=2024-09-14T13:46:11.407679+0000, chain.objs.size()=1 2024-09-14T11:56:13.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xcjbVBGcDV6dvTfe53KqEdrXhtSxrDK_0 2024-09-14T11:56:13.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7145872459836343902', time=2024-09-14T13:46:11.410931+0000, chain.objs.size()=1 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZkKHPingGnVqH0FpMbNj8QXyrNr4MtT_0 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17549017284488227806', time=2024-09-14T13:46:11.663633+0000, chain.objs.size()=1 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UEy3b5aqIb80Hd6anCAapywmmcA2oIO_0 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15069507639146366030', time=2024-09-14T13:46:11.682624+0000, chain.objs.size()=1 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DLwtL1Jrfd7GuFVDndRT99k1U-yp2JU_0 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.881+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6280131358413871639', time=2024-09-14T13:46:11.683541+0000, chain.objs.size()=1 2024-09-14T11:56:13.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.882+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ti7Et9WsaBRIw7zwEop2ohSLjpMYoyI_0 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17638598337435194768', time=2024-09-14T13:46:12.030645+0000, chain.objs.size()=1 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.72j8jp3LQn3zQiXsDzKp0Dr-uYudReG_0 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6891960551162380839', time=2024-09-14T13:46:12.116685+0000, chain.objs.size()=1 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dFiaKdgK4DyXzZe7zclz9Jw3CsKXfZs_0 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14872183097562569023', time=2024-09-14T13:46:12.138103+0000, chain.objs.size()=1 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tl01U_6K51fa5xz7JlO1tNgS7pSngDC_0 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5453789749867346409', time=2024-09-14T13:46:12.139064+0000, chain.objs.size()=1 2024-09-14T11:56:13.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XWvmxO4ug_mndpe-CS9fKs2SZfaBPjB_0 2024-09-14T11:56:13.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7063311703983179005', time=2024-09-14T13:46:12.456443+0000, chain.objs.size()=1 2024-09-14T11:56:13.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jvWrv6hQAd1MJLHNx9pWUrUOiCiydPg_0 2024-09-14T11:56:13.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3410462546541800836', time=2024-09-14T13:46:12.505290+0000, chain.objs.size()=1 2024-09-14T11:56:13.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EHms_2LmIDQQiE0F_iyZ8w-sj-NpZDI_0 2024-09-14T11:56:13.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.886+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4013131316259912319', time=2024-09-14T13:46:12.520589+0000, chain.objs.size()=1 2024-09-14T11:56:13.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.886+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.W94iT7Nwaiq2qs5qmijW3J-PE6Kb9db_0 2024-09-14T11:56:13.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1787200364831724314', time=2024-09-14T13:46:12.605558+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NREPa7_SXdv_mM5J4PQZAwDPBEUeiM2_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11293292519981749902', time=2024-09-14T13:46:12.615273+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AaKl0Q2SJfWXWJf8SkLeNWFWyGm4CJO_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662939508110510699', time=2024-09-14T13:46:12.632873+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eP9YMFRR82tJiHLOrfdInQD-MsaDN5u_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3162130784650266307', time=2024-09-14T13:46:12.655576+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4Ie5EiPUm3CnkQnhMdWuZA6_N-H_Hf1_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13097227776019606072', time=2024-09-14T13:46:12.665039+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.roEkL0N3swDkoyAkQ4p1pG860tmvn8w_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1469669504711395356', time=2024-09-14T13:46:20.731063+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jGAFSwCxWm7SMJTY2vW1yqZVXqgMdrJ_0 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.668633955604550158', time=2024-09-14T13:46:20.764045+0000, chain.objs.size()=1 2024-09-14T11:56:13.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S_-QsfW2RRpS6njALDWIfNRDnsbkTZj_0 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9496311246223723963', time=2024-09-14T13:46:20.902190+0000, chain.objs.size()=1 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.C1ELL5An0pkEZL4Qa5WULT4Cr3zDgqX_0 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1784026322654480941', time=2024-09-14T13:46:20.904274+0000, chain.objs.size()=1 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UMgp-LSysuU3N6tMDdyfhziS0uUK51z_0 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15421450224770222143', time=2024-09-14T13:46:20.920976+0000, chain.objs.size()=1 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.888+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wVx-0LHdsT4sL4DDqfDposgpB33xXYf_0 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.889+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10998465275171982578', time=2024-09-14T13:46:20.947800+0000, chain.objs.size()=1 2024-09-14T11:56:13.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.889+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aNaI9ph7zhEN8_YlQOce5MTYmVRkBci_0 2024-09-14T11:56:13.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3889662411954959352', time=2024-09-14T13:46:20.952920+0000, chain.objs.size()=1 2024-09-14T11:56:13.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bZkp0Qq0vp751GJEKSjmKe0L5U7Mh4F_0 2024-09-14T11:56:13.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13685264703872843500', time=2024-09-14T13:46:20.973894+0000, chain.objs.size()=1 2024-09-14T11:56:13.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8_N2lE5DcaLz2INwywkvaJslZu16t62_0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13728677074078030654', time=2024-09-14T13:46:21.000968+0000, chain.objs.size()=1 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AINMMF27tFWvfr6SvDYkNjuxA2yboSL_0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14786422658376768739', time=2024-09-14T13:46:21.012352+0000, chain.objs.size()=1 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.K7oj8YA9FyUk0kIX6b5BupNiVbTqzSN_0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14975391067389877819', time=2024-09-14T13:46:21.088895+0000, chain.objs.size()=1 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.j3hnSHzrl6xNTNxgqSgqDJtmSQfeXY3_0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6415940195462602228', time=2024-09-14T13:46:21.113756+0000, chain.objs.size()=1 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3-DldsHOSyGcAYMUTIyZ-mG6OG93Ol__0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18396804751689898982', time=2024-09-14T13:46:21.114570+0000, chain.objs.size()=1 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FUGX_gOn4CXYnD1HJ5JI9OjVCXHPFGx_0 2024-09-14T11:56:13.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9574505214525477080', time=2024-09-14T13:46:21.128028+0000, chain.objs.size()=1 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.J9IJl4WvxKg5ssfCytotGGqFnaoKtbv_0 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8100033684050842721', time=2024-09-14T13:46:21.140285+0000, chain.objs.size()=1 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vRmiw1XVPVf_yiHGn8zqLdWHt53wRzI_0 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12117835221086190715', time=2024-09-14T13:46:21.153545+0000, chain.objs.size()=1 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.892+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XQ7rxFoSSLyQP76WMZRFZE06PyP9qXt_0 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9116218324857523024', time=2024-09-14T13:46:21.171617+0000, chain.objs.size()=1 2024-09-14T11:56:13.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1WbFkcPpd8kDH6x-eyXvCUc23r4IIgx_0 2024-09-14T11:56:13.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7257942459653589712', time=2024-09-14T13:46:21.180634+0000, chain.objs.size()=1 2024-09-14T11:56:13.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LcPdBX22h9IEw50gXrEqdG4RswO7mXm_0 2024-09-14T11:56:13.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12841523249932385429', time=2024-09-14T13:46:21.198614+0000, chain.objs.size()=1 2024-09-14T11:56:13.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XmfpxqF5RAdjJU5X367N8HMlM4eQnW2_0 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7717442437967486637', time=2024-09-14T13:46:21.295203+0000, chain.objs.size()=1 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CuuhLGaT_skMZpJXs1brhJqXW3ohf0t_0 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15641949571181508485', time=2024-09-14T13:46:21.314157+0000, chain.objs.size()=1 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lUdTZqFE4uVYIDsgNX2lTYXrRLh9nz8_0 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11104287440250888588', time=2024-09-14T13:46:21.370157+0000, chain.objs.size()=1 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5VYioojtMMHZpvfmiQCTYPIvttc9kfx_0 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14986481816300081741', time=2024-09-14T13:46:21.523443+0000, chain.objs.size()=1 2024-09-14T11:56:13.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.895+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2hxxXDNg-JLxb0EtSj24o1wy3geq2SO_0 2024-09-14T11:56:13.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.899+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/45897 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.901+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.901+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.136810581585108723', time=2024-09-14T13:46:21.537037+0000, chain.objs.size()=1 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.901+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fe7vUhXkm2IghtPf6_1uXUnJ0MNM78O_0 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.901+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6536634789029665948', time=2024-09-14T13:46:21.738745+0000, chain.objs.size()=1 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.901+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UUKaGOsu9W-nAvIYT814IE2zie0-CGw_0 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13799465799387246485', time=2024-09-14T13:46:21.749028+0000, chain.objs.size()=1 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CqcKVKrgggi6UcvB2Iqxmk2TaOHokib_0 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4432072333990713492', time=2024-09-14T13:46:21.754175+0000, chain.objs.size()=1 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.k3rY_9kkLSLOLyoZoI4um0n-rwQLzM9_0 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12227884564712058975', time=2024-09-14T13:46:21.766776+0000, chain.objs.size()=1 2024-09-14T11:56:13.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EWpda5Tkfml727_msIQrchDO72-LnfZ_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.70039601988659964', time=2024-09-14T13:46:21.854270+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.A91mKjDj3nHOI0UAO-v_acMBYJxD4cQ_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3783277657592328702', time=2024-09-14T13:46:21.869845+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.e95AT9NfMQcHAvzcWm-UrS0ZUgFl7op_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17481529711908068418', time=2024-09-14T13:46:22.053142+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YoSSoYYa7oQSHWMZiy4I0jhHfN25vnw_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10791328116817678595', time=2024-09-14T13:46:22.060275+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iB0xQeSV59YuZ6pKVAHjSPdnwoJSKEw_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16205108260340328441', time=2024-09-14T13:46:22.088398+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1VTgssfwAIbVKley3-8QM2qCbGBDbvO_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12613442986401487783', time=2024-09-14T13:46:22.134347+0000, chain.objs.size()=1 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1-c_rhd5WN1JMVhkDE2ICXpYL1ghlWY_0 2024-09-14T11:56:13.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2829735145438393225', time=2024-09-14T13:46:22.138233+0000, chain.objs.size()=1 2024-09-14T11:56:13.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.902+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xxUmprngfFr7LzYeFnvfaQyKTf6m4gd_0 2024-09-14T11:56:13.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.904+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5574405180125211190', time=2024-09-14T13:46:22.280365+0000, chain.objs.size()=1 2024-09-14T11:56:13.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.904+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WXP8uHE1dhVHYeTx1FJ7NR-ZqQG28eE_0 2024-09-14T11:56:13.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.389697005105202543', time=2024-09-14T13:46:22.292372+0000, chain.objs.size()=1 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6QlDPKZi2_2ZtaEneysmyBvY-oJITfs_0 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6373679454587910343', time=2024-09-14T13:46:22.298434+0000, chain.objs.size()=1 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RUHNmYXuhkKu-doc-mJJmn7mX36WBUb_0 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.786086901532609612', time=2024-09-14T13:46:22.319266+0000, chain.objs.size()=1 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RxTG1F-vY8JuT8dpg9PkM36bUU8wv8E_0 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2959431146069794565', time=2024-09-14T13:46:22.319978+0000, chain.objs.size()=1 2024-09-14T11:56:13.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.905+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ikFQIWOwTU2_TviqsVubRiuW9JNmT9V_0 2024-09-14T11:56:13.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9701134197959728014', time=2024-09-14T13:46:23.215183+0000, chain.objs.size()=1 2024-09-14T11:56:13.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.327__shadow_.cdz79WRMgjaMn9KB07jV2fiuYFtpixk_0 2024-09-14T11:56:13.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3486474897050722694', time=2024-09-14T13:46:30.164227+0000, chain.objs.size()=1 2024-09-14T11:56:13.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.342__shadow_._Tq0LqlgfW3zVUjL_gpVqpd2PPiHnvc_0 2024-09-14T11:56:13.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3303127229021105207', time=2024-09-14T13:47:20.470201+0000, chain.objs.size()=1 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.442__shadow_.yNcMsr_b8Wj_z7dIPD7WUshPsp60ofS_0 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7726956376079972661', time=2024-09-14T13:47:42.657972+0000, chain.objs.size()=1 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.485__shadow_.PbkvkqJ7jGtRHIU1qUOMPUqLUYxTkVF_0 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4242614193941748703', time=2024-09-14T13:47:54.013975+0000, chain.objs.size()=6 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.906+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:13.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.907+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:13.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:13.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.909+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9357424070355454752', time=2024-09-14T13:47:54.239263+0000, chain.objs.size()=6 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:13.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~6VUVhRQugj6r1ebJ9kJkcinafhgqQIq', time=2024-09-14T13:48:20.526294+0000, chain.objs.size()=2 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.910+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.532__multipart_mymultipart.2~6VUVhRQugj6r1ebJ9kJkcinafhgqQIq.1 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.532__multipart_mymultipart.2~6VUVhRQugj6r1ebJ9kJkcinafhgqQIq.2 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~iYbXVakXGi3-ecq4AfCv836DLrlE8dW', time=2024-09-14T13:48:22.178173+0000, chain.objs.size()=1 2024-09-14T11:56:13.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.535__multipart_mymultipart.2~iYbXVakXGi3-ecq4AfCv836DLrlE8dW.1 2024-09-14T11:56:13.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2366016610791852845', time=2024-09-14T13:49:03.975328+0000, chain.objs.size()=1 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.563__shadow_.S1biQydzEW45llQmAsRNO0YIU1zJHsH_0 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6852928053228865594', time=2024-09-14T13:49:12.220939+0000, chain.objs.size()=1 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:Vt1f5psHqrXMc1w70x00px8sswllTxP_.yvjJ46ftChJkO0sa_7S-O2jgvex1dCg_0 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6527928225187540222', time=2024-09-14T13:49:27.700448+0000, chain.objs.size()=1 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:SFfLROI1i0tAR0qZTyW0m3LSdHlDpyM_.omri6KwrUlcx3SinIY_RSQuuqZLbqXg_0 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16028152238711869999', time=2024-09-14T13:49:30.958610+0000, chain.objs.size()=1 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:YL1TbdQ-FwGOtvihQV4T213VE7wFdlp_._t30U4GLJ8GJOn0cWvz9E2kAbmISlRr_0 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4813123663334151025', time=2024-09-14T13:49:31.976847+0000, chain.objs.size()=1 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:nlZi5orFjfVS3Nha9BWr4JstImF9Ggv_.17ZQueLtpzz8lxm4xr5yquxoh3YgqPh_0 2024-09-14T11:56:13.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7618940545730677256', time=2024-09-14T13:49:33.518127+0000, chain.objs.size()=1 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:UmhucRsd46sgU8jvcNYdj64cixAjDYE_.jV_S8Adwlf0P11Tn5QhM53eZkDUjDPe_0 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5334249936013959315', time=2024-09-14T13:49:34.375789+0000, chain.objs.size()=1 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:WbzZRxaxKgkYJ1mA.OWDe0GUVHG0ALm_.MWiHFjNIHYakZO3a56wn58TBefUsw66_0 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8132772682796402380', time=2024-09-14T13:49:45.657678+0000, chain.objs.size()=1 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:.AV2575I-5qIuRXuSCulT8wAc6vQN7n_.C9u9_3KrghLcNvNrO11CZU5Ag13LeOy_0 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11912049783269606629', time=2024-09-14T13:49:48.976011+0000, chain.objs.size()=1 2024-09-14T11:56:13.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.587__shadow:8NrU8Znn8oPkLMrgWTlhCOgYN0VAZIC_.Wax7cHAMwGMSaQMBaQi1jqaqSGJ6SY1_0 2024-09-14T11:56:13.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq', time=2024-09-14T13:52:14.136042+0000, chain.objs.size()=6 2024-09-14T11:56:13.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.1 2024-09-14T11:56:13.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.2 2024-09-14T11:56:13.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.3 2024-09-14T11:56:13.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.4 2024-09-14T11:56:13.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.5 2024-09-14T11:56:13.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.625__multipart_multipart_enc.2~IKrMC9bfV5Y6Ke4bPljsypXDJvOCAOq.6 2024-09-14T11:56:13.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi', time=2024-09-14T13:52:14.946034+0000, chain.objs.size()=6 2024-09-14T11:56:13.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.1 2024-09-14T11:56:13.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.2 2024-09-14T11:56:13.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.918+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.3 2024-09-14T11:56:13.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.919+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.4 2024-09-14T11:56:13.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.919+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.5 2024-09-14T11:56:13.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.920+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.626__multipart_multipart_enc.2~02gUr-kAXdoazFUpfmlIi7E8LZPAbqi.6 2024-09-14T11:56:13.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.920+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10847754618943894521', time=2024-09-14T13:53:27.052278+0000, chain.objs.size()=10 2024-09-14T11:56:13.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.920+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.1 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.2 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.3 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.4 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.5 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.6 2024-09-14T11:56:13.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.7 2024-09-14T11:56:13.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.924+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.8 2024-09-14T11:56:13.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.924+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.9 2024-09-14T11:56:13.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.924+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.736__multipart_foo.2~CgjpHON-x1A9qMQk5pJ2hlerHyAUSwv.10 2024-09-14T11:56:13.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.924+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3092676848985198921', time=2024-09-14T13:53:47.068464+0000, chain.objs.size()=1 2024-09-14T11:56:13.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.924+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.753__shadow_.ZTYQOHEWPvVUhazrw_IBud_V-dLL6E-_0 2024-09-14T11:56:13.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.928+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:13.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.931+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:56:13.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.932+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:13.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.932+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44216' 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_S3r5QTWsNmzR6IfCbb6tnRgjmSPSGxT', time=2024-09-14T13:43:20.906178+0000, chain.objs.size()=1 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.R4dtyCeJejYG56Yt2-WiPoYXwn44uek_0 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_tUVkli3JXxDGzKm-QRa6ZhVZ7WBH5gy', time=2024-09-14T13:43:22.560798+0000, chain.objs.size()=2 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.lMWPi56CTT2A6S1EjKjhy1i0Wb5cLeM_0 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.lMWPi56CTT2A6S1EjKjhy1i0Wb5cLeM_1 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3834328837234339134', time=2024-09-14T13:43:39.783589+0000, chain.objs.size()=1 2024-09-14T11:56:13.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.179__shadow_.IoP-O54p3sR2V39SF0s7I8CF2FGHDX-_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9176257841876114118', time=2024-09-14T13:45:08.195043+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.236__shadow_.nFOSTjmKt8NLQCU7zcDD2baQtshTkO-_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12319184023899129196', time=2024-09-14T13:45:09.560992+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.238__shadow_.erha3FVjiPY8DGK2dVpoDXBhDGITNuI_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10153356585003031685', time=2024-09-14T13:45:13.097387+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244__shadow_.9Jnx-NKck9YEo1pRqpgyfe9aZNAjOts_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12419298888693784542', time=2024-09-14T13:45:15.420791+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.248__shadow_.PKq-YvaYO9XbVkqJfMYHgXWsz09QaIq_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1848600042064815595', time=2024-09-14T13:45:16.416865+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.250__shadow_.44RJVyzP7ByAyERNjSnKKl1Pb5i9xAS_0 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5613031562100542346', time=2024-09-14T13:45:30.215197+0000, chain.objs.size()=1 2024-09-14T11:56:13.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rwfaS4zYJELbX5n9NA4iZ9iNGUuBqT2_0 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10307300305310796561', time=2024-09-14T13:45:30.260600+0000, chain.objs.size()=1 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sh1YxchSONwghPaKpdLGQ6OhT60a0iI_0 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4001447803537152266', time=2024-09-14T13:45:30.273563+0000, chain.objs.size()=1 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.933+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZRGVm2x0jDWGfS8CRYjXZjIC0Bec2dG_0 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.936+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9649564354008275410', time=2024-09-14T13:45:30.322154+0000, chain.objs.size()=1 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.936+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PPBu-s4h3vr0ilugmnLwKZA8Gc5KbXL_0 2024-09-14T11:56:13.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.937+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17521673517703573404', time=2024-09-14T13:45:30.407766+0000, chain.objs.size()=1 2024-09-14T11:56:13.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.937+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0xsZe9Uk8dRCvwsM0R9UUTme2DSAC2Z_0 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2826611655421830278', time=2024-09-14T13:45:30.428562+0000, chain.objs.size()=1 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uVHCJOYARxC739p91pd3yzyKE5BBawL_0 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12658980419975076441', time=2024-09-14T13:45:30.511490+0000, chain.objs.size()=1 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W40IXKJWBOjiPWuhUjpyhNC9ZhAwUF4_0 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5885252222112732741', time=2024-09-14T13:45:30.590459+0000, chain.objs.size()=1 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wTwpMTmly4WKAFZZhZ8ur5cKdJV9kGb_0 2024-09-14T11:56:13.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2508140701208127910', time=2024-09-14T13:45:30.595134+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QIRIXIa7lXbjcw6_L8I8bWlKExCqxa2_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3197669915679162085', time=2024-09-14T13:45:30.626727+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.C5LG8GS4ZJrhAinNdOv9Lp6hQIp8GIk_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7082100962842799605', time=2024-09-14T13:45:30.632737+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ndJGYPsxDRJebKmiIcyp7AgEGCKE8np_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12871210951184110642', time=2024-09-14T13:45:30.652467+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3i91vmY2ky9GA1tzU-8qUkuP0k3Lp7v_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1212668923445697029', time=2024-09-14T13:45:30.655526+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BrgocQxpqOJzZm-U7yAOwenE8qJpIrf_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17776406576863302760', time=2024-09-14T13:45:30.793383+0000, chain.objs.size()=1 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._QXgCqfT85vBnYdH8zaNOOGWuNTNO7W_0 2024-09-14T11:56:13.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12763540703050230162', time=2024-09-14T13:45:30.859469+0000, chain.objs.size()=1 2024-09-14T11:56:13.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7oVuULxTgowF_6wdRMYRbXodnLUrYcr_0 2024-09-14T11:56:13.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.939+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14362384640662972231', time=2024-09-14T13:45:30.978695+0000, chain.objs.size()=1 2024-09-14T11:56:13.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.939+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qObTAIibbN_0eiAOyQIhFURvS2R_UXw_0 2024-09-14T11:56:13.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11746289336490964398', time=2024-09-14T13:45:30.987359+0000, chain.objs.size()=1 2024-09-14T11:56:13.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QXdPUKnbM82_mi_0E3yZEUBchcReZk8_0 2024-09-14T11:56:13.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.941+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.500959495359542710', time=2024-09-14T13:45:30.992583+0000, chain.objs.size()=1 2024-09-14T11:56:13.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.941+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0vkfMAFjGGo9XDEZJt60N09h0wQZQtE_0 2024-09-14T11:56:13.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.941+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7877708674489328035', time=2024-09-14T13:45:30.994517+0000, chain.objs.size()=1 2024-09-14T11:56:13.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.941+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.21dxmdynuS0MevmJsMCFNSoJWeV9E-y_0 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3162086586943443114', time=2024-09-14T13:45:31.001856+0000, chain.objs.size()=1 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UGAxnwoDsrxWjwySwD2wWUtvSyNYCEl_0 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1928953637754744445', time=2024-09-14T13:45:31.005419+0000, chain.objs.size()=1 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I_eZ3Y3a9TAGOuIF_4AIYPBDUedYSRh_0 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8003191023679137378', time=2024-09-14T13:45:31.047221+0000, chain.objs.size()=1 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OXWalHB9lhOVD5C0bchCCVAP9HF3wQD_0 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4058752064261075565', time=2024-09-14T13:45:31.066974+0000, chain.objs.size()=1 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dm-HmPOPXUVBAlCDFtYCCN_1BE5pM_p_0 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17581546272721970430', time=2024-09-14T13:45:31.180792+0000, chain.objs.size()=1 2024-09-14T11:56:13.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EzD1VI-eAWm6F3YEQz-ywR6VVciLURU_0 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2681888632039660664', time=2024-09-14T13:45:31.189957+0000, chain.objs.size()=1 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8hxr7zBgehaRJRxisvVrggxI9wVDF2M_0 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16191125339424873273', time=2024-09-14T13:45:31.252935+0000, chain.objs.size()=1 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.b2oVUc3YmcKwcXowAW9vJE6u9zP4YhI_0 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9838081072808586835', time=2024-09-14T13:45:31.508010+0000, chain.objs.size()=1 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rG9fGEWKAYSeUuQEpMJxhWduLxmBVAy_0 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2962808169989855498', time=2024-09-14T13:45:31.538101+0000, chain.objs.size()=1 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qtnuZOSCGeRdQhK9iwPDbFB0K6OLSEn_0 2024-09-14T11:56:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.944+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10859019590270866233', time=2024-09-14T13:45:31.549785+0000, chain.objs.size()=1 2024-09-14T11:56:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.944+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TkNn7AXStqJyrP2jZF4cId6wvkhfS5o_0 2024-09-14T11:56:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.944+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5464637448971263891', time=2024-09-14T13:45:31.559966+0000, chain.objs.size()=1 2024-09-14T11:56:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.944+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qaw4QcZ2RBx8uZI2jzWWBkCTDp8_apM_0 2024-09-14T11:56:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15209227789637912558', time=2024-09-14T13:45:31.681416+0000, chain.objs.size()=1 2024-09-14T11:56:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aO_VayyE60F2LJtorn9Bwtiu9Be8tag_0 2024-09-14T11:56:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13242537475050547562', time=2024-09-14T13:45:31.682532+0000, chain.objs.size()=1 2024-09-14T11:56:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2LEEAKRvPw1Lg28FybaUcAoB6Z4JKZ-_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15577993122858933210', time=2024-09-14T13:45:31.686862+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4O1E867jxNVJDM275QBIOAkEjdwZYCj_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15986405435498123233', time=2024-09-14T13:45:31.731292+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CokZtQI5XIgPUwbSfXLs1I5jeiIxTZT_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9674951958335156758', time=2024-09-14T13:45:31.741646+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.i6yizZMt_IX5OA54dqnTBTeyy6vhfgu_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4651781973617883174', time=2024-09-14T13:45:31.745412+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TOuffOOSpxZsx_zEzb5HviFusw4Yt5Z_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11154837908687260734', time=2024-09-14T13:45:41.288988+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.282__shadow_.tbv7puDjIdvlTCc5MsamCPlGskwxX0P_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12283686335333975412', time=2024-09-14T13:45:42.812336+0000, chain.objs.size()=1 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.285__shadow_.zDC2flvojcBHdiyxGk1QEZB2HvEVggo_0 2024-09-14T11:56:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5698893919510358363', time=2024-09-14T13:45:49.666469+0000, chain.objs.size()=1 2024-09-14T11:56:13.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.297__shadow_.29eKIuOkrDkFnlJAm9vfXLrYJ-OqEfI_0 2024-09-14T11:56:13.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.950+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13783551062226670730', time=2024-09-14T13:45:53.586580+0000, chain.objs.size()=1 2024-09-14T11:56:13.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.950+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.305__shadow_.ivx6hKh-53Vm61Dnz5nCM1Ye93GENeM_0 2024-09-14T11:56:13.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.950+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4784703685287410261', time=2024-09-14T13:45:55.520729+0000, chain.objs.size()=1 2024-09-14T11:56:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.950+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.308__shadow:egRjttP.zbG.zTRbJcz9wOb4ghELES5_.XXfi6RTvjH00fQl1wmvPcqALJA_IhmW_0 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14526848407340521761', time=2024-09-14T13:46:02.566405+0000, chain.objs.size()=1 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.323__shadow_.BYBnwPQjSOr4sATKKUMij9WmzNVE4F-_0 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9733302313774830353', time=2024-09-14T13:46:10.997110+0000, chain.objs.size()=1 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZJhgdloabqY80OJ0xP56AhfOBPvsV_R_0 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13558322075849914657', time=2024-09-14T13:46:11.011258+0000, chain.objs.size()=1 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4qoC7Mhm64C0cC6gSfuxVLtQRoaK5g1_0 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2042869478636474987', time=2024-09-14T13:46:11.034359+0000, chain.objs.size()=1 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bZ2kNU714XNzTfdkpM8oVQjyE3oyRFB_0 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13465172124112378506', time=2024-09-14T13:46:11.141207+0000, chain.objs.size()=1 2024-09-14T11:56:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._X5Mrn0Wbn9KVFbvHMgOFpJUZgGNHOL_0 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10999794642377487198', time=2024-09-14T13:46:11.148297+0000, chain.objs.size()=1 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pED2hTsgb8Ur4B_omIvfvFedjrQcH6S_0 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15966663575502507757', time=2024-09-14T13:46:11.299794+0000, chain.objs.size()=1 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.951+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nFO-Ooz19_GcsO53Du8HsMTUyVeCa4X_0 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16766686565260693513', time=2024-09-14T13:46:11.331919+0000, chain.objs.size()=1 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Fn8ZBXPL8nLUEdFzB-DWwZbbXNpDc2b_0 2024-09-14T11:56:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16399453958948074769', time=2024-09-14T13:46:11.338235+0000, chain.objs.size()=1 2024-09-14T11:56:13.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6Kg_SFJlR0iHox7VjECzqgC-8OpOUZ0_0 2024-09-14T11:56:13.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.954+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7397527616119126595', time=2024-09-14T13:46:11.348102+0000, chain.objs.size()=1 2024-09-14T11:56:13.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.954+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.23hoht4htyktBCQCBmOB3JgzhHsRp6x_0 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8723807166944637929', time=2024-09-14T13:46:11.379380+0000, chain.objs.size()=1 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EjoSDoOojXGON7U7DTLrVxigUtZ6p3-_0 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17789747195425735187', time=2024-09-14T13:46:11.386350+0000, chain.objs.size()=1 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cOrrEGniopl1v0lk1SYc40v7ll2ZMb1_0 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3109712929277381286', time=2024-09-14T13:46:11.671657+0000, chain.objs.size()=1 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.beyReD24Dx_iVpw8cFIQQnE56J-Jw8D_0 2024-09-14T11:56:13.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12527078631433262133', time=2024-09-14T13:46:11.695387+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UI_nrR9rFMH7129ihCPRjhwJkh5ndLj_0 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13278600628402532553', time=2024-09-14T13:46:11.710123+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eNoWoQFH_I67ZiUmNMDvHmFro-AJuBI_0 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13777976241245348830', time=2024-09-14T13:46:11.715553+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TOr8Kxf786DVNayTGRWCPTwR1L146-v_0 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11566864303526534260', time=2024-09-14T13:46:11.857303+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SOnnKG_BzECoX6qbqX6SbkGphMGiRTU_0 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13256380318806454446', time=2024-09-14T13:46:11.928408+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UX_Vj7A-3zDx_q-EDuihplYHXcfELfV_0 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5300297492137347976', time=2024-09-14T13:46:11.950375+0000, chain.objs.size()=1 2024-09-14T11:56:13.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qqVcEVIoMGYDWsDDm0PELCvGn2yw-MZ_0 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2053624734288375372', time=2024-09-14T13:46:12.051626+0000, chain.objs.size()=1 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.956+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.OhkqjiWzAdhCxDgJK53hlUhE_HVctgK_0 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.958+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9256857609838021683', time=2024-09-14T13:46:12.133176+0000, chain.objs.size()=1 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.958+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A1ONqc6xGIRNhO4ZvvSllTYx0IYTArs_0 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6120224540452863845', time=2024-09-14T13:46:12.436964+0000, chain.objs.size()=1 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UDN0Z-6TVouS66w2P4lreon_ikmigYP_0 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16465632112454437454', time=2024-09-14T13:46:12.460280+0000, chain.objs.size()=1 2024-09-14T11:56:13.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Eqj-nQf3QbT8JDr7QYoQXwEUUYLzdBR_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18253153498538895732', time=2024-09-14T13:46:12.508183+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.akWSElbjGOD148A--VsEHLub45NLp-S_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5330363524986413170', time=2024-09-14T13:46:12.510963+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wc2cEJbjK2suFDsd_y2YirFfUbd1yTp_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15547036770682011046', time=2024-09-14T13:46:12.603282+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pgh9HpE_ZwfLei76wTzCXLxoz5JmDkw_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6020285682647852732', time=2024-09-14T13:46:12.623020+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KEHawM-2tBewinQ0_pPVUuyUGZdRDki_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.448098683658202385', time=2024-09-14T13:46:20.723256+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sKhCoDknPV-xwlkcH8fxXdc3BDGLbop_0 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9695078568806966232', time=2024-09-14T13:46:20.726947+0000, chain.objs.size()=1 2024-09-14T11:56:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nRQ9EgDfuTvz5QJ6Mm08Llx946tn4ry_0 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16241394049359276848', time=2024-09-14T13:46:20.776098+0000, chain.objs.size()=1 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6iPla6H0151-Mffao65oR7Axxnf38qE_0 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6074921590306254610', time=2024-09-14T13:46:20.803586+0000, chain.objs.size()=1 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xKCn-l2-lmxYE5hQXo6YkbIC-3lQqlO_0 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3440070588411722467', time=2024-09-14T13:46:20.804281+0000, chain.objs.size()=1 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.960+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WnAM8m9o3fQXpf5nK_6Gc60wlQu8TX6_0 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.963+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1332815711122171367', time=2024-09-14T13:46:20.913541+0000, chain.objs.size()=1 2024-09-14T11:56:13.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.963+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xJTTcp2SrKuQ6-rWp2XucwoYS69uB1l_0 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.964+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11288970205017219299', time=2024-09-14T13:46:20.926156+0000, chain.objs.size()=1 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.964+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DcduKtgRhSGGoYPHzPKxcqWHNpW63OC_0 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12813825680300582018', time=2024-09-14T13:46:20.946230+0000, chain.objs.size()=1 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JlCGklPiF8fXv0J6swzrHqFYPu0hVtM_0 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3364937566323339125', time=2024-09-14T13:46:20.957155+0000, chain.objs.size()=1 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PXBKuCHg88fyVq1XS184v8OdtyfJRIn_0 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10340681975779456877', time=2024-09-14T13:46:20.998383+0000, chain.objs.size()=1 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ERLz1KJ3u1Qw606j7395iRGqnuM3jws_0 2024-09-14T11:56:13.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17101844817775471545', time=2024-09-14T13:46:21.086694+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KXZpFTIoXeM1h3xpIdE7eSq0EBQQoFL_0 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3760190895988428267', time=2024-09-14T13:46:21.095888+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.f2c1xw26se0M31sdyB-CCpeWBEAoLeK_0 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.59690337739917394', time=2024-09-14T13:46:21.108672+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.509IJRCadCVXptxh_U5_T9xxhzfbtAG_0 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2246016892536418565', time=2024-09-14T13:46:21.153554+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7qCRHUGFF8fvnBCt_D14HyktK2KrQQ6_0 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.316621365760927151', time=2024-09-14T13:46:21.169326+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rWnjtlYyApbJF9-zNu8mdfwZzn4keSz_0 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16997123053403737683', time=2024-09-14T13:46:21.178896+0000, chain.objs.size()=1 2024-09-14T11:56:13.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.965+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.srEeYcCkdPap52YywtriMn7SMkHPhZe_0 2024-09-14T11:56:13.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.969+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18396131417955330391', time=2024-09-14T13:46:21.182754+0000, chain.objs.size()=1 2024-09-14T11:56:13.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.969+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wiE8o1Ojyd368TwfbQ9QoBSgyt6MpN3_0 2024-09-14T11:56:13.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.969+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9360853218406527707', time=2024-09-14T13:46:21.286224+0000, chain.objs.size()=1 2024-09-14T11:56:13.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.969+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HJb90VgP6U0AlJIep1OqtLWI3al6mcW_0 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9381160356356418173', time=2024-09-14T13:46:21.303690+0000, chain.objs.size()=1 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Wo4yPzNvQdkVbZMYUqf8qJ_NxJ5752E_0 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4219460552731240489', time=2024-09-14T13:46:21.390275+0000, chain.objs.size()=1 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KDBD4znl4PWCwiVgA9Dlnt93LKnxW0G_0 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12562088571105495133', time=2024-09-14T13:46:21.502778+0000, chain.objs.size()=1 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BuBqq7TfUafM6wZOthD8A72O7X5u2c__0 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5077293153019999923', time=2024-09-14T13:46:21.506835+0000, chain.objs.size()=1 2024-09-14T11:56:13.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0dUYnj5zFnGFILz3E7sI633jjv1wE46_0 2024-09-14T11:56:13.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17351033954190413571', time=2024-09-14T13:46:21.507861+0000, chain.objs.size()=1 2024-09-14T11:56:13.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xDzLVSbWilujJ8Ow8Bx2_CNwESA8vAp_0 2024-09-14T11:56:13.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7465840690020970054', time=2024-09-14T13:46:21.511792+0000, chain.objs.size()=1 2024-09-14T11:56:13.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.t6QGQ3RAn2-Tvrck1qpdzHZdBk7PdC8_0 2024-09-14T11:56:13.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.973+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44216 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8542444089983773504', time=2024-09-14T13:46:21.515793+0000, chain.objs.size()=1 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Sy9ktWrYTf0gsbWUl5VUetQdmX-OiT1_0 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4963285824323987481', time=2024-09-14T13:46:21.855367+0000, chain.objs.size()=1 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vp_1S0NoV-xADgXFITVWXsitDv70Ksp_0 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3965024999694284747', time=2024-09-14T13:46:21.856169+0000, chain.objs.size()=1 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ltQb26_PSHq7ml2ZNs4iKB3d1es90Pl_0 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7692986664152218749', time=2024-09-14T13:46:21.882975+0000, chain.objs.size()=1 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.b9iUG8FFL8PmZeIuhejuhbXgxhax79F_0 2024-09-14T11:56:13.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3142552104624072489', time=2024-09-14T13:46:21.889580+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ol0WHasWYNqzbWsk75FI9xrdImCASPg_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9370725497034619929', time=2024-09-14T13:46:21.906342+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.a3PXdncIAM50xG8BIKsyYul1B0MEgUT_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6633938869938721489', time=2024-09-14T13:46:21.937025+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tJeizs9z_hKqnqgTHPnfwTSO9VB3xsh_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13443807440974355960', time=2024-09-14T13:46:22.138980+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2AvrDGedb8uCRtP1ECTTZsjsQZOQT39_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3889673065704706685', time=2024-09-14T13:46:22.144415+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8MQ3WKy7gsFyJNGyWDCfz5E95rurcx0_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8870913548607194528', time=2024-09-14T13:46:22.265869+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S5cvBJW2RluOkzMHsfqLNh9QZr1Kytx_0 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9627087604940586408', time=2024-09-14T13:46:22.283780+0000, chain.objs.size()=1 2024-09-14T11:56:13.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.I9QFxiwZ5UE6hHlUu3m7oeunrUdOrMP_0 2024-09-14T11:56:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1143419300973744869', time=2024-09-14T13:46:22.284531+0000, chain.objs.size()=1 2024-09-14T11:56:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0DiDxgPAlL-GRUZELctfm0RFS7rWQlR_0 2024-09-14T11:56:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15564032400655660703', time=2024-09-14T13:46:22.347713+0000, chain.objs.size()=1 2024-09-14T11:56:13.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-o_U36CYhyFbRcw9KAmA3ik3B59_-4B_0 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13933260016868389714', time=2024-09-14T13:46:22.349209+0000, chain.objs.size()=1 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Nfqyke34dJjscbaDrHMHMtOk17vMFHw_0 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14795868084782285898', time=2024-09-14T13:46:22.350105+0000, chain.objs.size()=1 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3va1FwZgt3Ub37A_yE-2RAiOjG3uvP4_0 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12649950966554822641', time=2024-09-14T13:46:42.016043+0000, chain.objs.size()=1 2024-09-14T11:56:13.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.979+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.370__shadow_.am5pkDCJf59LANckqA2GDA9XivQfm3L_0 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3612423898088985743', time=2024-09-14T13:47:24.196934+0000, chain.objs.size()=1 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.448__shadow_.kP1FrQHF01bVBWk2q4X-YvPOcfN7SgK_0 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5071031307988738363', time=2024-09-14T13:47:42.118156+0000, chain.objs.size()=1 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.mL4Hsah3h22HM3lNQg3FPSRuqB4ijjm_0 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5352660148158589085', time=2024-09-14T13:48:01.110064+0000, chain.objs.size()=6 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.1 2024-09-14T11:56:13.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.2 2024-09-14T11:56:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.3 2024-09-14T11:56:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.4 2024-09-14T11:56:13.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.5 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.520__multipart_mymultipart.2~jPKpHd2jTaaybse_Ut3HBafADLR5WwG.6 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8200385976495581747', time=2024-09-14T13:48:39.119777+0000, chain.objs.size()=1 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.538__shadow_.cLnZ_s3hYfg3M0UJvtnd_L7t71sqP7Z_0 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8874720237975423954', time=2024-09-14T13:48:59.578428+0000, chain.objs.size()=1 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.556__shadow_.jBGgOU-sxcUZ98_a9jNhvkF3UT_ptAy_0 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5973638130927525295', time=2024-09-14T13:49:03.137762+0000, chain.objs.size()=1 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.562__multipart_mymultipart.2~LGd-rDLd0TAKMLwQaByk4DdLaUXkrTj.1 2024-09-14T11:56:13.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10413980392525742389', time=2024-09-14T13:49:14.996939+0000, chain.objs.size()=1 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:SlHVNPxPs-GIfPmNSVPrrQHZRDGDGpc_.QXkxtl97yng1PtnlD4VAOi-RlHhBmZr_0 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10177116523573967642', time=2024-09-14T13:49:17.722205+0000, chain.objs.size()=1 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:IuaBwC7uopUfCKllPDE392rXWQdd743_.IrXezxltmZWEG3sjtRjPGtln3LqZPd8_0 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9225702235909100485', time=2024-09-14T13:49:25.761065+0000, chain.objs.size()=1 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:un-pwFb3aVsl.FNPFYEonn13R3D9rN8_.VJ5_PlLuMLRQG8u6f8acoEDaQauS_f-_0 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18078465076326405763', time=2024-09-14T13:49:26.532904+0000, chain.objs.size()=1 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.983+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:SeOH1gVMFa9IWRrnLLuXYTv9k.28Qbi_.vqEtfcCGpgCNsdYiyty3YVPcjIMDcPR_0 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6019909713301027857', time=2024-09-14T13:49:45.643965+0000, chain.objs.size()=1 2024-09-14T11:56:13.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:KLjwikWVcH.nJrXuX9tmxGlIsCl.84U_.GrmbmGgem-qgfEO4tCgUqKjXukS2MG5_0 2024-09-14T11:56:13.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13059635810652544992', time=2024-09-14T13:49:48.986861+0000, chain.objs.size()=1 2024-09-14T11:56:13.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.587__shadow:ufFOT6BqiLN7QA-BBl4HDPszbpkxpwd_.JmLgfQoj2DtXzqoCwha5whXa-AlQ4u7_0 2024-09-14T11:56:13.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1860282240517298412', time=2024-09-14T13:49:56.857931+0000, chain.objs.size()=1 2024-09-14T11:56:13.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.985+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.605__shadow_.4pUGT8HYSPrkJGLNlRbubOqXEVJ36BJ_0 2024-09-14T11:56:13.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.987+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17159797013746122610', time=2024-09-14T13:51:08.349819+0000, chain.objs.size()=1 2024-09-14T11:56:13.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.987+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.618__shadow_.x6ruLKtfpW6t1m1w4YAYstvJbhul_0v_0 2024-09-14T11:56:13.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.987+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5503359510681778009', time=2024-09-14T13:52:13.274072+0000, chain.objs.size()=6 2024-09-14T11:56:13.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.987+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.1 2024-09-14T11:56:13.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.990+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.2 2024-09-14T11:56:13.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.990+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.3 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.4 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.5 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.624__multipart_multipart_enc.2~ycamSSHMrV82bnkaj5-Gz9w9LXhXjKI.6 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8682640528158306349', time=2024-09-14T13:52:41.655254+0000, chain.objs.size()=1 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.680__shadow_.pseQ2ET4IQOXkpvubxZYJEAgLAY3rOJ_0 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5236564794034488030', time=2024-09-14T13:54:08.483398+0000, chain.objs.size()=1 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.777__shadow_.XbmrdphLHLEjld5B-iTsXz9BwKrE8gk_0 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11782937572046401945', time=2024-09-14T13:54:09.196448+0000, chain.objs.size()=1 2024-09-14T11:56:13.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.778__shadow_.CKrW4UKll4JvKgxvPzwoqJJqgYKa3Rm_0 2024-09-14T11:56:13.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.995+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:13.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.998+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:56:13.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.999+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:13.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:13.999+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47586' 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='__RFZQKZG0OxAhAWjRS64KKZgiFoEDPj', time=2024-09-14T13:43:22.566575+0000, chain.objs.size()=1 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.9Q-HFlojzLKC-4k7yq0mq62ilQS-7rw_0 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16347911401137377983', time=2024-09-14T13:45:07.705397+0000, chain.objs.size()=1 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.235__shadow_.-EB_wVJmk0819Ey3Sn4c036P2eqpe_M_0 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11135512638009538628', time=2024-09-14T13:45:09.560823+0000, chain.objs.size()=1 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.238__shadow_.bj9gMmWefB7uIDObr7vW8IPSoCRtTX9_0 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8069565286926884829', time=2024-09-14T13:45:21.625267+0000, chain.objs.size()=1 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.261__shadow_.h-EYmLTdIX66imIa-cvCOW9In0Zdoio_0 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12513435183094433105', time=2024-09-14T13:45:21.626860+0000, chain.objs.size()=1 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.261__shadow_.wpd9LFWBSfUeEzSpnPXXIjr_uSTLBVX_0 2024-09-14T11:56:13.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5958928139373649311', time=2024-09-14T13:45:30.240609+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Vno8sXId2WNFWPTKbi6veUAi8ZS5cWE_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1866378974976231067', time=2024-09-14T13:45:30.243314+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PUTWwwBEe7bDytvCzU6fhYpzaSduKJk_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10812395908018073891', time=2024-09-14T13:45:30.247448+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QijWuHKYnr7VwiQq6kssEY3QZ_bmify_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13950584401243921394', time=2024-09-14T13:45:30.314143+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.shWcAOOSoABBspJATjB54WUpgi4NC1m_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9198898193970814019', time=2024-09-14T13:45:30.409596+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Hq_otRaKuplFETZugZzwJV2AOWYh_i5_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8694574196766351819', time=2024-09-14T13:45:30.416921+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KH-RT1FBexC00IgtKTX3g6dovZcmdiu_0 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6052200932432097968', time=2024-09-14T13:45:30.466943+0000, chain.objs.size()=1 2024-09-14T11:56:14.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WqJd_WaZtxipj5854yBa2nw-OvtyZyv_0 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.002+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8333798376986166581', time=2024-09-14T13:45:30.496063+0000, chain.objs.size()=1 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.002+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WodOKlfqhrXCbNL8Ok4Wqjek6mobCvi_0 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.003+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17807572529379455436', time=2024-09-14T13:45:30.505616+0000, chain.objs.size()=1 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.003+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EjIxl4OcuO4Wgjt_8521ts0Ik5w9uBK_0 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1597943615227758218', time=2024-09-14T13:45:30.594532+0000, chain.objs.size()=1 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.AuOFDrBCF-OJUFaUeCIDXPEt87sZnRh_0 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15226993562666552046', time=2024-09-14T13:45:30.615835+0000, chain.objs.size()=1 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I4bliZO5WBRQTWF5kF0e7oa4rZkKIq0_0 2024-09-14T11:56:14.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4863968360807588701', time=2024-09-14T13:45:30.642446+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wpYVQ9NgsjcbXZ3ywBqBKN9V1wObxN8_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6822990552576913356', time=2024-09-14T13:45:30.816411+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Y2rUvLHlVOlfC3VMhubebUDwdPyooXG_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11295301856698239689', time=2024-09-14T13:45:30.834890+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tnc_NTz2xxc4q5DgjN-4sbMbIfw11Ux_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8270723546319612720', time=2024-09-14T13:45:30.874109+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.h2k-Q145nkZxw52SlEZvjLzlQ-Yov04_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14726899630249660928', time=2024-09-14T13:45:31.035301+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UGFy1KwJ6VsABbRKExUepmNLF8L0P4M_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9972334131679036208', time=2024-09-14T13:45:31.151206+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lsg-zkwiH_gTdHAdUpKgZ6uRJK680X4_0 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7965274150083505598', time=2024-09-14T13:45:31.189852+0000, chain.objs.size()=1 2024-09-14T11:56:14.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.29DaMTW-w_rRE2C9e0gl8RZO1fbLBtE_0 2024-09-14T11:56:14.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.005+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2561384850330364159', time=2024-09-14T13:45:31.425726+0000, chain.objs.size()=1 2024-09-14T11:56:14.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.005+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.--vyvWKSap7wxHCT4HS8GeFiW1oxwGf_0 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.006+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8699081514599924272', time=2024-09-14T13:45:31.504756+0000, chain.objs.size()=1 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.006+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Deh0IEHA7nNLZYN4P0vaTMfz0b4mKfJ_0 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.006+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11797295066433387538', time=2024-09-14T13:45:31.518174+0000, chain.objs.size()=1 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.006+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RabH_AiFczO8eIS5IjCAL-y4RYN9o1l_0 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16463935808289013277', time=2024-09-14T13:45:31.529107+0000, chain.objs.size()=1 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8Oj8Di8Z4ckhivIUq5lXbi4bo2BhmMk_0 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1985432188849456538', time=2024-09-14T13:45:31.535995+0000, chain.objs.size()=1 2024-09-14T11:56:14.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6-F92QsakGI5-CT50iE0HRKEiNHUWoK_0 2024-09-14T11:56:14.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7955224958220594783', time=2024-09-14T13:45:31.558654+0000, chain.objs.size()=1 2024-09-14T11:56:14.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e9y_5EQmaW6u9HIYaoi5h8ut1tOsfDz_0 2024-09-14T11:56:14.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13457917030056530880', time=2024-09-14T13:45:31.569127+0000, chain.objs.size()=1 2024-09-14T11:56:14.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.007+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gCR5mNCVDF4shA1RHm2dY5Z63qfhfO__0 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4952941696896328487', time=2024-09-14T13:45:31.595975+0000, chain.objs.size()=1 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6bhcN-FXHrdKffZyqho4pxR8K1wRmp0_0 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3106131349496653938', time=2024-09-14T13:45:31.608176+0000, chain.objs.size()=1 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BwjPk9FZTkY5xyzge72cCO7Ot49-iO9_0 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2433582176293481093', time=2024-09-14T13:45:31.715630+0000, chain.objs.size()=1 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.U7aLyt4-qcuNBUyye240x_Bcab-rbnx_0 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.008+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8582064513411341077', time=2024-09-14T13:45:31.726530+0000, chain.objs.size()=1 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.009+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6haxNR0ehFaRcT5ued4xb4Vs2OcVpcu_0 2024-09-14T11:56:14.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.009+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12648436066047681086', time=2024-09-14T13:45:34.233736+0000, chain.objs.size()=1 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.009+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.268__shadow_.riaXP92C1ZSE7N0rIP1kLtKb-i4EFqE_0 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1700244734268722850', time=2024-09-14T13:45:43.338543+0000, chain.objs.size()=1 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.286__shadow_.4CYppuxNMT0qP0SurN-ZKSJhktQb16T_0 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10139905331512261604', time=2024-09-14T13:45:45.731871+0000, chain.objs.size()=1 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.291__shadow_.xIQ9ReWi0Ft7rtQNT5YI3gcCLJgk1xh_0 2024-09-14T11:56:14.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9504171505907277407', time=2024-09-14T13:45:48.188747+0000, chain.objs.size()=1 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.hdqqZS3GnlW5EjF3Im3QmoWMKVlsr62_0 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13176909515455277995', time=2024-09-14T13:46:10.936990+0000, chain.objs.size()=1 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.W4_MFcx0DXHdNeSmlixT__CeudwylnU_0 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5484405295869861120', time=2024-09-14T13:46:10.944668+0000, chain.objs.size()=1 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DoTQy_kMTUTA5OfYDjU4S701PQHP0uO_0 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14003077060500085764', time=2024-09-14T13:46:10.949844+0000, chain.objs.size()=1 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TrOXmX39D77SPfx2325Q6XXvX9CxsTA_0 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18033770835183232990', time=2024-09-14T13:46:11.012747+0000, chain.objs.size()=1 2024-09-14T11:56:14.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.011+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ScqIdmE4Z3OBDfLqQHBg9p-bNm1k5Dm_0 2024-09-14T11:56:14.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.012+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1866151058605653724', time=2024-09-14T13:46:11.016697+0000, chain.objs.size()=1 2024-09-14T11:56:14.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.012+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1BWEMTJUBPoHbcuqAnZm7KqbNfYrkaf_0 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.012+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3757098220455865417', time=2024-09-14T13:46:11.019688+0000, chain.objs.size()=1 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.012+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.v75si-W-JCHLPU4PEBLDafmELG1Y2um_0 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.013+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16295340452604699045', time=2024-09-14T13:46:11.136155+0000, chain.objs.size()=1 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.013+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pWY9h3t_EsP3d0dgVhuqwr1STT01_GT_0 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.013+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10249596345360025931', time=2024-09-14T13:46:11.166937+0000, chain.objs.size()=1 2024-09-14T11:56:14.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.013+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2Qp-w1JOjm3zQUzplALjaFkDU6oN4se_0 2024-09-14T11:56:14.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.014+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11373665226278226805', time=2024-09-14T13:46:11.203542+0000, chain.objs.size()=1 2024-09-14T11:56:14.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.014+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gtrN_enzLuxVSPNaw6ctlnT_LAeOgLH_0 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8745431740587516147', time=2024-09-14T13:46:11.312864+0000, chain.objs.size()=1 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gDWyvygXb8XruI8phJzbv0oCp0yyMwa_0 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2205768101886250962', time=2024-09-14T13:46:11.319402+0000, chain.objs.size()=1 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.16xi4DpzSnqwFWltZmkBxvKJaHzfJBD_0 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10208261529370701756', time=2024-09-14T13:46:11.411555+0000, chain.objs.size()=1 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KM74LYlQFL-4TWibwwZzY3SFEFim2rX_0 2024-09-14T11:56:14.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3647944214866412788', time=2024-09-14T13:46:11.416764+0000, chain.objs.size()=1 2024-09-14T11:56:14.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zRDcZKRWFN5TGZYjEA-LWuwxUenCX7f_0 2024-09-14T11:56:14.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10672937127659178346', time=2024-09-14T13:46:11.572795+0000, chain.objs.size()=1 2024-09-14T11:56:14.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6MB_sfmYFmMv6RkMyGz9V4bx5PXpsTO_0 2024-09-14T11:56:14.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15251342895621866989', time=2024-09-14T13:46:11.649955+0000, chain.objs.size()=1 2024-09-14T11:56:14.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.u4Zjk74IYkW4w1gL_khM_kf3-HTGvuH_0 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7164291921265424743', time=2024-09-14T13:46:11.651733+0000, chain.objs.size()=1 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hNiGKEMxNLoi7iNm92-CBNjkJISzxqD_0 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14479808256029844611', time=2024-09-14T13:46:11.659743+0000, chain.objs.size()=1 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.t1x6E8O9mFDV8Ur79QcBqXtNRoc36r8_0 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4139785558594491439', time=2024-09-14T13:46:11.704906+0000, chain.objs.size()=1 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nPdsXB4-U6ccpqnyAoHIGSW72hNOygo_0 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15955219049515160262', time=2024-09-14T13:46:11.716508+0000, chain.objs.size()=1 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bNoCL_z8HAYqlZEvVMqg39iZz1iY30h_0 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9377318359933240974', time=2024-09-14T13:46:11.725255+0000, chain.objs.size()=1 2024-09-14T11:56:14.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.017+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Pwqrv7UFAKIhcIyMeZGLD8oCk2KUhGq_0 2024-09-14T11:56:14.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2500484063222543826', time=2024-09-14T13:46:11.757114+0000, chain.objs.size()=1 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LkKqy9aFUWD9q18tzEH3QskcDHIMsPO_0 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8743695449963640304', time=2024-09-14T13:46:11.881129+0000, chain.objs.size()=1 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.O_8vktGUCl6wPdNeCs8Lr98x7xKnMWt_0 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3690233083702038067', time=2024-09-14T13:46:11.900280+0000, chain.objs.size()=1 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mvfwXDFgkwDB-_ohtmaCPyCZFhZt5p1_0 2024-09-14T11:56:14.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15434649726782870228', time=2024-09-14T13:46:11.916635+0000, chain.objs.size()=1 2024-09-14T11:56:14.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.U0Vpfrve0pQkRh8I-XEX4xBvKfgGKNZ_0 2024-09-14T11:56:14.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11149039219373698590', time=2024-09-14T13:46:11.928933+0000, chain.objs.size()=1 2024-09-14T11:56:14.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.t94tVRL515LySsUXY_47LcL1mW5nh5q_0 2024-09-14T11:56:14.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5836037683643266389', time=2024-09-14T13:46:11.940333+0000, chain.objs.size()=1 2024-09-14T11:56:14.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.020+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.f45zx8exr5G6Rwx9HPIyaEkSigwiCjR_0 2024-09-14T11:56:14.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7551041615143728006', time=2024-09-14T13:46:11.941930+0000, chain.objs.size()=1 2024-09-14T11:56:14.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z1_M1BxwSgSlN1NoTlRSs4vy375RgK1_0 2024-09-14T11:56:14.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5434836295270589882', time=2024-09-14T13:46:11.947173+0000, chain.objs.size()=1 2024-09-14T11:56:14.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xSTWV2oemjY3lIzyAgnQbnR2JGEL_kq_0 2024-09-14T11:56:14.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6317472895163089771', time=2024-09-14T13:46:12.033677+0000, chain.objs.size()=1 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.U0m3hT73siiQcpQFFG1sKlYjBF9f00C_0 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6862545464355678517', time=2024-09-14T13:46:12.043930+0000, chain.objs.size()=1 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PPfL3yyc-FcDn0poqW0LKXbUMrkZd-8_0 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8390481325026494761', time=2024-09-14T13:46:12.108421+0000, chain.objs.size()=1 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.021+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uOlA8mFNnPUagheP8si8_0k3JZS4GC9_0 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.022+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12260346514424177104', time=2024-09-14T13:46:12.139068+0000, chain.objs.size()=1 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.022+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yAY5UVHFgud_OpADG0ndaSFBhIECu7M_0 2024-09-14T11:56:14.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.022+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13445740741142289570', time=2024-09-14T13:46:12.448681+0000, chain.objs.size()=1 2024-09-14T11:56:14.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.022+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bGJ_yap8RkKCjArHo94I43fIhkfHvK3_0 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7457372874541723409', time=2024-09-14T13:46:12.473576+0000, chain.objs.size()=1 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eup5gb4tQe9clW7DK04wTSD5GNjgmyq_0 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6466688427215691144', time=2024-09-14T13:46:12.504087+0000, chain.objs.size()=1 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.atdkG3hup2WJAqHEHjo5fRhiD1sLM5i_0 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1891507537060969290', time=2024-09-14T13:46:12.512159+0000, chain.objs.size()=1 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gSit904JpPLnJynj4xoHt2HA4XV89YO_0 2024-09-14T11:56:14.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11118734317901745753', time=2024-09-14T13:46:12.513294+0000, chain.objs.size()=1 2024-09-14T11:56:14.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RQUuiOUYq9MzuYVXTCT69Srs6uvEFoo_0 2024-09-14T11:56:14.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17060061777639080857', time=2024-09-14T13:46:12.524513+0000, chain.objs.size()=1 2024-09-14T11:56:14.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.X_7bVp9MaYpJzh9w9raNm7oZEAn0lFf_0 2024-09-14T11:56:14.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.718806541271177000', time=2024-09-14T13:46:12.629333+0000, chain.objs.size()=1 2024-09-14T11:56:14.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.024+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WvvrGH1Ai_yN8Nso19gsQ4DZLz_JXIZ_0 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8720937844344189797', time=2024-09-14T13:46:12.642876+0000, chain.objs.size()=1 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.H9ZTyvtw1NM9QUpfGXL5Oid1HlIrtob_0 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12114267106133303677', time=2024-09-14T13:46:12.674617+0000, chain.objs.size()=1 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tAhVdfZOIgxloQ1HX491mYK2iFqNZlB_0 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6958119411524673772', time=2024-09-14T13:46:12.682426+0000, chain.objs.size()=1 2024-09-14T11:56:14.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Tj_qI5Nl_wRlk2OZ9iRa6Ai9o649rBJ_0 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17973021648722408545', time=2024-09-14T13:46:20.710716+0000, chain.objs.size()=1 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eJjpiiX1gu2D5IybSFEaI2Gl7W9gJCv_0 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16209559332989519565', time=2024-09-14T13:46:20.803278+0000, chain.objs.size()=1 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Lkp2npRTiqEe6ASt698xNf2DrbmGlV2_0 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8682190042693246021', time=2024-09-14T13:46:20.912484+0000, chain.objs.size()=1 2024-09-14T11:56:14.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rGkGgOVfd4X2HN2vrwwTJUr5f8hBGWE_0 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16634675651483343204', time=2024-09-14T13:46:20.939997+0000, chain.objs.size()=1 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4RGxAUM83_Kkf8oa8vw9JlfAri6BzE-_0 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5348387041019438524', time=2024-09-14T13:46:20.947701+0000, chain.objs.size()=1 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fAQ4fue0zgnIDD430hVf4SJbEABFpFU_0 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14980879204515397568', time=2024-09-14T13:46:20.983275+0000, chain.objs.size()=1 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fqdBLlLEkferMQMsFK5858M-1xl6HR-_0 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16685764938520892121', time=2024-09-14T13:46:20.994146+0000, chain.objs.size()=1 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Nvr1DmagwY5k1xL-xuoy-CcmbnB4ySq_0 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6386780345527257121', time=2024-09-14T13:46:21.202986+0000, chain.objs.size()=1 2024-09-14T11:56:14.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.029+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.hG3XPDmKzQOTOrso9MIGZdI9B7UEO2A_0 2024-09-14T11:56:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.030+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5005583414158952393', time=2024-09-14T13:46:21.301266+0000, chain.objs.size()=1 2024-09-14T11:56:14.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.030+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IWzacmZKdcC8VYfGdcqQzXxV70pJClB_0 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14246755998517354372', time=2024-09-14T13:46:21.389369+0000, chain.objs.size()=1 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EmHzteaJip_3XnCVuTT8Un3bP_nb2nH_0 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18216468315238164320', time=2024-09-14T13:46:21.495662+0000, chain.objs.size()=1 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-cno2UgsiiOKSI28ASe_a5exQg58511_0 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13421285379647108658', time=2024-09-14T13:46:21.756755+0000, chain.objs.size()=1 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DcIG9yeRdpMzZcQ-i2JzdugXAk6s9Pj_0 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17942840411064041713', time=2024-09-14T13:46:21.761324+0000, chain.objs.size()=1 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZMlu2L8uqhd-Mwb-7rnj86nWYo68QW6_0 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5536578001181016667', time=2024-09-14T13:46:21.853531+0000, chain.objs.size()=1 2024-09-14T11:56:14.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.hz9MYmOCrU4tIwRk3N0AvAxw4XgsIEP_0 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12965301392155086749', time=2024-09-14T13:46:21.873716+0000, chain.objs.size()=1 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.If3nGstZSa1MgWMqDMNVaKq8l2I06J4_0 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3770632114059067844', time=2024-09-14T13:46:21.898749+0000, chain.objs.size()=1 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fiwKCiARmY08u7axFaFAajTnqMA-tKE_0 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6424949090861019459', time=2024-09-14T13:46:21.908277+0000, chain.objs.size()=1 2024-09-14T11:56:14.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VFsyNxjwToM8hV0VveSvHPsg50z7owp_0 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.033+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8646565593618836200', time=2024-09-14T13:46:21.910127+0000, chain.objs.size()=1 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.033+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.24wRFon0U8_3h8vWXTmKqGuDPB4YONb_0 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.033+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2943113892161777143', time=2024-09-14T13:46:22.078638+0000, chain.objs.size()=1 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.033+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QlBU97uep5A19RFtHeeVCwu1VX15-5D_0 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.034+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1997980811392272600', time=2024-09-14T13:46:22.124495+0000, chain.objs.size()=1 2024-09-14T11:56:14.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.034+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aJ3soL0WHtFx1eeEvSHHGXli0wECijL_0 2024-09-14T11:56:14.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.037+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47586 2024-09-14T11:56:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:56:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13853368030695850926', time=2024-09-14T13:46:22.131808+0000, chain.objs.size()=1 2024-09-14T11:56:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lUOWA_jSCOCLNw-VuRfJw8idOVu6yGt_0 2024-09-14T11:56:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12701632695279893351', time=2024-09-14T13:46:22.137546+0000, chain.objs.size()=1 2024-09-14T11:56:14.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1SmtDwa0S3Hoe9r6ZUWmUr0lWb3zmIM_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5342764193338002538', time=2024-09-14T13:46:22.264050+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LJY_sWVM-w_JSyYoLHXs6FKNBsccFF1_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10146196017474623760', time=2024-09-14T13:46:22.284181+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VTF9du9zsXyWaxxL7qaHkOufWa-jEJe_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1390423984895257676', time=2024-09-14T13:46:22.349832+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ohuNMvMzC86BfvB4qwGMERzicL_3KZg_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15381755379714439049', time=2024-09-14T13:46:31.109723+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.344__shadow_.rvKXeiWNBHwMxcXO2nI6DVlBhyKtq99_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14041375572843721533', time=2024-09-14T13:47:17.327164+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.436__shadow_.tzF1cFDDnuHAy_2hywD9cDU7GTGhsle_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8639291822751548833', time=2024-09-14T13:47:30.756202+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.459__shadow_.GzuuyG9wbaROx_hS9XAq5Dljx0lfijH_0 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3804860090833817701', time=2024-09-14T13:47:35.660994+0000, chain.objs.size()=1 2024-09-14T11:56:14.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466__shadow_.kvfMUMd5KEeXMR1AK94_Lvi88f9KtyA_0 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17434960878964346149', time=2024-09-14T13:47:55.264952+0000, chain.objs.size()=1 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.512__multipart_mymultipart.2~pKjaXApzvDKizwZ64x-pqV4t_cYeRTy.1 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11390942492346302406', time=2024-09-14T13:49:02.023558+0000, chain.objs.size()=1 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.560__shadow_.5C-IARrL6HUgWFg9rgVWF7cEx5U3nME_0 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12398327314103685458', time=2024-09-14T13:49:21.268354+0000, chain.objs.size()=1 2024-09-14T11:56:14.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow_.FVdnsREvJmAOEq1z94RvNkjLJpb8J3I_0 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2077876755408146267', time=2024-09-14T13:49:33.195708+0000, chain.objs.size()=1 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:SwW8W9q3pR4jEd0b-FGey7IobV3t1ui_.LVs430C0ZKkWHeJWFZiOo7FpewSbxl3_0 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17063540189350545632', time=2024-09-14T13:49:35.915903+0000, chain.objs.size()=1 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:vri7v1toHFAvWYlj5PfH89bPgf2Zd-G_.f_6LAsR682EUXgE0R3Kg_KvVe8Zrqx0_0 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12972182093129442002', time=2024-09-14T13:49:36.606623+0000, chain.objs.size()=1 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:CvKeOkeDnMhlFmTUpaUTuA.DWYFOOP._.LKG0LLqMN4EF_-4tZVPt2PB-MFXxD-P_0 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17424583407297153424', time=2024-09-14T13:49:38.376996+0000, chain.objs.size()=1 2024-09-14T11:56:14.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:DdmfvMgEl5CtqLzBb84uOuwnYyyAn78_.kBvj4dOkZf0EMAUJJYFxyyZZQkyZSgC_0 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13159777686707881366', time=2024-09-14T13:49:38.830817+0000, chain.objs.size()=1 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:owb-ynRTLFXdjprtjCfpDIWyc2g19dn_.vvRVtWpYS84Yj3alftriu5MZj7dV-LR_0 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14001017573205517068', time=2024-09-14T13:49:43.022493+0000, chain.objs.size()=4 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~DxLlT_XgdVVMsGyPgHewVo8UaFlKStk.1 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~DxLlT_XgdVVMsGyPgHewVo8UaFlKStk.2 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~DxLlT_XgdVVMsGyPgHewVo8UaFlKStk.3 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~DxLlT_XgdVVMsGyPgHewVo8UaFlKStk.4 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4224201982474197190', time=2024-09-14T13:49:45.646217+0000, chain.objs.size()=1 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:YffzSNWiqnK6xw.eMu-NfhgJm5kMeJd_.8_3hIjmLpfaEQtp3Pt6A2tbMZ3U-3MG_0 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15313022669191559413', time=2024-09-14T13:49:46.223369+0000, chain.objs.size()=1 2024-09-14T11:56:14.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.044+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.583__shadow:KY2JwQrYeSMJ-HMyWEgGKmhbS4-1T0z_.oJqbSLzgNqHm7xE-TpPrJsJsMr16nd7_0 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12020391589155181069', time=2024-09-14T13:49:49.527339+0000, chain.objs.size()=1 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:NILt8kUL2neyALVye178hWji0YCnInT_.T_exO69yE4j9LIFWlO-YZJtN0pjqlGK_0 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2265380195447163301', time=2024-09-14T13:50:05.474816+0000, chain.objs.size()=6 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.1 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.2 2024-09-14T11:56:14.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.045+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.3 2024-09-14T11:56:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.047+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.4 2024-09-14T11:56:14.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.047+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.5 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.615__multipart_multipart_enc.2~Oh3I-tVCmK1mNjPjLQs6Mf1MLlQ5-2A.6 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10111581928708409509', time=2024-09-14T13:52:22.031891+0000, chain.objs.size()=1 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.641__shadow_.g1bpWVlXo3eLC919cKQFn2N_lDIFFNB_0 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17604974261410383912', time=2024-09-14T13:52:51.509668+0000, chain.objs.size()=1 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.703__multipart_file1.2~CIbwHtbmnQg5MdoS40Hx6bwiaqeN-tt.1 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9524227635414202615', time=2024-09-14T13:53:51.389003+0000, chain.objs.size()=1 2024-09-14T11:56:14.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.759__shadow_.trEC4gEHM1O1MuF2nmJ9h6fUm9HcCMe_0 2024-09-14T11:56:14.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.053+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.055+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:56:14.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.056+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.057+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44027' 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11632499699915872566', time=2024-09-14T13:43:21.786840+0000, chain.objs.size()=3 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-LUKEWARM.2~FgwzsdNjrGX-kek7Jd3ye2vZGoz9Ba_.1 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-LUKEWARM.2~FgwzsdNjrGX-kek7Jd3ye2vZGoz9Ba_.2 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-LUKEWARM.2~FgwzsdNjrGX-kek7Jd3ye2vZGoz9Ba_.3 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7736348628226773087', time=2024-09-14T13:45:08.194553+0000, chain.objs.size()=1 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.236__shadow_.2cTpq18DJJIqa7UVT3eOMtEvFy5_pc2_0 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13139425167778418104', time=2024-09-14T13:45:08.683019+0000, chain.objs.size()=1 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.237__shadow_.EplNb46afjuvdF94eADSTA6E7bxtwxJ_0 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4918026030346481734', time=2024-09-14T13:45:16.416834+0000, chain.objs.size()=1 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.250__shadow_.hB9rCYo8cTRzox4ip94SE29GN8eNJJR_0 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14907066592408129383', time=2024-09-14T13:45:30.228079+0000, chain.objs.size()=1 2024-09-14T11:56:14.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VsW_lrJifmwR3bYcAF6niTMYP4bN1Ig_0 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.477921862123505556', time=2024-09-14T13:45:30.275421+0000, chain.objs.size()=1 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ExhICi3haRHPlyrridgHFBem5dSMSzP_0 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3738852332898415560', time=2024-09-14T13:45:30.419122+0000, chain.objs.size()=1 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MCjK8oPBgXPKBcajsvuR5uESnExFjGN_0 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9847237993265728903', time=2024-09-14T13:45:30.481227+0000, chain.objs.size()=1 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.64ICbTNOJJQeX2vkCsB7eOot46R41-e_0 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8786199290037129048', time=2024-09-14T13:45:30.514320+0000, chain.objs.size()=1 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sSkrj5iPSiRT7BByPwpNMXaCguwjcX5_0 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2463877534273420798', time=2024-09-14T13:45:30.613267+0000, chain.objs.size()=1 2024-09-14T11:56:14.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.k4gjmtJLhWZ3jALgzGjXgmYboSSRABE_0 2024-09-14T11:56:14.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.061+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13922936383037570505', time=2024-09-14T13:45:30.635054+0000, chain.objs.size()=1 2024-09-14T11:56:14.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.061+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VsXcxLeKR1HtuwudGcVWihkW4AMeYjL_0 2024-09-14T11:56:14.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7948022557383362418', time=2024-09-14T13:45:30.639307+0000, chain.objs.size()=1 2024-09-14T11:56:14.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ngx45_MDKpWA4KrJu1-27hgoqhHF-Kr_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15492839406238633557', time=2024-09-14T13:45:30.662183+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.u8F6CPxHI_KcIACNJRulpeW1258RfcI_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3886062007185261006', time=2024-09-14T13:45:30.668263+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GUTK_Z1Z_M2za1fEMfrvKF4TOn2aVyp_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7446541386918742430', time=2024-09-14T13:45:30.790118+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.H3BlJXsLVLPdDWfBHHTD-wrDQyNIuPg_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8095435279985556273', time=2024-09-14T13:45:30.859260+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WgcimUuJ3DUeZJu8FwEsCU5RgNXPmFB_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7760680394628382490', time=2024-09-14T13:45:30.861937+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2dJLUhQHYjrJlZ047unhkN7miSyYlHD_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8945248684082218926', time=2024-09-14T13:45:30.868277+0000, chain.objs.size()=1 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.biNIjxPW6TxOK60gFFMpDmAGDeq32ut_0 2024-09-14T11:56:14.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4760506631589234354', time=2024-09-14T13:45:31.035098+0000, chain.objs.size()=1 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hfc-pkeZHNr32T3Ffjg_aF4TDXEg1w6_0 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4232042319796048153', time=2024-09-14T13:45:31.051821+0000, chain.objs.size()=1 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NpA6-APWsUqA-RlBXtcgdg5zI5MD79C_0 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18006528295127448455', time=2024-09-14T13:45:31.199346+0000, chain.objs.size()=1 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.A9waosN4UwQbcBy6QLZVquWNcNj7GGy_0 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.064+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13588417014055077231', time=2024-09-14T13:45:31.213391+0000, chain.objs.size()=1 2024-09-14T11:56:14.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.064+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.niSVaOYn6keueHrJCHV__1TZVNtKavK_0 2024-09-14T11:56:14.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.065+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11130785776909655079', time=2024-09-14T13:45:31.219079+0000, chain.objs.size()=1 2024-09-14T11:56:14.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.065+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bkhee5yos4oC7IKxZV_ZRcPyZqQ3kse_0 2024-09-14T11:56:14.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.066+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11370803630384425373', time=2024-09-14T13:45:31.234442+0000, chain.objs.size()=1 2024-09-14T11:56:14.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.066+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ca78Q_So6Iq1o6bWB0CPpAvDGAQk1Ai_0 2024-09-14T11:56:14.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.066+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3327493550852487027', time=2024-09-14T13:45:31.502074+0000, chain.objs.size()=1 2024-09-14T11:56:14.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.066+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TvnxRQvMtHXVEoNpV5_DcvQDIt2vqlF_0 2024-09-14T11:56:14.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5108240704740065693', time=2024-09-14T13:45:31.539438+0000, chain.objs.size()=1 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nhzh6zRDqpMM7pq_iJPMhV_B1sUyD4j_0 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15449722942268382532', time=2024-09-14T13:45:31.685239+0000, chain.objs.size()=1 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ca2w9OjNagwX3L86ReDCYlz5hEJi73h_0 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10846626019408257224', time=2024-09-14T13:45:31.712742+0000, chain.objs.size()=1 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.j0cNFZWL_4ukTwb29wa80xfIEGxATOJ_0 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2724738269078626439', time=2024-09-14T13:45:31.728073+0000, chain.objs.size()=1 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.M-2HRtZaoE0p82WDwd2ONEFGXjCpv_Q_0 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6838103922025912660', time=2024-09-14T13:45:41.287494+0000, chain.objs.size()=1 2024-09-14T11:56:14.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.282__shadow_.s_pkBdVVZqc4K595x3dcVfTKsZ04wje_0 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1957429064263181669', time=2024-09-14T13:45:44.334953+0000, chain.objs.size()=1 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.288__shadow_.I-ty4vmg7cXdHHdIQYkGeA63GCLUbWW_0 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8617705500386739451', time=2024-09-14T13:45:47.350665+0000, chain.objs.size()=1 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.067+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.ZM0q2YBk1KhNrrXu8dSOoge2G2Hkv3L_0 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.068+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14345109455522835587', time=2024-09-14T13:45:48.190243+0000, chain.objs.size()=1 2024-09-14T11:56:14.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.068+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.CPZ5lBGhX0lhHqFioTPDCCTTm0IPEjc_0 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15844378010519739057', time=2024-09-14T13:46:01.459173+0000, chain.objs.size()=1 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.320__shadow:oitq3y3ssOuNN.a-2byA3LLtAOauMgw_.0R7rVA4OOsYocmm9ChrxWzf3d-41zrv_0 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.826387837788776961', time=2024-09-14T13:46:10.920543+0000, chain.objs.size()=1 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.w1GOd0Zq53oRge7F7BqiYXChPAPANKr_0 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9018660768027464922', time=2024-09-14T13:46:10.927452+0000, chain.objs.size()=1 2024-09-14T11:56:14.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z-y9Xhc3FdKW-L_4tKtglQ6L9KkzjdD_0 2024-09-14T11:56:14.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2000229371069224775', time=2024-09-14T13:46:10.965534+0000, chain.objs.size()=1 2024-09-14T11:56:14.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7FvImmnlDyO2kdz01BmbWlMuxJmRb1E_0 2024-09-14T11:56:14.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17235435688438703397', time=2024-09-14T13:46:10.999340+0000, chain.objs.size()=1 2024-09-14T11:56:14.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IfFahTlS7eSAeLtWuwcw2u_8TH1Nbnf_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6660230174668799256', time=2024-09-14T13:46:11.125585+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-9B5PJ-Pu9zuSmUGTbIeXgCQXu8BUH2_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14933217757701145729', time=2024-09-14T13:46:11.126552+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1b8ZXpJZyNgLPOLp_g1jnX9NH8vfZHH_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15876324044722994854', time=2024-09-14T13:46:11.155595+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.psZ9KLwjAzCJ_4o6i2ey7giyLhMlbUy_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16454103861866928848', time=2024-09-14T13:46:11.169579+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._eS6mWHotZNf4QDR2Ma9wkjMs4bURqt_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9461110297123682072', time=2024-09-14T13:46:11.172555+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dF2bApVcIcC2GoC0x4WTsNMvityj3Zv_0 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15413483313771671360', time=2024-09-14T13:46:11.210385+0000, chain.objs.size()=1 2024-09-14T11:56:14.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.071+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BUqgsxkymvKEHMzUesLUS957mhDyLl8_0 2024-09-14T11:56:14.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9693751072074356175', time=2024-09-14T13:46:11.221316+0000, chain.objs.size()=1 2024-09-14T11:56:14.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CdZW9S9SgxqcHGddhPEpGwVX7Q4Bwwv_0 2024-09-14T11:56:14.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6542426735191788866', time=2024-09-14T13:46:11.310266+0000, chain.objs.size()=1 2024-09-14T11:56:14.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XFDeGxAbXPRZYgS_MKom1VS0rMrgsYc_0 2024-09-14T11:56:14.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16790123251325924839', time=2024-09-14T13:46:11.333399+0000, chain.objs.size()=1 2024-09-14T11:56:14.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.073+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mnmsTAQH-NU6qabl7rzbqt-E1aBrafy_0 2024-09-14T11:56:14.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17650605188563694378', time=2024-09-14T13:46:11.571259+0000, chain.objs.size()=1 2024-09-14T11:56:14.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6ZlNrjn1DLVqczBGCANji-MAgQr2EQ1_0 2024-09-14T11:56:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3027636707508959032', time=2024-09-14T13:46:11.574108+0000, chain.objs.size()=1 2024-09-14T11:56:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jV_VSZehSBPVBbmVh8vNxW1a_uSCNI__0 2024-09-14T11:56:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16575127725235983311', time=2024-09-14T13:46:11.667756+0000, chain.objs.size()=1 2024-09-14T11:56:14.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.075+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YC-yo4_pzNF_PLpeUct0roiXDu2lebp_0 2024-09-14T11:56:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.076+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9728213055530968083', time=2024-09-14T13:46:11.685734+0000, chain.objs.size()=1 2024-09-14T11:56:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.076+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AtWN1P5wVa33PZ-1xMx9S7FPZBPxg2I_0 2024-09-14T11:56:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.076+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12953528863391032587', time=2024-09-14T13:46:11.688979+0000, chain.objs.size()=1 2024-09-14T11:56:14.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.076+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-eyNjSUrPhjnSoFQg4Y0Bz0-GHT7_Gy_0 2024-09-14T11:56:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3475390582051875960', time=2024-09-14T13:46:11.696234+0000, chain.objs.size()=1 2024-09-14T11:56:14.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HVyiM2lSTrIKGhWs0qpLhGjBvHBUwRb_0 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7425499004943707030', time=2024-09-14T13:46:11.733405+0000, chain.objs.size()=1 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Z7Zs5vgpMfjUEtxursaT6VeNJ3Yt2fW_0 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7826927598864310937', time=2024-09-14T13:46:11.745970+0000, chain.objs.size()=1 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JKgWk0eYV48WZ-3awAetqQp2eqKc0A8_0 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4867302172723534368', time=2024-09-14T13:46:11.886386+0000, chain.objs.size()=1 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JVzyd4SPUVjw5oz094pmej64ygACQW__0 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7088704653438704676', time=2024-09-14T13:46:12.027492+0000, chain.objs.size()=1 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3X4cj0DeTf59mdaYIUCsWkMjP_Bcopr_0 2024-09-14T11:56:14.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7402302387954133380', time=2024-09-14T13:46:12.071743+0000, chain.objs.size()=1 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2c89AGeIvrN9iFCdA9dY0MKpE3-xjhv_0 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7600746086514075843', time=2024-09-14T13:46:12.107115+0000, chain.objs.size()=1 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DGeQ890eN1ybbLUH8YG1JgYsfGitZjz_0 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12838407765797494460', time=2024-09-14T13:46:12.132391+0000, chain.objs.size()=1 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.078+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-3V5X7VOAN_vK510mRqWNMyRB1ZGobv_0 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6473632206720852366', time=2024-09-14T13:46:12.219285+0000, chain.objs.size()=1 2024-09-14T11:56:14.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wn3BQZMub7Bd1ZKEZ0MnydSlNZTYzVF_0 2024-09-14T11:56:14.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.514918546807462783', time=2024-09-14T13:46:12.455079+0000, chain.objs.size()=1 2024-09-14T11:56:14.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Ls_owF06C5i6UihkyBRantucjfXmzq__0 2024-09-14T11:56:14.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14585986491716394804', time=2024-09-14T13:46:12.460661+0000, chain.objs.size()=1 2024-09-14T11:56:14.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tcuKgYKe7iC2glwh8ew0AwBcLXVIOTX_0 2024-09-14T11:56:14.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16824849046623219597', time=2024-09-14T13:46:12.475415+0000, chain.objs.size()=1 2024-09-14T11:56:14.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IsMKTCoyQd8O6BYtmm67HL5m7lh1XLR_0 2024-09-14T11:56:14.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10658348504240920916', time=2024-09-14T13:46:12.486407+0000, chain.objs.size()=1 2024-09-14T11:56:14.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JkX5P6IqmG9wlsQVbKo2HUVBhwxZ1fj_0 2024-09-14T11:56:14.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3010284888815140277', time=2024-09-14T13:46:12.511246+0000, chain.objs.size()=1 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ujgwWGI4lENVDsysIC4SCVwq4DXcCOR_0 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1611901880690512493', time=2024-09-14T13:46:12.525252+0000, chain.objs.size()=1 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pOilEa07x1N3l3-EutylJYCH4xqT8-B_0 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12369239257255984594', time=2024-09-14T13:46:12.527367+0000, chain.objs.size()=1 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.081+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.x8HyaAk79xAC6WSZ3NsmgpnpBF2hVhw_0 2024-09-14T11:56:14.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8693681751413046379', time=2024-09-14T13:46:12.665835+0000, chain.objs.size()=1 2024-09-14T11:56:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fXw3jZWDYbG9CJYH31WXZlTzddyZZoF_0 2024-09-14T11:56:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5050562937852320304', time=2024-09-14T13:46:20.714564+0000, chain.objs.size()=1 2024-09-14T11:56:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LpqMUmJdaJE7lfm7zJNy7U4CHoeIKT3_0 2024-09-14T11:56:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.367790758860390680', time=2024-09-14T13:46:20.782011+0000, chain.objs.size()=1 2024-09-14T11:56:14.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8hy78g8y83OCwBYYvu0a3TJ7fYYmQ2J_0 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3651417073141706105', time=2024-09-14T13:46:20.817611+0000, chain.objs.size()=1 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2qnpDdv6L3UINcMqsDrl7laTP8QWBi4_0 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12264980352246921246', time=2024-09-14T13:46:20.823350+0000, chain.objs.size()=1 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GDSb-4lnM3cvlOeHPIgDKCUNhiubMLF_0 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2089051216033508582', time=2024-09-14T13:46:20.939244+0000, chain.objs.size()=1 2024-09-14T11:56:14.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RHAJrssjf2zUnqtYcfTm5KHA99_sPkT_0 2024-09-14T11:56:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15722079313571717068', time=2024-09-14T13:46:20.985290+0000, chain.objs.size()=1 2024-09-14T11:56:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vsEraVNRF4YfymvtwUWv3Y5U-Jxv_db_0 2024-09-14T11:56:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6160293997635185518', time=2024-09-14T13:46:21.092395+0000, chain.objs.size()=1 2024-09-14T11:56:14.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7Bz37OFgXXMumx_suZVeKdw6C_TZU6n_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4579083059540592112', time=2024-09-14T13:46:21.106478+0000, chain.objs.size()=1 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BABBM9YSQS9Gxnj9qo4wXtrTf-5FfYP_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10475141067990884329', time=2024-09-14T13:46:21.133628+0000, chain.objs.size()=1 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.G-XYbpOTlothtux5DbJFoCqAECQhagt_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12468602174766988378', time=2024-09-14T13:46:21.170393+0000, chain.objs.size()=1 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.085+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Z5jYDP_luJLb1NYEkX3jzhieamLivnC_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.086+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13364308256257192661', time=2024-09-14T13:46:21.186646+0000, chain.objs.size()=1 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.086+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3794eI-Z_hfLGd_PABeIi61La0EE7KH_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.086+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14192940586357080622', time=2024-09-14T13:46:21.287500+0000, chain.objs.size()=1 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.086+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.R9kHuXoku1wMt-VBYlodNw4eGoM1Dd6_0 2024-09-14T11:56:14.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.087+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256726936020457996', time=2024-09-14T13:46:21.353376+0000, chain.objs.size()=1 2024-09-14T11:56:14.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.087+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5ZUG9ryBrZP_9vIKdtLswoPZ1k-dupG_0 2024-09-14T11:56:14.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.087+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12001252603404271254', time=2024-09-14T13:46:21.360770+0000, chain.objs.size()=1 2024-09-14T11:56:14.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.087+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yLbcB3-9TVYjHl-OIUScX8y8u7KVQh5_0 2024-09-14T11:56:14.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2097645905839518467', time=2024-09-14T13:46:21.481791+0000, chain.objs.size()=1 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZQYSRVCbXgC9utCXIeUULayEWptYr1w_0 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18206460958831578398', time=2024-09-14T13:46:21.483963+0000, chain.objs.size()=1 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FFDPMQkdHSRBSZSxggTGMz4FGw4IVH7_0 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5358871279966669856', time=2024-09-14T13:46:21.504419+0000, chain.objs.size()=1 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.89sYi_FqkKlFDewr6o4UVU8lKDaXZRX_0 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13583519924889268472', time=2024-09-14T13:46:21.507556+0000, chain.objs.size()=1 2024-09-14T11:56:14.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.j8V-yVEibPutEXoH8f2hzDRR0KP-QWH_0 2024-09-14T11:56:14.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3665005730153960485', time=2024-09-14T13:46:21.780227+0000, chain.objs.size()=1 2024-09-14T11:56:14.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.f-ByN1wHcAlZO70gcoOR8Hh_8NohJ-o_0 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1809882966850353343', time=2024-09-14T13:46:21.939934+0000, chain.objs.size()=1 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TzwHosnmAQ4EBkTsdgGBz8q8EBJSGQk_0 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10948306802878332852', time=2024-09-14T13:46:21.950452+0000, chain.objs.size()=1 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.h2jK8Y04PZ0XiD7bR95pnQz5qlvVqU8_0 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1131192129183753371', time=2024-09-14T13:46:22.039439+0000, chain.objs.size()=1 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.J7h7jeCilFIvDKqZBmqACMSwjMJ7RvS_0 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7515762696744722238', time=2024-09-14T13:46:22.040517+0000, chain.objs.size()=1 2024-09-14T11:56:14.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BxL1zCqrNi5dUq8urQKyEr4rO2YCwUP_0 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2583886720858352355', time=2024-09-14T13:46:22.135662+0000, chain.objs.size()=1 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.089+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-k4cv_vXUuqjGVhdz-JtYnUDBqN7h-u_0 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.090+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3366264408068311017', time=2024-09-14T13:46:22.141083+0000, chain.objs.size()=1 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.090+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.o3mcMO-lKlEQyFkkk5cmsv9YORF5j7Z_0 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16101335976786448052', time=2024-09-14T13:46:22.294107+0000, chain.objs.size()=1 2024-09-14T11:56:14.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aY7Z2Ce2-Cica9NV00HNAvk5lpRZZJ__0 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7642933569705814539', time=2024-09-14T13:46:22.318939+0000, chain.objs.size()=1 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AD2ylqMBgab_8K-0JZHTnRkYpOZC6n5_0 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5654817033207445830', time=2024-09-14T13:47:16.018620+0000, chain.objs.size()=1 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.433__shadow_.PsZ_-QfImO5DNj-FOSDm35t7jOT1MPT_0 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7828513379771421016', time=2024-09-14T13:47:29.292523+0000, chain.objs.size()=1 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.091+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.457__shadow_.NbERiahdqh6cQaMVfY8TyOtxEkh0rQR_0 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.092+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7608165941099695341', time=2024-09-14T13:47:42.120475+0000, chain.objs.size()=1 2024-09-14T11:56:14.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.092+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.K3UZBPqdOybUZdxwEI6nM_qxeDFeui-_0 2024-09-14T11:56:14.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.094+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9040178726862853502', time=2024-09-14T13:49:27.363560+0000, chain.objs.size()=1 2024-09-14T11:56:14.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.094+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:bOUutJQsy1RGiM2CchPTjRvWoUWuE0G_.Mv-5eJDAaF3gvrmYgLFmmcIfgviO8Wp_0 2024-09-14T11:56:14.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44027 2024-09-14T11:56:14.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:56:14.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15583903484343535001', time=2024-09-14T13:49:32.426515+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:SKb7ZUWd62.u.2n8vkoSo3kBJ-.mGUD_.unS83o6EyZ2W6n9ID-hmbuw0TyF2_a0_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4813688282005786944', time=2024-09-14T13:49:40.218747+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:ID57xAg.C2oUzH9WtXeHUs62euLUGfd_.yQktpnzLG5qpJAKCK8Uuj-528bAXExW_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15717607921273222852', time=2024-09-14T13:49:45.645826+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:KLjwikWVcH.nJrXuX9tmxGlIsCl.84U_.GrmbmGgem-qgfEO4tCgUqKjXukS2MG5_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16872946779629536528', time=2024-09-14T13:52:16.287530+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.629__shadow_.SJK6FJ7KF_EAknbgOzo6hUytbVCARF8_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5812329630830758559', time=2024-09-14T13:52:21.281961+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.639__shadow_.6p7R9nyn39y2xDkFuCH2s_z_8Kn89-4_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14294543963173311059', time=2024-09-14T13:53:26.049247+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.735__shadow_.95aB44BJxUBEVKicB8DxW6Re_igw3ys_0 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7320406818218818392', time=2024-09-14T13:54:02.869583+0000, chain.objs.size()=1 2024-09-14T11:56:14.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.771__shadow_.iE-_idDcXG3zuVbRdxFWTnvJsM6sxR__0 2024-09-14T11:56:14.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.102+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.104+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:56:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.105+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.106+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43024' 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4605515283250395739', time=2024-09-14T13:43:42.053036+0000, chain.objs.size()=1 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.184__shadow_.CXf_cpjGC9coiUTqQ-gkxvm7WrYUP5H_0 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1758662607122638765', time=2024-09-14T13:43:57.619647+0000, chain.objs.size()=1 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.204__shadow_.IWLAMtFy3lXMMokC8P9uYCrls0kPJVz_0 2024-09-14T11:56:14.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10810315295761549034', time=2024-09-14T13:45:17.825451+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.253__shadow_.RBoLhyMoKmOuXn6KSkWj9YzF9-UfmP8_0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17335794094817248920', time=2024-09-14T13:45:20.189916+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.258__shadow_.gHoUQKRO6_QUIsLbiCpPQ8JS-EygEwT_0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17595583853966472613', time=2024-09-14T13:45:20.190618+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.258__shadow_.LEscQPd5Jcg59xIvhjr_HgNYPw4XaTD_0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6495142391604601086', time=2024-09-14T13:45:30.214890+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aH1SAI0_vNs0tgwtrmCFlLAoMYjxKsS_0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2827396289809893759', time=2024-09-14T13:45:30.215584+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yrdRmMM5pJwNgozH2fObxlDvx_7vPF__0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14773005578060707247', time=2024-09-14T13:45:30.407912+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.99NFCIxZAuytFLP6Io4LLguY0Tpi-FO_0 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5462563605636166890', time=2024-09-14T13:45:30.423109+0000, chain.objs.size()=1 2024-09-14T11:56:14.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Cy13lPswX0sEyLYmt9a0q9_vyeNwKMi_0 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.770059092030682048', time=2024-09-14T13:45:30.492115+0000, chain.objs.size()=1 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.a65ObrR_uiySH4o_UIIrqb_HKOGspTw_0 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9207485893662866195', time=2024-09-14T13:45:30.611951+0000, chain.objs.size()=1 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Bb0x1HEeG-0VQyb_-eUywJAo6WI6MTB_0 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9373642498440108761', time=2024-09-14T13:45:30.626985+0000, chain.objs.size()=1 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.107+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fmfAeMIHhdDLGx4VHAKMwzqwy1IwhZf_0 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.109+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12914767410079709090', time=2024-09-14T13:45:30.679151+0000, chain.objs.size()=1 2024-09-14T11:56:14.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.109+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NHjIpCNh35EY8_rXMsZmmEyOzZJkDGV_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7559650785545292470', time=2024-09-14T13:45:30.779171+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.s2mUdcliFqRc2UvKhV6XdW-ad5L5MlZ_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2397187867634124431', time=2024-09-14T13:45:30.831101+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dlAlpMnYeL7NcdRLs_fhCdKoT1SQtgH_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2045444052504714351', time=2024-09-14T13:45:30.872796+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oUCLuGyL3O_p_c8xpJWA8so-bV1YniH_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10652223349760993259', time=2024-09-14T13:45:30.968327+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0t5nMZFKYj5dWJwDgNH794JnxdU9LHC_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2935968921929159357', time=2024-09-14T13:45:30.976060+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iHFfsEdjp-qJc-Z9ZJ9ekjFfbFznUEw_0 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10863206120929237293', time=2024-09-14T13:45:30.986793+0000, chain.objs.size()=1 2024-09-14T11:56:14.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4_e9OtjLiOrqTPyyzGWDVaZuR1X7_EP_0 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6519468394114977831', time=2024-09-14T13:45:30.989205+0000, chain.objs.size()=1 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1vr_cmoxvR7ECIh0SHLK7kP9dvPBsLp_0 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10720086288240350229', time=2024-09-14T13:45:31.060588+0000, chain.objs.size()=1 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kfQdvHnsP83_NOVIedoP_E8EftqDqf8_0 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17804879211621151084', time=2024-09-14T13:45:31.146869+0000, chain.objs.size()=1 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hkPYLnwOL8CT2-spOYOI5Iyr2cuaRb1_0 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15599951482497238024', time=2024-09-14T13:45:31.152335+0000, chain.objs.size()=1 2024-09-14T11:56:14.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f_zQ_puJyfmWO3_T0TwbOFVdioklffr_0 2024-09-14T11:56:14.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12520754850341418794', time=2024-09-14T13:45:31.191576+0000, chain.objs.size()=1 2024-09-14T11:56:14.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Aurt-AwADwHMqMORcYICYfOY0SqHL79_0 2024-09-14T11:56:14.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2668485761734113479', time=2024-09-14T13:45:31.208422+0000, chain.objs.size()=1 2024-09-14T11:56:14.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Psq6vYNCnEt7pvHRMxx6b4kFv_QcMqo_0 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9636067139712810223', time=2024-09-14T13:45:31.429219+0000, chain.objs.size()=1 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tESc27PbaJYQteBW1RDArY1Qdqib4DA_0 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7533681047533080535', time=2024-09-14T13:45:31.505705+0000, chain.objs.size()=1 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UFS7_h67EnRjUyzpsiMj7yGqShh3WpR_0 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4026311449965974797', time=2024-09-14T13:45:31.597533+0000, chain.objs.size()=1 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qSVFtD9_ehAyRusvKw8__S8fGkH2TNX_0 2024-09-14T11:56:14.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2649300759343496780', time=2024-09-14T13:45:31.609329+0000, chain.objs.size()=1 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SbvNU_9eQYUelNtDmXXJ5MUTZ3_6eRN_0 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5383620913448942164', time=2024-09-14T13:45:31.681015+0000, chain.objs.size()=1 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eVkxo2Sg1d8O4ttNFzPeqLYqw4CzYvi_0 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13333180621591622864', time=2024-09-14T13:45:31.685110+0000, chain.objs.size()=1 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W6scEdhwl0iZgjSdklhsttmRSmIhfnC_0 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.962013767928907828', time=2024-09-14T13:45:31.689312+0000, chain.objs.size()=1 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gIdHnle1MKAhUJQktfe0hcc3bwEWm66_0 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18259328266721789048', time=2024-09-14T13:45:31.755113+0000, chain.objs.size()=1 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.114+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7HV_mPIsrGBcoF4rEsDWv-PVWeh3s79_0 2024-09-14T11:56:14.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.115+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3468320819432639493', time=2024-09-14T13:45:32.267268+0000, chain.objs.size()=1 2024-09-14T11:56:14.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.115+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.264__shadow_.wze1Ap4evTydmegeoe-IlJlj1z00Jqr_0 2024-09-14T11:56:14.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.116+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14737468119934647550', time=2024-09-14T13:45:33.278641+0000, chain.objs.size()=1 2024-09-14T11:56:14.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.116+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.266__shadow_.8jMTTOjRLzbvI53HhtFmH_UczoI__ZG_0 2024-09-14T11:56:14.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11993549349626353899', time=2024-09-14T13:45:36.176330+0000, chain.objs.size()=1 2024-09-14T11:56:14.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.272__shadow_.-eAsChCCUF9kXhcNMsqStIk-KiChMtR_0 2024-09-14T11:56:14.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12286351179383756631', time=2024-09-14T13:45:36.177060+0000, chain.objs.size()=1 2024-09-14T11:56:14.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.272__shadow_.wj7dq37T7id9clQLfmNmYyKjR6vF0uy_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7954375276043809932', time=2024-09-14T13:45:43.873074+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.287__shadow_.ZUlUWTCwf0z2d9xqzyph_fqThdZ2ThS_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17299845040311849078', time=2024-09-14T13:45:48.181496+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.z9MMWS0HNI-8MZ4C_16v5eW38eIBBC3_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10841056582210587801', time=2024-09-14T13:45:48.195222+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.BI_NpDp0N3h57C70FbvN8znfSEME4GW_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16671469232016940244', time=2024-09-14T13:46:10.921861+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P7GAQ8U5K3Q5HV-IdjMSg9TT7uNwCuY_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10235495292592134880', time=2024-09-14T13:46:10.934838+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eLbIY1ZSD31pNiu2vr3hJPjqrJot5aL_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6984278576256860737', time=2024-09-14T13:46:11.129487+0000, chain.objs.size()=1 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.THACPDLkG-_fiNyYIDVnhMdBYGs5Xp1_0 2024-09-14T11:56:14.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18322929464781909992', time=2024-09-14T13:46:11.130148+0000, chain.objs.size()=1 2024-09-14T11:56:14.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vyOhpjBPaaGhMtQNzT_sgZWvDNKOZWg_0 2024-09-14T11:56:14.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15061426221276160834', time=2024-09-14T13:46:11.146923+0000, chain.objs.size()=1 2024-09-14T11:56:14.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P4oM0xpUlaDzQwHJGjnRMPE60bBL1SU_0 2024-09-14T11:56:14.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11006060589134613988', time=2024-09-14T13:46:11.184832+0000, chain.objs.size()=1 2024-09-14T11:56:14.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mQVhBSaiP3xHM5XLM6WOU6UIKFUCoJ8_0 2024-09-14T11:56:14.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17254695183325033760', time=2024-09-14T13:46:11.190797+0000, chain.objs.size()=1 2024-09-14T11:56:14.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ygoBu38g2J8Ypz4Kj5EVp1s_OxkH8zu_0 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6582369062494793392', time=2024-09-14T13:46:11.217228+0000, chain.objs.size()=1 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.c5IOdMM8DZshgynonG25ZJ1EBoJUrim_0 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7958572159801864905', time=2024-09-14T13:46:11.324921+0000, chain.objs.size()=1 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4o_5lEElqpNczDTwTLZ4T7AIQS6X1Dk_0 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12263921847126086675', time=2024-09-14T13:46:11.333402+0000, chain.objs.size()=1 2024-09-14T11:56:14.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.122+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ANp92VuN901hM-uiEBYWaNlA7oJ9ORJ_0 2024-09-14T11:56:14.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13372245177411917299', time=2024-09-14T13:46:11.359206+0000, chain.objs.size()=1 2024-09-14T11:56:14.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QOGUjrASBGYUxHsyIotueEVqIIHBA1a_0 2024-09-14T11:56:14.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10012379420891259819', time=2024-09-14T13:46:11.686556+0000, chain.objs.size()=1 2024-09-14T11:56:14.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LmETiDd2GNJpVZLC9PM7Y0H5ufSq9yd_0 2024-09-14T11:56:14.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16093058623122394783', time=2024-09-14T13:46:11.741064+0000, chain.objs.size()=1 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PN32xA8dsxMCi-9yyDtvpc_OJTO-Fsy_0 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15119057939311692544', time=2024-09-14T13:46:11.935418+0000, chain.objs.size()=1 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.123+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Z6r4iAOmOEPVO1rOpp6g2qDKsAyad3b_0 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.124+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11868262272652769458', time=2024-09-14T13:46:11.938340+0000, chain.objs.size()=1 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.124+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.so44HI4hbkrFi5xS3C3zifgcGokT21F_0 2024-09-14T11:56:14.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.125+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8599154912579998430', time=2024-09-14T13:46:12.045161+0000, chain.objs.size()=1 2024-09-14T11:56:14.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.125+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RuD6qbS7SFcj9JtcVaIyR27LCe7yOiH_0 2024-09-14T11:56:14.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.125+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17424529036880684370', time=2024-09-14T13:46:12.085760+0000, chain.objs.size()=1 2024-09-14T11:56:14.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.125+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CNSkNLQMIfJBa8tcP1utoF15w5kk5iV_0 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7482541955665008836', time=2024-09-14T13:46:12.095483+0000, chain.objs.size()=1 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XGWGeULyD5nHMdlqL7MC_FF3Z8fWYFK_0 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3839510603355215285', time=2024-09-14T13:46:12.099165+0000, chain.objs.size()=1 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rn2sCx11VIAjQ3rhmxrF4JbtyTiDu8Q_0 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5785453136522205586', time=2024-09-14T13:46:12.128161+0000, chain.objs.size()=1 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DSLnX7DUWsRnWylN8DmsmmTwHb4PtaV_0 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12943333712364815915', time=2024-09-14T13:46:12.137211+0000, chain.objs.size()=1 2024-09-14T11:56:14.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DeeDW4jDifnYBJz-rKJ4ZHulMIhnwWu_0 2024-09-14T11:56:14.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18435016021827648432', time=2024-09-14T13:46:12.215813+0000, chain.objs.size()=1 2024-09-14T11:56:14.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.126+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.S8dEPbaBlLvS560w3ddaguqqixnSBr4_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1741193221369020072', time=2024-09-14T13:46:12.469848+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BiGTTqwR-MNPmHoazD2dWf4m0SQRlVs_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13450897918382962065', time=2024-09-14T13:46:12.475952+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0YpilhvUp_ctEyuJMG0lu2_7V5e3oUO_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1258339678142408833', time=2024-09-14T13:46:12.523832+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sX9aMD9KZnYkQPCL650jDwN4X7c5vsX_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11810499325159539018', time=2024-09-14T13:46:12.609610+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ag80W6TLAXckTqCWGSLkPpLjt7Gb4O8_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13099732476665606175', time=2024-09-14T13:46:12.634462+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ssRHVzC7i0jEkCI0KFNczf6rjR-Mak0_0 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9984867189138568926', time=2024-09-14T13:46:12.660420+0000, chain.objs.size()=1 2024-09-14T11:56:14.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MhBPgHwqCsgNOpOBVT7QXK3TemRujnt_0 2024-09-14T11:56:14.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1540482984258332918', time=2024-09-14T13:46:12.679677+0000, chain.objs.size()=1 2024-09-14T11:56:14.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.130+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GwVzQA8z7afWaMqODPPnAVzP9GQNLu4_0 2024-09-14T11:56:14.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.131+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6762541958197013486', time=2024-09-14T13:46:12.685440+0000, chain.objs.size()=1 2024-09-14T11:56:14.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.131+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DboXVsjDAOkysiXmV5C3pVbx9JalXmS_0 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8762397642712394925', time=2024-09-14T13:46:12.687869+0000, chain.objs.size()=1 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.v1lK8EBVOQMxulxA-Bifa__n2gQ_DI8_0 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12317964256526760690', time=2024-09-14T13:46:20.709834+0000, chain.objs.size()=1 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UZl7Q0vBq2psq3bmiPISNWa2iB5Prx7_0 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10476222897114155739', time=2024-09-14T13:46:20.714748+0000, chain.objs.size()=1 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-yy0ubsKKs0S0tjfBw8xXyxQZ2Y8cVU_0 2024-09-14T11:56:14.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16007938139071605305', time=2024-09-14T13:46:20.737504+0000, chain.objs.size()=1 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._bPNWtrzRszcBlemfFOPHcRu8cj_ry__0 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9037410454896238091', time=2024-09-14T13:46:20.779528+0000, chain.objs.size()=1 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3IHUOERyLjZxnzwl7y1b5mNPojflHLq_0 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.133+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15348471474203901558', time=2024-09-14T13:46:20.798372+0000, chain.objs.size()=1 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.133+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kq3Yn-3Zr1BG2x59UDylItK04-MPAoD_0 2024-09-14T11:56:14.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13008483253956632983', time=2024-09-14T13:46:20.913555+0000, chain.objs.size()=1 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MncDKqDOuyAtSSJqSNvzL-yabb1NBf__0 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5459770349649281277', time=2024-09-14T13:46:20.920083+0000, chain.objs.size()=1 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IifEX1PdgHLnFvOeHOMZPUWIr9c5IQM_0 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5561568944994208485', time=2024-09-14T13:46:20.951601+0000, chain.objs.size()=1 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xtYJE3EUa0tJVSPxnAIZ27Fz67OflD__0 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10145212127257011868', time=2024-09-14T13:46:21.095629+0000, chain.objs.size()=1 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.134+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pSrwoKqwyKSyn4gvwmeBkStTwVMzWV1_0 2024-09-14T11:56:14.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2755730559675629558', time=2024-09-14T13:46:21.111948+0000, chain.objs.size()=1 2024-09-14T11:56:14.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9ub6SgBg4ECIK6SVolRxYTh8J1lJkmE_0 2024-09-14T11:56:14.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15854624574854317808', time=2024-09-14T13:46:21.179524+0000, chain.objs.size()=1 2024-09-14T11:56:14.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yx7xdvwqH5PmHP1dj8sZA2K_ez8NRNP_0 2024-09-14T11:56:14.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1779419098804834022', time=2024-09-14T13:46:21.181147+0000, chain.objs.size()=1 2024-09-14T11:56:14.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OHb83ldDd9nHATZlzwStLX4cCmvgXlC_0 2024-09-14T11:56:14.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14446187085573146664', time=2024-09-14T13:46:21.302190+0000, chain.objs.size()=1 2024-09-14T11:56:14.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1SDTLk2isuBXgAu7NIRVCWLHqqIBHwx_0 2024-09-14T11:56:14.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18347909580897817784', time=2024-09-14T13:46:21.333872+0000, chain.objs.size()=1 2024-09-14T11:56:14.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uw5UKnEUDHaN6G9XcJTzHuWdeItyK1T_0 2024-09-14T11:56:14.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.137+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10129674158313429504', time=2024-09-14T13:46:21.348645+0000, chain.objs.size()=1 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.137+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.F4InS6XTyHlC0IOfOqDi3EcDDxd5eGa_0 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11073886528328683027', time=2024-09-14T13:46:21.360997+0000, chain.objs.size()=1 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.oeUUmV36e4rmLbCVquQ-HTjAg9lPTk8_0 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6066922750270968623', time=2024-09-14T13:46:21.390724+0000, chain.objs.size()=1 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.e8S1dKGuFXv1Mjhuy7ChePhI0xBpwRC_0 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2039297474560267566', time=2024-09-14T13:46:21.472126+0000, chain.objs.size()=1 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.U5UfLwsmVenpjWEwoLC4aMFtbScmZUR_0 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3134445208808492901', time=2024-09-14T13:46:21.516770+0000, chain.objs.size()=1 2024-09-14T11:56:14.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lxA4pVJYEFF62OS2xRAgmqEN0iF90hD_0 2024-09-14T11:56:14.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5274159982799729063', time=2024-09-14T13:46:21.519946+0000, chain.objs.size()=1 2024-09-14T11:56:14.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7xoNdn1nrjgqWQYnstmlFEsQMYEEj-1_0 2024-09-14T11:56:14.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4838979611739859849', time=2024-09-14T13:46:21.537136+0000, chain.objs.size()=1 2024-09-14T11:56:14.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PGEQZARwnsXoSLlUCXorHUrfdTPcgf4_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14982994795259300889', time=2024-09-14T13:46:21.743508+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1NLyvFbb88MSkXnGp0QpDyq83DaatM9_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8679916584896041764', time=2024-09-14T13:46:21.853669+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AhnZAMXNsUJJ09yK4a82TvATY9KdJNu_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1905208491166928752', time=2024-09-14T13:46:21.863826+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.r-PJeP9iH4L_pSuKurnY-pOujml_LNA_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3813551525535252042', time=2024-09-14T13:46:21.882238+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.axVcKB5d85iGJm1-QwHaKYmSoVHIg1r_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13394641289985079798', time=2024-09-14T13:46:21.891581+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.140+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.in8Dxh1AzXyWyRJF61eoWiTNFthPAMt_0 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.141+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7591101863844107215', time=2024-09-14T13:46:21.899209+0000, chain.objs.size()=1 2024-09-14T11:56:14.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.141+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3npC-0ThFgvisMQDlrkOiTDK2a1VQar_0 2024-09-14T11:56:14.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17555147524249228167', time=2024-09-14T13:46:21.935522+0000, chain.objs.size()=1 2024-09-14T11:56:14.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2VsRE-1MDmV84e-o-m6FKfUMNyjKJXz_0 2024-09-14T11:56:14.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.143+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9431827588687404029', time=2024-09-14T13:46:22.041406+0000, chain.objs.size()=1 2024-09-14T11:56:14.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.143+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aH1PfJtxJoFTQZ4tZWn8aDGEY0IprE7_0 2024-09-14T11:56:14.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.145+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43024 2024-09-14T11:56:14.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4141696374432682139', time=2024-09-14T13:46:22.057410+0000, chain.objs.size()=1 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5RxiRgihdbR8oO1ltUoR7HV9A5H2NOi_0 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11888650006294661014', time=2024-09-14T13:46:22.063546+0000, chain.objs.size()=1 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5vFVeAf5xQ2GfH69yS6HbRfN9DAQT6k_0 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2863448155899480976', time=2024-09-14T13:46:22.073693+0000, chain.objs.size()=1 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JBajrfwKY20FAmHOdFcNQukP8fDaAGA_0 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10190298839140490368', time=2024-09-14T13:46:22.129822+0000, chain.objs.size()=1 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UNPtOZ33J6xXuhBp1YU9tvLsKI28IkX_0 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9362587922027551977', time=2024-09-14T13:46:22.216476+0000, chain.objs.size()=1 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tqm66ymZ0WgV1n7sjrdXDIGQkxmQRaq_0 2024-09-14T11:56:14.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10739583414789324113', time=2024-09-14T13:46:22.264263+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1NeYRn_7okFjjCgOl8XLyMFqjfCu2Th_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15410282135778703879', time=2024-09-14T13:46:22.315755+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._QK11zsInmr3d9gLfl6A_H6bAAJUDER_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16386260497854200973', time=2024-09-14T13:46:22.342120+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IjOneq6Bc0ckhDSBRTNCLLQ7do7Ac39_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16254436854706370882', time=2024-09-14T13:47:18.446667+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.438__shadow_.QeFGwYhCuwgzr6amr5TdHxNXRmai_S1_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2933932984124575065', time=2024-09-14T13:47:20.992546+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.443__shadow_.M5bDx0U1LKJv4cB2WTZk_u7qaqihOqG_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13128290624891492959', time=2024-09-14T13:47:32.201463+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.461__shadow_.3XPyDxWXt0MDs7vDMcpGQawQS1hyzU6_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17620161814115014842', time=2024-09-14T13:47:42.659529+0000, chain.objs.size()=1 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.147+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.485__shadow_.yEHlSyUYmuSkdbxxi9GTZVPf5P9BsdP_0 2024-09-14T11:56:14.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17883649573339523919', time=2024-09-14T13:47:44.201354+0000, chain.objs.size()=1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.488__shadow_.wFjxXZcupTIk1VyuspMnP1F6xrFsrzS_0 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17443620272959021730', time=2024-09-14T13:47:58.286392+0000, chain.objs.size()=1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.519__multipart_mymultipart.2~tNDNjXYQgF_rtmmZkwREecXIozINJ78.1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13660767865553896540', time=2024-09-14T13:48:13.880319+0000, chain.objs.size()=3 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~21rDzFgX8UvHwlunXRfvEpatAMahOR7.1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~21rDzFgX8UvHwlunXRfvEpatAMahOR7.2 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~21rDzFgX8UvHwlunXRfvEpatAMahOR7.3 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~Hz-c43SWIYSawwoLqQqQVcrLffRoH6X', time=2024-09-14T13:48:19.251345+0000, chain.objs.size()=2 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.530__multipart_mymultipart.2~Hz-c43SWIYSawwoLqQqQVcrLffRoH6X.1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.530__multipart_mymultipart.2~Hz-c43SWIYSawwoLqQqQVcrLffRoH6X.2 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7592035719448647854', time=2024-09-14T13:49:14.254932+0000, chain.objs.size()=1 2024-09-14T11:56:14.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:2JriG5olQItzTyXmM-zoQvp7oVZY33X_.NvK7KCSbSWXEb_GOwxdfMWd9p1YTKPy_0 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12320783033409029755', time=2024-09-14T13:49:35.058190+0000, chain.objs.size()=1 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:mbs5xoaGhrConXwxUIudb0wOqlVbNp5_.7xlltCD9DqJ4vKv_tkGyhSFmLeF0r-H_0 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16232167348022414998', time=2024-09-14T13:49:57.297079+0000, chain.objs.size()=1 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.606__shadow_._faqatyw5gAitvirQn5z6W8_YB4vTTg_0 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.152+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6214090520381474680', time=2024-09-14T13:49:58.643835+0000, chain.objs.size()=1 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.152+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.609__shadow_.LgvtP3nUbFapWMQEf6zgNnUPpbKCbht_0 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.155+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7132356375454398204', time=2024-09-14T13:52:55.896101+0000, chain.objs.size()=1 2024-09-14T11:56:14.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.155+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.712__multipart_file1.2~sSyFvzSBzLLBhfvW19jqWsQ3uInzdeu.1 2024-09-14T11:56:14.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.156+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17381936217273426024', time=2024-09-14T13:52:56.192416+0000, chain.objs.size()=1 2024-09-14T11:56:14.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.156+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.713__shadow:xwc4NTGKgrE5rN-6oSY676dTL3efsOD_.A3M7P3ZN1F1wP6ISYGJ7oMU5v8ijyq__0 2024-09-14T11:56:14.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.158+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.160+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:56:14.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.161+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53811' 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14435776823721537082', time=2024-09-14T13:43:18.847343+0000, chain.objs.size()=2 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.159__shadow_.42LqEqcKgq3poSRHkq67Y0NAiT2owW4_0 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.159__shadow_.42LqEqcKgq3poSRHkq67Y0NAiT2owW4_1 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13208736582428421692', time=2024-09-14T13:45:08.195370+0000, chain.objs.size()=1 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.236__shadow_.G51MuoqG9t-zj-ZhEcsvKhPanCOtUYB_0 2024-09-14T11:56:14.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13864587734860757045', time=2024-09-14T13:45:14.926549+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.247__shadow_.LOUHpBey7ybwOJfAmBD7GdZRePNx04t_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10221274602574007199', time=2024-09-14T13:45:19.236811+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256__shadow_.5_SoKYmutR69VMVlkoNxEiRFKrQdIIT_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16416477124172532792', time=2024-09-14T13:45:21.129489+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.260__shadow_.3ucPtilHhvOaqfhHjXnoAEwWN8vnGsl_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4831486673418823855', time=2024-09-14T13:45:30.226856+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RZEPliOtvPiPg7lbu2TAKJqlOGhMClh_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14819844360401373428', time=2024-09-14T13:45:30.252544+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9VHbrk3tMGIAmoeuo2TYu9CPgXY_whS_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5542680121571085446', time=2024-09-14T13:45:30.306861+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kP_B0D83e8YH1_z2BuyqW8P8FoBy8CH_0 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17196344553005302181', time=2024-09-14T13:45:30.310751+0000, chain.objs.size()=1 2024-09-14T11:56:14.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.G2sBAXqW4KDf5JcIQmBUhyXplXFJyGW_0 2024-09-14T11:56:14.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18086665100646646955', time=2024-09-14T13:45:30.447824+0000, chain.objs.size()=1 2024-09-14T11:56:14.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gjpYp_ZSalfKbN4TidijDkzv36E2hYO_0 2024-09-14T11:56:14.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.163+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9662977682641045511', time=2024-09-14T13:45:30.488768+0000, chain.objs.size()=1 2024-09-14T11:56:14.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.163+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.q3uvNmkS7UvIP1spm91k6AQBGIM7gjq_0 2024-09-14T11:56:14.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1056265696638965435', time=2024-09-14T13:45:30.602448+0000, chain.objs.size()=1 2024-09-14T11:56:14.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9ytnADJjRL5BidmAHUlNoBXXUPQDoP1_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1132562631760435206', time=2024-09-14T13:45:30.648849+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Nyxr78l-PmlxId-1Zp4NqQ28nLFxYSu_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4177138532931122249', time=2024-09-14T13:45:30.668258+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4SI9dpbTdm7_gLIBvafxJuIbTFctM3e_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17839276574641648575', time=2024-09-14T13:45:30.696839+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7ADQvYSCgR7md6BRMWpROg8c-CUx0F__0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1443405260634525842', time=2024-09-14T13:45:30.804814+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7DiLWf1nV8ccnjTAhIQKZj87V7IwYsy_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3846181504272814703', time=2024-09-14T13:45:30.822051+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BcCK8IzcV7EYbzDECdF2Q7GBzLbG0Eo_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14179883087811887162', time=2024-09-14T13:45:30.837999+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.J0BsAXsJUJlOK1HmejtNQ2c5SBMw50d_0 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2011756955931592951', time=2024-09-14T13:45:30.879410+0000, chain.objs.size()=1 2024-09-14T11:56:14.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e2_X0QFCHVz9RurVAdCLkq_X3BKtLmA_0 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9185362953884827561', time=2024-09-14T13:45:30.992448+0000, chain.objs.size()=1 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yUU73jgoc7yxUYL-0iIEP5ORwL1DGiu_0 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2652304481112295464', time=2024-09-14T13:45:31.045953+0000, chain.objs.size()=1 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6HoOY5zYPvLEBlmcOaiKmbXyk510L2P_0 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8149034683665247759', time=2024-09-14T13:45:31.143326+0000, chain.objs.size()=1 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.166+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YPOzOuJHdjvt3M9OJjg4DOMaqLGn_Lj_0 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.169+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8471457951400397936', time=2024-09-14T13:45:31.144704+0000, chain.objs.size()=1 2024-09-14T11:56:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.169+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ilgFALg7yTW1G2rElYkU4gGDC9uWSUA_0 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5421412151825538473', time=2024-09-14T13:45:31.201123+0000, chain.objs.size()=1 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f-d2ztIel6ibbINFkhBomL7j393I_n3_0 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17697428833173684168', time=2024-09-14T13:45:31.223066+0000, chain.objs.size()=1 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._OmCyaxL4-f28ZnYmeAo9sPMKJdAqeR_0 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16272325990898549761', time=2024-09-14T13:45:31.571565+0000, chain.objs.size()=1 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dHufvmToWvwqu3mV0_C8mvF-CogDS78_0 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7987041983481620252', time=2024-09-14T13:45:31.723250+0000, chain.objs.size()=1 2024-09-14T11:56:14.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.170+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ArSrukxpSDagiKdo2g1b2S5oLEyIBuD_0 2024-09-14T11:56:14.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6185758858290880347', time=2024-09-14T13:45:33.278394+0000, chain.objs.size()=1 2024-09-14T11:56:14.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.266__shadow_.JQX8Lw_L9cF0FnpXqRvrzoNUR8JaxrG_0 2024-09-14T11:56:14.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16304571354452446963', time=2024-09-14T13:45:42.283936+0000, chain.objs.size()=1 2024-09-14T11:56:14.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.284__shadow_.KfJHKrPbI1BefV0Z4M8Aot2kiKhmQ6u_0 2024-09-14T11:56:14.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13263571037241222491', time=2024-09-14T13:45:43.339054+0000, chain.objs.size()=1 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.286__shadow_.7bTcIQ5qy9oBGZoW8twVlXbU09DBR-K_0 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1422688791918256340', time=2024-09-14T13:45:47.361076+0000, chain.objs.size()=1 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.9DzXR4dhdqy3ZiCUTm_8rOmSwDB6BO7_0 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10743823832676579108', time=2024-09-14T13:45:48.677513+0000, chain.objs.size()=1 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.295__shadow_.P_9iPJO8x4OIkCAbIRy5fcSux_uik55_0 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6086780880236110425', time=2024-09-14T13:45:51.158353+0000, chain.objs.size()=1 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.300__shadow_.U6OZmoSLt9cYLeRvwCTy0KUbK613CKZ_0 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.172+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.368337130220677458', time=2024-09-14T13:45:53.090141+0000, chain.objs.size()=1 2024-09-14T11:56:14.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.172+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.304__shadow_.3ol7mB3t5RHchVfyP7Le-d733DYhcZN_0 2024-09-14T11:56:14.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6531935392313075816', time=2024-09-14T13:45:54.076161+0000, chain.objs.size()=1 2024-09-14T11:56:14.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.306__shadow_.aOszfpDk4pkgaWwBkHOIhwZdr1dPgMi_0 2024-09-14T11:56:14.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11043852972128968552', time=2024-09-14T13:46:01.459663+0000, chain.objs.size()=1 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.320__shadow:M2WTDeMOmFMki.IDOEoTaJkevHTBQTc_.Wp4gGJDzi6SdJh4tJcL2ZeT6NJdhzvp_0 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15916895727098790984', time=2024-09-14T13:46:10.927261+0000, chain.objs.size()=1 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.k6hb8r-OUl3dHe1ZpIqXY6pdJwNfIMp_0 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.74857070427656489', time=2024-09-14T13:46:10.954330+0000, chain.objs.size()=1 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HNYG5AfzdBIgho4CCoaX5NsujM2lqG__0 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5407627921947012577', time=2024-09-14T13:46:10.969648+0000, chain.objs.size()=1 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cMDxn9ZTAYBsHR5AoEbbceF8SLCsxQB_0 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13952692020466126373', time=2024-09-14T13:46:10.973917+0000, chain.objs.size()=1 2024-09-14T11:56:14.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.174+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MbleM2_0LZVe2dMJ16z5aovnoUKPGhV_0 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8968189321165295429', time=2024-09-14T13:46:11.000282+0000, chain.objs.size()=1 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rcNVVAc0TFb1nyPc41Lr9K6gKeILpYM_0 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11688677353984595758', time=2024-09-14T13:46:11.117484+0000, chain.objs.size()=1 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._cr_RAfgvDlbrCrtc7wggPLnfZDbhdv_0 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6195367174753274815', time=2024-09-14T13:46:11.177555+0000, chain.objs.size()=1 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b_gw1212ZjmMGBV39QtlEZacIacso7O_0 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17650453892861762816', time=2024-09-14T13:46:11.197548+0000, chain.objs.size()=1 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JK8flrq47IcPe-GcPrnP5vJpp4p6M8Q_0 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16253537118589010701', time=2024-09-14T13:46:11.211776+0000, chain.objs.size()=1 2024-09-14T11:56:14.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZSbFy3hcxcjCUMiN-ykP3lUUwmF9Z1y_0 2024-09-14T11:56:14.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.177+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4728188691110010758', time=2024-09-14T13:46:11.358549+0000, chain.objs.size()=1 2024-09-14T11:56:14.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.177+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LajEg_c9j4Tog3sAKQAsq9a2gpDNr9-_0 2024-09-14T11:56:14.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3253318189411182635', time=2024-09-14T13:46:11.399208+0000, chain.objs.size()=1 2024-09-14T11:56:14.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IEx50kCfJc5nMfPKZ1Vx4FGgOvPuxJf_0 2024-09-14T11:56:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12620048440095264767', time=2024-09-14T13:46:11.414305+0000, chain.objs.size()=1 2024-09-14T11:56:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jYQP_hyrsRoSdu4csR_5lG1KYvexqAI_0 2024-09-14T11:56:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2170807552576936509', time=2024-09-14T13:46:11.692704+0000, chain.objs.size()=1 2024-09-14T11:56:14.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.178+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JlRVfNoqvTPHu-PzU2ZiEHDCj0idlUQ_0 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5573997350461665607', time=2024-09-14T13:46:11.710744+0000, chain.objs.size()=1 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VPUDxMY1eLrh_v97Oln46LsoATImrrY_0 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7564444120374214987', time=2024-09-14T13:46:11.731051+0000, chain.objs.size()=1 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6Ep3VdBRFhNR6PDWyb39KyU9Ttm8Ad3_0 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12127771888220365236', time=2024-09-14T13:46:11.740673+0000, chain.objs.size()=1 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A7bLwjdLbz43Oxkvaasb7wdMxYMsppZ_0 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1004349349194403569', time=2024-09-14T13:46:11.853466+0000, chain.objs.size()=1 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xOf-Myfym2IxTdAkBNTby0zN4miss_Z_0 2024-09-14T11:56:14.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7873480765792228571', time=2024-09-14T13:46:11.883861+0000, chain.objs.size()=1 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hm20D6jY0Eu3catBAD88emelusSpcLz_0 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3447130489708878758', time=2024-09-14T13:46:11.905554+0000, chain.objs.size()=1 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8Y_BH2HaGNyNIvDrlXMl8_IyWgvryg7_0 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10198167682383354453', time=2024-09-14T13:46:11.911996+0000, chain.objs.size()=1 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.57iNRd3hyclR3u-ebdFKOvgGEFtrlRj_0 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.868471218748556029', time=2024-09-14T13:46:11.912741+0000, chain.objs.size()=1 2024-09-14T11:56:14.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kBOl11Au0x-2BCNGwY1PDmV4fOyrbk__0 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14712888652240787315', time=2024-09-14T13:46:11.945179+0000, chain.objs.size()=1 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YUbd5aUYbm8TcLodE4qMuDCxaZpNm1i_0 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15543339925961952570', time=2024-09-14T13:46:11.952925+0000, chain.objs.size()=1 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZQy8O0KlBw5_Mm001OAQG2dPt5Mquv5_0 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4672723990011730360', time=2024-09-14T13:46:12.045230+0000, chain.objs.size()=1 2024-09-14T11:56:14.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.181+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TvrilAS8ke0rzey_dsRxRj68POBwleD_0 2024-09-14T11:56:14.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.183+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16891223926203597059', time=2024-09-14T13:46:12.063569+0000, chain.objs.size()=1 2024-09-14T11:56:14.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.183+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KZBffpjLB3baVJsKOyO5r0f7JsimhBk_0 2024-09-14T11:56:14.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.183+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.753535727471687045', time=2024-09-14T13:46:12.090970+0000, chain.objs.size()=1 2024-09-14T11:56:14.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.183+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nzHV8FIYfrDLZ2Ui76Qc23XsFq88H8j_0 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9043787410246798163', time=2024-09-14T13:46:12.104781+0000, chain.objs.size()=1 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZZr4tY_E3Lsmat-jhFf5PxTx5NKMkPw_0 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8327448602548823324', time=2024-09-14T13:46:12.137036+0000, chain.objs.size()=1 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rjupPfF79wUGX2T7fIw1ydpP7dCsDLd_0 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3682797313990561386', time=2024-09-14T13:46:12.441357+0000, chain.objs.size()=1 2024-09-14T11:56:14.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.R4-w5YYTcTfwxRBBeyBjr1v5XY5lDXe_0 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14170869074919890432', time=2024-09-14T13:46:12.443664+0000, chain.objs.size()=1 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.184+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tzVuyWnWA3xAabaHE7-AYVB3TVPEzJJ_0 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4596973922323135203', time=2024-09-14T13:46:12.448448+0000, chain.objs.size()=1 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b00jR1Sp2532n7aCKEj4CwZ7hlYgx6O_0 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3415831447999651860', time=2024-09-14T13:46:12.486153+0000, chain.objs.size()=1 2024-09-14T11:56:14.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8oxkDmXVCjaoTxswU22U4YEai0dhtOA_0 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13775725418102919193', time=2024-09-14T13:46:12.509047+0000, chain.objs.size()=1 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EPUKkvr7pLDyxzJndr6XcsBm8G2imCV_0 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13967043645734390723', time=2024-09-14T13:46:12.512023+0000, chain.objs.size()=1 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oc_JPrkzGr6otFPEjgn2jJFG4cn1kq2_0 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7863919670717295120', time=2024-09-14T13:46:12.619561+0000, chain.objs.size()=1 2024-09-14T11:56:14.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.185+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qMKMmfzTvPwCIWuFVErOmSiKsZYM1Kd_0 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15829556641002368681', time=2024-09-14T13:46:12.621932+0000, chain.objs.size()=1 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.h6PHj4KwtGuONMpPSZSkzesmL7n5j-Q_0 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10976766870463530220', time=2024-09-14T13:46:12.661855+0000, chain.objs.size()=1 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.D_ZyOEqy-rsmbuD2rRZPKvvb06flYij_0 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6967391833146196798', time=2024-09-14T13:46:12.689298+0000, chain.objs.size()=1 2024-09-14T11:56:14.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.187+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qZ7tY7JxzQGhiT895FkgLoiTESjxKUq_0 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13483416214211966008', time=2024-09-14T13:46:20.713685+0000, chain.objs.size()=1 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lvk_vLf2wNtfj8Gl0kWjjNi2HJv3lHE_0 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2591358736082491576', time=2024-09-14T13:46:20.762518+0000, chain.objs.size()=1 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WhGfLBBCbey0VVJ_4voci4W_oITFqOy_0 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7783225726270538500', time=2024-09-14T13:46:20.785292+0000, chain.objs.size()=1 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0_NldbQ9hM6_yrL6n181888A7uHGcIL_0 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12479464038783877042', time=2024-09-14T13:46:20.811933+0000, chain.objs.size()=1 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CQ6Mu6dWEQrUA0QfVXj8W4n4QSjXdo0_0 2024-09-14T11:56:14.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15339580373500349089', time=2024-09-14T13:46:20.941886+0000, chain.objs.size()=1 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.q9LIPfh2TA5t9giGDBSiprqlfXCVC4p_0 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8553842919308964806', time=2024-09-14T13:46:20.945051+0000, chain.objs.size()=1 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BxtLCG0-dmHW-66jzYTRhqmmU_UfFCz_0 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1651197986452150747', time=2024-09-14T13:46:20.955185+0000, chain.objs.size()=1 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kExZXx1m5ilTh_wHaW4ipJiPLYoDt_t_0 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14625709743908170182', time=2024-09-14T13:46:20.968365+0000, chain.objs.size()=1 2024-09-14T11:56:14.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.U75PPp3MEFZ24xaHKcBB9a16kdnVVMA_0 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.815593609298655532', time=2024-09-14T13:46:20.982225+0000, chain.objs.size()=1 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.190+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.p7gD82wssa0puvp4FNI-hv6CKsYbcJL_0 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.191+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18405130488539175147', time=2024-09-14T13:46:20.990925+0000, chain.objs.size()=1 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.191+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5e49HTG19RDXDQYAXI5zQ4OVL7Sd52X_0 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.191+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9903180302759791019', time=2024-09-14T13:46:20.996888+0000, chain.objs.size()=1 2024-09-14T11:56:14.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.191+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dwQ6kxddVifusyV7qGvBzxbsb7wibGY_0 2024-09-14T11:56:14.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8515612465549685513', time=2024-09-14T13:46:21.011941+0000, chain.objs.size()=1 2024-09-14T11:56:14.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jFFagaY3dd8_kl0sFCEQLqdg8qXqaZx_0 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12177780110644820817', time=2024-09-14T13:46:21.108196+0000, chain.objs.size()=1 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SlpbcVkCDg5-rgCJwG9BuAo5KDmQ7yO_0 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10761379081940810100', time=2024-09-14T13:46:21.127348+0000, chain.objs.size()=1 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.X1FN5IDasUP-DeM0jRJUPWcKPwZBXwJ_0 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10622565962625662594', time=2024-09-14T13:46:21.136704+0000, chain.objs.size()=1 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5Gyp72WrLZ52CuzZtPpkztF87yznqFi_0 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12147418422818372495', time=2024-09-14T13:46:21.182603+0000, chain.objs.size()=1 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DSUddB6D9m6-jl1A71eMAVbC8fArRVl_0 2024-09-14T11:56:14.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4691235349427696430', time=2024-09-14T13:46:21.278999+0000, chain.objs.size()=1 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fqdr5lFAZvdl3LDmyJF-qbTh0zkn_SG_0 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13324922786559186912', time=2024-09-14T13:46:21.314296+0000, chain.objs.size()=1 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2ry4982PoPquuVq1PdxUM-J4Ua0AzFU_0 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13662462161806397162', time=2024-09-14T13:46:21.341486+0000, chain.objs.size()=1 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uGfbZr77dHTjm0pGNAE7SoO_ObsJRT7_0 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.454970457473174517', time=2024-09-14T13:46:21.373864+0000, chain.objs.size()=1 2024-09-14T11:56:14.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.194+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ebcjw2TsqTCJZutPQ6OM5GfWQvZXBgS_0 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2342211278356341374', time=2024-09-14T13:46:21.379446+0000, chain.objs.size()=1 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ID9GfLCbGSH8riHSXAUb6HKDSMPRdwr_0 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14085539057102401291', time=2024-09-14T13:46:21.388952+0000, chain.objs.size()=1 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uTd6qBKUFgeu-pwlFfDvx_7MWJcnyra_0 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9614465625929796319', time=2024-09-14T13:46:21.744037+0000, chain.objs.size()=1 2024-09-14T11:56:14.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.196+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4y7NI8jxKKBVJpGPvgfn09p29qpP4sH_0 2024-09-14T11:56:14.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.198+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11521776867935403099', time=2024-09-14T13:46:21.758624+0000, chain.objs.size()=1 2024-09-14T11:56:14.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.198+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bQDJqT4-Sgsa8JLvqKs3myF-DDsE1oW_0 2024-09-14T11:56:14.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.199+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9700431394076426098', time=2024-09-14T13:46:21.901479+0000, chain.objs.size()=1 2024-09-14T11:56:14.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.199+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vTfk50kelKl75Ur3UL71IB9eV_fhR70_0 2024-09-14T11:56:14.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.199+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13178181718346224208', time=2024-09-14T13:46:21.908967+0000, chain.objs.size()=1 2024-09-14T11:56:14.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.199+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IhQpyvH5X2J6UZD0IqcxS3B0f3OTKf4_0 2024-09-14T11:56:14.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.202+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/53811 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17841185015344338257', time=2024-09-14T13:46:21.948239+0000, chain.objs.size()=1 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4ymXd1k9RVLBNlFFoHGe5n4mIRTXxH6_0 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6070985241303174403', time=2024-09-14T13:46:22.059267+0000, chain.objs.size()=1 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mp8APqzJldbHbIRKRfOjBL53qdqq0C7_0 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17318346712353271665', time=2024-09-14T13:46:22.099918+0000, chain.objs.size()=1 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7EEslK2fEgIRzzs4QltHS59uedQJrcu_0 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2089052637678808468', time=2024-09-14T13:46:22.267608+0000, chain.objs.size()=1 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ek0pkh20yGn215Zr_3cTONjCNHcaidb_0 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7066333129745712221', time=2024-09-14T13:46:22.268387+0000, chain.objs.size()=1 2024-09-14T11:56:14.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-WMBH9X1ihJOmg3MQCevHPpgmSNzLKd_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13540869582334859262', time=2024-09-14T13:46:22.280921+0000, chain.objs.size()=1 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QyE_Xcn86C82KSUeBIdoWA49_x01Pkr_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17107335647866559356', time=2024-09-14T13:46:46.673831+0000, chain.objs.size()=1 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.378__shadow_.MJwGCnvsZq8tsFWbv1vtKcR9gHo9kYN_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8331291876734770058', time=2024-09-14T13:47:32.201367+0000, chain.objs.size()=1 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.461__shadow_.YuXsa8tRhxYI1p11kUO6SjjlvnEPgq3_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11030348726917020243', time=2024-09-14T13:47:34.838831+0000, chain.objs.size()=1 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465__shadow_.jz0xty6WhUn1mmE7Ti4YwD26AjFwDsL_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12078767746812797459', time=2024-09-14T13:47:48.963301+0000, chain.objs.size()=1 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.499__shadow_.oOm17nMvxqtrcdqDgtqjcxC4E6tcP28_0 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3959702254463653246', time=2024-09-14T13:48:10.574273+0000, chain.objs.size()=6 2024-09-14T11:56:14.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.1 2024-09-14T11:56:14.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.88U7yRk6u6iSFp5tvjn49LZFR9KbFMZG.2 2024-09-14T11:56:14.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.1TMbgPTrVPtejPwsraY1u2HhRnrKvtJt.3 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.4 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.5 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.6 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZJgL92kzj2i8bhnF_l_mMS0wI3BJdo3', time=2024-09-14T13:48:21.664242+0000, chain.objs.size()=1 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.534__multipart_mymultipart.2~ZJgL92kzj2i8bhnF_l_mMS0wI3BJdo3.1 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.576641027718664018', time=2024-09-14T13:49:16.707688+0000, chain.objs.size()=1 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:CymTEUbLDIndiscWXdBQHQwOGe0lBqC_.02SuPxUW4n3JqpKBgsWTDGKXRjOVO1t_0 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1730326158253534695', time=2024-09-14T13:49:26.852468+0000, chain.objs.size()=1 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:0VFrbfdS.tdDnZiA7FgemBSgiB8FyD9_.rmBM20zqxKbpeIkeHgK7b1ZdLBVBv-m_0 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1153448164597367586', time=2024-09-14T13:49:45.750218+0000, chain.objs.size()=1 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:.AV2575I-5qIuRXuSCulT8wAc6vQN7n_.C9u9_3KrghLcNvNrO11CZU5Ag13LeOy_0 2024-09-14T11:56:14.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4642714812237175147', time=2024-09-14T13:49:55.938102+0000, chain.objs.size()=1 2024-09-14T11:56:14.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.603__shadow_.bZi-ULbRJYxo-Zg4KlVZNkszk5lpa0q_0 2024-09-14T11:56:14.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1071078276436981682', time=2024-09-14T13:52:17.240561+0000, chain.objs.size()=1 2024-09-14T11:56:14.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.631__shadow_.xbcKbt_WYdBNP_iO_ObC-QnqinoXFZU_0 2024-09-14T11:56:14.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6699811741223187053', time=2024-09-14T13:52:28.437387+0000, chain.objs.size()=1 2024-09-14T11:56:14.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.653__shadow_.yQdSR4rQ2o3hKTkClcl_QuAmrKxEGWE_0 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3540106186817140324', time=2024-09-14T13:52:35.017478+0000, chain.objs.size()=1 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.665__shadow_.pDeBWEQigXXO7v8V58ClEhqZWrYT0ek_0 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4533921247418754943', time=2024-09-14T13:52:49.256585+0000, chain.objs.size()=1 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.698__shadow:iKROvu2vCrLTaIkyyzz1MMlgrFXryXv_.2VJ5MPoXUrGGRjby1kremMv6bQNM-W5_0 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8279901243843637563', time=2024-09-14T13:53:44.309518+0000, chain.objs.size()=1 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.749__shadow_.wNFBGYiwPIbQ9WqHkSf14vqTfh01h3y_0 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13409202809800119915', time=2024-09-14T13:53:53.657642+0000, chain.objs.size()=1 2024-09-14T11:56:14.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.761__shadow_.WOpH9ReZgdGhEZzRd_TPSiBxGaL5r-i_0 2024-09-14T11:56:14.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.215+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.218+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:56:14.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.219+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.219+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47234' 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13237085680075193932', time=2024-09-14T13:45:12.225063+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.243__shadow_.mPKhfctr44WPjCg6Uus0PQZw2rKx6uj_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1443685487968654618', time=2024-09-14T13:45:14.438097+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.246__shadow_.VfjB0RnkuvGkEUxphPVdNAAco5BF6Ey_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4219044238293405103', time=2024-09-14T13:45:17.339772+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.252__shadow_.BKFqrCf65ksW3ir2ybgXvKJwNu1BVlN_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.192593703313074502', time=2024-09-14T13:45:18.325641+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.254__shadow_.CKEJZLZO1CNpKBPEsZXKzykvneBggd5_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16063630548232935911', time=2024-09-14T13:45:19.732187+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.257__shadow_.Am4PqJKPDlpOrCt_9xREp2ZF6B1S51X_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2040854899871379427', time=2024-09-14T13:45:19.732876+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.257__shadow_.0TdWW2d7CUgUf-xMCX0vmw7a2oNb8y9_0 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1569432069909201987', time=2024-09-14T13:45:19.733625+0000, chain.objs.size()=1 2024-09-14T11:56:14.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.257__shadow_.mmRzZD9kkLSzCnuW9E62goAaShMNcU3_0 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9013426370965486647', time=2024-09-14T13:45:30.433599+0000, chain.objs.size()=1 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OoRuoi-nOU3QaHTZkWbo_hP0H0spiH5_0 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9543845208821083910', time=2024-09-14T13:45:30.468403+0000, chain.objs.size()=1 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HO2Pb3moUhwvolKnvnV_ZFvccU5cy-C_0 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16727346807257330322', time=2024-09-14T13:45:30.510213+0000, chain.objs.size()=1 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4u8-X2W2dRVQy0vuRfqz_cj4dozEGNe_0 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9686210173625686526', time=2024-09-14T13:45:30.593474+0000, chain.objs.size()=1 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.J7VV_87qUt32u2CJ-8hUBrwJZ4IFWkA_0 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1706681364361870886', time=2024-09-14T13:45:30.596918+0000, chain.objs.size()=1 2024-09-14T11:56:14.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YCiJfVLi4etkWNS3C7zqkXp69CBEvep_0 2024-09-14T11:56:14.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.222+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5652112052374181235', time=2024-09-14T13:45:30.665757+0000, chain.objs.size()=1 2024-09-14T11:56:14.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.222+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.COeTSugkY7vE9Q6Ly6S-4g2OLBMD02v_0 2024-09-14T11:56:14.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.223+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1231844339394291536', time=2024-09-14T13:45:30.689864+0000, chain.objs.size()=1 2024-09-14T11:56:14.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.223+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Mboz-C7b8jC1I8-SJr83A0ohVY4pc8N_0 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14619104831384507354', time=2024-09-14T13:45:30.694397+0000, chain.objs.size()=1 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FrI_rVlv2lJYD9tCCFVs2a25aoFZXTO_0 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8581692725247898193', time=2024-09-14T13:45:30.805566+0000, chain.objs.size()=1 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WkEw6tGvGtmQlvcOmQW4IDPMS5aMgZp_0 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.892158473019159748', time=2024-09-14T13:45:30.817020+0000, chain.objs.size()=1 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I_zPMKWFWQMCKKWonIaFZujVtivtUfk_0 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9735571951168728723', time=2024-09-14T13:45:30.834840+0000, chain.objs.size()=1 2024-09-14T11:56:14.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W22-RHBlrgl4AQhzMNQ6RUTOod7gCeE_0 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11266134578558810849', time=2024-09-14T13:45:30.869272+0000, chain.objs.size()=1 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-jbYQy3-y4sN0rVRaBczp-JTRKMf3_O_0 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15315849960913124623', time=2024-09-14T13:45:30.957001+0000, chain.objs.size()=1 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2U2Ce8DiFGomND8-R_0dGmEx6y3NPCt_0 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1812909142883888595', time=2024-09-14T13:45:30.995768+0000, chain.objs.size()=1 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iPYBuZff8gvloRXamSoK5HitL_MaDZE_0 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5059471366737028030', time=2024-09-14T13:45:31.001825+0000, chain.objs.size()=1 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TwQ0FXpd4jmk2jm4G6cBkvOSERfFsOj_0 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1188768755242663819', time=2024-09-14T13:45:31.040771+0000, chain.objs.size()=1 2024-09-14T11:56:14.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EvxaHWpuehbRVRLM9K7hrCzi4p5N9tr_0 2024-09-14T11:56:14.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16889749411589957816', time=2024-09-14T13:45:31.055819+0000, chain.objs.size()=1 2024-09-14T11:56:14.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0-qpwwAWvt3v9FGq9AAdCA7smAE_EdY_0 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1891870148954976505', time=2024-09-14T13:45:31.150961+0000, chain.objs.size()=1 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rI6aAlo7JiBj16pyXr2-bRyfEBhGVRD_0 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9775973641703649473', time=2024-09-14T13:45:31.160773+0000, chain.objs.size()=1 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yXJxmRPMTlTLtGs5X0LZkgbA0aN6TIU_0 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7022183907037540836', time=2024-09-14T13:45:31.168876+0000, chain.objs.size()=1 2024-09-14T11:56:14.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.227+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kVLf0k3kjOT8krKqRMz-oG3fD4qfxSO_0 2024-09-14T11:56:14.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1934889636099770956', time=2024-09-14T13:45:31.175336+0000, chain.objs.size()=1 2024-09-14T11:56:14.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Nro1xwdD9EAuXL_Rq1hhYj0Zc94IBnv_0 2024-09-14T11:56:14.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14744350884656938136', time=2024-09-14T13:45:31.222370+0000, chain.objs.size()=1 2024-09-14T11:56:14.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZGivGobdeevDsJwqz2spnVKLnQShN2D_0 2024-09-14T11:56:14.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13102959564251522295', time=2024-09-14T13:45:31.504791+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fsar7va030YguoI13mzJngxRtCqFupa_0 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17802226243248874955', time=2024-09-14T13:45:31.506022+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BNc30m13KqceJsjvdD-WuovfHzk3vRv_0 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11487372583520962395', time=2024-09-14T13:45:31.547205+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9zIdOxW3BJUVtlEIzp6yruO9nhproqe_0 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10643441103707902907', time=2024-09-14T13:45:31.553006+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vIai46Kq0vf4mCE1gUNmCek-pcIq4Ks_0 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8017232204134381983', time=2024-09-14T13:45:31.757469+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Lu2wKv0gSkhp9l2G4hnELH_ia4w2oE5_0 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.229+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3898988469547796506', time=2024-09-14T13:45:31.763909+0000, chain.objs.size()=1 2024-09-14T11:56:14.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3h6chp5EFqhtVHsSXi5xYzxoQwOHQ2h_0 2024-09-14T11:56:14.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10679883486312400427', time=2024-09-14T13:45:35.673752+0000, chain.objs.size()=1 2024-09-14T11:56:14.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.271__shadow_.z1cQ9bLAHvt3Kjvq1OrYCzqwtk9vuNq_0 2024-09-14T11:56:14.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6950564923693137539', time=2024-09-14T13:45:38.612765+0000, chain.objs.size()=1 2024-09-14T11:56:14.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.277__shadow_.esga8xe4EG-rejPDhdXIOwCoJKzkNrX_0 2024-09-14T11:56:14.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4359619826262933716', time=2024-09-14T13:45:39.106015+0000, chain.objs.size()=1 2024-09-14T11:56:14.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.231+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.278__shadow_.AvFMxpevyNS-8WiLsn4dlG6KKxvofcy_0 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14239461203620615329', time=2024-09-14T13:45:39.802484+0000, chain.objs.size()=1 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.279__shadow_._7GH3UILkUqRO5hjCjG2OXAeRKcZZco_0 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8649925216342743280', time=2024-09-14T13:45:43.872067+0000, chain.objs.size()=1 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.287__shadow_.1Sg-PD9wBzTjcBO76H04rvmYgn1dvZz_0 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10334336189250471647', time=2024-09-14T13:45:44.821712+0000, chain.objs.size()=1 2024-09-14T11:56:14.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.289__shadow_.fijQc5V1mT1eiZaHuXfJYMlYQ-mA5ZV_0 2024-09-14T11:56:14.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1653528754593961021', time=2024-09-14T13:45:51.158409+0000, chain.objs.size()=1 2024-09-14T11:56:14.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.300__shadow_.pK3rsTdlrpZ7Qm_uEZekGr2r2zIkl47_0 2024-09-14T11:56:14.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17788159868318298948', time=2024-09-14T13:46:10.962567+0000, chain.objs.size()=1 2024-09-14T11:56:14.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VnWM1TifkiqS6XFAbuMx5NUzkEAOHWQ_0 2024-09-14T11:56:14.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5698199898903909217', time=2024-09-14T13:46:10.974138+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oSEGXv23lByT5h3NONcFlH4HQYnnO_7_0 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15468925865550279516', time=2024-09-14T13:46:11.017257+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lrvoDcds0M3-schLnhdB2o7abrDzlSf_0 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5798596597363032183', time=2024-09-14T13:46:11.020217+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZU6r4aURiP1caSkEjKZqqA8vDq0_jFY_0 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9923037547954746185', time=2024-09-14T13:46:11.028263+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kOu5PJv2-7h_mMFPZ5tk9ckVStze9MD_0 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9830426921628527325', time=2024-09-14T13:46:11.170913+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lkLIXzrkJyM7rA_YAc2xdTA-xpnb2ZR_0 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9178836979182816107', time=2024-09-14T13:46:11.173845+0000, chain.objs.size()=1 2024-09-14T11:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.p_dY2yxyiWU24hvJLkUOvDkyBx4W7Sf_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11273114616461637329', time=2024-09-14T13:46:11.205529+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3CPgfwwQ-OAryvCKI7lqm7rw5BPuUyD_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2851607074625966148', time=2024-09-14T13:46:11.214849+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AvSPd-OkWDyoYRKwbUb2G8xuVY0V_wl_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4229657954337931905', time=2024-09-14T13:46:11.222478+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5TG3AZJdfovim65ajHrX6jX6eGfLRX6_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12172719190816936335', time=2024-09-14T13:46:11.303008+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nX6L6ITkCq1jQOhlJJGPAC4KxK_OTed_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6054938651909768548', time=2024-09-14T13:46:11.337513+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ah7ueN71s35GrmmkZ7379qc-7yBP6se_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13226915594674264676', time=2024-09-14T13:46:11.338432+0000, chain.objs.size()=1 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7NxBaNmtRuQExrnclUFYKX-vDOM7Yo6_0 2024-09-14T11:56:14.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9317267847712330520', time=2024-09-14T13:46:11.394126+0000, chain.objs.size()=1 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zPmSoG8QlGnEM_6c1eFcJaqe3uq48Xt_0 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3097755792784368626', time=2024-09-14T13:46:11.404252+0000, chain.objs.size()=1 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.FKIHCCcxMbJv9YFJclX1r3qeVU21zJU_0 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10110013003532355027', time=2024-09-14T13:46:11.668910+0000, chain.objs.size()=1 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YWJvv3AFb4gh-BpC_X09tXFY-o78r9M_0 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17192137021940001234', time=2024-09-14T13:46:11.677860+0000, chain.objs.size()=1 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2ZNa4Vgnex0uhi4Vkk8GCe-P3Asd_zd_0 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18370956725413361275', time=2024-09-14T13:46:11.699406+0000, chain.objs.size()=1 2024-09-14T11:56:14.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.238+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cOStEDgu7e1GAvd20xohYyxm7ab7Shv_0 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16809472503141205596', time=2024-09-14T13:46:11.714770+0000, chain.objs.size()=1 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0MH1UK_MvcKEw7AX9YeLutSASJWh5sQ_0 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1290425117337571125', time=2024-09-14T13:46:11.842975+0000, chain.objs.size()=1 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A_Hu3djUaG_sw96vM-J41QLdrF6TvoR_0 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9271733966104491124', time=2024-09-14T13:46:11.844471+0000, chain.objs.size()=1 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y-RqsI64b5byq6dmRQ6AwbV4vwpzU1a_0 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10550150082665609186', time=2024-09-14T13:46:11.868438+0000, chain.objs.size()=1 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._bDWsELMK-EyFAv_kQL3hR10LgdODey_0 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6103685243588008035', time=2024-09-14T13:46:11.871926+0000, chain.objs.size()=1 2024-09-14T11:56:14.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rcVCBk44qIq-8WFRtPPCiYYIorOLLNb_0 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.242+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3647859075063453150', time=2024-09-14T13:46:11.873653+0000, chain.objs.size()=1 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.243+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WQvJ76PDefwQC19U22aKqGLNQDYH1C1_0 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.243+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11854154562633474107', time=2024-09-14T13:46:11.887826+0000, chain.objs.size()=1 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.243+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GgruvAInaDb013Bo4tkm9oLs24e79T5_0 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.243+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15639343643806638515', time=2024-09-14T13:46:11.910030+0000, chain.objs.size()=1 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.243+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UrH2HT5cDK7EgkchGCsIfw5n3Z86Q3F_0 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2579136389726017969', time=2024-09-14T13:46:11.916027+0000, chain.objs.size()=1 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.q4kPr-dKk62SE53jVxEM2pc4yI66suo_0 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13452050110358592826', time=2024-09-14T13:46:11.927555+0000, chain.objs.size()=1 2024-09-14T11:56:14.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MKEvMlV5OtGZ9SZq6VPxFwtS6a5erpc_0 2024-09-14T11:56:14.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4740206563210835164', time=2024-09-14T13:46:12.029883+0000, chain.objs.size()=1 2024-09-14T11:56:14.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.92eVJqDlpAEjats02cfPIpFkI0minJg_0 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15235329130772902045', time=2024-09-14T13:46:12.055007+0000, chain.objs.size()=1 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4PKzYSsCs3rEEmLVUj0N4Kto1CU9ZUq_0 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1042601969453358728', time=2024-09-14T13:46:12.063788+0000, chain.objs.size()=1 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PYtT6e23fsbwVYar-kSDEg7uAKDfLQ6_0 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5896441126826141934', time=2024-09-14T13:46:12.075672+0000, chain.objs.size()=1 2024-09-14T11:56:14.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.s9zJQTgeEuzy-3ey2GJEK85glnXdjsB_0 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11860488155654887203', time=2024-09-14T13:46:12.076330+0000, chain.objs.size()=1 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BqaI5pMljA_OAQbmbbucsovDYWbpr7t_0 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13334354769611885097', time=2024-09-14T13:46:12.441439+0000, chain.objs.size()=1 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vWwFLQJY6M2KlcU5g_J1oZ9QAhvrV8u_0 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2321549753439161877', time=2024-09-14T13:46:12.485118+0000, chain.objs.size()=1 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Rmbm1zUrKxyIaJViGqK8usBqtLBCG36_0 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9195077230167073502', time=2024-09-14T13:46:12.486439+0000, chain.objs.size()=1 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7Wjfn46p2u3qYlTvmCIjinnrqUvOXmK_0 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18251775136110555917', time=2024-09-14T13:46:12.504358+0000, chain.objs.size()=1 2024-09-14T11:56:14.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.246+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.F_FFUbph6hYSYdZUN--R5O7f_2tk8Ls_0 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.247+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8790587346433027340', time=2024-09-14T13:46:12.603066+0000, chain.objs.size()=1 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.247+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tYa6Y1dVFfKrmqlFp8MKJjotAQqKiqN_0 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15082711449044922833', time=2024-09-14T13:46:12.636497+0000, chain.objs.size()=1 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uSMvZgt6KBgOYNxEaCyaW99NfsWNb2R_0 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9310660995995758633', time=2024-09-14T13:46:12.658599+0000, chain.objs.size()=1 2024-09-14T11:56:14.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2wjOyLzdA_B8pD8cYARxlKCUG5NSkac_0 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7556290580848779433', time=2024-09-14T13:46:12.668065+0000, chain.objs.size()=1 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.O9aU-4BOzfmTV4nZoRFFDpEnF2ycADw_0 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16533584595260199971', time=2024-09-14T13:46:12.668817+0000, chain.objs.size()=1 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.i_2lsk0MGM8zW7Rokd7srB5CuaCalw1_0 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17705833447714582217', time=2024-09-14T13:46:20.711815+0000, chain.objs.size()=1 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._3yD88FCb0cbjnnICpn0TCKD0zHDOsQ_0 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4344100626473310572', time=2024-09-14T13:46:20.714391+0000, chain.objs.size()=1 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.W76xfAD45o2-jpzXLnQMmEksnOp0Kzp_0 2024-09-14T11:56:14.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2110773670599534087', time=2024-09-14T13:46:20.761746+0000, chain.objs.size()=1 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S5Y-VA0Zqi61Oe2Xk-so_7JIHlMpqVg_0 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14590503146881936901', time=2024-09-14T13:46:20.810990+0000, chain.objs.size()=1 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.250+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S79mHA0lKGdtgzjE5WDwx7bmpBNOKTg_0 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5413415854430788838', time=2024-09-14T13:46:20.820052+0000, chain.objs.size()=1 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YKONXLhXqGF17_Mb0Pb4asj2Iz9EJGt_0 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16679386432674988177', time=2024-09-14T13:46:20.931578+0000, chain.objs.size()=1 2024-09-14T11:56:14.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5Le8q3tDNBx6kgEluXiBHi2c8l4UsBD_0 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13400950472368843643', time=2024-09-14T13:46:20.959469+0000, chain.objs.size()=1 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9YoH5Q4ROvrz0e-vYTfy9x9mwjXeV1v_0 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14268742653621627914', time=2024-09-14T13:46:20.963131+0000, chain.objs.size()=1 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Zjykz7i0dJBfeA7ISGbLcljUXhrLCmN_0 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4348370430756764419', time=2024-09-14T13:46:20.984134+0000, chain.objs.size()=1 2024-09-14T11:56:14.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.251+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6qkfYfkNqBj25vGlgfosp7sZG_GheyL_0 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7608711595194830817', time=2024-09-14T13:46:21.005667+0000, chain.objs.size()=1 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EKJVLhaEpqYNzF2kDMPcx3Bwxj-fvf1_0 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5483304972472688474', time=2024-09-14T13:46:21.095782+0000, chain.objs.size()=1 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AP8D6PFhVcNhiU5sQtYLsePhc3ENjXy_0 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7510702852814581515', time=2024-09-14T13:46:21.167566+0000, chain.objs.size()=1 2024-09-14T11:56:14.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Y4muzD92vNBF7MUL9csrFI41y5dpeEB_0 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16257194666198279730', time=2024-09-14T13:46:21.201423+0000, chain.objs.size()=1 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.gH7k2juPVZ-O06xtdSTUMjGWLSpcj23_0 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.215550871854638199', time=2024-09-14T13:46:21.283233+0000, chain.objs.size()=1 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7DX5ixewLITXip-ZCPqZRG0MneBMMC6_0 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1101539515941929725', time=2024-09-14T13:46:21.287332+0000, chain.objs.size()=1 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nNfBzYBDAw3I-tNiaWVixVEhAkPjCU4_0 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5892451625039332718', time=2024-09-14T13:46:21.338243+0000, chain.objs.size()=1 2024-09-14T11:56:14.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.255+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YIlCPkrGsHymyBooARqEtDQFKwyvqH9_0 2024-09-14T11:56:14.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.259+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47234 2024-09-14T11:56:14.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T11:56:14.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.855509900306151080', time=2024-09-14T13:46:21.488625+0000, chain.objs.size()=1 2024-09-14T11:56:14.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.A8yy6PiV8f_WdbEQ5ycGmaZHR6meC9e_0 2024-09-14T11:56:14.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5605089285079687926', time=2024-09-14T13:46:21.493502+0000, chain.objs.size()=1 2024-09-14T11:56:14.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.b_zw19F4ODduPSVgzxmCg4EhT3dYvKQ_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3507961266154430838', time=2024-09-14T13:46:21.522804+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eilkJUbJLJ9KbAzQWlJ6TRD-lO4GpZy_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.652976418130745660', time=2024-09-14T13:46:21.762541+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WLGIVW2V5HXZo7CowPWgz42mTpWR9vK_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15336726635310688378', time=2024-09-14T13:46:21.764527+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ut9UJ8l0yHdswZ3N6pIDptjY9DAtqZJ_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13116982858175510669', time=2024-09-14T13:46:21.900936+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yaXOR1Y6WJQdl6SmWX9E2nw_oBOdg8H_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10822590217224112987', time=2024-09-14T13:46:21.920559+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JAwtZk8TVwrnmvDM3l3JpwGdqvpezT4_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9905097893961910934', time=2024-09-14T13:46:22.044097+0000, chain.objs.size()=1 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zPWaGMdffCSaW7aFNbcrwXtkmBeWOce_0 2024-09-14T11:56:14.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15949073268293381540', time=2024-09-14T13:46:22.050865+0000, chain.objs.size()=1 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xElZKmM5ddjolujUC1Y8DJcp9gQgGlR_0 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4073096602777845015', time=2024-09-14T13:46:22.071446+0000, chain.objs.size()=1 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QT5L8_DcEnbUYiW4VsFG9h3Bt6gkXsr_0 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2253842246747592141', time=2024-09-14T13:46:22.099091+0000, chain.objs.size()=1 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.78v0KdnAif89aGikylu0MszoUC4_P_W_0 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10333919269217508515', time=2024-09-14T13:46:22.148662+0000, chain.objs.size()=1 2024-09-14T11:56:14.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jF_8JZBlLn4WwNira0-wvCJzL2liCH3_0 2024-09-14T11:56:14.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17828845462708140816', time=2024-09-14T13:46:22.281413+0000, chain.objs.size()=1 2024-09-14T11:56:14.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LAtNlrU_ZOxAoQylUNHKUnbClvMzxYT_0 2024-09-14T11:56:14.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12476048284693146254', time=2024-09-14T13:46:22.301888+0000, chain.objs.size()=1 2024-09-14T11:56:14.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.h2enRXgDI7eqGcp0maQtbTGvqE9Wt1U_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15451144117265753355', time=2024-09-14T13:46:22.342127+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FcMM9aEgIlqnRqQ6WQmni_IoB_AhNy1_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6293097087822190244', time=2024-09-14T13:47:19.960432+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.441__shadow_.U_1P_IRlar5Bovo_QpXeEWrElWZ9S2l_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1702296754704199659', time=2024-09-14T13:47:32.961876+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.462__shadow_.z9nZFzS61hFLStMXGHbqFufTMzn7XRM_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7112414087093986979', time=2024-09-14T13:47:34.892251+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465__shadow_.SL3z9u4mVsiPkNPJJKHDMU3-tjvA0Yq_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5708202335386974122', time=2024-09-14T13:47:35.661413+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466__shadow_.Y7Fy9Eek6BaS78DyeZPjiE5uFiCECz__0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5233673354326874451', time=2024-09-14T13:47:36.269686+0000, chain.objs.size()=1 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.467__shadow_.lSoqexuPnoj2D98-YJFOKuI2TRfh5Js_0 2024-09-14T11:56:14.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11495211900780081377', time=2024-09-14T13:47:42.121838+0000, chain.objs.size()=1 2024-09-14T11:56:14.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.zXZrIfPfVnx7vr6ByAtbNrzk4goUBLr_0 2024-09-14T11:56:14.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7949604133484568717', time=2024-09-14T13:47:59.017114+0000, chain.objs.size()=1 2024-09-14T11:56:14.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.519__multipart_mymultipart.2~rlt7zfpEXfxSpD5OkYDGThFrEMygSaz.1 2024-09-14T11:56:14.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd', time=2024-09-14T13:48:17.390878+0000, chain.objs.size()=10 2024-09-14T11:56:14.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.1 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.2 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.3 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.4 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.5 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.6 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.7 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.8 2024-09-14T11:56:14.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.9 2024-09-14T11:56:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.527__multipart_mymultipart.2~XL5vehGwbuZ2u3oyxoIh7aRpACMfGZd.10 2024-09-14T11:56:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7919591551921795499', time=2024-09-14T13:48:56.726982+0000, chain.objs.size()=1 2024-09-14T11:56:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.552__shadow_.R3mgaro8ISD0p7VVRIOuAK1rgMvpuj2_0 2024-09-14T11:56:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16408809089402044637', time=2024-09-14T13:48:57.607255+0000, chain.objs.size()=1 2024-09-14T11:56:14.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.553__shadow_.DjseD4IY1oA_hlavt0X_XYZ3bW9bxts_0 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15182661600554833079', time=2024-09-14T13:48:57.963733+0000, chain.objs.size()=1 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.554__shadow_.CNn_5QeFc-buWFVzBJ_jzYqKMYGsUak_0 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14519876416121892672', time=2024-09-14T13:49:14.676724+0000, chain.objs.size()=1 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:65ex3diCvNBZQbwb94oNW0KbjsK2B6R_.w84tRODM7UypGyfyY3H8NwRFve-yyjH_0 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13451089520520895984', time=2024-09-14T13:49:17.532108+0000, chain.objs.size()=1 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:VCD1A8dp1p61RZYT2YvvkGg4W-Rw1Bt_.CNXz_yJYfwAnU25gTzCvEk741FM_wTk_0 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4582244893177743374', time=2024-09-14T13:49:48.336197+0000, chain.objs.size()=1 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.586__shadow:837FXgMpkVNumsqzYw4tzVJ5Ze26lzo_.RdywJVTE6Uo8dGOcEmTvTPVcPOMUlYM_0 2024-09-14T11:56:14.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8577652282602843364', time=2024-09-14T13:52:36.482061+0000, chain.objs.size()=1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.667__shadow_.iZnawF5F9ZHGHG2lwR5VuPTrRZxFSd6_0 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10854274030884521607', time=2024-09-14T13:52:50.994734+0000, chain.objs.size()=1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.702__shadow:mvqkc9oJPrOmBwZKmMv3fWi8bIoiUMd_.9_7oXd1N_DBpyv_vyFd-A0e9uhgUMRe_0 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13203724065113264183', time=2024-09-14T13:52:56.984185+0000, chain.objs.size()=1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.715__shadow:vTz4NAPmoR62JuJml6x14s3X06CvjGz_.GW0QcWC9dizfZKNPnL74t_-0vUKznt7_0 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9195215041713660677', time=2024-09-14T13:53:31.226251+0000, chain.objs.size()=1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.743__multipart_mymultipart3.2~uJw9NrT2_tyU_dF0n5Ls0sA3n1I1UGm.1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~4ZvslSRflDAjW96aeNvlR834oV8MTC7', time=2024-09-14T13:53:31.284538+0000, chain.objs.size()=1 2024-09-14T11:56:14.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.743__multipart_mymultipart2.2~4ZvslSRflDAjW96aeNvlR834oV8MTC7.1 2024-09-14T11:56:14.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.277+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.280+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:56:14.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.281+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42898' 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5397516590010976948', time=2024-09-14T13:43:14.974003+0000, chain.objs.size()=1 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.152__shadow_.6RvSyfpuiL9hVqeWp5AOeuewRKFIlRy_0 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_gX6U4BLXoxEI1cebI9c0qh_Ht6OnIq6', time=2024-09-14T13:43:23.130617+0000, chain.objs.size()=1 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.164__shadow_.Nz8pG6syKGbUSFq422DhAxzF2YdeQsx_0 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11869726380479196657', time=2024-09-14T13:43:25.074511+0000, chain.objs.size()=1 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.171__shadow_.hHN5F69ucvH9BgY95aKMUKlb4pTZce4_0 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16355636314604881102', time=2024-09-14T13:45:11.292932+0000, chain.objs.size()=1 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.282+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.241__shadow_.niP1XII27DNCnnYcSdk_p9OqMI_i-8l_0 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15396836536656626547', time=2024-09-14T13:45:13.094703+0000, chain.objs.size()=1 2024-09-14T11:56:14.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244__shadow_.nfAl_ZKnrwnSqifbbNOKcVs1C2fe6Fs_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16086864203162839258', time=2024-09-14T13:45:15.421589+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.248__shadow_.9aRryufCIkXkC6XnPHR_vCNiz73iFxU_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12102071798955050599', time=2024-09-14T13:45:20.679495+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.259__shadow_.i2i3iQqknkM2hw7OB82g3iqnCMR1fff_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8118382370307477235', time=2024-09-14T13:45:30.215877+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JzNImrv4Z9mumqpIKU310gLueqGudnj_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6515611405991138239', time=2024-09-14T13:45:30.218289+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cAtadmHfePJjmVhkVhgFTdChqyMo4sW_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2176735536450255618', time=2024-09-14T13:45:30.255039+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hZiELdyR0GSYB1VuQiAbmA5Sw_LbGWD_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5204949002450928185', time=2024-09-14T13:45:30.303414+0000, chain.objs.size()=1 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.s3uATRIhED4J_0OFfIvqHpigXe7Ri9B_0 2024-09-14T11:56:14.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13892141456322216704', time=2024-09-14T13:45:30.323201+0000, chain.objs.size()=1 2024-09-14T11:56:14.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.283+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Fzfjb3gbXkBcaRP3l1JFeHjBr6NrFM9_0 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7449810406598520634', time=2024-09-14T13:45:30.419034+0000, chain.objs.size()=1 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VVbk_yr_ACuxi_GNovMuyUpZ5iRIG5o_0 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15789802724651624916', time=2024-09-14T13:45:30.434379+0000, chain.objs.size()=1 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vB809nYiLUylAonuRg0KncIIW8Xelrb_0 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6868803669373672242', time=2024-09-14T13:45:30.456787+0000, chain.objs.size()=1 2024-09-14T11:56:14.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EZJazwmq9Vv9fWqBCoBnjYkZYM8vMFi_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15125514704369087908', time=2024-09-14T13:45:30.457872+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bi_B8rPySDGEaC3aAtir3x1t33aod7D_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16393588080787856420', time=2024-09-14T13:45:30.468210+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.z_C5kZ2mFckIiST6-aIKWf14_maN8x7_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2836738715651183679', time=2024-09-14T13:45:30.507330+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3gl0oTyRbKitmriNCBZQ5iF9uFGfwGY_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7595491709107882856', time=2024-09-14T13:45:30.513285+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.n7ok2ggNefxt6khjA4t24Fe-DpxCquZ_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3458831815947913252', time=2024-09-14T13:45:30.603198+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rP7ZWPWfR13ILHNFVuy-0X4IdUDgR7__0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7236215587679115580', time=2024-09-14T13:45:30.604021+0000, chain.objs.size()=1 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vFdoq27OcDBW-pYHNmPKYj7PmdYsZwg_0 2024-09-14T11:56:14.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4197192025307491173', time=2024-09-14T13:45:30.613246+0000, chain.objs.size()=1 2024-09-14T11:56:14.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rwYeIzT80gXIJ-nyPYCqujOF7fV8ZRn_0 2024-09-14T11:56:14.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6965926924302083824', time=2024-09-14T13:45:30.624851+0000, chain.objs.size()=1 2024-09-14T11:56:14.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YONFHKpJOCABCuuxfcAXvlMx1r8ISdD_0 2024-09-14T11:56:14.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12053096863553626816', time=2024-09-14T13:45:30.627762+0000, chain.objs.size()=1 2024-09-14T11:56:14.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.myGcya5scZD67xyRDU_hMcXD9Z5CYoI_0 2024-09-14T11:56:14.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4229826210998441261', time=2024-09-14T13:45:30.639326+0000, chain.objs.size()=1 2024-09-14T11:56:14.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5Ok6sLsgGrKN8banZ7fBP1K8l4NOb2q_0 2024-09-14T11:56:14.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2481557793834021826', time=2024-09-14T13:45:30.640559+0000, chain.objs.size()=1 2024-09-14T11:56:14.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GxKDVx7DaMyJyI_naNYIbcpufMlKzMX_0 2024-09-14T11:56:14.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.290+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3439282874508009384', time=2024-09-14T13:45:30.650996+0000, chain.objs.size()=1 2024-09-14T11:56:14.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.290+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Oncetpmavtms2BTCTxM7giaJYYB-B2f_0 2024-09-14T11:56:14.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10394954698161230589', time=2024-09-14T13:45:30.673868+0000, chain.objs.size()=1 2024-09-14T11:56:14.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.482HljO8ikoBI9Mt7aW4EB7Y3e7F1z0_0 2024-09-14T11:56:14.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4834180354104687958', time=2024-09-14T13:45:30.691851+0000, chain.objs.size()=1 2024-09-14T11:56:14.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hbC-51p4GqsZORSZgoOuqU388hHWg9p_0 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16174953091189960576', time=2024-09-14T13:45:30.693982+0000, chain.objs.size()=1 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ao4SoUhjGd4AJ3HyZDEdt0f67hzQGjv_0 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11589939543790504350', time=2024-09-14T13:45:30.813039+0000, chain.objs.size()=1 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bXHkwfRrdkgkxjzG51uPsQ3ZP0YW2_K_0 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10265136721651599302', time=2024-09-14T13:45:30.849891+0000, chain.objs.size()=1 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.c7RGdpE9BF3nhOSBmzZ4mr9OH3a2cxz_0 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5516822614080047744', time=2024-09-14T13:45:30.856420+0000, chain.objs.size()=1 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.s_rTuaF6damG81dSzqhn15QHj4cUk3g_0 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5586989957985653960', time=2024-09-14T13:45:30.976038+0000, chain.objs.size()=1 2024-09-14T11:56:14.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.291+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SQSSjdGcfJPH01Oyutt3TiqF1e9ylVL_0 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13774431450294898631', time=2024-09-14T13:45:30.981956+0000, chain.objs.size()=1 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Z35_QjkyQOvpaRAr7rMEFdRppbCzcxD_0 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4159135392382378153', time=2024-09-14T13:45:31.003741+0000, chain.objs.size()=1 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fHY3PVtlLRv-ice0z650rkK7C7HguSc_0 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15539729483775136902', time=2024-09-14T13:45:31.004746+0000, chain.objs.size()=1 2024-09-14T11:56:14.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.293+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.72yMtNYLmDDD4t_PSn-u-rX3fA4lvY3_0 2024-09-14T11:56:14.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.294+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9744433010488444175', time=2024-09-14T13:45:31.021101+0000, chain.objs.size()=1 2024-09-14T11:56:14.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.294+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Q_KC7valPJPV1UtIQB1vx7USD7b_Q6b_0 2024-09-14T11:56:14.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.295+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7979495331879237016', time=2024-09-14T13:45:31.055711+0000, chain.objs.size()=1 2024-09-14T11:56:14.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.295+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FLZe9YNgq95IV2uc9MMFKkTcHB8ySiM_0 2024-09-14T11:56:14.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.295+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11905739591560629874', time=2024-09-14T13:45:31.148357+0000, chain.objs.size()=1 2024-09-14T11:56:14.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.295+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jG7j5kh0kIwYbguGicsNlGsX2wfbqRf_0 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2418461232610384058', time=2024-09-14T13:45:31.176902+0000, chain.objs.size()=1 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nGcQwAvS2pJF33S1pdyGKTUj_2XWvf4_0 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16552382381844119434', time=2024-09-14T13:45:31.218240+0000, chain.objs.size()=1 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uwH5pTZgHmA2v81kz1tIEnBe_hRJ4CF_0 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14761143801325326858', time=2024-09-14T13:45:31.242049+0000, chain.objs.size()=1 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EuX1K_viuFOOgaGJoEAM9Q7AwUX6Ri9_0 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4497020016982449919', time=2024-09-14T13:45:31.530099+0000, chain.objs.size()=1 2024-09-14T11:56:14.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.296+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3vzTViIdscOA2dt7eeDSxVPbHp0Ht6n_0 2024-09-14T11:56:14.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16532869651556854052', time=2024-09-14T13:45:31.563674+0000, chain.objs.size()=1 2024-09-14T11:56:14.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JbrnNiFjE2g9wcxTh1KFXWZrqET4fGJ_0 2024-09-14T11:56:14.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12113462673938563989', time=2024-09-14T13:45:31.569540+0000, chain.objs.size()=1 2024-09-14T11:56:14.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lrXqHQ7nTiRrH5X4hqoJWxnU9TzXy23_0 2024-09-14T11:56:14.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2919780204513272603', time=2024-09-14T13:45:31.570424+0000, chain.objs.size()=1 2024-09-14T11:56:14.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HR3jJhU9pnxgjTqrKikOuvCZwUvn-Dp_0 2024-09-14T11:56:14.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3327027573319175563', time=2024-09-14T13:45:31.573014+0000, chain.objs.size()=1 2024-09-14T11:56:14.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.297+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qsF31vD1aXoHdILNtCU84R5jma32r9c_0 2024-09-14T11:56:14.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.298+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5935185174646293866', time=2024-09-14T13:45:31.598284+0000, chain.objs.size()=1 2024-09-14T11:56:14.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.298+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.a1qMTI5StkScaQKQvwtXO8KfIoBhloC_0 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.813925319276640740', time=2024-09-14T13:45:31.699623+0000, chain.objs.size()=1 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wtng39e9d4OevXoLNIRpcbUCJIhtoWP_0 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2043578282636025779', time=2024-09-14T13:45:31.704148+0000, chain.objs.size()=1 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3rhHXcv5ajd_w1P77onJdr2zjKSNms4_0 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16562318606593200637', time=2024-09-14T13:45:31.753000+0000, chain.objs.size()=1 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.l7TXVVXB_4j63akOia1q-NPqjWbhveE_0 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6153254169024763418', time=2024-09-14T13:45:40.297324+0000, chain.objs.size()=1 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.280__shadow_.xJa8UJU7RixEesyyp3f_wDPa3tsL0Hf_0 2024-09-14T11:56:14.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17771472782619768131', time=2024-09-14T13:45:40.797264+0000, chain.objs.size()=1 2024-09-14T11:56:14.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.281__shadow_.MzHmNheDJzrgR3ksvkVLEFhRTkz7dAN_0 2024-09-14T11:56:14.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11101273408332415051', time=2024-09-14T13:45:42.284647+0000, chain.objs.size()=1 2024-09-14T11:56:14.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.300+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.284__shadow_.WZoox4ZjyUyy2FQLJbCxBvisFd4NSRR_0 2024-09-14T11:56:14.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17876042802461975754', time=2024-09-14T13:45:44.822796+0000, chain.objs.size()=1 2024-09-14T11:56:14.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.289__shadow_.Dtf1RaX2beM30mJBEXlpzPH4EOSrhKB_0 2024-09-14T11:56:14.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4022756376783338828', time=2024-09-14T13:45:45.277712+0000, chain.objs.size()=1 2024-09-14T11:56:14.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.290__shadow_.zeg4_9rYk1tpTZE4dT2fmbUDAFkjDQ2_0 2024-09-14T11:56:14.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16832874586531637733', time=2024-09-14T13:45:48.181121+0000, chain.objs.size()=1 2024-09-14T11:56:14.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.302+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.SsUDIXTy6Swt-ri6u3vSKY48Ic-7N5e_0 2024-09-14T11:56:14.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2069732956944782327', time=2024-09-14T13:45:49.171933+0000, chain.objs.size()=1 2024-09-14T11:56:14.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.296__shadow_.CFvEUn7aUhs2krgOZzSNvQoE_FeQV2R_0 2024-09-14T11:56:14.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17257105413278605940', time=2024-09-14T13:45:52.637414+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.303__shadow_.ESVvC7RRVO_M7WbKwFKcRl5FVL-Ei4N_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18268208610595589246', time=2024-09-14T13:46:10.962942+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M67F3cqQO1pOzYwWYTrerV5di-3Mqd7_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18429997783571267325', time=2024-09-14T13:46:10.991851+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IfD6cHXl3HZ4wn9uRHPEC7CmJd2qE7Y_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5888668156593501581', time=2024-09-14T13:46:11.120530+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SdW8A6YtVFwX_spe1qc20n7Pi7O2UKr_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3200202654091076556', time=2024-09-14T13:46:11.136327+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.u-HM-quZRBZKWG6v4ezq_YgD_zooM7w_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.304+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.682813658429031881', time=2024-09-14T13:46:11.137439+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.304+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M370KbSiTPsWoKfKjMc7F0mj2jpjrjN_0 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.304+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1943838919033113360', time=2024-09-14T13:46:11.142714+0000, chain.objs.size()=1 2024-09-14T11:56:14.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.304+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3Ey8SEa8XPMlxcOuy2BMNoL6rCpxAtP_0 2024-09-14T11:56:14.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17521063219549801722', time=2024-09-14T13:46:11.170236+0000, chain.objs.size()=1 2024-09-14T11:56:14.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RUlIPUayOd-gCwbf3xtbHUdNdqD2ljD_0 2024-09-14T11:56:14.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11834444127011987380', time=2024-09-14T13:46:11.209591+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zwM4oXubzFE1ZHphoybHRV_HMHqGM_J_0 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14087556272998053135', time=2024-09-14T13:46:11.308146+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UNOQmGg9T0JsB_MpYpT3sIXbSXq5j5N_0 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11907418876784964026', time=2024-09-14T13:46:11.326934+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Hug0ohbz_KGbvfHBRKz8MI9_BeGqs5V_0 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.399504624642138582', time=2024-09-14T13:46:11.351046+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.e-Jbky3KeyptttZAbDEadvXk9iDl0t0_0 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14608880145784560573', time=2024-09-14T13:46:11.402736+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ApH-98AUjy7j6Qh3fESXwOmb6ZbslLZ_0 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5509888659389458997', time=2024-09-14T13:46:11.416757+0000, chain.objs.size()=1 2024-09-14T11:56:14.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.307+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.r-OAKOgXkNdqosKqam1qS_UiN3qA249_0 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12780290747019558386', time=2024-09-14T13:46:11.572554+0000, chain.objs.size()=1 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.d4oABr8_Be4Cbp0CCPDWs2Wx6W6j2M8_0 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13709744894768261998', time=2024-09-14T13:46:11.658260+0000, chain.objs.size()=1 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RDCqBQst3yjwVFjonRyRc1E3B-zFN4w_0 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1286583271239425636', time=2024-09-14T13:46:11.693710+0000, chain.objs.size()=1 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._oqHV6cktEeuwsqJIezq_nvuBR_Mw8z_0 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5226571209548290391', time=2024-09-14T13:46:11.735834+0000, chain.objs.size()=1 2024-09-14T11:56:14.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xRFvNQ-5zlvdzE7or3MtTlX9eAnsDfD_0 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16418798211382300942', time=2024-09-14T13:46:11.878980+0000, chain.objs.size()=1 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Y25qhWueabr7PDTidjRiWBFYSI6gZRV_0 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5288857995596061407', time=2024-09-14T13:46:11.898738+0000, chain.objs.size()=1 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JRKIDFEYaY3jXmvnbZ6wS0z77IsBt-x_0 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9298559362787265415', time=2024-09-14T13:46:12.087753+0000, chain.objs.size()=1 2024-09-14T11:56:14.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aC_Yo4WJbZAn8cYF_m8723YVqQiiE3z_0 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9551838126050137329', time=2024-09-14T13:46:12.117549+0000, chain.objs.size()=1 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cdu1auyo0egh9eUtxTdX6lFG7Nm1DH7_0 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16885236505960223463', time=2024-09-14T13:46:12.134181+0000, chain.objs.size()=1 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LzZiEhVx91BxlAt9IMLLm-QuRBenwMT_0 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5309855015919028088', time=2024-09-14T13:46:12.488042+0000, chain.objs.size()=1 2024-09-14T11:56:14.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.310+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jsmJ1Rel9t-exdCeK3DZfpM3YVrex7A_0 2024-09-14T11:56:14.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.312+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10383743364953090264', time=2024-09-14T13:46:12.492198+0000, chain.objs.size()=1 2024-09-14T11:56:14.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.312+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.muI_i0m86rH_TrRtkKV0KpyO1KHsTM__0 2024-09-14T11:56:14.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14513290311407197218', time=2024-09-14T13:46:12.526163+0000, chain.objs.size()=1 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QNtfKjbRaStpSOgBROWIbIBt4pAXeb__0 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13437027251611202919', time=2024-09-14T13:46:12.629090+0000, chain.objs.size()=1 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.915p7LLCLysjG8KA2d2kNTlfIMdH-TN_0 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13084207461444756307', time=2024-09-14T13:46:12.687198+0000, chain.objs.size()=1 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.21LDXEcz4tbKAKrDzZtzyHs7b8jiMqg_0 2024-09-14T11:56:14.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17051121196377574009', time=2024-09-14T13:46:20.766732+0000, chain.objs.size()=1 2024-09-14T11:56:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iZl2zh8bhXdzlqlZmuSMD2hDhSO6vQo_0 2024-09-14T11:56:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11779506710289967496', time=2024-09-14T13:46:20.898612+0000, chain.objs.size()=1 2024-09-14T11:56:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cyQLR96RJpk-be024sWyLXn00nv8TJf_0 2024-09-14T11:56:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7755744401344367183', time=2024-09-14T13:46:20.928572+0000, chain.objs.size()=1 2024-09-14T11:56:14.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.314+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WHNArFfagSqoZeRV3wOIzS1qGDdj4u2_0 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3216075152065242254', time=2024-09-14T13:46:20.975530+0000, chain.objs.size()=1 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fGKFKelisUDNtW-PBE0-qgKIm35-2xR_0 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17051897103323796498', time=2024-09-14T13:46:20.995813+0000, chain.objs.size()=1 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2cWiZNWl64ehaD63US2j_-kmDDYz4yl_0 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6755745941755521835', time=2024-09-14T13:46:21.105144+0000, chain.objs.size()=1 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MfOlfZQPpmVs6wSt-DhHIkSdq6Nfqjd_0 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6037725503762734974', time=2024-09-14T13:46:21.112510+0000, chain.objs.size()=1 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.e4cBk8uO7W2XNHy4dr2Y_gJC_b1EenM_0 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4433422851928179709', time=2024-09-14T13:46:21.154888+0000, chain.objs.size()=1 2024-09-14T11:56:14.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pUMp2tfuER5sTOdgemcspvCC2eKY_qR_0 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6677321602490173596', time=2024-09-14T13:46:21.197251+0000, chain.objs.size()=1 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-9nm2I6pg2BSDQUfyIDQ7dRSs-acimF_0 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4409760931720420031', time=2024-09-14T13:46:21.202423+0000, chain.objs.size()=1 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.d--Nku5yEBSJSD9JJ9zCz5v_M_WdHrl_0 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7629770147848277307', time=2024-09-14T13:46:21.302497+0000, chain.objs.size()=1 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DCvimKEZVYBkaVK7sstKT6qtZDG20BQ_0 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14714994967930217323', time=2024-09-14T13:46:21.337819+0000, chain.objs.size()=1 2024-09-14T11:56:14.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OuL4fuLLYoDoA9vAXBfjXFRPxLxtHu9_0 2024-09-14T11:56:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4562176776323289520', time=2024-09-14T13:46:21.348380+0000, chain.objs.size()=1 2024-09-14T11:56:14.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S1L9DDmIk6e4RbGFupeVG6B-5U4eo-S_0 2024-09-14T11:56:14.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.321+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/42898 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12244461393442348672', time=2024-09-14T13:46:21.394858+0000, chain.objs.size()=1 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Gvn_jYWaUwsvP08eHZ4m2SyfOXburCj_0 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10053422795299089652', time=2024-09-14T13:46:21.481219+0000, chain.objs.size()=1 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BCKHOs-ih7IrhFdEs7z4DfZGb-zEsoI_0 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4726385965412137713', time=2024-09-14T13:46:21.736318+0000, chain.objs.size()=1 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.luiz6cfde8AqJ5Ja9FylaWor1U1-kBo_0 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16986959444864174675', time=2024-09-14T13:46:21.764910+0000, chain.objs.size()=1 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.N-BYP1LVNP10ck5RF8pwb8dD3J-ZCFe_0 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10132402944189215604', time=2024-09-14T13:46:21.775192+0000, chain.objs.size()=1 2024-09-14T11:56:14.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-wA2f_V8URoILWBSHGqbyOHb-foeXtg_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13412851760965075585', time=2024-09-14T13:46:21.963282+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.to-WH5DVdEXOsQ_4ZO3bVUsbk1tNxQK_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3988255514978509002', time=2024-09-14T13:46:22.036097+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TOghX3KD8SMaCnx-umAZoRIe8GSEBWd_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1048342208099574312', time=2024-09-14T13:46:22.087120+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aFTiE_FxfXHfnA09W2sGXFmfhihCOOY_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11567073845883252541', time=2024-09-14T13:46:22.096086+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.I697LSX_6FSxHkc_v-weUx8JEa0BsIo_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6993492089793457520', time=2024-09-14T13:46:22.103352+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lsIuVwII0dGQJE1rpBz6OaHS3xu3jwF_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5036944529368773256', time=2024-09-14T13:46:22.104180+0000, chain.objs.size()=1 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TI-ARzmqlIz9tGFcW6t0lV57CIY3Pc3_0 2024-09-14T11:56:14.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8213393330905197657', time=2024-09-14T13:46:22.122439+0000, chain.objs.size()=1 2024-09-14T11:56:14.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ABms5q_at6PIItT-E5UV2CJgjQbdMiC_0 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4411957790323966231', time=2024-09-14T13:46:22.130070+0000, chain.objs.size()=1 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vnrVThmpCzN8jt9BgRNgD1FQ-2FpvAM_0 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3200503325629534698', time=2024-09-14T13:46:22.131463+0000, chain.objs.size()=1 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.licfPLUqW_urnXpUMzGVB7bikdgvIvK_0 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3936787846951126491', time=2024-09-14T13:46:22.220752+0000, chain.objs.size()=1 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.B5WuyQ_wksrCx4L90ZcnpaUhl4BrU6o_0 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10670279166348348992', time=2024-09-14T13:46:22.295124+0000, chain.objs.size()=1 2024-09-14T11:56:14.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EpNKQWcFqb139gj7NZgXJvMLkIMKDe8_0 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13794712839714340821', time=2024-09-14T13:46:22.308738+0000, chain.objs.size()=1 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OxxS5v9x3XVw485AkzmE1pvY0HLmswW_0 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9950104514815994799', time=2024-09-14T13:46:22.330230+0000, chain.objs.size()=1 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.coOnNcQG9Zm4N7LteBqHqhSMzAeyXyP_0 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15811852511974232558', time=2024-09-14T13:47:31.478504+0000, chain.objs.size()=1 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.460__shadow_.g9d75YrQTyah9dnHIa_gooBpQdFn2By_0 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8751379653265039096', time=2024-09-14T13:47:35.051783+0000, chain.objs.size()=1 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465__shadow_.Iobgw5vYZivUmKbJFYi_nLjvRuBuf87_0 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7701939967206409169', time=2024-09-14T13:47:35.660880+0000, chain.objs.size()=1 2024-09-14T11:56:14.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466__shadow_.HKM3MW_TePmJIWX-hOpaJF2uBtaqaps_0 2024-09-14T11:56:14.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2271796952571119275', time=2024-09-14T13:47:42.657122+0000, chain.objs.size()=1 2024-09-14T11:56:14.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.485__shadow_.VRlIkUGgO8R1e-mW3lce_fvBsvRFoHZ_0 2024-09-14T11:56:14.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10423575667217885788', time=2024-09-14T13:48:57.384607+0000, chain.objs.size()=1 2024-09-14T11:56:14.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.328+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.553__shadow_.6S3yQR1LUEweVkazfZZiHtWbV3DMb_w_0 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14539417042440042524', time=2024-09-14T13:49:03.495718+0000, chain.objs.size()=1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.562__multipart_mymultipart.Iy7p__7pEHPsYfdUWFWtRJwoQBIjeaeU.1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8189889614908310036', time=2024-09-14T13:49:20.404618+0000, chain.objs.size()=1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.574__shadow_.3yHXt4_MHPsKPDD6k9z2tWIcymWXFCr_0 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10752048791624580083', time=2024-09-14T13:52:21.397579+0000, chain.objs.size()=1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.640__shadow_.-ft7qnNolQsD0I0EOj3FSCWsl7ObtWf_0 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4785992887791942422', time=2024-09-14T13:52:35.017839+0000, chain.objs.size()=1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.665__shadow_.W5CkJyl6xpZm5a5qoUFFN6BM4Ux4YHz_0 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1404765508321374308', time=2024-09-14T13:52:35.626228+0000, chain.objs.size()=1 2024-09-14T11:56:14.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.666__shadow_.Rol5dWxn70Cbdl0_X3GtnY9pa19UL1J_0 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.418728554773483618', time=2024-09-14T13:52:36.482649+0000, chain.objs.size()=1 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.667__shadow_.AFcrXZ5TRTBGizSFTQboeesaWS4AgBU_0 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15690877225065441761', time=2024-09-14T13:52:48.790027+0000, chain.objs.size()=1 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.697__shadow:4Mip0v12AU8jF13VtRifxydlGIzqwfY_.TRcSZQjwUQ_8sJP0PSqtMEmwI567Qa1_0 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17341701046071131347', time=2024-09-14T13:52:54.379416+0000, chain.objs.size()=1 2024-09-14T11:56:14.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.332+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.709__shadow:f2SUKPZ1kl3-folCPc9WOcpdEvg9Kp1_.ZA5JYMBbH8RoX7Bx9Wsiwr__2Nj6Mtr_0 2024-09-14T11:56:14.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.335+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.338+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:56:14.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.339+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47936' 2024-09-14T11:56:14.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9260572278811823253', time=2024-09-14T13:43:14.492656+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.149__shadow_.HXDSY3J2G3KTiwKys3iS3eeJwMEgfPt_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_FcUna9KZhRVjHkSE2223JCDHjCifOW3', time=2024-09-14T13:43:22.407605+0000, chain.objs.size()=2 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.qH4x5lqy6Nd9nkYzHholutnsa4mZDkI_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.qH4x5lqy6Nd9nkYzHholutnsa4mZDkI_1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13865023920120300846', time=2024-09-14T13:45:11.754480+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.242__shadow_.hMt_nLg_YfxpXlKzfcax1EezItdFe67_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13752175822906353680', time=2024-09-14T13:45:30.318865+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JWRtrlEAzk68UhGNUXZ_t9zlkfFWKuS_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12839974895663170234', time=2024-09-14T13:45:30.320126+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vgb2WodsYAiXNEZXeN1p4rnkPyZeJlN_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5195900773434213806', time=2024-09-14T13:45:30.416765+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Y-VZhomTDTY_AljW-7kB80T4bylNnb1_0 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.390164561051346962', time=2024-09-14T13:45:30.435218+0000, chain.objs.size()=1 2024-09-14T11:56:14.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aaRb8lk67PHtI1cmRbTnqDA287fyBPr_0 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1719718659222802522', time=2024-09-14T13:45:30.443159+0000, chain.objs.size()=1 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9KRpTMXUbucsGKL7xIYLtTzdynE_nA5_0 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10896225546726467857', time=2024-09-14T13:45:30.477929+0000, chain.objs.size()=1 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.340+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.O82YsUtYlSag47eWLJcCZ0xZnvFzTxQ_0 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.341+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17983799463866567695', time=2024-09-14T13:45:30.496227+0000, chain.objs.size()=1 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.341+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tNpvQNtdpZ6T42_S--wyGJWVS8KTf2U_0 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.341+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17227054378572704498', time=2024-09-14T13:45:30.647106+0000, chain.objs.size()=1 2024-09-14T11:56:14.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.341+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EkmDUgnpn-hi0ABEotQoVsZ6LY_dDJb_0 2024-09-14T11:56:14.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.344+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10064152379730574875', time=2024-09-14T13:45:30.776757+0000, chain.objs.size()=1 2024-09-14T11:56:14.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.344+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3uXoWPO8ZW2GMhxLXT2ODA2ihOZgWj8_0 2024-09-14T11:56:14.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.344+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7462281869450043600', time=2024-09-14T13:45:30.777557+0000, chain.objs.size()=1 2024-09-14T11:56:14.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.344+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.xxxj6UaCvLOD3z800JdFE3UeP29yS-l_0 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6166000492606783113', time=2024-09-14T13:45:30.815443+0000, chain.objs.size()=1 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CRnF5rgv6_zmVDlBxz1BJW3yrunseov_0 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9225738161444178722', time=2024-09-14T13:45:30.822332+0000, chain.objs.size()=1 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tkK2PRY0qkgX1qlpW6ZLynFTSWngrrW_0 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11063970129303767114', time=2024-09-14T13:45:30.836408+0000, chain.objs.size()=1 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kAgonzqB463h7tbho8SVpkqCX3ugiCz_0 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3283998435307345330', time=2024-09-14T13:45:30.844642+0000, chain.objs.size()=1 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.apYkX6tb6DPDvDWZxshiWDfMpdKjYBh_0 2024-09-14T11:56:14.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12375619693704795785', time=2024-09-14T13:45:30.854193+0000, chain.objs.size()=1 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tw4quzeUpzDZ97zDNlCqQ-DuaPxORTr_0 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10650172229128189451', time=2024-09-14T13:45:31.040241+0000, chain.objs.size()=1 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QlHiaUr2pAO86ZTJSaTNgoDCUDHZ9l2_0 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1248953965134487792', time=2024-09-14T13:45:31.061099+0000, chain.objs.size()=1 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8XwlD2ERrphdOpabDbBOxHzoly3WdSU_0 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4444306440059650921', time=2024-09-14T13:45:31.146787+0000, chain.objs.size()=1 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DjyhAm6G4tQCTet2ssFXKa_wNtvl9sk_0 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8362542825171352021', time=2024-09-14T13:45:31.178077+0000, chain.objs.size()=1 2024-09-14T11:56:14.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RzEXOjWgh5ta70Wk6A55CnVOyMWsAmp_0 2024-09-14T11:56:14.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.347+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16876745600556106162', time=2024-09-14T13:45:31.207933+0000, chain.objs.size()=1 2024-09-14T11:56:14.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4WJWKONvLzoANXyVA0vrmYSW5YQB7Wp_0 2024-09-14T11:56:14.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.348+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4376371528102611656', time=2024-09-14T13:45:31.240498+0000, chain.objs.size()=1 2024-09-14T11:56:14.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.348+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.npjB2PhRhj2Db8lMb9qEFwUcZ6iOUpb_0 2024-09-14T11:56:14.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14998032321434784786', time=2024-09-14T13:45:31.549258+0000, chain.objs.size()=1 2024-09-14T11:56:14.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.40sMYTNtKYEjV56gdBv8qYeMG97FhhB_0 2024-09-14T11:56:14.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14241429636895960019', time=2024-09-14T13:45:31.552280+0000, chain.objs.size()=1 2024-09-14T11:56:14.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Zf4IQl95DUDwSIBt5-l0igej5BwgJXW_0 2024-09-14T11:56:14.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6528908668666925049', time=2024-09-14T13:45:31.560657+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8wGeCeYuq0MsSJbwyj24vqyDoKf-DnQ_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8785908142663196767', time=2024-09-14T13:45:31.598694+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YvQJSXvalzkezEeCIks_798IUfM-Kms_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2979882931060197299', time=2024-09-14T13:45:31.680749+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NGwxe7hK1x9xr-c-iMl3QykMqI2Oked_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7494287780260929943', time=2024-09-14T13:45:31.707733+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XgCiimRi3euLha_K_-YUlFHcVJRlSfh_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9131391390524098016', time=2024-09-14T13:45:31.765585+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.S81qRqzUS2fyDId3hVjljuemYvIxpfF_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15912730424482381023', time=2024-09-14T13:45:37.151371+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.274__shadow_.bQKFNnY63THeaUSEcu-JMKp-SpqGl0F_0 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8070391112521137303', time=2024-09-14T13:45:37.616058+0000, chain.objs.size()=1 2024-09-14T11:56:14.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.275__shadow_.CdDOjhsk_zke27n2w-woZe5uxXX75iW_0 2024-09-14T11:56:14.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.351+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6787824549751743134', time=2024-09-14T13:45:42.811196+0000, chain.objs.size()=1 2024-09-14T11:56:14.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.351+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.285__shadow_.bFoQbxzP3h_aXnIqon69JV-IUG7S5bm_0 2024-09-14T11:56:14.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.351+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15505431863560696255', time=2024-09-14T13:45:44.333893+0000, chain.objs.size()=1 2024-09-14T11:56:14.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.351+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.288__shadow_.VZATixw4n4U1EcFmtMNp849A_-JOre-_0 2024-09-14T11:56:14.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5092079271317434304', time=2024-09-14T13:45:47.358310+0000, chain.objs.size()=1 2024-09-14T11:56:14.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.zrhTat4tya_SUyIiGGCynSEkuFcpNU0_0 2024-09-14T11:56:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12852970477475285992', time=2024-09-14T13:45:48.183648+0000, chain.objs.size()=1 2024-09-14T11:56:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.Cr2AGVAntst1hA3JyQwwG9YRvv4WPHs_0 2024-09-14T11:56:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10326315511283079103', time=2024-09-14T13:45:49.667478+0000, chain.objs.size()=1 2024-09-14T11:56:14.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.353+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.297__shadow_.k7cwy7PE3AMmuoRBj1RrJ9TuOZNUk8b_0 2024-09-14T11:56:14.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8575074186833861080', time=2024-09-14T13:45:50.659429+0000, chain.objs.size()=1 2024-09-14T11:56:14.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.299__shadow_.bd-uu67QvbcnO4umEgValNAEZTBhLQq_0 2024-09-14T11:56:14.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16748945185689682846', time=2024-09-14T13:45:52.636008+0000, chain.objs.size()=1 2024-09-14T11:56:14.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.303__shadow_.uobcCjSmVF9CvJOF7p5gqDFZryHG-tY_0 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16719913412681354659', time=2024-09-14T13:45:58.559093+0000, chain.objs.size()=1 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.314__shadow_.oqiYEejZekxnVhxP_dnS9p_0dUFFfG5_0 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15905610040982449634', time=2024-09-14T13:46:11.018385+0000, chain.objs.size()=1 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eIySLZs4PufOXLq67-X83BenYsUQlz7_0 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5433833313773967626', time=2024-09-14T13:46:11.113415+0000, chain.objs.size()=1 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gBiZyHjYoHG9NcYaJBCiaqa8cgtnUaw_0 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11326478190231565361', time=2024-09-14T13:46:11.157813+0000, chain.objs.size()=1 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aoFRBgueMso8A9T2Yn3KqeIkkMT87O2_0 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5013575777332872132', time=2024-09-14T13:46:11.201677+0000, chain.objs.size()=1 2024-09-14T11:56:14.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.354+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9-vqErjT_lZ3uDIoylLehzA38vMGJ-f_0 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11221244805351891973', time=2024-09-14T13:46:11.404664+0000, chain.objs.size()=1 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Sl0l4k1H557ktvHjKHcKMY7QMBuGQq6_0 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12550827499639362875', time=2024-09-14T13:46:11.675551+0000, chain.objs.size()=1 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gSB6NI03r2_gB_m1Ka4Oqdvbd_E_CVH_0 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17106643525650527468', time=2024-09-14T13:46:11.713245+0000, chain.objs.size()=1 2024-09-14T11:56:14.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.356+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.feok7o-9j-MZ3xfZlq3VlFF96DwN-xj_0 2024-09-14T11:56:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.357+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15443088207405928893', time=2024-09-14T13:46:11.725415+0000, chain.objs.size()=1 2024-09-14T11:56:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.357+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.FNzbhkAsbNxkXE5wIhQW4uYnPqnjDjv_0 2024-09-14T11:56:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.357+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9720837972034792729', time=2024-09-14T13:46:11.753281+0000, chain.objs.size()=1 2024-09-14T11:56:14.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.357+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Rx3MTWMFzDceYRaFTXDF2s9OTw7pQZh_0 2024-09-14T11:56:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.359+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14930897280381506231', time=2024-09-14T13:46:11.856925+0000, chain.objs.size()=1 2024-09-14T11:56:14.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.359+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CR94mun_W0PY5k1qy50_r26H_56rhj1_0 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7011135633538813607', time=2024-09-14T13:46:11.867957+0000, chain.objs.size()=1 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.n7AZmlewFyhsb34GbCzkSTvodKg2oxV_0 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17788174224358827253', time=2024-09-14T13:46:11.904093+0000, chain.objs.size()=1 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.clDGZXDZ1xJRCAoXqui1Q7RaZ3MgZEw_0 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10733158572326162594', time=2024-09-14T13:46:12.100310+0000, chain.objs.size()=1 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CWcKBL8gXlZsr_HLGZHpeLmQaWUcaay_0 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2875526531678068204', time=2024-09-14T13:46:12.126491+0000, chain.objs.size()=1 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VmwAzD3F_R89kbKtAjVVcrHK7UPhcjt_0 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7322443458256067621', time=2024-09-14T13:46:12.132004+0000, chain.objs.size()=1 2024-09-14T11:56:14.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uL2vWLK26vZctTJB5lzQbIrnNxPkPbf_0 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16809112418855214756', time=2024-09-14T13:46:12.215630+0000, chain.objs.size()=1 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Bsq835xwFF3y0NnYHz1l6SHell4loR1_0 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15063895370052161522', time=2024-09-14T13:46:12.466960+0000, chain.objs.size()=1 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fQnkU8f8x8Zut8ZbFPsN3Q1ablTYMys_0 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6754946223324276482', time=2024-09-14T13:46:12.472374+0000, chain.objs.size()=1 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.361+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.OAQJMdkCqcgcFcgn9TFee1Uw7hXpque_0 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.362+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15040428876680625750', time=2024-09-14T13:46:12.633402+0000, chain.objs.size()=1 2024-09-14T11:56:14.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.362+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nCfHUWM3lU3XOkIqvj5ZuE2wvtkJQ7G_0 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.362+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18303985622397181093', time=2024-09-14T13:46:12.672299+0000, chain.objs.size()=1 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.362+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6mW4I4tsjEYRQTzaJN9sYqg6spJXxTR_0 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.363+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4910710215715308727', time=2024-09-14T13:46:12.684120+0000, chain.objs.size()=1 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.363+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YY0rypSvZt2um8ol9xG-eaGj25AY_nQ_0 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1920866047968237327', time=2024-09-14T13:46:20.716369+0000, chain.objs.size()=1 2024-09-14T11:56:14.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.21p64GOpSCMn97ecvOrk7zdt8KriA53_0 2024-09-14T11:56:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2351043606267496139', time=2024-09-14T13:46:20.724336+0000, chain.objs.size()=1 2024-09-14T11:56:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Hw15PmAhjxZ1Scz3JFCdktsNxxtlNfe_0 2024-09-14T11:56:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13349461595626987304', time=2024-09-14T13:46:20.749772+0000, chain.objs.size()=1 2024-09-14T11:56:14.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Tctbhu0X2NgsUj-Tictt7Sdrcor9e50_0 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16380463532983519394', time=2024-09-14T13:46:20.758893+0000, chain.objs.size()=1 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Sj3VZT9EX9eoTiry_ZUMDGY82iOHyvd_0 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12737797663775855525', time=2024-09-14T13:46:20.774765+0000, chain.objs.size()=1 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SfwXZkBje-D7xHqzTon1z4HBEs9vmxZ_0 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11740438344803886245', time=2024-09-14T13:46:20.785707+0000, chain.objs.size()=1 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.am3i6xiEs5SLcqioiCORc2eUl2e2SBn_0 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18001792569145694922', time=2024-09-14T13:46:20.798548+0000, chain.objs.size()=1 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ruOW5aUWHYP0xQyFpJCX_dZuTzan9R0_0 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7578635202803580351', time=2024-09-14T13:46:20.918345+0000, chain.objs.size()=1 2024-09-14T11:56:14.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.365+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fMwd8FcSy42jLYD5UmiHf-xAEOE8_0u_0 2024-09-14T11:56:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7635559501977353454', time=2024-09-14T13:46:20.920049+0000, chain.objs.size()=1 2024-09-14T11:56:14.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tukZ_0CveBWbrSpWElu2o3WDDrI-8jD_0 2024-09-14T11:56:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9236067670836254145', time=2024-09-14T13:46:20.936270+0000, chain.objs.size()=1 2024-09-14T11:56:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.chCe58_UsxloNEbeFVeOJG1AJSUB2xw_0 2024-09-14T11:56:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16171796757301469447', time=2024-09-14T13:46:21.088871+0000, chain.objs.size()=1 2024-09-14T11:56:14.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.367+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AMz3LsD7hckvOuKldBCRVll50N4YBMd_0 2024-09-14T11:56:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16395128873707976602', time=2024-09-14T13:46:21.172356+0000, chain.objs.size()=1 2024-09-14T11:56:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zgxeLUjoTLs-VUMfxLIxnffqKJ0Y7pA_0 2024-09-14T11:56:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9774971714629749640', time=2024-09-14T13:46:21.302058+0000, chain.objs.size()=1 2024-09-14T11:56:14.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IbXZVf789esrC0P0AKhm9RNKyOHPxTU_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15817278163279071366', time=2024-09-14T13:46:21.367866+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wBUyINRAVZ94TLvsbg34phb5sVzlWu2_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3157309278910401336', time=2024-09-14T13:46:21.492959+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.j8KeeUl6zsmdviR443GZpf5hHp4LzFy_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14595512236786371422', time=2024-09-14T13:46:21.529439+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.F1AOZ5WNcobwLU9WbCFGIbjYTXnW27E_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7253802345070009794', time=2024-09-14T13:46:21.754972+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.P7PvZ3RIbWPsB_mYvYwfWniaIEaWwd9_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16677971665818969106', time=2024-09-14T13:46:21.857910+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LuPwXHJhzhDiGhGyCgYcsX_PELQ9VSZ_0 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11158849785281272951', time=2024-09-14T13:46:21.858699+0000, chain.objs.size()=1 2024-09-14T11:56:14.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.369+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Aokfn8xAaS07eEhM0tVLfkNDQANsiMj_0 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15310290653475092001', time=2024-09-14T13:46:21.866256+0000, chain.objs.size()=1 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vZ9ij5nh45q3E0-qVAVL2tNpybtbTWR_0 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14940187169771713959', time=2024-09-14T13:46:21.873154+0000, chain.objs.size()=1 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.92HQdfjvb5ru1QGP2k1f-V6NkWjiKZ6_0 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.776678491592400814', time=2024-09-14T13:46:21.879840+0000, chain.objs.size()=1 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.371+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wqtn0y4MalkeU5N3nwjFHrykwuM4-S6_0 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3870693591992461610', time=2024-09-14T13:46:21.921002+0000, chain.objs.size()=1 2024-09-14T11:56:14.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DtpCYvBtH6zCpDD8M4QQOHLNYAzT30y_0 2024-09-14T11:56:14.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5248617681130198601', time=2024-09-14T13:46:21.922890+0000, chain.objs.size()=1 2024-09-14T11:56:14.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._Imk2Wv3w34I_p1C02B6UU-IGCaFQ55_0 2024-09-14T11:56:14.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16014135108114198541', time=2024-09-14T13:46:21.931768+0000, chain.objs.size()=1 2024-09-14T11:56:14.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rr4HFziq9ERmWMOmIy4io9zQ-Hvv664_0 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4043384385660931548', time=2024-09-14T13:46:21.954985+0000, chain.objs.size()=1 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.A0tdIutnyk8TrftFlQPawY02s4fsAoB_0 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9931631567740631540', time=2024-09-14T13:46:22.053950+0000, chain.objs.size()=1 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KIN-auo_WgkPgoz739dSjwJBD3CNEdj_0 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.107999459953342186', time=2024-09-14T13:46:22.075934+0000, chain.objs.size()=1 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.H5-Pn_-xRLuzQ44la5-CFdV7_Cvmo92_0 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13430720244645397963', time=2024-09-14T13:46:22.093903+0000, chain.objs.size()=1 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.r672qnfzBW-3yPHygsEFbot68_0IFPv_0 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8721908338453975875', time=2024-09-14T13:46:22.273416+0000, chain.objs.size()=1 2024-09-14T11:56:14.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6rNk7luH9I96Ys3lPjy1Q1Tp3NPxDyw_0 2024-09-14T11:56:14.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13574185502782166883', time=2024-09-14T13:46:22.324527+0000, chain.objs.size()=1 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zzq83piHXu2D1KAMUmK6ZMH1TzAN_xw_0 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1924934698031742311', time=2024-09-14T13:46:27.913654+0000, chain.objs.size()=1 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.337__shadow_.8BuJyU3ikT5v9EFEdUYlaFJgSMZXxg5_0 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14665578908018224645', time=2024-09-14T13:46:53.467383+0000, chain.objs.size()=1 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.391__shadow_.t0sGKX0OKuxKlAIUX-PnDGVuwSUVKmV_0 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2778949467719905348', time=2024-09-14T13:47:15.029790+0000, chain.objs.size()=1 2024-09-14T11:56:14.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.431__shadow_.JMD9PE1gg0qDX9z84D5zW5sHoRu6_ig_0 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.273015018282305060', time=2024-09-14T13:47:17.962757+0000, chain.objs.size()=1 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.437__shadow_.RJ4Uen8IpLiGIPddZGAqcwNzPaecrqI_0 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11238599325601263796', time=2024-09-14T13:47:25.811247+0000, chain.objs.size()=1 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.451__shadow_.7aXav3XaJH76MqhbdmLIwzkoESXXlMX_0 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3258360368002596980', time=2024-09-14T13:47:44.201615+0000, chain.objs.size()=1 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.488__shadow_.wFjxXZcupTIk1VyuspMnP1F6xrFsrzS_0 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8877739200554937579', time=2024-09-14T13:47:48.849583+0000, chain.objs.size()=1 2024-09-14T11:56:14.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.498__shadow_.FP4-mnCz5bSRWVA9JlOHgYZZFjTQlmo_0 2024-09-14T11:56:14.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.380+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47936 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16117010327041299087', time=2024-09-14T13:47:49.692069+0000, chain.objs.size()=1 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.501__shadow_.QY1Ps_fZZAdmtKPHPSdewt4af2sP6xN_0 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4595231103297899046', time=2024-09-14T13:47:54.128656+0000, chain.objs.size()=6 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11382080984198992277', time=2024-09-14T13:48:05.598838+0000, chain.objs.size()=6 2024-09-14T11:56:14.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.hifmLZN8pkwoti0Q_X9mQ90Fl2uOCHot.1 2024-09-14T11:56:14.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.2 2024-09-14T11:56:14.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.3 2024-09-14T11:56:14.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.4 2024-09-14T11:56:14.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.382+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.5 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.6 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI', time=2024-09-14T13:48:06.980773+0000, chain.objs.size()=1 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.3 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5560441984001416827', time=2024-09-14T13:48:56.274862+0000, chain.objs.size()=1 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.551__shadow_.qQLKTaN5UKD2eU8Jroxu4qpKod8dyO0_0 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6117597784471117034', time=2024-09-14T13:48:58.709539+0000, chain.objs.size()=1 2024-09-14T11:56:14.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.555__shadow_.eUU6pqz9iGSEHHzlX91bXk1r8_KWfOn_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13720709007724236157', time=2024-09-14T13:49:15.838611+0000, chain.objs.size()=1 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:tUWkH5uVRr82zTQ1QCm2f6LnsUEe11t_.gajO4qINNf-QJKMfTIWN8nm5mdjZtcE_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5596686474439153591', time=2024-09-14T13:49:35.506863+0000, chain.objs.size()=1 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:VRVAWYaL4q3GdMLdk.xgf4ePpexjkfD_.ZO_FfxccWX8YkQpR5PagN93trM6jrLd_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1775144486267882714', time=2024-09-14T13:49:46.875834+0000, chain.objs.size()=1 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.584__shadow:gdl-s4y9t9oukUlfPAZtQW-lIzn67eE_.lHWHI6K212_C4zHldZ3UaCsetzP2v7__0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6866260955822153586', time=2024-09-14T13:49:48.342065+0000, chain.objs.size()=1 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.586__shadow:DTZbY1T3KpCBy4MQ2236VPj2euzGJyR_.bdzkSTt0VaYCA6qT-crkIJogwh-peVo_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9055861067966890150', time=2024-09-14T13:52:17.715731+0000, chain.objs.size()=1 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.632__shadow_._kM4QltDrUsbrrAsI_d1D9fvDsY1pka_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11772139437252939703', time=2024-09-14T13:52:23.777729+0000, chain.objs.size()=2 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.645__shadow_.QCBfsRIW7bbiwUc9Tz11p2OaBSPTE0Z_0 2024-09-14T11:56:14.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.645__shadow_.QCBfsRIW7bbiwUc9Tz11p2OaBSPTE0Z_1 2024-09-14T11:56:14.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12721096441081825803', time=2024-09-14T13:52:35.018322+0000, chain.objs.size()=1 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.665__shadow_.Sjepeks6CSvhsJbh5eWgbX5rKG6aR8y_0 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15081359146534596979', time=2024-09-14T13:53:52.480503+0000, chain.objs.size()=1 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.760__shadow_.D8CM27bI7ZN39ShXmUMBaRmHhbEYE_s_0 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1985065281954543323', time=2024-09-14T13:53:59.708539+0000, chain.objs.size()=1 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.767__shadow_.bIEJzMUxzWPaXFcjq2El2avgj199FkZ_0 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2757593265061154893', time=2024-09-14T13:54:24.399944+0000, chain.objs.size()=3 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.780__shadow_.Wr8l-R51UnvtHEoDMt21knNP-MNKK7F_0 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.780__shadow_.Wr8l-R51UnvtHEoDMt21knNP-MNKK7F_1 2024-09-14T11:56:14.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.390+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.780__shadow_.Wr8l-R51UnvtHEoDMt21knNP-MNKK7F_2 2024-09-14T11:56:14.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.394+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.396+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:56:14.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.398+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.398+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54413' 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1842736030082474097', time=2024-09-14T13:43:19.931938+0000, chain.objs.size()=3 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-STANDARD.2~9osDKMaCzKotCIhN_oRuIR-_Vm-tIb-.1 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-STANDARD.2~9osDKMaCzKotCIhN_oRuIR-_Vm-tIb-.2 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-STANDARD.2~9osDKMaCzKotCIhN_oRuIR-_Vm-tIb-.3 2024-09-14T11:56:14.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9054724662267106198', time=2024-09-14T13:43:54.574231+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.198__shadow_.SfOe19pCYD9Rbj1mEgkoW0FnRy9ZBS7_0 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15069003324434967610', time=2024-09-14T13:45:09.561767+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.238__shadow_.AyXrr-7dNrBpdpIH4fvwG8i6weAoAn-_0 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10519695176139497040', time=2024-09-14T13:45:11.755296+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.242__shadow_.-pMnVY8XaCzp12ujh6kL6RkNXWrwzEz_0 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14374029047402499960', time=2024-09-14T13:45:14.437414+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.246__shadow_.fhVDR_u04hGeeD92u57-MsaDc2RcBHz_0 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15758610065819855538', time=2024-09-14T13:45:18.326433+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.254__shadow_.pRl8_tiKGNySBlS43MVnKlw_3-hERcS_0 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9960301424645082478', time=2024-09-14T13:45:22.123326+0000, chain.objs.size()=1 2024-09-14T11:56:14.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.262__shadow_.ULUE09rkzPrX-ElQHOEO9i2x0VcWygJ_0 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8700836265137677297', time=2024-09-14T13:45:30.216129+0000, chain.objs.size()=1 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CvsTJDnnuRssq9yXEnFqyMHhA-PIfUY_0 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8145220065725345857', time=2024-09-14T13:45:30.217313+0000, chain.objs.size()=1 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EJf6o_nzA1ynbtj3b_m9REiXqeT6rmj_0 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15166930539108002414', time=2024-09-14T13:45:30.230099+0000, chain.objs.size()=1 2024-09-14T11:56:14.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.400+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7JqCe-ebfyGghn4n5PR8QtmG9BOCboC_0 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.266085532540159006', time=2024-09-14T13:45:30.242197+0000, chain.objs.size()=1 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ti8i7MqwPV53DtXlIJFjoiYQobvuc5a_0 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16020097849282366261', time=2024-09-14T13:45:30.255366+0000, chain.objs.size()=1 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Sw-6E_CjKxctM0isUgHd4lzMbFhSVvZ_0 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1961209223410814733', time=2024-09-14T13:45:30.405673+0000, chain.objs.size()=1 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yszpxkHFYNfQCJSadKkMXV8A-7bNh-y_0 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2243637608064374115', time=2024-09-14T13:45:30.447008+0000, chain.objs.size()=1 2024-09-14T11:56:14.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yB79-_K72c5QKOhoI6dLpGmjJ21oVwj_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14636325564503157730', time=2024-09-14T13:45:30.453988+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.b6VPb9bnvmbCMmNeDecR8cNSFlcn6KO_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10363931638177736886', time=2024-09-14T13:45:30.469090+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5zjfvOfJ_tV8Rhi485F_FXgs2CtWeHm_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18051481668707800185', time=2024-09-14T13:45:30.471590+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QwxAJ-hlOedRpzVFu3ykZXfP21mI6FN_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12120913778950775543', time=2024-09-14T13:45:30.493988+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NisUXev299-7kUfKQooZe_BrhnNy8fT_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1432665147008319560', time=2024-09-14T13:45:30.509288+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fEP3CIaGe9DWqAf-g5cEfteZNpYDY_Y_0 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13781050282916497805', time=2024-09-14T13:45:30.619003+0000, chain.objs.size()=1 2024-09-14T11:56:14.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.L8qiO693Xp-oU0gBK9cna9H01HnZ_Tu_0 2024-09-14T11:56:14.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4377476490100762782', time=2024-09-14T13:45:30.773929+0000, chain.objs.size()=1 2024-09-14T11:56:14.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.404+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aGotbHAYPswbeRk_32a10l9SJonGWMO_0 2024-09-14T11:56:14.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.407+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3763141744148573638', time=2024-09-14T13:45:30.822378+0000, chain.objs.size()=1 2024-09-14T11:56:14.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.407+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.viC7kDBq2RPSyr3p3HBi_2OzbqA3-Ms_0 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5401335365511755858', time=2024-09-14T13:45:30.835364+0000, chain.objs.size()=1 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-UDBAsh4LC8ICXXBS5VupNP-WiGcYpD_0 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1114970342408390870', time=2024-09-14T13:45:30.864220+0000, chain.objs.size()=1 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HKkPnsVWXF2AQRYF-U59dEHQefzHGFf_0 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16457259040400193069', time=2024-09-14T13:45:30.958514+0000, chain.objs.size()=1 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.--6nErGrxajcH7ypaMtDY9bSV6w_Gz7_0 2024-09-14T11:56:14.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1192308954837162310', time=2024-09-14T13:45:31.001097+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.D5RUbkhAqDd17nJ34E0SEt1MH55yNre_0 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14406677234796403608', time=2024-09-14T13:45:31.038489+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.IqewG7M6M7qLXWKTFuFbK4PPZi7Nnfh_0 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10226841344658624913', time=2024-09-14T13:45:31.143123+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.P_tqOvL9lCO0FXjibzV-lE_VWgP8p6m_0 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9509896890292859590', time=2024-09-14T13:45:31.160761+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9se5rDpi7xpndiP_wzMDI9TReyGWaVB_0 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11953888482322754977', time=2024-09-14T13:45:31.206521+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.U3HuWfnmDnvb9s0wyH5Mx7LR3fgjLzS_0 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12345524188559513619', time=2024-09-14T13:45:31.225275+0000, chain.objs.size()=1 2024-09-14T11:56:14.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gOZydOwXTEa99qs-Cmeh5EOYF_Ftq8p_0 2024-09-14T11:56:14.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.948467120320515034', time=2024-09-14T13:45:31.515995+0000, chain.objs.size()=1 2024-09-14T11:56:14.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vFq-RaoLO46U_Vr8aqIf7NWw8lpcPtD_0 2024-09-14T11:56:14.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.409+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9257294813012763400', time=2024-09-14T13:45:31.550998+0000, chain.objs.size()=1 2024-09-14T11:56:14.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fyC7_yQY1gcCN2hwH7qGmcZzKEgLezd_0 2024-09-14T11:56:14.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3861502429640596457', time=2024-09-14T13:45:31.568583+0000, chain.objs.size()=1 2024-09-14T11:56:14.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eqiJIHzXw18dg3kz2CkGB8BdB6LjFgg_0 2024-09-14T11:56:14.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15582544651284314768', time=2024-09-14T13:45:31.591424+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-nAneC1Di0-Yvii448rAwd-HdgkVcqR_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9379466871859071979', time=2024-09-14T13:45:31.694001+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jNjTusyxJlpMN4XJueeeXNGp3T9CJTo_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.844588129616625528', time=2024-09-14T13:45:31.698804+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2azxv1RQEcxj5QnN7DmSV4LSTcsrTgp_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15724744213456510065', time=2024-09-14T13:45:31.739606+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TY8uxOeqUfB_xwrUO4xxV9rk10nf2BN_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8814439292513388435', time=2024-09-14T13:45:31.741372+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.v4Gxav4htVPBEuG1UVHevG3PnhVXgh-_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16886722924168856879', time=2024-09-14T13:45:31.743638+0000, chain.objs.size()=1 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.G2FEUdx-Upm6r6IIKQasr2x6OGjq0dp_0 2024-09-14T11:56:14.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3610411213419289729', time=2024-09-14T13:45:34.234213+0000, chain.objs.size()=1 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.268__shadow_.xCVBrk2Qfnad4Z-ZTZdqH4qllY1P4Hl_0 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13717424891116273363', time=2024-09-14T13:45:50.123857+0000, chain.objs.size()=1 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.298__shadow_.Grn6PSxvE3o0-JQEqbnw5JCLZn9vv-6_0 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12084619069214945374', time=2024-09-14T13:45:53.586508+0000, chain.objs.size()=1 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.305__shadow_.Q6oPAyDxI191tfYAQ0XiJWITAVK_hBo_0 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6105720507077450085', time=2024-09-14T13:46:01.459347+0000, chain.objs.size()=1 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.320__shadow:l1RD3F4dBH0YiRCMPa-3PXm9s4IZ-Ui_.3MvjBEQ3HMjhCCxbU2baZr-YLiLlDP-_0 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12822585940244034556', time=2024-09-14T13:46:01.987086+0000, chain.objs.size()=1 2024-09-14T11:56:14.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.322__shadow_.5H5NortkIJ4AryEi6EMzGn01gYHwRQD_0 2024-09-14T11:56:14.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2739614520117573683', time=2024-09-14T13:46:10.938464+0000, chain.objs.size()=1 2024-09-14T11:56:14.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Yi1xj03ssahorKLLnJ-BpOYl3UDblgH_0 2024-09-14T11:56:14.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4011935018919994650', time=2024-09-14T13:46:10.942098+0000, chain.objs.size()=1 2024-09-14T11:56:14.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.416+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EFdduBOvJSzjiSqF4YXbiRv_ALMk2de_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465724461132310803', time=2024-09-14T13:46:10.945429+0000, chain.objs.size()=1 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.szzq_E4rnHp0V4wXHooEug_paOK6fJ4_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10249419895985288380', time=2024-09-14T13:46:10.977603+0000, chain.objs.size()=1 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.c4l4W5kEguMpWKTPs0GFdEAe4jUIR7j_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11915253952730705139', time=2024-09-14T13:46:11.115911+0000, chain.objs.size()=1 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2qDvACAAe4NTBnX4_wu9NNotHXHn56K_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1299531180689002053', time=2024-09-14T13:46:11.119734+0000, chain.objs.size()=1 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tHIia0Hz9bSRqXr1Brx3MD9ggnxb54J_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4968423991890666826', time=2024-09-14T13:46:11.154164+0000, chain.objs.size()=1 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iHS3ppKdG6qgm1WpflzA5H4kvxRTZN-_0 2024-09-14T11:56:14.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6110649475887483629', time=2024-09-14T13:46:11.168613+0000, chain.objs.size()=1 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kv8RXA9D2HMGwTfOpPXv77nAT4DiZiI_0 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12114046965861849841', time=2024-09-14T13:46:11.196368+0000, chain.objs.size()=1 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6EZtbJlqjz5pLx6-6Z9Qqcqb4Qw2lcw_0 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13849901939194501818', time=2024-09-14T13:46:11.222721+0000, chain.objs.size()=1 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZhJxLk0ciGOLvIy4rWtkfl23f-re-wr_0 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4197989312768223730', time=2024-09-14T13:46:11.334817+0000, chain.objs.size()=1 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zzRW3Wat1Zo72JFi3J9lh8uApt-jb-I_0 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.419+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18138401805383314465', time=2024-09-14T13:46:11.343265+0000, chain.objs.size()=1 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.419+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z-YXOkxk02V3vb_EF5HmyHRU49oqUpG_0 2024-09-14T11:56:14.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.419+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12042353732689284069', time=2024-09-14T13:46:11.365528+0000, chain.objs.size()=1 2024-09-14T11:56:14.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.419+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Ez9obCA50GQIrAmpZY9hjkSXpGz-1qT_0 2024-09-14T11:56:14.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.422+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16649367406463355506', time=2024-09-14T13:46:11.392589+0000, chain.objs.size()=1 2024-09-14T11:56:14.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.422+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KbaahL-MsePokNKlVorpEFNJj-37rzd_0 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14845985376607248896', time=2024-09-14T13:46:11.650315+0000, chain.objs.size()=1 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VW-5NosilROmiRUtgTe0_y54S4kPomz_0 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16058309888225261079', time=2024-09-14T13:46:11.661490+0000, chain.objs.size()=1 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KPoKM37GnBLM605MSDzd4zwhc2jTqP2_0 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16664065118609641236', time=2024-09-14T13:46:11.698152+0000, chain.objs.size()=1 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.V9vxjO4fkjdEdGO0zyMNFRLv7zsfveY_0 2024-09-14T11:56:14.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14215650268356421981', time=2024-09-14T13:46:11.701707+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Vk6nJeKzIo2FoqW13tGPq4PLp8nBsJd_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16199676911716787824', time=2024-09-14T13:46:11.717575+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fBwe8dQinv4gzDEmtA3Bh4nP8o4NNfj_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1551566036526896482', time=2024-09-14T13:46:11.739475+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4kqgvQq9XMUI_uHbWDyiokQBzMY6x-K_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5000080764225371270', time=2024-09-14T13:46:11.938256+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gBVRlJgPnOp3HlwxhKMTc9tIMjP1swD_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4181340373120222746', time=2024-09-14T13:46:11.944407+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZiSBG1N0gRlwQFVgVLf1-4x0i6F-gnI_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13522545985326017147', time=2024-09-14T13:46:11.948377+0000, chain.objs.size()=1 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VCUA3MtaUxBgbNqznzq2wV68F46cSDc_0 2024-09-14T11:56:14.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12753355918008700121', time=2024-09-14T13:46:12.029457+0000, chain.objs.size()=1 2024-09-14T11:56:14.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.FdlqBUCKlLJ8_KDmiE0TNtoFQsIgdzJ_0 2024-09-14T11:56:14.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.425+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13611142057125142093', time=2024-09-14T13:46:12.107480+0000, chain.objs.size()=1 2024-09-14T11:56:14.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.425+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ntYLwnPuuOB4e5-NMJFnC_TnNfE8l9e_0 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16044310523898837290', time=2024-09-14T13:46:12.125359+0000, chain.objs.size()=1 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.h3zRbipi7uD11x2pw03PXSxt0dPugYw_0 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6203516307607780813', time=2024-09-14T13:46:12.432214+0000, chain.objs.size()=1 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YC0MZ3xuXs-91MM633o3gfwXyNy4A_9_0 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7040324081737708121', time=2024-09-14T13:46:12.504457+0000, chain.objs.size()=1 2024-09-14T11:56:14.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P5YClVumFLKNUklw2wl2u8hL889BNBS_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11077795436570974800', time=2024-09-14T13:46:12.637415+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Snem0FfB0O3ZNS2p_DdTDLLX2-STMNh_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2506073420634432083', time=2024-09-14T13:46:20.714559+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WbULO8tvbl81gI1fo15tw2_Qb83Kl6-_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9502904184284860863', time=2024-09-14T13:46:20.748719+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.r9Z1nDQKOLwhRYQ-2M3I_4Wws-mb_Hm_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7294199373381447081', time=2024-09-14T13:46:20.749491+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AQT2ytEtJQrb1GSVuF8K4_GYJU6LAYC_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17746275418915516694', time=2024-09-14T13:46:20.783618+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rW_1p5cQLcWN_9t11n0izM_-yt1OpIt_0 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16526604516554881690', time=2024-09-14T13:46:20.786199+0000, chain.objs.size()=1 2024-09-14T11:56:14.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FQ1w0wk3NgKZefXntEP2xvURTR8bH0Y_0 2024-09-14T11:56:14.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5616705568153266361', time=2024-09-14T13:46:20.819759+0000, chain.objs.size()=1 2024-09-14T11:56:14.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cO4kylNb_k3HeJ8iEMWr_NCw8E9tBjB_0 2024-09-14T11:56:14.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8729899849070215773', time=2024-09-14T13:46:20.820786+0000, chain.objs.size()=1 2024-09-14T11:56:14.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Dppq-iUgU1SUNMvTY8L0PICR7n0qOZp_0 2024-09-14T11:56:14.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1490104427528241134', time=2024-09-14T13:46:20.822502+0000, chain.objs.size()=1 2024-09-14T11:56:14.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.f2Oj_h8DoP1TV1tg1fBrhJOFe7DwPo1_0 2024-09-14T11:56:14.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11304259751108381817', time=2024-09-14T13:46:20.900678+0000, chain.objs.size()=1 2024-09-14T11:56:14.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YYcLDRXCLW4_grrpCe8S9Y6pYJt1K-C_0 2024-09-14T11:56:14.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13269441721507454654', time=2024-09-14T13:46:20.932294+0000, chain.objs.size()=1 2024-09-14T11:56:14.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.431+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3gy1V48vdTjG-Y7plBNAT7F2TtEeTyv_0 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1509515591781581881', time=2024-09-14T13:46:20.972805+0000, chain.objs.size()=1 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7DuJ4UbeG33BZbaedq14olV7sFIvk30_0 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8816823645086501965', time=2024-09-14T13:46:21.002473+0000, chain.objs.size()=1 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tEWmczxs2fDPpMZ4c9a_sj2ILo5dGlJ_0 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6261424694569190678', time=2024-09-14T13:46:21.138326+0000, chain.objs.size()=1 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.a-EVv7qyq6kGs7S8JxeoJj8lezqV3pT_0 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2003210982173359371', time=2024-09-14T13:46:21.284421+0000, chain.objs.size()=1 2024-09-14T11:56:14.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RYRC1hGh9VhktJyKEZQtmS6ONLVXV9n_0 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16765113619963791015', time=2024-09-14T13:46:21.307783+0000, chain.objs.size()=1 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PHDE5Vm2nCtMIabmrZ-LTwFabiEVdum_0 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14134266231081544752', time=2024-09-14T13:46:21.308625+0000, chain.objs.size()=1 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RWKZZ-uF-4wvaHoma2meXWJI_3PO36p_0 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10802893321592982425', time=2024-09-14T13:46:21.326414+0000, chain.objs.size()=1 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VlI7PYrGVdgDRcfWNrCpf6tZK6a0yaJ_0 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9451745210857612096', time=2024-09-14T13:46:21.334984+0000, chain.objs.size()=1 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AO3UJhxGqtvvW1unIBJDenkihy7Ezjx_0 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2381838228037785614', time=2024-09-14T13:46:21.339308+0000, chain.objs.size()=1 2024-09-14T11:56:14.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cVWEsbzkEiDpqO6zth1u2fMPiOs8Gxa_0 2024-09-14T11:56:14.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17722018787112256402', time=2024-09-14T13:46:21.361947+0000, chain.objs.size()=1 2024-09-14T11:56:14.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.o_JDr6P9sOGBaVbra9TDFQCp5c-lV_P_0 2024-09-14T11:56:14.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2642927035981101667', time=2024-09-14T13:46:21.474921+0000, chain.objs.size()=1 2024-09-14T11:56:14.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zUECp0k-nLdj2fhz3ulwuShPsf0lRyQ_0 2024-09-14T11:56:14.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12266772415605061952', time=2024-09-14T13:46:21.530583+0000, chain.objs.size()=1 2024-09-14T11:56:14.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.e9u5n_q91Xmgo1aFTIxUHIdzILohpKA_0 2024-09-14T11:56:14.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6896730735936403210', time=2024-09-14T13:46:21.749185+0000, chain.objs.size()=1 2024-09-14T11:56:14.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nhWUoXPHp5ZoSyubjH-sCqzJ2cI7G-x_0 2024-09-14T11:56:14.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3156650064991311220', time=2024-09-14T13:46:21.857605+0000, chain.objs.size()=1 2024-09-14T11:56:14.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Zam5KR_T8jtybHFrLoo-Yzatw3Z_euu_0 2024-09-14T11:56:14.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3360175400315991450', time=2024-09-14T13:46:21.905926+0000, chain.objs.size()=1 2024-09-14T11:56:14.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.437+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.r3TgfRS_JItuc9OJlyCfqwCXihqJ6QO_0 2024-09-14T11:56:14.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.438+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1220131180427761012', time=2024-09-14T13:46:22.038420+0000, chain.objs.size()=1 2024-09-14T11:56:14.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.438+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.E8GwlMp0G8ZBqbhihq6Ya6R7XmC86ua_0 2024-09-14T11:56:14.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/54413 2024-09-14T11:56:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.442+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:56:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.442+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13516184075363613987', time=2024-09-14T13:46:22.089107+0000, chain.objs.size()=1 2024-09-14T11:56:14.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GI9WIHaZHSEfjB0elPeJbQ0LdyNSLyK_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7654523247396280757', time=2024-09-14T13:46:22.091384+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7xw5OlH6kYcENSiEEY6B1OUZPyd7NHL_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10226976117492054287', time=2024-09-14T13:46:22.118126+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QUyF_6FlQClCm6TAzFtsgb6mI9vemry_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12196721116181451303', time=2024-09-14T13:46:22.123886+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wbClE5ZLMNx2CWpkHuj7tzopBkKDKD5_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1961660207095980157', time=2024-09-14T13:46:22.132883+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BENN8mhX8mjvwcFZvkG74WVKPtSi0on_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13744257612923092837', time=2024-09-14T13:46:22.138604+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aGBTVXlqtoue0gpjXhcnzvnK1wU--I1_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15914387319866992197', time=2024-09-14T13:46:22.311494+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.70DMfZYqoj0UylB8e6BJyXLTD7OLRTm_0 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9523475939388087248', time=2024-09-14T13:46:22.333916+0000, chain.objs.size()=1 2024-09-14T11:56:14.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.R-ODEJt0fJb5te4Qb5Qpyua8brLjk2F_0 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5389173887908138889', time=2024-09-14T13:46:22.342104+0000, chain.objs.size()=1 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.W7GBJEG7GFfj1KxaYK7sKADIO87E6ph_0 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2769884687917199698', time=2024-09-14T13:46:24.503577+0000, chain.objs.size()=1 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.330__shadow_.NkN_J5XD_Ae7CnAUKt73od-Wip3Uehx_0 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4768200891635254545', time=2024-09-14T13:47:47.697863+0000, chain.objs.size()=1 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.496__shadow_.tkMD_C1t9-MRNU2O5tHzzX5CdvU0_N9_0 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7647694417147867266', time=2024-09-14T13:47:49.579101+0000, chain.objs.size()=1 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.500__shadow_.qcnxE17T29TtMVEpaWARFNCg38YJAox_0 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3729670729071049904', time=2024-09-14T13:47:59.257659+0000, chain.objs.size()=1 2024-09-14T11:56:14.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.518__shadow_.utF-GDdDHDth7brwucKnKgGzmOruBM8_0 2024-09-14T11:56:14.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7066216496848609338', time=2024-09-14T13:48:16.692409+0000, chain.objs.size()=1 2024-09-14T11:56:14.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.525__shadow_.VhyzfBHmQ7C4pvotcq2v26FgpPIc7ps_0 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10164177107488699646', time=2024-09-14T13:48:18.123289+0000, chain.objs.size()=4 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.528__multipart_mymultipart.2~tJgfG3OBIEmOlx2ulkuNQPDrXHIeb3S.1 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.528__multipart_mymultipart.2~tJgfG3OBIEmOlx2ulkuNQPDrXHIeb3S.2 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.528__multipart_mymultipart.2~tJgfG3OBIEmOlx2ulkuNQPDrXHIeb3S.3 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.528__multipart_mymultipart.2~tJgfG3OBIEmOlx2ulkuNQPDrXHIeb3S.4 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~zawWHx6D-_d09wg9YxXumQJsqyfRaBA', time=2024-09-14T13:48:20.532632+0000, chain.objs.size()=1 2024-09-14T11:56:14.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.532__multipart_mymultipart2.2~zawWHx6D-_d09wg9YxXumQJsqyfRaBA.1 2024-09-14T11:56:14.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3082452569262820951', time=2024-09-14T13:49:02.732127+0000, chain.objs.size()=1 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.561__shadow_.ywlAjEer8LicAaCjPDfqmS3y9vm6jFU_0 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14151447248326817346', time=2024-09-14T13:49:16.518762+0000, chain.objs.size()=1 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:FDA27w53b.txp8uqTXTCtaZSuic0agw_.7zKbCuQbnEw2PuyMBAfnoXnr6XOARto_0 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4285395351486252408', time=2024-09-14T13:52:52.395133+0000, chain.objs.size()=1 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.705__shadow:20uJOcKDoe0siY1FA2OOkeMEWY0qxEg_.PKzUwOegqJrivNk1UJcKGkpN9_OSJRI_0 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10928007488272592665', time=2024-09-14T13:53:31.997263+0000, chain.objs.size()=3 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.744__multipart_mymultipart3.2~KfbTHEB3DJcwN85_10yUrfoJDL4GWeG.1 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.744__multipart_mymultipart3.2~KfbTHEB3DJcwN85_10yUrfoJDL4GWeG.2 2024-09-14T11:56:14.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.744__multipart_mymultipart3.2~KfbTHEB3DJcwN85_10yUrfoJDL4GWeG.3 2024-09-14T11:56:14.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.451+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14428128638297736006', time=2024-09-14T13:53:43.778161+0000, chain.objs.size()=1 2024-09-14T11:56:14.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.451+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.748__shadow_.8WbMsMUVsn5w1FxlR3iOfgEqnqovh86_0 2024-09-14T11:56:14.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.453+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.456+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:56:14.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.457+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.457+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=0, next_marker='' 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2280678052365062123', time=2024-09-14T13:45:08.682304+0000, chain.objs.size()=1 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.237__shadow_.z3GVEwhBtdkvfXjloM4d0aIKUR69F90_0 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15083622399409648580', time=2024-09-14T13:45:18.781397+0000, chain.objs.size()=1 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.255__shadow_.o0rJYJyaT4Jv0GTGPEHI_RCK5Tg1kzA_0 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17243409651828741832', time=2024-09-14T13:45:19.237577+0000, chain.objs.size()=1 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256__shadow_.hOutTY5ajXWh5-NY2BKryff6LAE52d7_0 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16275382773108541169', time=2024-09-14T13:45:30.230337+0000, chain.objs.size()=1 2024-09-14T11:56:14.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.131ldkFHCZq0GOGGvQn9cnJPCqXd6_T_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14512129681902303426', time=2024-09-14T13:45:30.406106+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ebg2sbeDnHkk5YtFHqWUTMTD7KHsq5h_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4987759407360512098', time=2024-09-14T13:45:30.430767+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nivMte_TmkNzgWtOP1Q4Gr_sqYB1ZTk_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18071338963295265770', time=2024-09-14T13:45:30.433705+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kC5GrBBQHnrcAj_ffRB5E2vlkAGYicx_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4352757583054971998', time=2024-09-14T13:45:30.476104+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ofg8B6T1xkeOaD65IjlCrisr1x2PSPX_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14542720250327049294', time=2024-09-14T13:45:30.502390+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VaqgIOLh32U1PWwxsh4PpiwGYN-Lt8y_0 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11404570113606792824', time=2024-09-14T13:45:30.698095+0000, chain.objs.size()=1 2024-09-14T11:56:14.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nxUKj34JNG80gPwQ_H9lF7E8JbdAaJ8_0 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8469931613305843703', time=2024-09-14T13:45:30.774277+0000, chain.objs.size()=1 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lkGf45wyK7VNWRr3lBwILt3Vx0vn4YF_0 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4761568643578325480', time=2024-09-14T13:45:30.835088+0000, chain.objs.size()=1 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UjtpLMPfD-Vs6tP2dB4LoD7wbaPUGSm_0 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.460+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4819273471119279122', time=2024-09-14T13:45:30.855530+0000, chain.objs.size()=1 2024-09-14T11:56:14.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.460+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EameCI0qYfH8yOHgV_9pJOJX7UGhreK_0 2024-09-14T11:56:14.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15068851841900496637', time=2024-09-14T13:45:31.047966+0000, chain.objs.size()=1 2024-09-14T11:56:14.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8OZQeuJUsTl8cNPKr-3fAuOqdVmVClX_0 2024-09-14T11:56:14.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4227486610187267798', time=2024-09-14T13:45:31.052851+0000, chain.objs.size()=1 2024-09-14T11:56:14.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uz3d87WDj09-_GfSCccb-wXgXvxa9zl_0 2024-09-14T11:56:14.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1144586083067436506', time=2024-09-14T13:45:31.148782+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kr687yqaFJzIEJLZgpsqtAHYJTX2fgh_0 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14587548665151025054', time=2024-09-14T13:45:31.206008+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Bn_Qe-ogrNvhKMU1xkR5lTV88Z52xhW_0 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11165112725537782347', time=2024-09-14T13:45:31.257549+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QckeEuP8LQOYDWQnn2Sg9BGyM65KnTn_0 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6262322968238725560', time=2024-09-14T13:45:31.516117+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.M0o8Au3CzPvbs-CW1fErnvMXpXWN5Mg_0 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1698533625235175691', time=2024-09-14T13:45:31.524017+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.t6ywOvSkUhMN2zt4QMyyuOkijIUAZFr_0 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13959116087681641165', time=2024-09-14T13:45:31.687520+0000, chain.objs.size()=1 2024-09-14T11:56:14.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SKtDoDUMCn3TuAFwTRV7qK4FALT1WPS_0 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.434126822370080167', time=2024-09-14T13:45:31.688262+0000, chain.objs.size()=1 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.M9YG4DeDEOiv5QZGdwrW3dsTedGBheF_0 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6765508296277926346', time=2024-09-14T13:45:31.729040+0000, chain.objs.size()=1 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NWkM0whsKcXZiXmEzivpVeBtbyvFNep_0 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5768423363438853682', time=2024-09-14T13:45:31.739730+0000, chain.objs.size()=1 2024-09-14T11:56:14.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.q7SESBaB9JQzv5U5mdkKxBROzJX3vbn_0 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17861314632316765125', time=2024-09-14T13:45:31.755663+0000, chain.objs.size()=1 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RpXbi-RYUJ31P8c3c7YEKZcqFvx4Ax0_0 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17501587879392923523', time=2024-09-14T13:45:37.151624+0000, chain.objs.size()=1 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.274__shadow_.Wd5VY2EJu9OIIO1iNNE6BU9h56YcL_B_0 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1516740021678461120', time=2024-09-14T13:45:38.118599+0000, chain.objs.size()=1 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.276__shadow_.WbKEO6pwYKLKasquFb3ncfV5ieIOoc6_0 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8601083917747026040', time=2024-09-14T13:45:41.781706+0000, chain.objs.size()=1 2024-09-14T11:56:14.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.283__shadow_.OfYNDo_ZR1X3SBURSgIcMIoJ2Wg_UGI_0 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5317017022272739523', time=2024-09-14T13:45:48.181548+0000, chain.objs.size()=1 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.ajg_Q-HyfJtvLBTMe3vnTwI3-m_ccDt_0 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10081065285839257713', time=2024-09-14T13:45:48.187225+0000, chain.objs.size()=1 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.cqwFSTSjuCGBX0WsaDjkqpeyvVx1g8I_0 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2857750624594774203', time=2024-09-14T13:45:48.199072+0000, chain.objs.size()=1 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.n8Z4KMqSRuTQd2Uggrd4Ep4kpWeTOyM_0 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663467748124455992', time=2024-09-14T13:45:51.648841+0000, chain.objs.size()=1 2024-09-14T11:56:14.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.301__shadow_.YyIhdUE7RyDwvIAZmhWDYSM6EJ-IDdQ_0 2024-09-14T11:56:14.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.468+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5218771382675001626', time=2024-09-14T13:45:54.731218+0000, chain.objs.size()=1 2024-09-14T11:56:14.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.468+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.307__shadow_.e5uPY_uAEFeZ_CyxGSdi6AoH_ATR3OA_0 2024-09-14T11:56:14.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.468+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5636499285989820881', time=2024-09-14T13:46:02.565922+0000, chain.objs.size()=1 2024-09-14T11:56:14.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.468+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.323__shadow_.JWIcKfA8esA0DFhGfn8wJZCIgNdtgrn_0 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4138350446319163840', time=2024-09-14T13:46:11.033854+0000, chain.objs.size()=1 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.evood-Co7OhiBeyKsK0RYqhlkpRY33Q_0 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14415340245181825235', time=2024-09-14T13:46:11.123863+0000, chain.objs.size()=1 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.crolfNuvoiVCvGWr2oyRqv66qCAPp7h_0 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13109790189810314494', time=2024-09-14T13:46:11.127604+0000, chain.objs.size()=1 2024-09-14T11:56:14.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HomcuoKMvq6PlXZlNzEKxizAIb12cFN_0 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5929304113657856001', time=2024-09-14T13:46:11.144746+0000, chain.objs.size()=1 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9gkPqKrE6FTa8zOHwD38mei0cU6iQOF_0 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9184716569133443667', time=2024-09-14T13:46:11.158965+0000, chain.objs.size()=1 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1LSuMuwEeXnF4pQnZRtCb1w5B0PQ4F1_0 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17931207184211889108', time=2024-09-14T13:46:11.184765+0000, chain.objs.size()=1 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.evcoX7bsb5fl7BPgTTAnDhJ504WQhMI_0 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2184934446217761703', time=2024-09-14T13:46:11.314674+0000, chain.objs.size()=1 2024-09-14T11:56:14.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-YCHlAPJONJ4nTlf1XInUSenumShpsy_0 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7312102872056655624', time=2024-09-14T13:46:11.332276+0000, chain.objs.size()=1 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rVaMtyUrQ3bYV57Z9HtXi_9NkPUGlWT_0 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7967138717351940490', time=2024-09-14T13:46:11.348368+0000, chain.objs.size()=1 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SnIKW4mKSKTj4RwpeO-kftV26g29ApJ_0 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.769280298843850727', time=2024-09-14T13:46:11.356963+0000, chain.objs.size()=1 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.471+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xIQ1s7pepJwGuyBquwoDBjDiKTL5uBt_0 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6416670796591767776', time=2024-09-14T13:46:11.650551+0000, chain.objs.size()=1 2024-09-14T11:56:14.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.K597Uk35ziduMBw6YuWj7qMw-NrH8bJ_0 2024-09-14T11:56:14.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12832181614371262213', time=2024-09-14T13:46:11.654288+0000, chain.objs.size()=1 2024-09-14T11:56:14.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UBCtvqVMLL93yXd3lOunOESq07T2X4L_0 2024-09-14T11:56:14.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17720839712725971793', time=2024-09-14T13:46:11.696553+0000, chain.objs.size()=1 2024-09-14T11:56:14.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eg8XqgKfFNcYOG3muV8ljfYYXw4v2fB_0 2024-09-14T11:56:14.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17716920026178906413', time=2024-09-14T13:46:11.701685+0000, chain.objs.size()=1 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.60UjPscjM55yQIhuiEaUDt_MmXjtSCN_0 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7006172641879103184', time=2024-09-14T13:46:11.894636+0000, chain.objs.size()=1 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ebgbMNlbGNeOTaIpt2yhXWQZBEmEnND_0 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17276323422751185249', time=2024-09-14T13:46:11.928749+0000, chain.objs.size()=1 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.474+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GoJ2_9sham4JwqsXntPllD6LBTRWa6Y_0 2024-09-14T11:56:14.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11172144030718923296', time=2024-09-14T13:46:11.953602+0000, chain.objs.size()=1 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Oqn0x0TtP8A0DriNHa9Gf2fhwO-UVPQ_0 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10770170261595784932', time=2024-09-14T13:46:12.029948+0000, chain.objs.size()=1 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ddbxpy4Rktvw9hMHuziSYUd0ve4yIKz_0 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6075608904268789037', time=2024-09-14T13:46:12.062322+0000, chain.objs.size()=1 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MTAtAbxyS1kku3L31BNDwQJNedkHdGc_0 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16133943514144276863', time=2024-09-14T13:46:12.064808+0000, chain.objs.size()=1 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Zm5mVrZ7FpHRmUzhw7YK7gGEDU6gvbJ_0 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15956786864433480543', time=2024-09-14T13:46:12.237965+0000, chain.objs.size()=1 2024-09-14T11:56:14.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.476+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1SwI7Flflog1i0JkEVpqbrXtjqVqvK2_0 2024-09-14T11:56:14.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14136143926020248833', time=2024-09-14T13:46:12.466214+0000, chain.objs.size()=1 2024-09-14T11:56:14.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sZEJqjwp_8GUvDCxx5T7d2DWTVSrxeJ_0 2024-09-14T11:56:14.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14765637063768417620', time=2024-09-14T13:46:12.470922+0000, chain.objs.size()=1 2024-09-14T11:56:14.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mTT0WbVJpbMOro8zp96ZzkpHFW1JO1d_0 2024-09-14T11:56:14.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9003270235727500079', time=2024-09-14T13:46:12.624177+0000, chain.objs.size()=1 2024-09-14T11:56:14.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o-iaRzrxw1cQ_LZBIoMfDx244VFgN2X_0 2024-09-14T11:56:14.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5882887188453694399', time=2024-09-14T13:46:12.629361+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.51Cp2xWpCW2SBuftraqXJ1BW3EjCZ4M_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5497184712433878351', time=2024-09-14T13:46:12.647170+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-coDZ34Vr9k2LDhENwDO8ea3zKBUaUn_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.454141876635840844', time=2024-09-14T13:46:12.673729+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9hSoGDKKcvOms4yVtgnOaKlHoO5pgkb_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17912907347148042179', time=2024-09-14T13:46:20.748436+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zoiWO0CxGU01O-KOZmKY5LOs-UDdPG4_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17990874603826955280', time=2024-09-14T13:46:20.755709+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.E_eCfmIk74sN_T4CKEbAhqqfBKg9-fq_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11466158895434774379', time=2024-09-14T13:46:20.761221+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.djKA6Z8PLHmKtjWvP-fOcl0cQt_7B9c_0 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6546988915219434110', time=2024-09-14T13:46:20.777526+0000, chain.objs.size()=1 2024-09-14T11:56:14.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lciHZdo79-QXfD5FOYb8cQPnRgQfpBb_0 2024-09-14T11:56:14.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8376469000534837117', time=2024-09-14T13:46:20.933167+0000, chain.objs.size()=1 2024-09-14T11:56:14.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.480+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lYxwO9wApw3OSZyeOrGITOSyZmyK8fj_0 2024-09-14T11:56:14.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.481+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8189577359752425218', time=2024-09-14T13:46:20.990204+0000, chain.objs.size()=1 2024-09-14T11:56:14.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.481+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qQ-O5pMHmgeYYPEQiBKkitzVarKmnFW_0 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8346106507395718920', time=2024-09-14T13:46:21.089840+0000, chain.objs.size()=1 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.q1o-3-tQeLY5hyE_2u6FkQrzH6tAZE5_0 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3399101002119457714', time=2024-09-14T13:46:21.147311+0000, chain.objs.size()=1 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.90Ht4zXI_lsJt33Lm7oDcmQ9l8wXncg_0 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11778946506879262945', time=2024-09-14T13:46:21.300611+0000, chain.objs.size()=1 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QBgYw3-L0O5PQv-zKmgzB79-PHrMphl_0 2024-09-14T11:56:14.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15437241927334844622', time=2024-09-14T13:46:21.344750+0000, chain.objs.size()=1 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6ZsfpqQJpoiydyr_tD530EYMzv9jjZr_0 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3964728165739152922', time=2024-09-14T13:46:21.474794+0000, chain.objs.size()=1 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.483+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9eq2_-d3QdDC5uSaannC_NTZvzSqL_L_0 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.970653993334539931', time=2024-09-14T13:46:21.743318+0000, chain.objs.size()=1 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Zlo16BVwx57cWiEdTGJ6L5TfCXCNenE_0 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3906873365356546766', time=2024-09-14T13:46:21.746890+0000, chain.objs.size()=1 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SMTuFNLkOk_hbPz8NtKRV6pD34VjDbp_0 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15358657960065790375', time=2024-09-14T13:46:21.853015+0000, chain.objs.size()=1 2024-09-14T11:56:14.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dT7RsWyXwCJpeCsustTUEgfdO23q9UV_0 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9524495332083188136', time=2024-09-14T13:46:21.916725+0000, chain.objs.size()=1 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.484+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MrPOapOh5Y5j_tdvkUZ-l1bX8quWy4N_0 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.485+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4882819184210195905', time=2024-09-14T13:46:22.034920+0000, chain.objs.size()=1 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.485+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5qQJiC80f6t3_PZg_MgnQ4V3DGu60_p_0 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.485+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8601680806907969190', time=2024-09-14T13:46:22.038609+0000, chain.objs.size()=1 2024-09-14T11:56:14.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.485+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Q4_AKRjAo7JUeDKo8irRlAD-1pt2KZB_0 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17720275673879458184', time=2024-09-14T13:46:22.051113+0000, chain.objs.size()=1 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dZQF1M0oeKvSler-LWiRxU-IxKR4Lum_0 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.669487939224742368', time=2024-09-14T13:46:22.058184+0000, chain.objs.size()=1 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DCb2OQfkR_Yc8bYVgkb3CMaYkHRaWOB_0 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16458533657081648454', time=2024-09-14T13:46:22.069161+0000, chain.objs.size()=1 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cpp_H68a1QIg28vI8zgL0Q1Z72b7RAL_0 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15608629149573251376', time=2024-09-14T13:46:22.112353+0000, chain.objs.size()=1 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.A2F4UW3UdUle3x0bZu-Fm4XqKMBalhS_0 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17009055978976643221', time=2024-09-14T13:46:22.122757+0000, chain.objs.size()=1 2024-09-14T11:56:14.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WOnymumq29gxabEyruQH4p9nOvq2-dE_0 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10754227909726884050', time=2024-09-14T13:46:22.320745+0000, chain.objs.size()=1 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.488+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KBnMQd58eqcvbWApTdw_mWD9GjW3ipB_0 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11268735225230066892', time=2024-09-14T13:46:48.804128+0000, chain.objs.size()=1 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.382__shadow_.VL8tlSA8zB0P9zaq1-TP98Gz_X9fxCS_0 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5156455036283495065', time=2024-09-14T13:47:15.548990+0000, chain.objs.size()=1 2024-09-14T11:56:14.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.432__shadow_.Jiw_NdodQSJArHm1QSoSLqjrpn8V44t_0 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3692334541745460195', time=2024-09-14T13:47:28.527068+0000, chain.objs.size()=1 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.456__shadow_.o8FgJAcmJ-i0i7FlxMKGCdp-mTyOkIJ_0 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI', time=2024-09-14T13:48:05.592778+0000, chain.objs.size()=1 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.2 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17297547934239639579', time=2024-09-14T13:49:00.093536+0000, chain.objs.size()=1 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.489+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.557__shadow_.RV7pOngaJXx4qyT_Y0FBv95_fsw-ckk_0 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4892251555960459277', time=2024-09-14T13:49:00.750505+0000, chain.objs.size()=1 2024-09-14T11:56:14.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.558__shadow_.2GK5CPIRrc1ksac3SEOVWBXTr2jEIyx_0 2024-09-14T11:56:14.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8011294060436402925', time=2024-09-14T13:49:01.438277+0000, chain.objs.size()=2 2024-09-14T11:56:14.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.559__shadow_.MADWxJsb44k0skBqS7yY-h9RHLefI0m_0 2024-09-14T11:56:14.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.559__shadow_.MADWxJsb44k0skBqS7yY-h9RHLefI0m_1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15362700404181267400', time=2024-09-14T13:49:21.902509+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:t6H2PMaiVaV-7Qmy3qHgiPvcZ631tLE_.0Wx2tpQoJKSdbThvDmebxjRZixEZr_R_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4277781884702291789', time=2024-09-14T13:49:26.168797+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:ev4K5lwICKWJFl3iWdBrTGBl9iPDdkV_.jWwlUrm8mwXEjIOXgYrHOIuicklP74k_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8568513476312022351', time=2024-09-14T13:49:36.888002+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:lUO0sQUPOZzoHakHsduGPeGP4lnwEhK_.zSOh8VVoh4vwTfOQJL4C7r9X15qQc2n_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1358519519858287406', time=2024-09-14T13:49:49.479237+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:RBmZeG4RX5wcZy7Q9xreCCLZBeWHOu0_.XtMt_MJd3oG7hR8UiDnz4en_CsSsh_1_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5330406861545554710', time=2024-09-14T13:52:27.436865+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.651__shadow_.S8nFio4-QpaA6uONRu_C3e9C_7OCOpd_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9116155708039314450', time=2024-09-14T13:52:34.345357+0000, chain.objs.size()=1 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.664__shadow_.AZb_7mXKD77XgbX6a5E0vczIFx04a35_0 2024-09-14T11:56:14.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10852922123514262299', time=2024-09-14T13:52:47.473463+0000, chain.objs.size()=1 2024-09-14T11:56:14.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.694__shadow:Iv26Yt7U2LTlvk25IAkVfzGjzpLgBun_.W1A0yo550NFWc8R5Pu6MRk7DHA1bz-d_0 2024-09-14T11:56:14.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4397212128787565917', time=2024-09-14T13:53:19.111011+0000, chain.objs.size()=1 2024-09-14T11:56:14.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.720__shadow_._B1f_dlNvUUnCOysLsyO0V1RRbmHMry_0 2024-09-14T11:56:14.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11246227532828350613', time=2024-09-14T13:53:43.265993+0000, chain.objs.size()=1 2024-09-14T11:56:14.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.747__shadow_.un03r0SXlbm6Cn4ThUUgfZvvgLrfcnV_0 2024-09-14T11:56:14.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.498+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.501+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:56:14.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.502+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.503+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/156385' 2024-09-14T11:56:14.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~9OeI58D9qRWvzExwtlxOt1ET2GnjxnR', time=2024-09-14T13:43:56.557926+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.202__multipart_mymultipart.2~9OeI58D9qRWvzExwtlxOt1ET2GnjxnR.1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12729424787144135557', time=2024-09-14T13:45:13.933042+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.245__shadow_.WxL_GOrIVdpmHtjW2uAYGw6Bn7m2WGG_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13485817491236149631', time=2024-09-14T13:45:30.213349+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DxQnI1bWHqsx1EyZPm1J-ch3sDKzvD4_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16331163146035927108', time=2024-09-14T13:45:30.228825+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qIp745wxSHA9AxRbchXDAUQcnI02nBc_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8519323105812654061', time=2024-09-14T13:45:30.278853+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NwqhmEhvD_V-jZFdyeaFLUAMMROkR7c_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16597406719576940549', time=2024-09-14T13:45:30.425157+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9Fm-B_qsNOcnMUJjer779loZYiq2ErQ_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2897613820801086585', time=2024-09-14T13:45:30.451223+0000, chain.objs.size()=1 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JrRjbZH9Ck12QOA8hOUbvNKf26Yc_jF_0 2024-09-14T11:56:14.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3890341984178360714', time=2024-09-14T13:45:30.481811+0000, chain.objs.size()=1 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2sVECQlPgkNUuLcUDEFUOK8OCnvnBaq_0 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7224083152871624983', time=2024-09-14T13:45:30.484850+0000, chain.objs.size()=1 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.S7P0rwgqMLyRh54USCYT6v7_jCmJm4u_0 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14176213295155051933', time=2024-09-14T13:45:30.632048+0000, chain.objs.size()=1 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rtHL7IfK1XVviMKmHX1kKXs4cYDGJtO_0 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2841113975091882544', time=2024-09-14T13:45:30.653629+0000, chain.objs.size()=1 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.q_7ADKh7lqG2dhh6f-hmDhjMQdkSWpx_0 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15942462327735947141', time=2024-09-14T13:45:30.660611+0000, chain.objs.size()=1 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dY_-s19ogD_BBLpsia2JgozdH94_cQH_0 2024-09-14T11:56:14.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.507+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3720127106059802061', time=2024-09-14T13:45:30.803531+0000, chain.objs.size()=1 2024-09-14T11:56:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.507+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PH2FSWhwXbakRyUEvLcb04BHSmdQFyU_0 2024-09-14T11:56:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.507+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12037599954818722618', time=2024-09-14T13:45:30.811027+0000, chain.objs.size()=1 2024-09-14T11:56:14.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.507+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.p5yqSEs-S54OSLUeku4B5outW_HQkZe_0 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.393422688608827550', time=2024-09-14T13:45:30.820013+0000, chain.objs.size()=1 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TG6d5nsSIpx4Lgk8-E2SJeR7btVd_u4_0 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15087108217850175752', time=2024-09-14T13:45:30.823713+0000, chain.objs.size()=1 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YwCBa4qjkkDQgJ4IhJLeVKG30QmXcsv_0 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11743809439475196445', time=2024-09-14T13:45:30.830115+0000, chain.objs.size()=1 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m6jOuh3IpBBQn24gN-ykw7S6oaxGs1O_0 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2556633920045403386', time=2024-09-14T13:45:30.847840+0000, chain.objs.size()=1 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BI5fi5FXyLNSIq0blgE5gNRAOlB5MFp_0 2024-09-14T11:56:14.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6664963166882492926', time=2024-09-14T13:45:30.868311+0000, chain.objs.size()=1 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rxHvrLTpeah19wIogVVC967V16dfCLj_0 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10721076605926817950', time=2024-09-14T13:45:30.877336+0000, chain.objs.size()=1 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dHd4PzbOgbEH-dwbyt6ifIm62ipisWS_0 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10037677352041725246', time=2024-09-14T13:45:30.958415+0000, chain.objs.size()=1 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.o1xs3E9qXBhRbS38yrZy82Uatlajire_0 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2408975879876444723', time=2024-09-14T13:45:30.960815+0000, chain.objs.size()=1 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.grnNkVQY-dXqv9SHXkPPa0QrHLEcJiC_0 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13611386253696670435', time=2024-09-14T13:45:30.962043+0000, chain.objs.size()=1 2024-09-14T11:56:14.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QtzBWxyL3XXbr9ZAG7rsDYnotvAnFo7_0 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15960205429602304308', time=2024-09-14T13:45:31.019314+0000, chain.objs.size()=1 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.axN07I86Aj7XS38n_g38jNWfP9MCxX2_0 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18423069936371966910', time=2024-09-14T13:45:31.021039+0000, chain.objs.size()=1 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W-O7YXIna-_7JfZ4NO-YubTCIKUSM2x_0 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18038987809574036076', time=2024-09-14T13:45:31.024955+0000, chain.objs.size()=1 2024-09-14T11:56:14.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.511+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7LLKs8INs4Ahws1jv7yDYpLg-D1a_U9_0 2024-09-14T11:56:14.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5751083218557514241', time=2024-09-14T13:45:31.042510+0000, chain.objs.size()=1 2024-09-14T11:56:14.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._z8LmY1DDhi6OF9G-NwcBs5oabKwsMV_0 2024-09-14T11:56:14.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6400889771399397613', time=2024-09-14T13:45:31.169547+0000, chain.objs.size()=1 2024-09-14T11:56:14.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jvRv8tDGVW1nirBV-ibNcgPSKUb5MUO_0 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6044646878395670047', time=2024-09-14T13:45:31.233299+0000, chain.objs.size()=1 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.K06kx9F8N2Y7wtq-92sBCtgqyKRh0NE_0 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13775620736045837255', time=2024-09-14T13:45:31.254635+0000, chain.objs.size()=1 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cqgJ--o0Kj4Xc86M-uoF3_pcUinXuoF_0 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4057250005806642950', time=2024-09-14T13:45:31.502704+0000, chain.objs.size()=1 2024-09-14T11:56:14.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5FEftDPaEVSgb0B9R5F5KSa17pVGMl-_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10543383688845366217', time=2024-09-14T13:45:31.506941+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.y4cwCr8nAuhfvSaPV2H7UyxMP7SG0bb_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7117311904262449305', time=2024-09-14T13:45:31.526055+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5mo2v72jsaXjR9VgIvUtXb7XxLx8d-0_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5113118992539408437', time=2024-09-14T13:45:31.532743+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.baE2gMjeCla0Xzs-NvRI2fGje268G3v_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5307813975653350662', time=2024-09-14T13:45:31.533513+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YCfRPhttZpFhvm4_gJjOONqOrvH1GC4_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8651760637735013250', time=2024-09-14T13:45:31.575835+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eQ2k0pWrwzVZ6loGdN36xBJ629kIa_-_0 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3808979671018066033', time=2024-09-14T13:45:31.699327+0000, chain.objs.size()=1 2024-09-14T11:56:14.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.514+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FkU0s4MauIbuuexDy6EGJq7ZBxld6kE_0 2024-09-14T11:56:14.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9148241471507045145', time=2024-09-14T13:45:31.700747+0000, chain.objs.size()=1 2024-09-14T11:56:14.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HeeMhOrUPgCUCpD08KhafJ_8pCB9ppy_0 2024-09-14T11:56:14.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10376271603134021303', time=2024-09-14T13:45:31.723703+0000, chain.objs.size()=1 2024-09-14T11:56:14.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aliFYVym_sV7ebaz3g5CaA8ASD6Z1Uv_0 2024-09-14T11:56:14.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15490750955605472056', time=2024-09-14T13:45:31.756387+0000, chain.objs.size()=1 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uW05lBUlAQ9qtCUzMOxVCNV9f4vSjp2_0 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8146913240982610013', time=2024-09-14T13:45:35.674573+0000, chain.objs.size()=1 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.516+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.271__shadow_.3_fzI0-8wRKqCM4uh0CR2wKw1NX8MVH_0 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.517+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14013568901598903910', time=2024-09-14T13:45:36.670380+0000, chain.objs.size()=1 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.517+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.273__shadow_.D7UgG_Va5VKGmY-x5_7ln-dqxL-trJ0_0 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.517+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12485370463900165290', time=2024-09-14T13:45:38.611843+0000, chain.objs.size()=1 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.517+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.277__shadow_.7zCPAlcj0MDl1uysclT4zYbRFQmcUWI_0 2024-09-14T11:56:14.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3335821551167240654', time=2024-09-14T13:45:40.295819+0000, chain.objs.size()=1 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.280__shadow_.0u-pIrq-rSbJ047b3VQUiSMxtcH_Uat_0 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.557481776005979242', time=2024-09-14T13:45:40.796489+0000, chain.objs.size()=1 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.281__shadow_.qDpBrGFbVhOQw6jyV24DRXXwsKGNa_B_0 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17975536685288088937', time=2024-09-14T13:45:41.288318+0000, chain.objs.size()=1 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.282__shadow_.ReQOSkVFVJNQYTWvHuA0NQH_II9sacU_0 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6880449081143411975', time=2024-09-14T13:45:45.276986+0000, chain.objs.size()=1 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.290__shadow_.DRCR6ADS2zF9HfHx6CLT8nj1hYeW4i__0 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16952238129252841681', time=2024-09-14T13:45:46.530938+0000, chain.objs.size()=1 2024-09-14T11:56:14.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.518+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.292__shadow_.Y41jeiZGdG7-W7O6aXbVhgTXn5mZQBs_0 2024-09-14T11:56:14.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.519+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.344650219550146219', time=2024-09-14T13:45:47.360081+0000, chain.objs.size()=1 2024-09-14T11:56:14.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.519+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.55mkXDpNo-0SpoRDkpRY9-Y1_D9nZ--_0 2024-09-14T11:56:14.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4699748571656521307', time=2024-09-14T13:45:49.171731+0000, chain.objs.size()=1 2024-09-14T11:56:14.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.296__shadow_.OzImXbDfSCmP6VWa4uRJkcj3TtRA0CY_0 2024-09-14T11:56:14.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5657783564563399460', time=2024-09-14T13:45:53.586353+0000, chain.objs.size()=1 2024-09-14T11:56:14.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.305__shadow_.qDIQaEqBGILXEqUKEw_F1vk_R9q8UMf_0 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4080890650727414757', time=2024-09-14T13:46:10.930530+0000, chain.objs.size()=1 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Ot0-jRb5azTIW7kyj1FMqAlYshEPeXt_0 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3125667418818842524', time=2024-09-14T13:46:11.029510+0000, chain.objs.size()=1 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.521+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.i62c_dZFsAM6M3GnBBl8pKYURwymHey_0 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.521+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14320396501348300519', time=2024-09-14T13:46:11.035535+0000, chain.objs.size()=1 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.521+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Wc8UA3_ATnEl2rrLc7jlnc1isAwdKqW_0 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17499836612100905264', time=2024-09-14T13:46:11.119726+0000, chain.objs.size()=1 2024-09-14T11:56:14.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sRWuF999FzYX86XBzRPPgdCLqDbggXN_0 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2911047943680743085', time=2024-09-14T13:46:11.181335+0000, chain.objs.size()=1 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6Bk4Fbdgrz0IuVjIsUtiuGAsPrGgxme_0 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14025625478100392735', time=2024-09-14T13:46:11.301103+0000, chain.objs.size()=1 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CcDkjm0zYhTCmDXNMUVYjmCX0BfDLwB_0 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9925777891677970331', time=2024-09-14T13:46:11.318403+0000, chain.objs.size()=1 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GuyZmUmhzGc-xLOGO8fDxg4Orhg1bxr_0 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12899149981471865273', time=2024-09-14T13:46:11.374415+0000, chain.objs.size()=1 2024-09-14T11:56:14.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BfMzqKofIetKq1KihuNRp0ZdZIl2Icj_0 2024-09-14T11:56:14.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.523+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12620982712314910094', time=2024-09-14T13:46:11.394827+0000, chain.objs.size()=1 2024-09-14T11:56:14.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.523+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zFKWFZ1RvYVFla13iv_SrOT4WdZ3SCy_0 2024-09-14T11:56:14.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.524+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8847233681738149129', time=2024-09-14T13:46:11.652015+0000, chain.objs.size()=1 2024-09-14T11:56:14.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.524+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jqWHW4V1GQgOmt8lZAEEzYixVJ90Q1__0 2024-09-14T11:56:14.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.524+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8294080373285498335', time=2024-09-14T13:46:11.681861+0000, chain.objs.size()=1 2024-09-14T11:56:14.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.524+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BTpSoui16CzlbKJhRnfAxmHvec-lh-X_0 2024-09-14T11:56:14.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14034305934779511340', time=2024-09-14T13:46:11.701676+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ECgsM48GyR1AjPM5tbdf9VwyPUVC-yX_0 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2069020452801934210', time=2024-09-14T13:46:11.705370+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ftEwfJovrAN2cjDtlN0vKD9O0SUcxHO_0 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10758029120821441067', time=2024-09-14T13:46:11.727870+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pzeMKYsr81IFs5N6HAymvRJXutC7xKU_0 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11181000769267727312', time=2024-09-14T13:46:11.838971+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.u4zPp_teM3D8kDx6zKZytJYG_wKaq7F_0 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11917163602476149860', time=2024-09-14T13:46:11.865264+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lbFyghh9na_d0BPFZ6cK1vKvL6ha_Lt_0 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2639498914435262052', time=2024-09-14T13:46:11.871301+0000, chain.objs.size()=1 2024-09-14T11:56:14.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cFl3-BNUp21XLYmzqAFPk5Y4N5pq8Zl_0 2024-09-14T11:56:14.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17257841050296333773', time=2024-09-14T13:46:11.892533+0000, chain.objs.size()=1 2024-09-14T11:56:14.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sk3srwYB6KVgdZv7FzmvU-Ice6T0vHM_0 2024-09-14T11:56:14.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1517667417601655941', time=2024-09-14T13:46:11.896699+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A9mSrs2QNCTsyDXyjt82QvASW_eGIw0_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6351479896288709575', time=2024-09-14T13:46:11.911986+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xoSd_zkrEYV_X3D6NjqH1oz4pwbNDZm_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14995782340112532725', time=2024-09-14T13:46:12.030839+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LHlMcmQY0KdEVumAatLlwuyQzkBKher_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12012046868401917190', time=2024-09-14T13:46:12.031455+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ljJeQNRWW1ww6wWtD7iGvNgd3RzTfxl_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9647659280586296032', time=2024-09-14T13:46:12.034333+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.528+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2T-cKSGMIqLNjoAf4MSA2sEzpenbvVn_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3300548630737000115', time=2024-09-14T13:46:12.035739+0000, chain.objs.size()=1 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uK9aoYkVjjv9Tb5Ejzgws6cTe1S07YC_0 2024-09-14T11:56:14.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6899164977092540383', time=2024-09-14T13:46:12.075001+0000, chain.objs.size()=1 2024-09-14T11:56:14.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oAluE_NmZ8DR0aGMVtbiUySYLLMpUz4_0 2024-09-14T11:56:14.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2997554224806423858', time=2024-09-14T13:46:12.130052+0000, chain.objs.size()=1 2024-09-14T11:56:14.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.529+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MpiF_xW-oXngT9XLNRMcmpwjm2yx5vh_0 2024-09-14T11:56:14.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.530+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14504468605033282991', time=2024-09-14T13:46:12.219010+0000, chain.objs.size()=1 2024-09-14T11:56:14.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.530+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.s2WOoPbPt-BnBp6yuYqTbN4zEZHCCp3_0 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8366407119091732719', time=2024-09-14T13:46:12.475539+0000, chain.objs.size()=1 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1hnVD5pBtqaRnbDqbu8sNNAEs03yBvZ_0 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17757834526937034457', time=2024-09-14T13:46:12.503108+0000, chain.objs.size()=1 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tUffoXGExKL6FbPhb2O0hBQR9y--Mkf_0 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8714054899231861159', time=2024-09-14T13:46:12.618855+0000, chain.objs.size()=1 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dBzDU3SFsNKt1Qmy7aK9NEvDz6cIp4e_0 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5457134511888118729', time=2024-09-14T13:46:12.649767+0000, chain.objs.size()=1 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xNFbDdAoj6EUTeazNVr4HTvjG7pHlvt_0 2024-09-14T11:56:14.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.56992682030697982', time=2024-09-14T13:46:20.727812+0000, chain.objs.size()=1 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZX0V_8op6lCo6IRxEwMyt8fAT3okez2_0 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1887324622793361082', time=2024-09-14T13:46:20.935420+0000, chain.objs.size()=1 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.532+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.C7Gs0wtMiTMMo8iHXuQtu8a5XbPIxDr_0 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16404672230429151467', time=2024-09-14T13:46:20.936077+0000, chain.objs.size()=1 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5FNmlISZiFwND0iXT34OqpdSrJwaOq4_0 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17609679853665780949', time=2024-09-14T13:46:20.944113+0000, chain.objs.size()=1 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.hZifX9ArcL5hW1tLdiAczzoQaN3aHnr_0 2024-09-14T11:56:14.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13705570894775034193', time=2024-09-14T13:46:21.180754+0000, chain.objs.size()=1 2024-09-14T11:56:14.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.drfR-5ADS6RI44XRzD8ia-gW_qsOJJ-_0 2024-09-14T11:56:14.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5496396768747616797', time=2024-09-14T13:46:21.339424+0000, chain.objs.size()=1 2024-09-14T11:56:14.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NqvG3wXndCe-jbSRhHeWSMxF48l2vFg_0 2024-09-14T11:56:14.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12770059011175624406', time=2024-09-14T13:46:21.349324+0000, chain.objs.size()=1 2024-09-14T11:56:14.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.533+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1-s4h6gB7Mgp6xOg9Eb5-m1y-n0dHpi_0 2024-09-14T11:56:14.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8572180009063169926', time=2024-09-14T13:46:21.367824+0000, chain.objs.size()=1 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UHDqir84izeC2LIZENwxXV4CbAIsZzx_0 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2474331356024219032', time=2024-09-14T13:46:21.375624+0000, chain.objs.size()=1 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KB3fdVGP7gakoovh-iY5lHxawADfgxZ_0 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13803318891945264335', time=2024-09-14T13:46:21.505040+0000, chain.objs.size()=1 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZfVATtihQYjvMU6hxE4HCJ1qzo_EQPR_0 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17423186368057373868', time=2024-09-14T13:46:21.510053+0000, chain.objs.size()=1 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.537+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.j2XwGbxsHt3A5zCr1BMtRRWVvkQFnas_0 2024-09-14T11:56:14.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.538+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14312429571022245659', time=2024-09-14T13:46:21.516674+0000, chain.objs.size()=1 2024-09-14T11:56:14.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.538+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NfyVO0m-7OQGihgxxbN5xi1RjicUXeK_0 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1499017031153846298', time=2024-09-14T13:46:21.736582+0000, chain.objs.size()=1 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JPi9jBEXUzlqF1htPhPzVOevu3zg0MW_0 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13617312521717144403', time=2024-09-14T13:46:21.746918+0000, chain.objs.size()=1 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RgDkOsOTNCfJCvsYap_mRDllq1KBQkS_0 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5733437138614123161', time=2024-09-14T13:46:21.758816+0000, chain.objs.size()=1 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.p8BZ_wanazb0aluFUlUfwbbLSt8mW3p_0 2024-09-14T11:56:14.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2885550567720689383', time=2024-09-14T13:46:21.861201+0000, chain.objs.size()=1 2024-09-14T11:56:14.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.x3Rhmr5SDH77fLzfSBBSyefM-M7Zysa_0 2024-09-14T11:56:14.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10516053079796004152', time=2024-09-14T13:46:21.897402+0000, chain.objs.size()=1 2024-09-14T11:56:14.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nktrhZxklRD1inU1OM5QR2MCWnx8O49_0 2024-09-14T11:56:14.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18272649491207630432', time=2024-09-14T13:46:21.942431+0000, chain.objs.size()=1 2024-09-14T11:56:14.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.envBbrQ_VIcDlgmiRbaLTu0li6O-o7u_0 2024-09-14T11:56:14.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/156385 2024-09-14T11:56:14.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T11:56:14.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7693572931775921361', time=2024-09-14T13:46:22.059343+0000, chain.objs.size()=1 2024-09-14T11:56:14.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CxBuSLi2ux8MDHD9q0YUa1NZg6qBGp3_0 2024-09-14T11:56:14.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1684214405748763917', time=2024-09-14T13:46:22.113173+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JtXTJWoRWgkIKME59ypcrHM0DIXR48B_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3216591222194137202', time=2024-09-14T13:46:22.125157+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-r_C8QSFHZR_5JbGcq0shfF10wLU0Xn_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1397326790091775658', time=2024-09-14T13:46:22.264394+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-3hvrlt7JUpZVCgNMnf8grdD-2bzqH8_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4068597743948556929', time=2024-09-14T13:46:22.265469+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fmX5-CT7b5hvPj4mQpnopR81Yuuyd8W_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10322611981394127244', time=2024-09-14T13:46:22.270983+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3h9s6C8WHLOGP_hw3sVx00Qz1-ZR7Cm_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16463306715211276939', time=2024-09-14T13:46:22.272450+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.U3w_DeV2nm1NXNVxYRWw-4YcCo6ooWq_0 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3078064899417004199', time=2024-09-14T13:46:22.273445+0000, chain.objs.size()=1 2024-09-14T11:56:14.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aO9zdSr1yOMmKZbVxVPuOq0IyGDJSc9_0 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17520851725115171664', time=2024-09-14T13:46:22.312933+0000, chain.objs.size()=1 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GhZYoLz1sI3C4hsyDuF-YCUbHM3ky-E_0 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18110862603172417539', time=2024-09-14T13:46:22.314204+0000, chain.objs.size()=1 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GYZ0eQJt9wFo6nbyBuzFHaS673BKjOt_0 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10762593158436978156', time=2024-09-14T13:46:22.329524+0000, chain.objs.size()=1 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1Vh49cz6j63UgdMd5h7N4qZoukDdZSc_0 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10302302393146219905', time=2024-09-14T13:46:48.955805+0000, chain.objs.size()=1 2024-09-14T11:56:14.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.546+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.382__shadow_._YjRMZkhVD8pUhdkG-1agqKHyBN3PKM_0 2024-09-14T11:56:14.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12627675582162126896', time=2024-09-14T13:47:36.268770+0000, chain.objs.size()=1 2024-09-14T11:56:14.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.467__shadow_.aeVsLAC7eFSuO2QwyYISu7CZ_jvQ2DJ_0 2024-09-14T11:56:14.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5065613473585548475', time=2024-09-14T13:47:44.754524+0000, chain.objs.size()=1 2024-09-14T11:56:14.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.489__shadow_.AOWDMEsEGlTxMwz6c1REKsHca74l5Yc_0 2024-09-14T11:56:14.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3070540929714422355', time=2024-09-14T13:47:49.578686+0000, chain.objs.size()=1 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.500__shadow_.qcnxE17T29TtMVEpaWARFNCg38YJAox_0 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14221209769069495373', time=2024-09-14T13:48:15.640225+0000, chain.objs.size()=2 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~pU0oIpqsLge6TXCgdzwyN15khctzGTw.1 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~pU0oIpqsLge6TXCgdzwyN15khctzGTw.2 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~5CfWyTrqbzlmgoXDlOaVFh-TYIIvlW1', time=2024-09-14T13:48:20.519146+0000, chain.objs.size()=1 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.532__multipart_mymultipart.2~5CfWyTrqbzlmgoXDlOaVFh-TYIIvlW1.1 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2784126827169851943', time=2024-09-14T13:48:58.126357+0000, chain.objs.size()=1 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.554__shadow_.mHjFtT2aA-_9KeJnOFMZqT8e9qpIneW_0 2024-09-14T11:56:14.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8847871882365306640', time=2024-09-14T13:49:00.104688+0000, chain.objs.size()=1 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.557__shadow_.e8duLfbn4sqsltWxBRDloPl8pSWaBIL_0 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6958494689376352781', time=2024-09-14T13:49:09.298282+0000, chain.objs.size()=1 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.565__shadow_.zuVgsV2C-nMidWfkJw-HdQ-K2rG2-z1_0 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12945660904918355138', time=2024-09-14T13:49:12.640878+0000, chain.objs.size()=1 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:a5UkIFkzxDzpnaI1mpcsx.4qurM-NXG_.fafY72_GLITZKhP3dYAx5_Zn9qoJT6g_0 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4121366022002894743', time=2024-09-14T13:49:16.853126+0000, chain.objs.size()=1 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:oMr9Joh-2rQV1eGEchWlQuvU2Wz28Xq_.M2WY5qLZBe5-LMZrL6l6xjYf_QPZSTO_0 2024-09-14T11:56:14.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.552+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18354339057666973683', time=2024-09-14T13:49:19.729534+0000, chain.objs.size()=1 2024-09-14T11:56:14.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.552+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.573__shadow_.tqfu9ZzlpWaLS2bvMXYHoSSJcFzHd0F_0 2024-09-14T11:56:14.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.553+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16479272700322663086', time=2024-09-14T13:49:24.210959+0000, chain.objs.size()=1 2024-09-14T11:56:14.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.553+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.576__shadow_.-oVeVVBYkrzTDIxsXpH3jZMaqayMXIM_0 2024-09-14T11:56:14.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8122361997887203557', time=2024-09-14T13:49:27.553752+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:5h.pIoT1MJtlngvdxYB5RnTgbYOkcdZ_.yBsj6KseR29BO6Yfa_1K0pu2cuqTUAS_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.923895145255735316', time=2024-09-14T13:49:34.034279+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:ETQQfWWz6E1SUBoAq21YS0k.G--L-MF_.-78L_9jgAvcL23gn0FbWZX8XHmpd4Oa_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13301405436081940000', time=2024-09-14T13:49:49.594372+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:Vr1RWwE2Fvp91O-eLPaKUMI1uExLwaa_.-XoZhRZAZfzc5ymk_ya0sZvzIFwP5Qg_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6969447856522517999', time=2024-09-14T13:50:06.933708+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.617__shadow_.x7P3fwwF6gcm6GiNy0-2Zl4D0LAEFsR_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15732521173744992092', time=2024-09-14T13:52:25.537284+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.648__shadow_.4lVXnUdIKfaMr9QCQDFpcmxPVXIZJSI_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13482927771676398905', time=2024-09-14T13:52:34.345349+0000, chain.objs.size()=1 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.664__shadow_.g5TwAzSkmQ_cec6j4zEkJOQDwR0lDoj_0 2024-09-14T11:56:14.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2711521048039723845', time=2024-09-14T13:52:48.901118+0000, chain.objs.size()=1 2024-09-14T11:56:14.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.697__shadow:g1ONucGQbpvkpJy.yNf6LIkmyTJveW5_.yWTWUHqArPGupmomSQTnZ-IZ0k5vzCQ_0 2024-09-14T11:56:14.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8982531529644056568', time=2024-09-14T13:53:45.765263+0000, chain.objs.size()=1 2024-09-14T11:56:14.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.751__shadow_.xZcrEJsjBhvBPAy9pdX_yNXe5y0wMGD_0 2024-09-14T11:56:14.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3685759582558115811', time=2024-09-14T13:53:48.339562+0000, chain.objs.size()=1 2024-09-14T11:56:14.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.754__shadow_.csckFXhycveJzBBi-9t-QcW1B68VdSO_0 2024-09-14T11:56:14.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.559+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.561+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:56:14.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.562+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.563+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47812' 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_Sb8qstH2bmYWvGIR54qZ1c0UGzFhfew', time=2024-09-14T13:43:21.357718+0000, chain.objs.size()=1 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.Az6tsdsZvmM9twuCNpma3K9GhkPBArA_0 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9812481553136969835', time=2024-09-14T13:43:40.257446+0000, chain.objs.size()=1 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.180__shadow_._afyLanx37SgHCVuaume4DXw_8yLAUE_0 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5421544976876073782', time=2024-09-14T13:43:41.590166+0000, chain.objs.size()=1 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.183__shadow_.SBSlK0qHYaYB_EtQhthQTQ5uzTgj8E__0 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13005194256080140520', time=2024-09-14T13:43:56.131961+0000, chain.objs.size()=1 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.201__shadow_.IDcutdOYFo_xDJOsOWe_NJ9qmnJ4qWz_0 2024-09-14T11:56:14.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6114858780788175560', time=2024-09-14T13:45:17.826744+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.253__shadow_.T1DFxGU2apd78bBIomGWg48f3JDkqkq_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3992777762235230711', time=2024-09-14T13:45:17.827460+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.253__shadow_.QiPeZsb0XBq5w-LLia8vVw5wHkLHp8n_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4182085261569902103', time=2024-09-14T13:45:20.189697+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.258__shadow_.jpIPxoLaXuppJ4Eg7sLsJBW60Ugxh-h_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2493718240637438161', time=2024-09-14T13:45:21.626279+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.261__shadow_.ssXQ4d_5Q5oxT-1sQIBkh7JEYUOC1EN_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12795686980933242750', time=2024-09-14T13:45:30.243096+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.v9Bg-pvGyNexuK55Tjk05MvZNCfhNEN_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6033489885538992434', time=2024-09-14T13:45:30.263705+0000, chain.objs.size()=1 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RGYjsx0V8zGDVi-ZJJ3KZ3iIX7lTl_8_0 2024-09-14T11:56:14.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8889169632496812035', time=2024-09-14T13:45:30.279620+0000, chain.objs.size()=1 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jHA6HgtEmY7ojtjYAWp9ZTO4E_Ce1J8_0 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.270672129647954860', time=2024-09-14T13:45:30.280352+0000, chain.objs.size()=1 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.564+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.q6kkPqTqcyWfTSvQBde9orH1XvtO9RC_0 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2239710297890700585', time=2024-09-14T13:45:30.404729+0000, chain.objs.size()=1 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EIJXugQKstywVTeXzYhnWb2cnxsmwcp_0 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14209598356526927536', time=2024-09-14T13:45:30.446530+0000, chain.objs.size()=1 2024-09-14T11:56:14.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fIupIUkTiBS4FwqauciMUM_RH2u41-D_0 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5774417292756100321', time=2024-09-14T13:45:30.512500+0000, chain.objs.size()=1 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.M0lrpp4x3owhT7xQxXEtVcrhdDEipX3_0 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.567+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8274539255189744746', time=2024-09-14T13:45:30.604766+0000, chain.objs.size()=1 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.567+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Elp3nCmG2X6jhGa6BKhQGZiJ9kLdJRs_0 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.567+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12647980276256501848', time=2024-09-14T13:45:30.606138+0000, chain.objs.size()=1 2024-09-14T11:56:14.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.567+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QBJV7e_J_XEw-L1d3B7w-bL-j7V3BPg_0 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8945937258627502458', time=2024-09-14T13:45:30.667154+0000, chain.objs.size()=1 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YVhF1lGRazH-LL36AAPRzM4WKZVq3VD_0 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8908006187906392701', time=2024-09-14T13:45:30.668078+0000, chain.objs.size()=1 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sAz8ryE2Euc_pv4LOniZuSlquhfVfVx_0 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3319340320567133511', time=2024-09-14T13:45:30.689977+0000, chain.objs.size()=1 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MmqUfk5tG_SFo6HCv-hi9xgY-r7q4L6_0 2024-09-14T11:56:14.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11518677908816514771', time=2024-09-14T13:45:30.779150+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XmDke17T6B61N5gJFH5FG-HOeqEayvH_0 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2527954547566428399', time=2024-09-14T13:45:30.861117+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ihGZI017wE3MYQRUyTH4i_gLJeIx2ZQ_0 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6361903846308206579', time=2024-09-14T13:45:30.862715+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ejZhCOaQYlSn__q_yebuIXoa4_KHVxs_0 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17470164016367349647', time=2024-09-14T13:45:31.036926+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.IB_-sriE4T82RsmF-VA91gsqDPc7Nw5_0 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13924855900547596761', time=2024-09-14T13:45:31.045491+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DwRLfz1gCQdEnyLNkDDQbKxuOmQYNGr_0 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4347161143186589747', time=2024-09-14T13:45:31.052228+0000, chain.objs.size()=1 2024-09-14T11:56:14.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rK_Iqc6uXOsCVceuE_5teT4kxMOnQuJ_0 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.570+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3774274837472709814', time=2024-09-14T13:45:31.061277+0000, chain.objs.size()=1 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.570+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2lL9-HcQ2hLBEa7-2wmrvpN9XllyGKS_0 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.570+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.39379609169269512', time=2024-09-14T13:45:31.066238+0000, chain.objs.size()=1 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.570+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aSzB48JVBRHSJVV2itwDDYUlZyzrW4a_0 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7150739340113280310', time=2024-09-14T13:45:31.067952+0000, chain.objs.size()=1 2024-09-14T11:56:14.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RC0G9N-Cx-5YlVAHSnZifjn8drfnVjD_0 2024-09-14T11:56:14.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1031475488283134145', time=2024-09-14T13:45:31.155630+0000, chain.objs.size()=1 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.s1zJO6pyyo7z28xOpZsq4JkfxiU87Pl_0 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2791084271220395604', time=2024-09-14T13:45:31.197852+0000, chain.objs.size()=1 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bKDZdd855_aJFHcEWUjJfANZWb553sX_0 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16390920483642477649', time=2024-09-14T13:45:31.235001+0000, chain.objs.size()=1 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.572+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lrMSk_owe3ObEagXYuZLIEPnJEoMa7K_0 2024-09-14T11:56:14.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.573+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10438855485131979410', time=2024-09-14T13:45:31.244797+0000, chain.objs.size()=1 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.573+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EuvtjdRN9MryOfKXgh3TnVQjH4-e1zY_0 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.573+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8080512041636680583', time=2024-09-14T13:45:31.504100+0000, chain.objs.size()=1 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.573+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.quzDa3en3oICOE-BJMPRASVx5VkaWQx_0 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14497908693381612778', time=2024-09-14T13:45:31.532621+0000, chain.objs.size()=1 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6uFesfZ612evi2ZPK7FP4fsvF8mIljX_0 2024-09-14T11:56:14.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6099896975478664443', time=2024-09-14T13:45:31.541129+0000, chain.objs.size()=1 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GcrpbyLgkR8b-taeTN0-zK0QKTm8WT1_0 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1531871820976331264', time=2024-09-14T13:45:31.597875+0000, chain.objs.size()=1 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9Lt4q-4FJjcwKDhvOOvhSDO4vBn5UIl_0 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9101450876929027025', time=2024-09-14T13:45:31.681391+0000, chain.objs.size()=1 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.REcERuIYmlsHxhO-kMCus-ZvWv4ADOJ_0 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5087195777976993488', time=2024-09-14T13:45:31.719411+0000, chain.objs.size()=1 2024-09-14T11:56:14.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tME19EfUoLLV3pMPBjslqpFe6JepxvR_0 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2404741434187949521', time=2024-09-14T13:45:31.756265+0000, chain.objs.size()=1 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.umWLhVElTBYlXWIuvLIPGo8LZdfBvWN_0 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4805724143430320984', time=2024-09-14T13:45:42.811127+0000, chain.objs.size()=1 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.285__shadow_.chXkY1gA-QiztdrpLj-cjeju9yLBXXY_0 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7186402231593299284', time=2024-09-14T13:45:43.338352+0000, chain.objs.size()=1 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.286__shadow_.uhHshOA7EU8w1gR1PB9CMLaTbe3II-P_0 2024-09-14T11:56:14.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7988005599147438565', time=2024-09-14T13:46:10.946466+0000, chain.objs.size()=1 2024-09-14T11:56:14.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.576+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GVsOY02oZDQnkkyRKm7Ekww7jlOcXbP_0 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5144968769329842609', time=2024-09-14T13:46:10.964384+0000, chain.objs.size()=1 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eB1_U8z1E6yoSrAySEoDrsVe5CHDg0l_0 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10150241120195644793', time=2024-09-14T13:46:10.988410+0000, chain.objs.size()=1 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.v2XbrhoxIG357uXQZp3WP7BlytOlyZx_0 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7849417619484799479', time=2024-09-14T13:46:11.023517+0000, chain.objs.size()=1 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YYwOk-Fx1PxvIoq8w_XElHyw2oogR5Y_0 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17284115986777941968', time=2024-09-14T13:46:11.142467+0000, chain.objs.size()=1 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.38KJAIq6FjTNkxk0eHpUpRPbrjZuODC_0 2024-09-14T11:56:14.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.230277165084452906', time=2024-09-14T13:46:11.162703+0000, chain.objs.size()=1 2024-09-14T11:56:14.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.O7Aq-N9PBwHwjdc010ILm-YRhJMZMUL_0 2024-09-14T11:56:14.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13865225860325398701', time=2024-09-14T13:46:11.180955+0000, chain.objs.size()=1 2024-09-14T11:56:14.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.V-EYXTyEHUWXvtMOVeVyfNCv8Hq6Sty_0 2024-09-14T11:56:14.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14077715648526638133', time=2024-09-14T13:46:11.193880+0000, chain.objs.size()=1 2024-09-14T11:56:14.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Jxon612k8T3vdK8p1kxWFPgcViPXgKh_0 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10949617624269925364', time=2024-09-14T13:46:11.376763+0000, chain.objs.size()=1 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NO3bJ-5ATpzlpdwW_VNtdet2LxtIXWl_0 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2083775670715350374', time=2024-09-14T13:46:11.377515+0000, chain.objs.size()=1 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hQhoj-hNC4MGU8i7QGOXo6zoGA0Lvt3_0 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11504477403155144837', time=2024-09-14T13:46:11.379123+0000, chain.objs.size()=1 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4bn_JsHZGt8kF2GPYM0dscujIhMBD02_0 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13530211196133409607', time=2024-09-14T13:46:11.387532+0000, chain.objs.size()=1 2024-09-14T11:56:14.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VFSnZLcoWBBb2CPNmDjdXpASd1ECX-0_0 2024-09-14T11:56:14.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11726773077860454737', time=2024-09-14T13:46:11.409039+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y4W3kFjcRYarMsDgJQE3CuXg17iusIG_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8984578183475901330', time=2024-09-14T13:46:11.733990+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uQCul57AscvJLbZnBRr4NCk3w0e4-pP_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.23297231680814412', time=2024-09-14T13:46:11.751532+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M_8SwH2DpczIYxE93xgzy_YGpFv9erO_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.777303495829274640', time=2024-09-14T13:46:11.758754+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oY-78AkpNioo-1zuZ3T5ZTry5zif9b0_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2873218258603519911', time=2024-09-14T13:46:11.870538+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wuucBwWMWGKdTRQ_m2a3NrgN_PYyLqG_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15655683525926929198', time=2024-09-14T13:46:11.898016+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o99YYld-aY3mrsmlVZYugv78D9OF65D_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14504653562804815328', time=2024-09-14T13:46:11.920380+0000, chain.objs.size()=1 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.I833U4WU8sE9g2StXTNrzO1JzWdj_Ip_0 2024-09-14T11:56:14.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2420244394579147079', time=2024-09-14T13:46:11.944904+0000, chain.objs.size()=1 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QGoRSyIzdcJnWafvxlmbHIVsQ8Sl9P0_0 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11327233713103487974', time=2024-09-14T13:46:11.948053+0000, chain.objs.size()=1 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lAfOLzmRlG1kjzX5oaiVYZPWzfdcleX_0 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.180615456890625658', time=2024-09-14T13:46:12.047798+0000, chain.objs.size()=1 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.G_9MZeeLfc8aNGQcJ6aVDgnPBuUx099_0 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10579369072615929460', time=2024-09-14T13:46:12.064803+0000, chain.objs.size()=1 2024-09-14T11:56:14.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.584+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Oh0gnfT6zZvrE-DYXob6cR2B2MBOOP1_0 2024-09-14T11:56:14.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.586+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.350902484581886946', time=2024-09-14T13:46:12.072463+0000, chain.objs.size()=1 2024-09-14T11:56:14.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.586+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hEzWoMWYLR6HmdiZL8OJ_sGqScFFv38_0 2024-09-14T11:56:14.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3173475829826612224', time=2024-09-14T13:46:12.098913+0000, chain.objs.size()=1 2024-09-14T11:56:14.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8IRCbm2Q3UpxBx0GHilty24JOUXUDDh_0 2024-09-14T11:56:14.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15910774496102174152', time=2024-09-14T13:46:12.141087+0000, chain.objs.size()=1 2024-09-14T11:56:14.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eKlX4BFA37Mg6MBSxzzpSaHG8j5ItP4_0 2024-09-14T11:56:14.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15593864237842790370', time=2024-09-14T13:46:12.219309+0000, chain.objs.size()=1 2024-09-14T11:56:14.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fW0wAnLKROQAQnTeuaSHAsqFHFk8cBE_0 2024-09-14T11:56:14.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1584401056460227936', time=2024-09-14T13:46:12.221171+0000, chain.objs.size()=1 2024-09-14T11:56:14.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.587+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.S-yVA5nEwkc9utYjuMZDUZ-4LCuiz2F_0 2024-09-14T11:56:14.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13643517080313906882', time=2024-09-14T13:46:12.223107+0000, chain.objs.size()=1 2024-09-14T11:56:14.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.w6CojABTms_SrVbnfOBtR0wOY_Oz8F-_0 2024-09-14T11:56:14.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12271114174038694017', time=2024-09-14T13:46:12.432176+0000, chain.objs.size()=1 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dfOYto6HM1kw-bHpWia6Z706vYDPNVG_0 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18101932044295541648', time=2024-09-14T13:46:12.434411+0000, chain.objs.size()=1 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UBOor8Va04uTezhajyPExxL5jq7xtP-_0 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3205113220969728343', time=2024-09-14T13:46:12.459825+0000, chain.objs.size()=1 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-esLElzqscUB5Y2eIBBmXD0hnurjNIG_0 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15272096473145964331', time=2024-09-14T13:46:12.657747+0000, chain.objs.size()=1 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.X_mK-qrr887O0ZpNze5RRXmIJAVppxa_0 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2926699433793271935', time=2024-09-14T13:46:12.684786+0000, chain.objs.size()=1 2024-09-14T11:56:14.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.h8m5J5lAdiK2iR1Fk_AoELuN4SmfQtN_0 2024-09-14T11:56:14.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.589+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2746527848066311365', time=2024-09-14T13:46:20.757539+0000, chain.objs.size()=1 2024-09-14T11:56:14.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.589+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nAiCSpN2CISfLbt69aZslyW0xBLOpfp_0 2024-09-14T11:56:14.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.589+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15397696466705573114', time=2024-09-14T13:46:20.763376+0000, chain.objs.size()=1 2024-09-14T11:56:14.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.589+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6xEATs6KWc2VwvC4t6BFxXcL1Pz7Dlp_0 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.590+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16025488438347292132', time=2024-09-14T13:46:20.768950+0000, chain.objs.size()=1 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.590+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JDq36QvsUyVaXq2LjDvJnZbGcWDA0c3_0 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.591+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16485327887090331550', time=2024-09-14T13:46:20.784072+0000, chain.objs.size()=1 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.591+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.du5-8GRIOXIXBsgKmDKD0GNWlaGyhFR_0 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.591+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3887926518618684120', time=2024-09-14T13:46:20.813017+0000, chain.objs.size()=1 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.591+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.deJ7AIVunf-9GPNIm3Hp2Yoefr9Dbt6_0 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.592+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8347717416205629552', time=2024-09-14T13:46:20.905219+0000, chain.objs.size()=1 2024-09-14T11:56:14.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.592+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RGlY5J2ck9n2fZycLdIZCkWrBJgLAaY_0 2024-09-14T11:56:14.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2505979188314537637', time=2024-09-14T13:46:20.919416+0000, chain.objs.size()=1 2024-09-14T11:56:14.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.c1R5kWLFY1AOH5LZ2U1-mhvDz20TlKd_0 2024-09-14T11:56:14.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3014650896823887618', time=2024-09-14T13:46:21.119221+0000, chain.objs.size()=1 2024-09-14T11:56:14.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cjIiGpUOXVWd3ZwmBikY6ZGkR-CDYlP_0 2024-09-14T11:56:14.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1177140920764148697', time=2024-09-14T13:46:21.121306+0000, chain.objs.size()=1 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-U6wpUWesDqEyEovjgPsgiGqwkDTnPz_0 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13355066958359734964', time=2024-09-14T13:46:21.124391+0000, chain.objs.size()=1 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mPwmWmHTJ39u8cy0g9nSqS8EFyBp_nr_0 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7362189377315124414', time=2024-09-14T13:46:21.145308+0000, chain.objs.size()=1 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EaSd2g4ov8uw9W4lr23XBjIFfJEOWw5_0 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2260647151693458759', time=2024-09-14T13:46:21.161252+0000, chain.objs.size()=1 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zzNLWNSk0Hpnwd6rubtAn4vlrekq8W3_0 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5090361006812377749', time=2024-09-14T13:46:21.283961+0000, chain.objs.size()=1 2024-09-14T11:56:14.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lXYlkkLLsD71eEko_0BvwfWXzP3zwGE_0 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.866207562143402458', time=2024-09-14T13:46:21.302393+0000, chain.objs.size()=1 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UDVy1_7mLrO9J_LTqeQ-svt6I9YOnFb_0 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7547983729118503756', time=2024-09-14T13:46:21.319056+0000, chain.objs.size()=1 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zowBJOUc10Wa2CxWJ4s4on2C4_fN0sZ_0 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6249162488456808938', time=2024-09-14T13:46:21.364632+0000, chain.objs.size()=1 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.594+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.z43_zgOJ8ygcaxuQmzFFkdAy2O1Tsmy_0 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.595+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12879889460080301570', time=2024-09-14T13:46:21.373759+0000, chain.objs.size()=1 2024-09-14T11:56:14.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.595+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fnPFS4eY9NkHyLXJe20tRHSbC_Y3WeQ_0 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15455586507570613000', time=2024-09-14T13:46:21.390201+0000, chain.objs.size()=1 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dSzn3Y2Ogh96cR0C-CTXAhI1ohPkeKa_0 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4529877768208059572', time=2024-09-14T13:46:21.529136+0000, chain.objs.size()=1 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GkKoBQdehG-wx9tGqV9IlxfAFkDPToe_0 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17850808428734917315', time=2024-09-14T13:46:21.767989+0000, chain.objs.size()=1 2024-09-14T11:56:14.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.596+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9_SB8eLnCVs8j8-9_iRbsC-9deUxZBj_0 2024-09-14T11:56:14.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14217143517763996390', time=2024-09-14T13:46:21.777984+0000, chain.objs.size()=1 2024-09-14T11:56:14.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.txsQprdhhMdZwqoqkG6vCLvSoFUmJcl_0 2024-09-14T11:56:14.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12903102999373461666', time=2024-09-14T13:46:21.856923+0000, chain.objs.size()=1 2024-09-14T11:56:14.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rAUxVAjEQ15PCKTfJjKSBW1OYpFl1R9_0 2024-09-14T11:56:14.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2244543647095563851', time=2024-09-14T13:46:21.879578+0000, chain.objs.size()=1 2024-09-14T11:56:14.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7bwinZEHI7e8cWuRgXWdtBcE2ywXH1c_0 2024-09-14T11:56:14.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2038876661108966339', time=2024-09-14T13:46:21.898664+0000, chain.objs.size()=1 2024-09-14T11:56:14.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7UARWIZbCKtYW1tgOod-_sQ8BKmJ6EW_0 2024-09-14T11:56:14.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.604+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47812 2024-09-14T11:56:14.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-14T11:56:14.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3383463051997285029', time=2024-09-14T13:46:21.956473+0000, chain.objs.size()=1 2024-09-14T11:56:14.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xKtIFa4lHYzJvPbXylBvCC9JO4fKGG1_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17473390141873079629', time=2024-09-14T13:46:22.044787+0000, chain.objs.size()=1 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.931_nfELm3tUOi65-hAAeymeBgTgg_T_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6193577546660664617', time=2024-09-14T13:46:22.071546+0000, chain.objs.size()=1 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VaE2apcNh9hlftDd9f7o2QR-AUBnGOA_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15454210973400369786', time=2024-09-14T13:46:22.106794+0000, chain.objs.size()=1 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dBJo3r4etMxb9rPezk6AOW1NO5xjKWd_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2924006646467579474', time=2024-09-14T13:46:22.108692+0000, chain.objs.size()=1 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YYeH9LLA2D37lhUS-OJtpi0yLfCWEsz_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11003736557701741581', time=2024-09-14T13:46:22.139062+0000, chain.objs.size()=1 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IvLjJe5kTOONaSlR-_5xCqbp_BBWifd_0 2024-09-14T11:56:14.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11358385859339211507', time=2024-09-14T13:46:22.146763+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Vb3bNITKOb6e1zcWBei9M4bSwKrso_n_0 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10240087917733702305', time=2024-09-14T13:46:22.148950+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xt7h9cayQDJFnSSodYwAItkb9C4TWS8_0 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9933478845482902523', time=2024-09-14T13:46:22.216821+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XAUsgsqA5nnsJfL-NUvZ3-TFL8T-wZa_0 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5497932663219186880', time=2024-09-14T13:46:22.294390+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.U8QZm18uCJg28Ebptpm5hBg0wGzdJKT_0 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17421633381629698358', time=2024-09-14T13:46:22.298803+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nuhxsLt2Aequ5YDwsMgihQ9fp87RvCH_0 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8739913624355672518', time=2024-09-14T13:46:22.336014+0000, chain.objs.size()=1 2024-09-14T11:56:14.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.b4fpzsOK6JxOO4G0TywNjiFkIvbQRgW_0 2024-09-14T11:56:14.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10979062819032978746', time=2024-09-14T13:46:22.347303+0000, chain.objs.size()=1 2024-09-14T11:56:14.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0BmrQH9--xzWMvDJd56q7SeWqW8Xkt5_0 2024-09-14T11:56:14.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14671401185476762541', time=2024-09-14T13:46:23.652103+0000, chain.objs.size()=1 2024-09-14T11:56:14.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.328__shadow_.uWLk9dCIHNizXdCwsO7TKHiC6z4H42B_0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5632579281612688457', time=2024-09-14T13:46:25.934602+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.333__shadow_.TBQmRk2K2etW96p1dsXoi7eqHD0rDW__0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7627938800264349872', time=2024-09-14T13:46:30.645236+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.343__shadow_.TKrz4EGiHUPQX5NC6p5odWhzKnLMEaj_0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6264078751724213284', time=2024-09-14T13:46:32.054037+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.346__shadow_.PasGeuahD4aSStSBNdCr2lakcWUYhsp_0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18182971182260131200', time=2024-09-14T13:46:35.536791+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.354__shadow_.sjg-IZ-p_UbA_hGGpq_nXRM-gAIB4ZQ_0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7040283116019049887', time=2024-09-14T13:46:45.827081+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.376__shadow_.1QJzBJ_8P6zvTzzj9exsBuKw8brZvZz_0 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16712967562985756745', time=2024-09-14T13:46:53.467884+0000, chain.objs.size()=1 2024-09-14T11:56:14.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.391__shadow_.boFc1A6FFXnWnPa6maPSWF6DJuUQWcb_0 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10632133334844420164', time=2024-09-14T13:46:53.468827+0000, chain.objs.size()=1 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.391__shadow_.me2vuo-Qad_uO_ujSZ_1EgvBc0twcbA_0 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6336818910695187857', time=2024-09-14T13:47:30.021181+0000, chain.objs.size()=1 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.458__shadow_.Wl74S8D7uN5-iBfBt6VBT4iyB4HIFP1_0 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2433085324146140042', time=2024-09-14T13:47:40.913861+0000, chain.objs.size()=1 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.482__shadow_.N_c0PwKmUZftoFLFDPisYEkCZxUN5J-_0 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7490284669763750066', time=2024-09-14T13:47:42.115544+0000, chain.objs.size()=1 2024-09-14T11:56:14.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.5kKk4pAVTylzbQR3o9YnxHreiM9XP6c_0 2024-09-14T11:56:14.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.615+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8733972102639480891', time=2024-09-14T13:47:42.952864+0000, chain.objs.size()=1 2024-09-14T11:56:14.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.615+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.486__shadow_.hHlwH6gIozi46El5wF-ut94n-O2DBRv_0 2024-09-14T11:56:14.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.615+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14851396418466489139', time=2024-09-14T13:47:43.678506+0000, chain.objs.size()=1 2024-09-14T11:56:14.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.615+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.487__shadow_.4o0Y5q9lNMkPKkvB-8y_PKzHVAUPAhp_0 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3182056356867134574', time=2024-09-14T13:47:54.239466+0000, chain.objs.size()=6 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:14.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE', time=2024-09-14T13:48:08.772810+0000, chain.objs.size()=1 2024-09-14T11:56:14.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.2 2024-09-14T11:56:14.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE', time=2024-09-14T13:48:08.774112+0000, chain.objs.size()=1 2024-09-14T11:56:14.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~cyuMFGSu_z7pswlk4bFqqLESy3VJZeE.3 2024-09-14T11:56:14.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.618+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16402516008976677386', time=2024-09-14T13:49:08.788038+0000, chain.objs.size()=2 2024-09-14T11:56:14.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.618+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.564__shadow_.6Fjl8sXKiRZHaxMJ_yol-5J_TRUrvHg_0 2024-09-14T11:56:14.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.618+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.564__shadow_.6Fjl8sXKiRZHaxMJ_yol-5J_TRUrvHg_1 2024-09-14T11:56:14.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13887796075055320428', time=2024-09-14T13:49:12.958476+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:eIkUzcMn0vZb9FMz0Wh9LuQl5FfM2ql_.ZechVOYOa5fGSLl9fh26JxERQYrVUiL_0 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10903721558120652094', time=2024-09-14T13:49:29.355877+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:x3IbgvTmVCNwkrFuf0FlDLQxZ-9.CV1_.A7CJjrWJBSqX4-8-ftYzQLISXEVvVIU_0 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4167876863844367394', time=2024-09-14T13:49:40.649878+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.619+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:eYcWCFMAY9z8grWedgq0Y0vPCT.WnnW_.6-3FCLad2k0mx6KnkrFqTN3xwPNVgBS_0 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5620875934575727690', time=2024-09-14T13:49:48.981345+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.587__shadow:5lu5-xHoc8olvf1dG.TXfUs80l5lNgw_.zHinQ3iN8kyqL3UH8Aag7Zms9Kpwj2W_0 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11202451431881403425', time=2024-09-14T13:49:49.602330+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:quV3AvmZQVsITmA1hlowp1gW.ktx95t_.A7L7UX02Wws1Uz2R76QosuDXzMohESQ_0 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18433792646654502080', time=2024-09-14T13:49:53.464993+0000, chain.objs.size()=1 2024-09-14T11:56:14.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.597__shadow_.Ehm-3PnXguD8zKanwYCRouLQCZj2ExZ_0 2024-09-14T11:56:14.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13913401923410755613', time=2024-09-14T13:52:49.702663+0000, chain.objs.size()=1 2024-09-14T11:56:14.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.699__shadow:b2pCTzQamGe5whue7Ek0faWq5uR5QPe_.70ms-SV7_U6UTYtv5zEvX0oQFmUtC2S_0 2024-09-14T11:56:14.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1447414759945553394', time=2024-09-14T13:53:55.501614+0000, chain.objs.size()=1 2024-09-14T11:56:14.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.762__shadow_.0ZMJ7EoNccXnKm4Fv10FLvBhOBM5r-S_0 2024-09-14T11:56:14.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.624+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.626+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:56:14.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.628+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.628+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46737' 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9723496455188248968', time=2024-09-14T13:43:23.049833+0000, chain.objs.size()=1 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.163__shadow_.sCZMXnK6WVB353khpnewbkLxLATvBP-_0 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13954323163025305171', time=2024-09-14T13:45:08.683114+0000, chain.objs.size()=1 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.237__shadow_.LKVx7Ctg_uDzY6sC8vogqyf55V6esJI_0 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15425156576474786050', time=2024-09-14T13:45:13.094838+0000, chain.objs.size()=1 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244__shadow_.gQVIrtFIz2XTOCkxjg5RVONpECCrcUy_0 2024-09-14T11:56:14.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12444440318601220335', time=2024-09-14T13:45:13.097446+0000, chain.objs.size()=1 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244__shadow_.M3jVZhryeDxL-zHOdrrKEaEc3uBRWAe_0 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7810312355645934782', time=2024-09-14T13:45:14.925336+0000, chain.objs.size()=1 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.247__shadow_.BYWwqwjCRG-VQbVl7e1USYJZqtYqqrZ_0 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9928679916415316747', time=2024-09-14T13:45:14.926376+0000, chain.objs.size()=1 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.247__shadow_.YcRrOYQv3XVwb3Ti15x4_3V8eOoDqMG_0 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8082155233820901164', time=2024-09-14T13:45:15.909290+0000, chain.objs.size()=1 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.249__shadow_.4us9IDbBg2MBLlzvmDwu_YPiYzMVctg_0 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11153434113411039234', time=2024-09-14T13:45:17.337502+0000, chain.objs.size()=1 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.252__shadow_.AyZC1zJNky4X2vUMP2MqOb7Qx2ZYyQu_0 2024-09-14T11:56:14.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6378510160219715966', time=2024-09-14T13:45:30.231664+0000, chain.objs.size()=1 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Oxj4UXamTXr4vQPpGHs5pOOJ3n6IIKc_0 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17570820820081356779', time=2024-09-14T13:45:30.295040+0000, chain.objs.size()=1 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XFRdiCf8XV539D-3VQ3JFLntmWYTpi6_0 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2192752909099998408', time=2024-09-14T13:45:30.303825+0000, chain.objs.size()=1 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.pPWCgExpsDVlbWWja6Q7qd_9NxXnASM_0 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5950061058462663647', time=2024-09-14T13:45:30.419265+0000, chain.objs.size()=1 2024-09-14T11:56:14.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FLZvO4vSSsWTCrBj_ryuSHpewDpe1LH_0 2024-09-14T11:56:14.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.631+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2701386971926407299', time=2024-09-14T13:45:30.451161+0000, chain.objs.size()=1 2024-09-14T11:56:14.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.631+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QHLf_M0fOGmkxO42xStCEgSm3eFNswR_0 2024-09-14T11:56:14.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.631+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11513989021967141621', time=2024-09-14T13:45:30.485219+0000, chain.objs.size()=1 2024-09-14T11:56:14.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.631+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kqif6WiGup6sLtMyY9YK0jTqqF8PM3v_0 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14230744258761316607', time=2024-09-14T13:45:30.500113+0000, chain.objs.size()=1 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rfZnKAMbOjwYelEd6I_MAUl6fqdEKTI_0 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8492405040190331914', time=2024-09-14T13:45:30.590207+0000, chain.objs.size()=1 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.O31-vpRjPv7LHUg9mXq7G7bMEgFHLfR_0 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18295367039501131130', time=2024-09-14T13:45:30.608443+0000, chain.objs.size()=1 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rkjkKUJK3K_blq21JFxjI3IYCSzxXZM_0 2024-09-14T11:56:14.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3150184400692021818', time=2024-09-14T13:45:30.621443+0000, chain.objs.size()=1 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GR46vPKaSWGfjoGGin9f2-ZP2LgKxoE_0 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.361079482786774409', time=2024-09-14T13:45:30.628216+0000, chain.objs.size()=1 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.632+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.71HdT8caErUJLPS9kUxolYoVSyU8VT1_0 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14364407216719754763', time=2024-09-14T13:45:30.663485+0000, chain.objs.size()=1 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ulij5CKCE61UtBalgy9BqcUy3hBEQ-a_0 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1327702259138205599', time=2024-09-14T13:45:30.688718+0000, chain.objs.size()=1 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aG_cMQNyfPylEzzA2aoBrWiDgbNIo3Z_0 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2350605376587521082', time=2024-09-14T13:45:30.773907+0000, chain.objs.size()=1 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Oh-aTJc5gRaksv_7DjTXbiUXdgat75C_0 2024-09-14T11:56:14.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.764270785881826965', time=2024-09-14T13:45:30.785271+0000, chain.objs.size()=1 2024-09-14T11:56:14.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.633+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1F0M8ql7xSGawSGKE_faMQRQv0W9xeM_0 2024-09-14T11:56:14.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.634+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8070930901792535636', time=2024-09-14T13:45:30.957620+0000, chain.objs.size()=1 2024-09-14T11:56:14.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.634+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.l6SFO-qWSZrYRluZGA8NRCPpRaq2wRs_0 2024-09-14T11:56:14.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5776556501709985736', time=2024-09-14T13:45:31.016115+0000, chain.objs.size()=1 2024-09-14T11:56:14.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.foDRTeGPSiPhqUnYa3wzgifnfKP9-C5_0 2024-09-14T11:56:14.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5272352964248433665', time=2024-09-14T13:45:31.040903+0000, chain.objs.size()=1 2024-09-14T11:56:14.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0qPO2HWQwyhm10U7ir-CxlzUJU1-dza_0 2024-09-14T11:56:14.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18270428209081432263', time=2024-09-14T13:45:31.145645+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Z2Eb5HmaG7UQxSfweNAqY3Gv7f8OYPg_0 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18247617549463290391', time=2024-09-14T13:45:31.168942+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Xhz_7WlHExEkNEmQXKG2oV4xsridyqu_0 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5329725545551785512', time=2024-09-14T13:45:31.194767+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lyJvzDUX2vocX9QN0VzlfNAvhGtcZON_0 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4723290448736458738', time=2024-09-14T13:45:31.210516+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dEghmjHi88tPvhwP2qsmG7bKLTQJy8B_0 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15851225311419548801', time=2024-09-14T13:45:31.531500+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Mh7pcngWVm726HaK9eBZxIEC1Mke0xF_0 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16809447102505830706', time=2024-09-14T13:45:31.542298+0000, chain.objs.size()=1 2024-09-14T11:56:14.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4wDs0_wFlqQd9StkG9wB3HmuLSU1Yuz_0 2024-09-14T11:56:14.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3500892396895366013', time=2024-09-14T13:45:31.568352+0000, chain.objs.size()=1 2024-09-14T11:56:14.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.637+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kOXAf4RtDjSddwxe5RJBWNsUm3ITQxB_0 2024-09-14T11:56:14.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.638+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13534754140999480524', time=2024-09-14T13:45:31.605723+0000, chain.objs.size()=1 2024-09-14T11:56:14.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.638+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ip-7oPt53Hzx8o9WUM6qSQ7hjb_HYz4_0 2024-09-14T11:56:14.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.638+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10307693929258845549', time=2024-09-14T13:45:31.695120+0000, chain.objs.size()=1 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.638+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MeJOwv39GfyMWxc_HLu9aDF3dwujmzy_0 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3114929149895525369', time=2024-09-14T13:45:31.696772+0000, chain.objs.size()=1 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CIaNaZqC7o4MxkfcWmNH3FN9Wd0m9q1_0 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9140867702281147027', time=2024-09-14T13:45:31.699638+0000, chain.objs.size()=1 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZK5b3v23WqrlRI93AnBD3qiI-9-AMrg_0 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1014998507586423489', time=2024-09-14T13:45:31.710655+0000, chain.objs.size()=1 2024-09-14T11:56:14.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Fw4YxSSDZXQ7oLATeQcOtHDV_HxMxeF_0 2024-09-14T11:56:14.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10148012545157908236', time=2024-09-14T13:45:31.714042+0000, chain.objs.size()=1 2024-09-14T11:56:14.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.akSIgThNI8FQJC0KdyPC1XmrFwxW0w2_0 2024-09-14T11:56:14.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11530075110336362699', time=2024-09-14T13:45:31.730478+0000, chain.objs.size()=1 2024-09-14T11:56:14.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.640+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ygBQkRHtL9aDhqoCAC1nFYd90R66EIS_0 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9839736153555315224', time=2024-09-14T13:45:31.732639+0000, chain.objs.size()=1 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tgkDJ0jf8s6Ljv9t7evAYBFNadlK-hp_0 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16330834445321573216', time=2024-09-14T13:45:31.743385+0000, chain.objs.size()=1 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vyv32t_dH4b940SCYEJjma03PtK-jKK_0 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10638637875344393419', time=2024-09-14T13:45:31.759879+0000, chain.objs.size()=1 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4PtRT-UvQ_QwcfWzovslGRRvD6GpjrS_0 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.642+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.815520401008212762', time=2024-09-14T13:45:45.731999+0000, chain.objs.size()=1 2024-09-14T11:56:14.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.642+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.291__shadow_.cvDANpexBrVv0ubc0OH4XOdcthZoA12_0 2024-09-14T11:56:14.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.643+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15860901484601273969', time=2024-09-14T13:45:47.348168+0000, chain.objs.size()=1 2024-09-14T11:56:14.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.643+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.LhUjJ57KzG-fvqvhPFN5CxaXqcLxzCV_0 2024-09-14T11:56:14.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.643+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2833366386167113004', time=2024-09-14T13:45:47.349189+0000, chain.objs.size()=1 2024-09-14T11:56:14.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.643+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.YbuiK2g8YWwt0HFCxSpP-sPZKJ8eXaQ_0 2024-09-14T11:56:14.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8013571695121988267', time=2024-09-14T13:45:47.352488+0000, chain.objs.size()=1 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.2iw8rlqNOYqR4hrkxs0kVogSQgEUG3v_0 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17301822967686696481', time=2024-09-14T13:45:48.175923+0000, chain.objs.size()=1 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.ugUNqkNlVuDhAcQNw7OvNLAb80VC7uB_0 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12355968441048293285', time=2024-09-14T13:45:48.196160+0000, chain.objs.size()=1 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.uALAR8MShW8f_4Ctwim2lKwWkCQjNaL_0 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7902262215410236007', time=2024-09-14T13:45:50.123778+0000, chain.objs.size()=1 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.298__shadow_.xwPm9RldjM3Ia79Kcy04Eun6wOZMzH__0 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16341535680599578386', time=2024-09-14T13:45:51.648717+0000, chain.objs.size()=1 2024-09-14T11:56:14.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.301__shadow_.0Nqzn3pQPmEW5FNpOIzDwnqhLVbj_2v_0 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11186587523909049727', time=2024-09-14T13:46:10.924796+0000, chain.objs.size()=1 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.htXltN8tynhY0Kss7VqOpZE27_H7hsn_0 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15461707843794752029', time=2024-09-14T13:46:10.926243+0000, chain.objs.size()=1 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Argog4Qpjqqhm6_9yAbwG9v2KIEHCkH_0 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14085989362177423567', time=2024-09-14T13:46:10.930065+0000, chain.objs.size()=1 2024-09-14T11:56:14.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VaNyg-TygJtCTRyjnA6QScLxzrWSLMT_0 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6143741321842507518', time=2024-09-14T13:46:10.958024+0000, chain.objs.size()=1 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6Y2lsjOsI19WeFAheHIPA2Fev5ubqpi_0 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.646+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5292052827725190273', time=2024-09-14T13:46:11.129110+0000, chain.objs.size()=1 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.646+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JpWAgqyos7eSTn4FXK6vKhiFgltmwaj_0 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.646+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6769947420234596978', time=2024-09-14T13:46:11.144842+0000, chain.objs.size()=1 2024-09-14T11:56:14.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.646+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Cx6j3rYByC0_ZdkwzkWTYr17Xu_gNFM_0 2024-09-14T11:56:14.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3392664758576391218', time=2024-09-14T13:46:11.210422+0000, chain.objs.size()=1 2024-09-14T11:56:14.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XDYuWV8IDQMVjmNOtxvcTr6V3HjYqq5_0 2024-09-14T11:56:14.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16337848508221577028', time=2024-09-14T13:46:11.219081+0000, chain.objs.size()=1 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dcahsWosNWwCCYJerfMettmAsHk_EtR_0 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11059965726011331337', time=2024-09-14T13:46:11.221300+0000, chain.objs.size()=1 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.l04SpiivYIjgxzkhGo-0LTMSg9KsPb8_0 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13228989425124358959', time=2024-09-14T13:46:11.349200+0000, chain.objs.size()=1 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5uP4UMGY1XFUOHwZDsDJtOGiC6LbFUP_0 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13858243275487051769', time=2024-09-14T13:46:11.384799+0000, chain.objs.size()=1 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7yxIy98T5zaa7N7BRG97VIDTOtZWrqc_0 2024-09-14T11:56:14.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9403282669064307725', time=2024-09-14T13:46:11.910771+0000, chain.objs.size()=1 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.icz2QKOWYFHCTSZVplbbcfNAAZ5aMNU_0 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16255939561705940303', time=2024-09-14T13:46:12.448458+0000, chain.objs.size()=1 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4YtVxbHnJlf7soWgho905dG0Zvd3ym0_0 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7287723349539972407', time=2024-09-14T13:46:12.468283+0000, chain.objs.size()=1 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qyCFyEGdcdDM5BFPC_d93oSGXYfzC16_0 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15318047815956881015', time=2024-09-14T13:46:12.482560+0000, chain.objs.size()=1 2024-09-14T11:56:14.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.648+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P9w5juM2wgCx3zx_1tzb1ieZS4M0u0O_0 2024-09-14T11:56:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.649+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15133974765224198770', time=2024-09-14T13:46:12.600915+0000, chain.objs.size()=1 2024-09-14T11:56:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.649+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ORbAimP4ZT4wvJD3JCsfEHuTMElK7eq_0 2024-09-14T11:56:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.650+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9207319013550147212', time=2024-09-14T13:46:12.609841+0000, chain.objs.size()=1 2024-09-14T11:56:14.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.650+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PvgTCRwp80QvjRbOWb6rX47U8Fqz9Cn_0 2024-09-14T11:56:14.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17756960408352594919', time=2024-09-14T13:46:12.658396+0000, chain.objs.size()=1 2024-09-14T11:56:14.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0j0RuAyvRSRUHyg0P1Zri6op7NGKLSo_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14696634732416129769', time=2024-09-14T13:46:20.742041+0000, chain.objs.size()=1 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jxCrNEnYTU6beXtJ7d3H1jdNPY_bzYk_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7672865300024032760', time=2024-09-14T13:46:20.753861+0000, chain.objs.size()=1 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.s9gkgB7qqEvPVKaqC1WpVtJyf0zTdgM_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1992753831796858987', time=2024-09-14T13:46:20.770658+0000, chain.objs.size()=1 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.58Xqe0rOBQ5S5VLQrAuQnvxWRRD0LnJ_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12940718939435580038', time=2024-09-14T13:46:20.793739+0000, chain.objs.size()=1 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6udKJy7LUOPip9Z7tFxMpqQkTasvTl6_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5463571210701281261', time=2024-09-14T13:46:20.806445+0000, chain.objs.size()=1 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.raxj8f-f5vALRafOtUIF8lNkqYr9w_b_0 2024-09-14T11:56:14.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.652+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15580111700775949848', time=2024-09-14T13:46:20.902924+0000, chain.objs.size()=1 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DaCEJ9EcGO7diMhVIXUzWmioK8pxtqg_0 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9904830613908013295', time=2024-09-14T13:46:20.923035+0000, chain.objs.size()=1 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tXBnw97sUAIX_sQlzx9hAztefWrIWyz_0 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17148696837308946824', time=2024-09-14T13:46:20.995537+0000, chain.objs.size()=1 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Z0TQYacKSNMbeXkrb-5rTLA1D0TaoHj_0 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11346184511242184140', time=2024-09-14T13:46:21.000578+0000, chain.objs.size()=1 2024-09-14T11:56:14.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.653+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CoXGh0_344g71S_OPhhj4cdbsGl2uO7_0 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2514573315475445642', time=2024-09-14T13:46:21.005219+0000, chain.objs.size()=1 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kSW1fto_0lbg5TIhdjkFNX2QUmkQZwY_0 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11446730488900296495', time=2024-09-14T13:46:21.107773+0000, chain.objs.size()=1 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yVjyhwJdbjpWVX9fWn_o8acbFsFJLX7_0 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16451791431231503547', time=2024-09-14T13:46:21.112591+0000, chain.objs.size()=1 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GqRDpGyLsSSsnEy1TEL2Ykr2n1wSv6x_0 2024-09-14T11:56:14.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13507848679057317034', time=2024-09-14T13:46:21.121051+0000, chain.objs.size()=1 2024-09-14T11:56:14.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZYr9yVvuA4g514S-yL5hqf60HNBGD-0_0 2024-09-14T11:56:14.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18412493148745229896', time=2024-09-14T13:46:21.129422+0000, chain.objs.size()=1 2024-09-14T11:56:14.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.655+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7-czXWSW4udzlHhOzpYQfazZX622F2g_0 2024-09-14T11:56:14.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.656+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17983517853542147187', time=2024-09-14T13:46:21.138813+0000, chain.objs.size()=1 2024-09-14T11:56:14.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.656+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Yhm9p5hRAhsP3mm7F-1ESpdbU3S5BKH_0 2024-09-14T11:56:14.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.656+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14230946585516496002', time=2024-09-14T13:46:21.146046+0000, chain.objs.size()=1 2024-09-14T11:56:14.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.656+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CzCWDAV2PTYJaxAxpNs4Ci2mJlsedPP_0 2024-09-14T11:56:14.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.657+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2978007894727070838', time=2024-09-14T13:46:21.147800+0000, chain.objs.size()=1 2024-09-14T11:56:14.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.657+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9SlGND1EZyexTS6CieRzSG1J8Q7qXYB_0 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16812424493771575157', time=2024-09-14T13:46:21.280092+0000, chain.objs.size()=1 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JMvFc4HUykyP87CNUUFxChyOqKFbYb8_0 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11130692538882487178', time=2024-09-14T13:46:21.333157+0000, chain.objs.size()=1 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CCQqbU1sxvSlBzc4bah6rG2pc6Df7wD_0 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13862363809161501233', time=2024-09-14T13:46:21.359544+0000, chain.objs.size()=1 2024-09-14T11:56:14.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.658+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DLlM-f4W8PuCEkzk7BZEoXJHJB9jqbL_0 2024-09-14T11:56:14.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.303871245398106552', time=2024-09-14T13:46:21.363507+0000, chain.objs.size()=1 2024-09-14T11:56:14.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ptsCxIAUX6N7fFmev0hLrIDHKRAMRUI_0 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15224012488437530700', time=2024-09-14T13:46:21.513440+0000, chain.objs.size()=1 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.foooTNNd_ZemUPoJG85ecSjGI1eQmH5_0 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6143275694351753087', time=2024-09-14T13:46:21.533986+0000, chain.objs.size()=1 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IgTIiZs4q71hQ-fbaWI-5DBmrOK4QCb_0 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8218797178637920350', time=2024-09-14T13:46:21.745699+0000, chain.objs.size()=1 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PeS5VnM0iCPfZ5mx22WZyhGRXS6I8bf_0 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14879461453343340351', time=2024-09-14T13:46:21.872890+0000, chain.objs.size()=1 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.659+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pyOR9URNrhmQx6PgJDjcP7jiEVJnD8D_0 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.660+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18383657354480758842', time=2024-09-14T13:46:21.910796+0000, chain.objs.size()=1 2024-09-14T11:56:14.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.660+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iefmORofDhsDdNqN13duQzur8FsPVA3_0 2024-09-14T11:56:14.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.660+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11373651155855258749', time=2024-09-14T13:46:21.925251+0000, chain.objs.size()=1 2024-09-14T11:56:14.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.660+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.R0glrYIj9jIHgBpXLH-jwLPsG7FdNka_0 2024-09-14T11:56:14.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.662+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3160135666534275833', time=2024-09-14T13:46:21.930431+0000, chain.objs.size()=1 2024-09-14T11:56:14.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.662+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OcFKSUz2gl9LOlayD9PDG3BTmBV_Oiq_0 2024-09-14T11:56:14.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7801935957113471894', time=2024-09-14T13:46:21.956677+0000, chain.objs.size()=1 2024-09-14T11:56:14.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WSB-dwzjkwgxa6Y891t19tFbBNwpCvw_0 2024-09-14T11:56:14.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16706911616002927919', time=2024-09-14T13:46:22.274307+0000, chain.objs.size()=1 2024-09-14T11:56:14.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.shsmex0MOYyZ6-SfP4DaMvkvGhuENEZ_0 2024-09-14T11:56:14.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1859212886224158479', time=2024-09-14T13:46:22.300291+0000, chain.objs.size()=1 2024-09-14T11:56:14.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.664+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XqT2BLTWG9dBK8dw-ttw9yTfkVB0bLu_0 2024-09-14T11:56:14.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.666+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46737 2024-09-14T11:56:14.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:56:14.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3098318970483200582', time=2024-09-14T13:46:22.349890+0000, chain.objs.size()=1 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NorL_l8Zx6CbJscr6opJ4tNNfEq1MDE_0 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5268294742447128449', time=2024-09-14T13:46:28.382254+0000, chain.objs.size()=1 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.338__shadow_.sX1OkryLcvtKfjlswgTyY-AmxcU4O8y_0 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9054325100480287859', time=2024-09-14T13:46:50.477795+0000, chain.objs.size()=1 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.385__shadow_.WSmLFmofqQF9FucIhZmyQVfWvfwDxw4_0 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3053363994867510914', time=2024-09-14T13:47:35.051678+0000, chain.objs.size()=1 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465__shadow_.P7gL9GYx416cqLqjYja_m-nsEXZI7pY_0 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8450435158924511608', time=2024-09-14T13:47:54.014624+0000, chain.objs.size()=6 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:14.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3210924988561049257', time=2024-09-14T13:49:23.437982+0000, chain.objs.size()=1 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:ntbHpMYZrr232b3yo2l2G0vHI0EMSBe_.k6HdwAqGtOXCg2CYeTHBM1_nTaHcg62_0 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5534590068601558737', time=2024-09-14T13:49:39.937258+0000, chain.objs.size()=1 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.668+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:HTLjgx35wgy2rCUwv.WYoJoeoYjKO3Y_.p24ceoNWY9awva3Qpe5b0Wz2_ljhpGD_0 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9671115541118156453', time=2024-09-14T13:49:46.227415+0000, chain.objs.size()=1 2024-09-14T11:56:14.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.583__shadow:x4ahcTcOWnEVSlxPS4POAnKJCYzAWFR_.zL4vDSfmhwDbbTw-jSagyrFIN60YjdO_0 2024-09-14T11:56:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3748930666342473585', time=2024-09-14T13:49:49.597945+0000, chain.objs.size()=1 2024-09-14T11:56:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:lKwUlXlZ2qMq.dy97QseTIjpyDKJQpd_.hXXrpVwKwID4asfMRnBnF2gvliQf1g9_0 2024-09-14T11:56:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1099358054916631535', time=2024-09-14T13:54:04.478482+0000, chain.objs.size()=1 2024-09-14T11:56:14.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.773__shadow_.KtLC5XahNu9BHoxmeohZkTwMG4WHcJO_0 2024-09-14T11:56:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1569090247967080265', time=2024-09-14T13:54:05.293143+0000, chain.objs.size()=1 2024-09-14T11:56:14.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.671+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.774__shadow_.DnQkikL7DQ1Erlan3RpP58jNAGsdgQe_0 2024-09-14T11:56:14.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.674+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.676+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:56:14.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.677+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.678+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47510' 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_vecQiuZSq3l4aR3KAtybyRIFFRLpg5B', time=2024-09-14T13:43:20.755867+0000, chain.objs.size()=2 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.sDpe_6jcsMzlLlDdLjhU_N-_WIx5Cd0_0 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.sDpe_6jcsMzlLlDdLjhU_N-_WIx5Cd0_1 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14719694156339280320', time=2024-09-14T13:43:38.904785+0000, chain.objs.size()=1 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.177__shadow_.SjpUV8Dqvj-i5RzYJfiCJ4yVaIAspPc_0 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11249537986381868999', time=2024-09-14T13:45:05.736361+0000, chain.objs.size()=1 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.231__shadow_.F-jDwqyfgYPXlDttdB5Vbd3MkHw0OZu_0 2024-09-14T11:56:14.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.632483005991561974', time=2024-09-14T13:45:13.931603+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.245__shadow_.zvKzM_BE_twlXak3sIGUNQS3_Fo61mm_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11785611966030697655', time=2024-09-14T13:45:30.264079+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f0V2PnVyIr6xESvNse9Qz9ntevIKfGX_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6780866693381112497', time=2024-09-14T13:45:30.266035+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JiF8AcnSkZlZGaHW1MM8qofNazkX5GV_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17508204573104071509', time=2024-09-14T13:45:30.283624+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2Ak_mC4G9JCwFW3MZVv5hdN1pFTKuCn_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1323839766970704968', time=2024-09-14T13:45:30.286980+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.g0ZxS58AS3vGM3hWYLNEuXnY-7SW_zE_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6009625365843479024', time=2024-09-14T13:45:30.315755+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UzMzDh3UvEMm9y0OsST-P3AL14lfO1V_0 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14198046865689516564', time=2024-09-14T13:45:30.317458+0000, chain.objs.size()=1 2024-09-14T11:56:14.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3SkfDxuRVQUEaA848BlIAqky0e35bld_0 2024-09-14T11:56:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5138936839992080135', time=2024-09-14T13:45:30.468278+0000, chain.objs.size()=1 2024-09-14T11:56:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.679+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TXWN5l8fdP8_U-jM0-A6tf0pYHY1XNu_0 2024-09-14T11:56:14.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.681+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1380273012248360120', time=2024-09-14T13:45:30.676172+0000, chain.objs.size()=1 2024-09-14T11:56:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.681+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rs9aezDMLMx42--A3Xq_VPpgDptvQWo_0 2024-09-14T11:56:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.682+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9724248043839341685', time=2024-09-14T13:45:30.773724+0000, chain.objs.size()=1 2024-09-14T11:56:14.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.682+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aHMsTRcx_jltSrPaJ1BKoPUcUzr5jrq_0 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4705119472437310880', time=2024-09-14T13:45:30.817730+0000, chain.objs.size()=1 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uDKyPOcFj2v1tbFFRFXpdgLky2yF9RC_0 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4487056989280198017', time=2024-09-14T13:45:30.839013+0000, chain.objs.size()=1 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-yC6liWtEcqsJczOaqZUEGvrcBK3hOB_0 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1759624794700655833', time=2024-09-14T13:45:30.881266+0000, chain.objs.size()=1 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FNcA0C6Q81HqprTwUawV7xc8btGcFdd_0 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10278373214359550312', time=2024-09-14T13:45:30.981835+0000, chain.objs.size()=1 2024-09-14T11:56:14.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.683+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7Cw3LAwIgwdpOirORVG6N_lz3K4LAv8_0 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5174691255793905516', time=2024-09-14T13:45:31.054164+0000, chain.objs.size()=1 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.p8jW2Gi5TsnVX4I_oQQ1BKe806j3GRY_0 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8580059843213352465', time=2024-09-14T13:45:31.069030+0000, chain.objs.size()=1 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KVbf1dHmBbVIzbJUKrYar2qjqKcvN5z_0 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10798858799606676517', time=2024-09-14T13:45:31.166837+0000, chain.objs.size()=1 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W98AeFOrbHQWbJlmmzsJJIOhWDq_YLs_0 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1661685745152607740', time=2024-09-14T13:45:31.197505+0000, chain.objs.size()=1 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Bt3i2MWSERbHdRHH5v_J8Pb91aSdP4K_0 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1637485332763723341', time=2024-09-14T13:45:31.244701+0000, chain.objs.size()=1 2024-09-14T11:56:14.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LFM_Fr8Sl2LaoaEfk8werMQtTWa23FL_0 2024-09-14T11:56:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11575730278474803435', time=2024-09-14T13:45:31.542862+0000, chain.objs.size()=1 2024-09-14T11:56:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.684+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.B2slvHRwm_zeuYBtfXZYjojkXjKUGib_0 2024-09-14T11:56:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.685+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10544811516799140434', time=2024-09-14T13:45:31.548517+0000, chain.objs.size()=1 2024-09-14T11:56:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.685+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MiZ9SCEk8d2iYWgvjo1aUqmGItvqlkp_0 2024-09-14T11:56:14.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5024961047340219998', time=2024-09-14T13:45:31.590978+0000, chain.objs.size()=1 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KYVSY1qj4xRjKvD4AsaDV1I6tPrNc1t_0 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1705490352020568050', time=2024-09-14T13:45:31.608926+0000, chain.objs.size()=1 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RLN8uBHnmSDP_g-LY5pU088aHHjm6L3_0 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14768167210147285320', time=2024-09-14T13:45:31.715146+0000, chain.objs.size()=1 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3VvRGIxpP75kpNIYOSblUtFL3G6VMDI_0 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2733782808689562564', time=2024-09-14T13:45:31.735382+0000, chain.objs.size()=1 2024-09-14T11:56:14.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.686+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OrLFRr1Y28nT5jvDMBAzHWY64IiR4FR_0 2024-09-14T11:56:14.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.687+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7447170604551505042', time=2024-09-14T13:45:31.750979+0000, chain.objs.size()=1 2024-09-14T11:56:14.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.687+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fVx0lKrvawX1iDro2lg7p2zcO_yHTkF_0 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.687+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9243149674208089518', time=2024-09-14T13:45:31.769775+0000, chain.objs.size()=1 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.687+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uGCVfMvs1yrqJYoWhSXiub1le-xrXrr_0 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10856539845727613637', time=2024-09-14T13:45:33.278404+0000, chain.objs.size()=1 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.266__shadow_.E3BJ1FeOizrhQko_EhzC8Dy19CrR47h_0 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1030216082347387359', time=2024-09-14T13:45:33.765147+0000, chain.objs.size()=1 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.267__shadow_.whEq6BszflwCzTgvEcDxLmYYr9s1Ii1_0 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15254613491566977695', time=2024-09-14T13:45:37.153414+0000, chain.objs.size()=1 2024-09-14T11:56:14.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.274__shadow_.4HEBdxHjbqAmFFbIq0sZ-MtErSkfGMw_0 2024-09-14T11:56:14.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12046844239889293632', time=2024-09-14T13:45:47.345124+0000, chain.objs.size()=1 2024-09-14T11:56:14.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.mQp6DjU2B1WO_RwcnehBEj-gtlQvxaT_0 2024-09-14T11:56:14.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11054269766676956160', time=2024-09-14T13:45:48.677437+0000, chain.objs.size()=1 2024-09-14T11:56:14.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.688+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.295__shadow_.Su7cfXicC5JdjKG0aAt3DcunGplBifn_0 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18364064423641558916', time=2024-09-14T13:46:01.986967+0000, chain.objs.size()=1 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.322__shadow_.qvV55xUZS-8MzE4tAiYEwc6JC0xdtRA_0 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8576010192086355172', time=2024-09-14T13:46:10.979902+0000, chain.objs.size()=1 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QYr6C6g8dJxrN7DJvFsdpXYHaWF70fI_0 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7537551444649748659', time=2024-09-14T13:46:11.007510+0000, chain.objs.size()=1 2024-09-14T11:56:14.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.690+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TAmjVnuPjWCl3YZT84xEyARltL_Y9Rv_0 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4806484317788207989', time=2024-09-14T13:46:11.167658+0000, chain.objs.size()=1 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rQHg9ly_MDPVtN2YeJxF51essSkDAxB_0 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5497837144546537893', time=2024-09-14T13:46:11.416735+0000, chain.objs.size()=1 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vK2sL2y6eO0sSsr08cLddwaWcV2uYXV_0 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.414858746071922810', time=2024-09-14T13:46:11.664158+0000, chain.objs.size()=1 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6IelfYEa6sbOR6HfL6y1CDH7RHLFa7A_0 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12718994078940712962', time=2024-09-14T13:46:11.667215+0000, chain.objs.size()=1 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nWIjUxAPi__8EhiVo51B7KCdKd5pos5_0 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31734166103546917', time=2024-09-14T13:46:11.718818+0000, chain.objs.size()=1 2024-09-14T11:56:14.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.692+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KKb0WWfdooJtrgT-_oJB_qH7FE3nhh7_0 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1064205242039243639', time=2024-09-14T13:46:11.761161+0000, chain.objs.size()=1 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cr7hUPMZN9-IQS01eETAGpczoCDBKeT_0 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4057604089976351302', time=2024-09-14T13:46:11.855264+0000, chain.objs.size()=1 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qypjI5PiSNcZslxqR6UlmThGkP4CVnR_0 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11356633464609455423', time=2024-09-14T13:46:11.879554+0000, chain.objs.size()=1 2024-09-14T11:56:14.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.693+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.n48EmyV8KsWqdrbwGe6Mfpr4WPbKnqw_0 2024-09-14T11:56:14.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.887326762357142121', time=2024-09-14T13:46:11.883862+0000, chain.objs.size()=1 2024-09-14T11:56:14.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DEX-qxepsJTZ3pm1XBXld7Tz8qOOXSP_0 2024-09-14T11:56:14.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13254253084315094959', time=2024-09-14T13:46:11.886483+0000, chain.objs.size()=1 2024-09-14T11:56:14.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5j0lu-JNIF57m_E8RSMtV6JKIHtmjvg_0 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6372823158109730252', time=2024-09-14T13:46:11.907721+0000, chain.objs.size()=1 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nNz7mQM2XZ0YGUF7fCh4GXtSD6GPppb_0 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3888020572696024161', time=2024-09-14T13:46:11.935713+0000, chain.objs.size()=1 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.694+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.m4eexqAPEcNhxGHFCjvsXo0tN1oix9j_0 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3086840015768590591', time=2024-09-14T13:46:12.043268+0000, chain.objs.size()=1 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oqx8KFXT_Ymr8c1eS72kK8OrA20cIR2_0 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13107092216271028038', time=2024-09-14T13:46:12.109950+0000, chain.objs.size()=1 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.J4DbPkF9B7UqIbE_T8FXk1QI8ye2_p1_0 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5892683385435737737', time=2024-09-14T13:46:12.223200+0000, chain.objs.size()=1 2024-09-14T11:56:14.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.695+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pK-F3zlukRxXMv9_d6aH4eCQxRkVgLT_0 2024-09-14T11:56:14.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11825015139722437936', time=2024-09-14T13:46:12.224934+0000, chain.objs.size()=1 2024-09-14T11:56:14.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pNh48qq4ZRRVjDUy8YqUWpSA_ftZ16b_0 2024-09-14T11:56:14.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7476754136998756584', time=2024-09-14T13:46:12.233083+0000, chain.objs.size()=1 2024-09-14T11:56:14.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.c5OVjauAIG4X3erAGCqzktkRyzjPD5K_0 2024-09-14T11:56:14.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8412676706437314444', time=2024-09-14T13:46:12.233826+0000, chain.objs.size()=1 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2g25AxQjvqsb8Elv6x-KBPMFtUAP89__0 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6608421427734434955', time=2024-09-14T13:46:12.497604+0000, chain.objs.size()=1 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2PTgsnuH6ldFl5ss8cG8Szgwi-xMFnY_0 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16504075523096172104', time=2024-09-14T13:46:12.518355+0000, chain.objs.size()=1 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iBCqAfGdqzFq55t4wfN4xmdKzvB4xQn_0 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2011618991912490419', time=2024-09-14T13:46:12.523078+0000, chain.objs.size()=1 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DFwaD7OEm1GnEnsKxxDtDKvV_G01Gj9_0 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12505072648824894785', time=2024-09-14T13:46:20.748048+0000, chain.objs.size()=1 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fbK7Cbvvp3BJrdV2Bfgf3WGqkwAwSwk_0 2024-09-14T11:56:14.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2869917896154630172', time=2024-09-14T13:46:20.764054+0000, chain.objs.size()=1 2024-09-14T11:56:14.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.697+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rGfBD8BxGG2Lh4nvOc-5wOyUYqa75bX_0 2024-09-14T11:56:14.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.699+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11147904160156698669', time=2024-09-14T13:46:20.771582+0000, chain.objs.size()=1 2024-09-14T11:56:14.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.699+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PNbco-sfpjjfAXO3UAvYZTQMFOR3RYv_0 2024-09-14T11:56:14.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.699+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6404523945613719384', time=2024-09-14T13:46:20.918409+0000, chain.objs.size()=1 2024-09-14T11:56:14.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.699+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.z8NHcny2MyoA9pywUSl5TAFmskFe-6h_0 2024-09-14T11:56:14.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.700+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5586266265365445713', time=2024-09-14T13:46:20.943181+0000, chain.objs.size()=1 2024-09-14T11:56:14.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.700+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IToG544XPZZziInK8Ml5FziNpcF3-Rg_0 2024-09-14T11:56:14.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16972803108992138851', time=2024-09-14T13:46:20.999024+0000, chain.objs.size()=1 2024-09-14T11:56:14.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.A-YTiRLHkBcE2xN39k6Nn-BmPplEbru_0 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8184099519891577604', time=2024-09-14T13:46:21.008433+0000, chain.objs.size()=1 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.d1ktFBO7zijDfpt8HJHmNdkygPtV6Od_0 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14870297989452301186', time=2024-09-14T13:46:21.011484+0000, chain.objs.size()=1 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cZcVDyf_l0eSwm5EoSoNPVhI4XzHGJx_0 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13512253217519192101', time=2024-09-14T13:46:21.103362+0000, chain.objs.size()=1 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TUQQevbVdEjp5QTZ0dJEPE4NMb1tbCQ_0 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9813813800140581928', time=2024-09-14T13:46:21.132702+0000, chain.objs.size()=1 2024-09-14T11:56:14.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DKhYq-sdKri4_8FpIVatlCIvqTDA_PO_0 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4368215594114171007', time=2024-09-14T13:46:21.140319+0000, chain.objs.size()=1 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZC5RlzKG3q8aZDDmHhXGVBfdpBMCj6c_0 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12085336304301291450', time=2024-09-14T13:46:21.141914+0000, chain.objs.size()=1 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.702+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._Q01lJ3U1hwnroZGaI1v3UggEGpi-KN_0 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.703+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5228770443287337609', time=2024-09-14T13:46:21.186743+0000, chain.objs.size()=1 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.703+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.O3LxcDQOnit7BmdjXlWtV5yRe_hqVZc_0 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.703+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3284419768453739377', time=2024-09-14T13:46:21.190415+0000, chain.objs.size()=1 2024-09-14T11:56:14.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.703+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.llodMbH1MHSfATbCannolj5gI6AICCY_0 2024-09-14T11:56:14.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.704+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5048503693225302797', time=2024-09-14T13:46:21.200829+0000, chain.objs.size()=1 2024-09-14T11:56:14.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.704+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dI7-q-zjZd7x-j1V-TMXi7kzhafZ3ng_0 2024-09-14T11:56:14.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.704+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13531714270355556491', time=2024-09-14T13:46:21.282608+0000, chain.objs.size()=1 2024-09-14T11:56:14.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.704+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tptFuCxrkzWdV_yCn5FuJtsDlYCmCmY_0 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.706+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9866263552337695358', time=2024-09-14T13:46:21.283366+0000, chain.objs.size()=1 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZgAjvbWzos2oUfC5kwKOiB0MRavK1vs_0 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12869146047893399480', time=2024-09-14T13:46:21.313101+0000, chain.objs.size()=1 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MkuTvdJUP3fLgRMZZSymp6L4YmlQhSP_0 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7999603291309612185', time=2024-09-14T13:46:21.346882+0000, chain.objs.size()=1 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.hPukNxlbfsPpwYaND0ffbekirfzPtUp_0 2024-09-14T11:56:14.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16919101961035968325', time=2024-09-14T13:46:21.389398+0000, chain.objs.size()=1 2024-09-14T11:56:14.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.707+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.k5o-1MOs_HOjrjNdp0kdvUe50SfSjoz_0 2024-09-14T11:56:14.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10860697816777477056', time=2024-09-14T13:46:21.468709+0000, chain.objs.size()=1 2024-09-14T11:56:14.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.P9LWjmYSPGMmGVuFlUGQzv8taJxgUxM_0 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2416300615224499492', time=2024-09-14T13:46:21.469451+0000, chain.objs.size()=1 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.t2fawKhQloDnFSzESnE6KO1X9vteKBp_0 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.107665192917814118', time=2024-09-14T13:46:21.476474+0000, chain.objs.size()=1 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BFxQQGhV__Pu3vJED03t9txXrPJNKCP_0 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16799046708418819465', time=2024-09-14T13:46:21.529992+0000, chain.objs.size()=1 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FXjegfE3SWc1loJnTij6fSDClJ2MX_I_0 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8680511262131518324', time=2024-09-14T13:46:21.761070+0000, chain.objs.size()=1 2024-09-14T11:56:14.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.708+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.q-fzLGKmtVNoklbH43F0ty6tiAxeBk9_0 2024-09-14T11:56:14.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.709+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12471499258105775635', time=2024-09-14T13:46:21.768626+0000, chain.objs.size()=1 2024-09-14T11:56:14.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.709+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Gq-Rfm5P53kjgTp5kA8onmhfKYR_j02_0 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.709+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17193683224413762523', time=2024-09-14T13:46:21.779627+0000, chain.objs.size()=1 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.709+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.oNoCn_n4RNoEQcDR4nz4Ite8rQMoO-6_0 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4223429221616155152', time=2024-09-14T13:46:21.897864+0000, chain.objs.size()=1 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0LXLEIUVRvPn-mFAMhxJ1liOeAjWTgG_0 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10119028450954654361', time=2024-09-14T13:46:21.914460+0000, chain.objs.size()=1 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3YeOhvOyIp9TuYqGob22WQEuur4rP3f_0 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9827993571685078147', time=2024-09-14T13:46:21.941364+0000, chain.objs.size()=1 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7f4ty0aVXZ2O9nQ7SRZomJNuYT7xx_1_0 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2190923704721523067', time=2024-09-14T13:46:21.962847+0000, chain.objs.size()=1 2024-09-14T11:56:14.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aTgHpn7J3TXtvUcrBDdXQ8_Phdi6XTl_0 2024-09-14T11:56:14.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5356829253998284503', time=2024-09-14T13:46:22.046835+0000, chain.objs.size()=1 2024-09-14T11:56:14.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.710+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UkKKBI1sE74s2LMbtJiCFP7hzhf57Hi_0 2024-09-14T11:56:14.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14119951156271007268', time=2024-09-14T13:46:22.050722+0000, chain.objs.size()=1 2024-09-14T11:56:14.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.y7_c4HK7OVQj-YIimRMQuhErHhSniy7_0 2024-09-14T11:56:14.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17952301462682871706', time=2024-09-14T13:46:22.072577+0000, chain.objs.size()=1 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.g55QGcGmbepD9C66QUhPP-CzWz_E4Vn_0 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11617926068198277529', time=2024-09-14T13:46:22.114892+0000, chain.objs.size()=1 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.d8tWPkBsOAJR3NbWCRcVlveEaM0fdtg_0 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8879325846904730217', time=2024-09-14T13:46:22.146264+0000, chain.objs.size()=1 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.711+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WcSPxmtVIp7FTtdWxuVq9oc71Wd467Y_0 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13265015851923579938', time=2024-09-14T13:46:22.307305+0000, chain.objs.size()=1 2024-09-14T11:56:14.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ae_HIm2RRKfvP6toEg7_dOJwgRzES4D_0 2024-09-14T11:56:14.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16495738490394513159', time=2024-09-14T13:46:26.455323+0000, chain.objs.size()=1 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.334__shadow_.rNeHZIoAfEkFnPDd1A-9pnG2TleHFAP_0 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3464881747781973225', time=2024-09-14T13:47:40.913673+0000, chain.objs.size()=1 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.713+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.482__shadow_.49OqZk-jUNliVAqe7qSaAe0lRrIiBpW_0 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.714+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4382749898655970255', time=2024-09-14T13:47:51.545800+0000, chain.objs.size()=1 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.714+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.714+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2886298593668513767', time=2024-09-14T13:48:13.331428+0000, chain.objs.size()=2 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.714+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~XWgW3QW9C8qvzioV9b3DBbjEy45PXPd.1 2024-09-14T11:56:14.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.714+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~XWgW3QW9C8qvzioV9b3DBbjEy45PXPd.2 2024-09-14T11:56:14.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.717+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47510 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4131073677541244085', time=2024-09-14T13:48:16.482117+0000, chain.objs.size()=3 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~-844nzI3Mce1hzbpqnKuqFiTiXqXCm3.1 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~-844nzI3Mce1hzbpqnKuqFiTiXqXCm3.2 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~-844nzI3Mce1hzbpqnKuqFiTiXqXCm3.3 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11317124848645472842', time=2024-09-14T13:48:16.807541+0000, chain.objs.size()=2 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~Od2rfzngHYuolkNC3fjQKMZCU0vGcsa.1 2024-09-14T11:56:14.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~Od2rfzngHYuolkNC3fjQKMZCU0vGcsa.2 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9900755224988086797', time=2024-09-14T13:49:00.713988+0000, chain.objs.size()=1 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.558__shadow_.2Vm7pFEAND3iRAM8g9ydgTcVrGn4uAg_0 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4697083609494215173', time=2024-09-14T13:49:17.022876+0000, chain.objs.size()=1 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:JiuQlGSDEiQUKRAQLm7Vq-PetbPlU.5_.-jPrTYtgeSK2rH-Hb379RLIBk2hxYro_0 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14182120963674085662', time=2024-09-14T13:49:23.099311+0000, chain.objs.size()=1 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:tcP6Wsu5HBEdW6dooNY2CxuorBxW6yY_.QABNIT5ESWTZr_W4-uEX8CcWEcrZxCx_0 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17707777463909776297', time=2024-09-14T13:49:28.906916+0000, chain.objs.size()=1 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:xe2OFL8Es9qANr8IQDRhC9QW2J1l9e7_.cHfgG87QmC0KzdhZsV3LbLK8di0Sc1r_0 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15945774795644890441', time=2024-09-14T13:49:42.740828+0000, chain.objs.size()=4 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~o7pnqSrzwpCD8EDQip3x_4lz7JNIgK9.1 2024-09-14T11:56:14.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~o7pnqSrzwpCD8EDQip3x_4lz7JNIgK9.2 2024-09-14T11:56:14.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.720+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~o7pnqSrzwpCD8EDQip3x_4lz7JNIgK9.3 2024-09-14T11:56:14.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.579__multipart_testobj.2~o7pnqSrzwpCD8EDQip3x_4lz7JNIgK9.4 2024-09-14T11:56:14.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13633529745054044279', time=2024-09-14T13:49:53.466151+0000, chain.objs.size()=1 2024-09-14T11:56:14.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.597__shadow_.qf4b-GtKZpbHgXONU8WTWN09Ph576oe_0 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13489632220846075089', time=2024-09-14T13:50:02.895797+0000, chain.objs.size()=6 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.1 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.2 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.3 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.4 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.722+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.5 2024-09-14T11:56:14.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.723+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614__multipart_multipart_enc.2~ACkEeVvV1QnoU9DFPXnJyDDEhCy_-mQ.6 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.723+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14679018255766483294', time=2024-09-14T13:52:24.921954+0000, chain.objs.size()=1 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.723+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.647__shadow_.dbBm7FMLzkjlm1bjdKOwPqquWG-b_Kt_0 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.723+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16777951214462580469', time=2024-09-14T13:52:26.155950+0000, chain.objs.size()=1 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.723+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.649__shadow_.KaYC5W87VZ38pxc9cPLKXrGKitaOy5j_0 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.724+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16338488927216702488', time=2024-09-14T13:52:47.895268+0000, chain.objs.size()=1 2024-09-14T11:56:14.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.724+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.695__shadow:RykNUys4sLh94s27JEDChPTZ.A85wlQ_.Ux4rEMUgeZ9citdEZMXFy7GePJWVRJV_0 2024-09-14T11:56:14.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.725+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.345247003483567172', time=2024-09-14T13:53:50.817814+0000, chain.objs.size()=1 2024-09-14T11:56:14.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.725+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.758__shadow_.kQz3y2yimXFSL_GuN7s1a0ad2wn6kWE_0 2024-09-14T11:56:14.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.728+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2928179811083131062', time=2024-09-14T13:54:06.664119+0000, chain.objs.size()=1 2024-09-14T11:56:14.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.728+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.775__shadow_.dEYb3JjE07LqnYOGl8XxhJCkLwOTrxb_0 2024-09-14T11:56:14.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.730+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.733+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:56:14.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.734+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.734+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42562' 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_VroJQMe_TgOra-xpxWATWzPstZDV4cJ', time=2024-09-14T13:43:20.145866+0000, chain.objs.size()=1 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.WCNPPkw8xbf87YVu4dFM_Tg2ZZLC3aJ_0 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18214284491962367830', time=2024-09-14T13:45:05.736468+0000, chain.objs.size()=1 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.231__shadow_.L1BObn0d4RsEYGjeQudlVabhmZqXYqV_0 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2602627761890301746', time=2024-09-14T13:45:14.436675+0000, chain.objs.size()=1 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.246__shadow_.7W2cNLpllsz0X_iCeN6mRlyRbR6vb97_0 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2936976009446664555', time=2024-09-14T13:45:21.626188+0000, chain.objs.size()=1 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.261__shadow_.qCQIsEwdsbXnNLk2DFQrvv8zDgbwTg4_0 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9754647882011337552', time=2024-09-14T13:45:30.211561+0000, chain.objs.size()=1 2024-09-14T11:56:14.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZzJaDRMgfDT1xSK_B0CQyoQr20GM93t_0 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16435076412994563753', time=2024-09-14T13:45:30.275596+0000, chain.objs.size()=1 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PpMsi4FzxNcRGzl3n3iNaQYvKIcaT0f_0 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3864923762937504139', time=2024-09-14T13:45:30.437707+0000, chain.objs.size()=1 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.a-49DzVY9cAxjgKkGAclOEaJwftLDVk_0 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14404465502604719930', time=2024-09-14T13:45:30.462697+0000, chain.objs.size()=1 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yiivoVy_5mmmeajFPZr3-GcPXmQ1dmy_0 2024-09-14T11:56:14.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4799792371366185977', time=2024-09-14T13:45:30.468062+0000, chain.objs.size()=1 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-ydY6AtjdScGfd9csp6yZBuFmlyG1VC_0 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17424091702708415020', time=2024-09-14T13:45:30.592159+0000, chain.objs.size()=1 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V1PRi2mI_rriaUCzVH8cIBHIOywmgVQ_0 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12811405670629946876', time=2024-09-14T13:45:30.595032+0000, chain.objs.size()=1 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oDfspkFOz3qpjSPKhT8fViXrgyXhs2y_0 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6211644291877808861', time=2024-09-14T13:45:30.608459+0000, chain.objs.size()=1 2024-09-14T11:56:14.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.735+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I1xS2fYflKCkBG7X3eZf79vvDzPc4zH_0 2024-09-14T11:56:14.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.737+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3641589035170446136', time=2024-09-14T13:45:30.618021+0000, chain.objs.size()=1 2024-09-14T11:56:14.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.737+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.xyzxOKJyJrRGWtIrAnGsSrfaM0nPUWh_0 2024-09-14T11:56:14.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.737+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9657503557955981587', time=2024-09-14T13:45:30.629250+0000, chain.objs.size()=1 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.737+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.p2J2vIUQvtiAiUIDflJcV0c2yJ6Ybxv_0 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7087337898250313326', time=2024-09-14T13:45:30.681463+0000, chain.objs.size()=1 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3CnWY2Xdz2ww9p7D-qNQwnJv8qf88an_0 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14318445166471562615', time=2024-09-14T13:45:30.807703+0000, chain.objs.size()=1 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sgf3e8PiTBlCDR1rWqHP849hm_MnSBM_0 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2062183998926912569', time=2024-09-14T13:45:30.842238+0000, chain.objs.size()=1 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.mFCqEhrTyNU_n-GKWaem1Z3wxRY0C-V_0 2024-09-14T11:56:14.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7206318217368145359', time=2024-09-14T13:45:30.852958+0000, chain.objs.size()=1 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.738+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OoYWDxFIjby-t9WixeZOjjlrNHHNPFL_0 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10387188788910096506', time=2024-09-14T13:45:30.868885+0000, chain.objs.size()=1 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zaZEKLlGMtICKPuoaJ1vu8HvK_OGiAg_0 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11729000201187885066', time=2024-09-14T13:45:30.871783+0000, chain.objs.size()=1 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yjHG2JmpJ5Ma_0N_9GPGvnZZi8Bw8lP_0 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15176008863196081941', time=2024-09-14T13:45:30.960917+0000, chain.objs.size()=1 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TviLfUEkFdhb82ulzO57omyfWbOj73l_0 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4051279821401905132', time=2024-09-14T13:45:30.964695+0000, chain.objs.size()=1 2024-09-14T11:56:14.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ROtJNO1cgU3MHBZ12-MS7mVe_PgMOIg_0 2024-09-14T11:56:14.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3639322309787162034', time=2024-09-14T13:45:30.971128+0000, chain.objs.size()=1 2024-09-14T11:56:14.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.739+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DGUClt8lsafCK1R_CWvAK22pulXNei7_0 2024-09-14T11:56:14.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.742+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.629449333033928493', time=2024-09-14T13:45:30.982447+0000, chain.objs.size()=1 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.742+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ejhtyeNQkmk4hOzfbWpC0shwng4aVsJ_0 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.742+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17423214201810745201', time=2024-09-14T13:45:31.180629+0000, chain.objs.size()=1 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.742+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ERsBXZNeM62c4DxKnWJmkI3q0ZYp7cl_0 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13345473852643049095', time=2024-09-14T13:45:31.192697+0000, chain.objs.size()=1 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.w4WrX8uvc8pbtT2rP5zjRESjcy39bbu_0 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9235745666028312707', time=2024-09-14T13:45:31.425083+0000, chain.objs.size()=1 2024-09-14T11:56:14.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.r2ojkN-wSEaUiP6n6mtw-d3yewTBXh7_0 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13483725645404755131', time=2024-09-14T13:45:31.518114+0000, chain.objs.size()=1 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TcnavTaswEjk6NlrMhHIxodfcVV1UTo_0 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6434999367211659039', time=2024-09-14T13:45:31.547813+0000, chain.objs.size()=1 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JAzFgavIdQxLdCN6to3PhCmfPCum2oX_0 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17525819241558336558', time=2024-09-14T13:45:31.556470+0000, chain.objs.size()=1 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8nTlGTwn5hm5O939PWmk8bPLbVIpkSH_0 2024-09-14T11:56:14.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11067323412606336938', time=2024-09-14T13:45:31.575916+0000, chain.objs.size()=1 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2-hPgZyt2nr9Dxh6znbGNQnExuhv2cL_0 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10359600314448805948', time=2024-09-14T13:45:31.584249+0000, chain.objs.size()=1 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ik0-un-hYuPtpHA2jhPjJ1mSnVMcF1l_0 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6613694870649666482', time=2024-09-14T13:45:31.585861+0000, chain.objs.size()=1 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UfLQT1VCHoNzFA7PvXNRcnFKF1K2z6u_0 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1067163383110927398', time=2024-09-14T13:45:31.710458+0000, chain.objs.size()=1 2024-09-14T11:56:14.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.743+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1IjJHr171AiGQLwzo-6Xn7fu341omJy_0 2024-09-14T11:56:14.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.745+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1836302236837424474', time=2024-09-14T13:45:31.712797+0000, chain.objs.size()=1 2024-09-14T11:56:14.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.745+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qACg3dmWntk397YdwwDiyRfjnl8kSb9_0 2024-09-14T11:56:14.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.746+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4696083273718134207', time=2024-09-14T13:45:31.755894+0000, chain.objs.size()=1 2024-09-14T11:56:14.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.746+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MCixoYmf5FI4DyR7uvDRLB1jM03Iluj_0 2024-09-14T11:56:14.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.746+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12913844453039950620', time=2024-09-14T13:45:31.758231+0000, chain.objs.size()=1 2024-09-14T11:56:14.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.746+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.F3vFYq0k0NWTAHLD0sNV90KdycN2v0M_0 2024-09-14T11:56:14.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6947847500242248262', time=2024-09-14T13:45:31.770086+0000, chain.objs.size()=1 2024-09-14T11:56:14.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nYnBeJ3OBas8b1Skg21IFIF3o2YQCXW_0 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15675689472643268702', time=2024-09-14T13:45:36.670139+0000, chain.objs.size()=1 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.273__shadow_.h2nDMCjv4fTvSI6OUNOp5Gmsdp6OlLP_0 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3875354887756014616', time=2024-09-14T13:45:40.296244+0000, chain.objs.size()=1 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.280__shadow_.I5yxMKhPuunwV_M7JnQMtb7BDx_QqEs_0 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14518150259552671342', time=2024-09-14T13:45:42.284725+0000, chain.objs.size()=1 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.284__shadow_.tOfRJ0-BqRqYl3vQcTCf02AOF_aWMhh_0 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16960577882837557771', time=2024-09-14T13:45:52.635116+0000, chain.objs.size()=1 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.303__shadow_.1wlqHLl2EMRQn3tLQxmce-kAJucNlaQ_0 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3941805806032431902', time=2024-09-14T13:45:53.090442+0000, chain.objs.size()=1 2024-09-14T11:56:14.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.304__shadow_.0iZJa5NeYtAkYniyaFy-TYAIithfV4s_0 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11089305068329555896', time=2024-09-14T13:45:55.520270+0000, chain.objs.size()=1 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.308__shadow:XDHox2B.o50MNuqOTfaOD-zReiddvmG_.JbrIQy2L29kcVt45sXnp8thgMdycOYI_0 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17770801826168184205', time=2024-09-14T13:46:10.923297+0000, chain.objs.size()=1 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.747+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.C-oBiHOdNhrVbxpWJRDg1MO2p0SfKFU_0 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.748+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8466113454137694804', time=2024-09-14T13:46:10.945392+0000, chain.objs.size()=1 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.748+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aNKXh5YxMUw5SCVFVp8SWh7J7mXxGZ6_0 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.749+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2832341833028423557', time=2024-09-14T13:46:10.961886+0000, chain.objs.size()=1 2024-09-14T11:56:14.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.749+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZnQAx0Flpy-DIoUgvoLlkL6PR3zW9Mi_0 2024-09-14T11:56:14.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.751+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6689601836868841465', time=2024-09-14T13:46:11.118013+0000, chain.objs.size()=1 2024-09-14T11:56:14.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.751+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PieWoSpF-yIhrGR8PPXwikYpvKiEycB_0 2024-09-14T11:56:14.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.751+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14134125812469407635', time=2024-09-14T13:46:11.361257+0000, chain.objs.size()=1 2024-09-14T11:56:14.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.751+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LMf7BzUT52mF297AJghH--R_73aSlPF_0 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7252297890005054825', time=2024-09-14T13:46:11.363407+0000, chain.objs.size()=1 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1kfVG3nNxWyZsKs2RGEvMVG0YB00QlE_0 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3153829756941202360', time=2024-09-14T13:46:11.391896+0000, chain.objs.size()=1 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.f-MRYpot-v3ZqKIc4Kls7tZvlw63Bfy_0 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9604045696031147331', time=2024-09-14T13:46:11.653137+0000, chain.objs.size()=1 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8M_YvCUU5w-ttOiOP9f85sjWieq8NpX_0 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10368388964348247146', time=2024-09-14T13:46:11.670785+0000, chain.objs.size()=1 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Wkd-5_DYUEBWj14He8P2K6emZDtrZme_0 2024-09-14T11:56:14.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8788226717297434907', time=2024-09-14T13:46:11.687864+0000, chain.objs.size()=1 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1DxY2vCl9QOEhUnf_BgWxX1YgF-uqjY_0 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3671810392432275914', time=2024-09-14T13:46:11.726677+0000, chain.objs.size()=1 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aYWqCo9Jn2Fbuk5YWvxaCce57zGqgvf_0 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17404612759045776687', time=2024-09-14T13:46:11.738757+0000, chain.objs.size()=1 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.j7FZfAWPKOAHXfoQ1_yNdA9RZT6G0wB_0 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.491681606201866346', time=2024-09-14T13:46:11.745270+0000, chain.objs.size()=1 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AbBYOSil26jFHF3Rw7EgAeuWioHD6Ce_0 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10807221310253709854', time=2024-09-14T13:46:11.749688+0000, chain.objs.size()=1 2024-09-14T11:56:14.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.752+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rx51ZkbOXiis1r0YhWGJGRlCFTeuuQI_0 2024-09-14T11:56:14.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.755+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7860592728655298600', time=2024-09-14T13:46:11.751261+0000, chain.objs.size()=1 2024-09-14T11:56:14.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.755+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Rwx3o9GjQmXuYjQkBLaXvkgP06zeoX8_0 2024-09-14T11:56:14.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.755+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5424376776201089839', time=2024-09-14T13:46:11.753474+0000, chain.objs.size()=1 2024-09-14T11:56:14.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.755+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.R7MJ9C4Rt5f8olnkyPXlOPcEdkyTvym_0 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5870927193637595602', time=2024-09-14T13:46:11.897758+0000, chain.objs.size()=1 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7kdeZHcVYccx_e73TdbTr5buPQ1J68L_0 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14562160740846559403', time=2024-09-14T13:46:11.909198+0000, chain.objs.size()=1 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BTOODYWPqt6V8TUY0_OOqEbJv4jLilQ_0 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13429873075044143122', time=2024-09-14T13:46:12.064475+0000, chain.objs.size()=1 2024-09-14T11:56:14.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-o1XGRSAVUnD2Q127vrEuHHNDOAHze__0 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.693336868066966998', time=2024-09-14T13:46:12.126857+0000, chain.objs.size()=1 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9HbIfaMlKV6h9-xubGOYcWHSiZMfJ8S_0 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5704785050128403539', time=2024-09-14T13:46:12.457007+0000, chain.objs.size()=1 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JO7i1zgqeQ61QZn5w_ijrsmnvfXsq6h_0 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.693091125295112496', time=2024-09-14T13:46:12.489114+0000, chain.objs.size()=1 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ybh0fpV4JHmw3F_2WJucxn7J6Rcp47p_0 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16877166678149946302', time=2024-09-14T13:46:12.655874+0000, chain.objs.size()=1 2024-09-14T11:56:14.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.756+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GCOjzVIli-z83w0TBCSKrSZYnoQxnrA_0 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10792048296127128928', time=2024-09-14T13:46:12.656536+0000, chain.objs.size()=1 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cMNOhNnnZL8jp0KNiX1QkS8h6qOHS_Y_0 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16049832466976488165', time=2024-09-14T13:46:12.670301+0000, chain.objs.size()=1 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.OKGOswDno-5oiUdISoz2IS9ocBf3jTt_0 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5126354306269610750', time=2024-09-14T13:46:20.724111+0000, chain.objs.size()=1 2024-09-14T11:56:14.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.757+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XdC4heTWx7F38KjkQsbsf5RczcaUj55_0 2024-09-14T11:56:14.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.759+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11492207910573726068', time=2024-09-14T13:46:20.750815+0000, chain.objs.size()=1 2024-09-14T11:56:14.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.759+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tR-QFClKmq_04oqgEYZXdIPmt5tZn5f_0 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18092312949528373573', time=2024-09-14T13:46:20.763850+0000, chain.objs.size()=1 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HrbWqP7t-yB3-PbYiBYoym8nGpvDbnC_0 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11084701252563127888', time=2024-09-14T13:46:20.768333+0000, chain.objs.size()=1 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5lmPJeZhT2MI7kgAEYpKixb8LrZO1ic_0 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2483552201127362357', time=2024-09-14T13:46:20.769555+0000, chain.objs.size()=1 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6BGxS17JcBJbUWkDH8zG14h8HTA5GWV_0 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7986971287766707492', time=2024-09-14T13:46:20.798019+0000, chain.objs.size()=1 2024-09-14T11:56:14.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2QOHZ2COehfoMzq33ild0OrDX2QchBv_0 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17877381994482036043', time=2024-09-14T13:46:20.934627+0000, chain.objs.size()=1 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FLcLyEyulRtf_hmB-u72p-5NNYXqzzR_0 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16364227682227690196', time=2024-09-14T13:46:20.993763+0000, chain.objs.size()=1 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mj_NQgchveE7I1xToCIw-uqzchwS0fX_0 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18362964660742004503', time=2024-09-14T13:46:21.095784+0000, chain.objs.size()=1 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dlDM_bLS0vIrwKIVnAzv9AFXZNJwt8c_0 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3787408501416453019', time=2024-09-14T13:46:21.118640+0000, chain.objs.size()=1 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Tt0SywRxgtX8I7_bTGLz_lLyDrahjY6_0 2024-09-14T11:56:14.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7614175321682701315', time=2024-09-14T13:46:21.148829+0000, chain.objs.size()=1 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Yxn51IiytNHNpKyDicZzw8Sj0DWWosF_0 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8670991164987733096', time=2024-09-14T13:46:21.149773+0000, chain.objs.size()=1 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.79_GGz03i6CDeAP6sGgOU5JTtr9q28k_0 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8434553074508323718', time=2024-09-14T13:46:21.206917+0000, chain.objs.size()=1 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.761+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WX4yN59mrMPys7SzAIwHoBjJmL_HfxY_0 2024-09-14T11:56:14.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.764+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.373895608723535222', time=2024-09-14T13:46:21.298551+0000, chain.objs.size()=1 2024-09-14T11:56:14.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.764+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MRh4WQb23IV6XOIFpbwuNAQYqCVYTPK_0 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2974404659551775438', time=2024-09-14T13:46:21.300644+0000, chain.objs.size()=1 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mJXnTE2cMSepdPuPUiivodrcA_5rUYu_0 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8870789953513623019', time=2024-09-14T13:46:21.324348+0000, chain.objs.size()=1 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nRmfb6F35ajrq135_STSoVfAMVLFtV7_0 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8454409147168031546', time=2024-09-14T13:46:21.325272+0000, chain.objs.size()=1 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TYfoBWSAn1_K1PpksFxRPu3Y9Cn3MgQ_0 2024-09-14T11:56:14.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9456771860873250798', time=2024-09-14T13:46:21.365685+0000, chain.objs.size()=1 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.D65zDpl6mv1xZFi1n7CaWzfkECnjxhQ_0 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11360829089932244938', time=2024-09-14T13:46:21.514449+0000, chain.objs.size()=1 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GCjnTwCfpZ3F-AqemwLX8pDcQ6AP5y-_0 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6805122972994281691', time=2024-09-14T13:46:21.779769+0000, chain.objs.size()=1 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2etp802Q3zknZOI9Z5Upjc0CZLxM7KJ_0 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.765+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14642613216047379797', time=2024-09-14T13:46:21.856229+0000, chain.objs.size()=1 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.766+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.veRoEtqnw31POJFKcekkR6hMYB1pMpF_0 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.766+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16810065359296298012', time=2024-09-14T13:46:21.883396+0000, chain.objs.size()=1 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.766+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rJFzkcNDOEpoExEWM8_dWk49xSQMNV7_0 2024-09-14T11:56:14.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.766+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5409279723460549235', time=2024-09-14T13:46:21.905488+0000, chain.objs.size()=1 2024-09-14T11:56:14.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.766+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.v_bF_bgVly0WBqBgzR9oQ9FjpqhswSg_0 2024-09-14T11:56:14.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.767+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10475106701541134970', time=2024-09-14T13:46:21.918131+0000, chain.objs.size()=1 2024-09-14T11:56:14.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.767+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.D541_-C7v-73tXuHWvQ_X-yxlv96nu2_0 2024-09-14T11:56:14.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.767+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8595211889145493493', time=2024-09-14T13:46:21.935891+0000, chain.objs.size()=1 2024-09-14T11:56:14.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.767+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UkGUgAZToRCx7ekThJ2VyyYPHHQ1s0j_0 2024-09-14T11:56:14.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.769+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8092953276271843927', time=2024-09-14T13:46:21.951139+0000, chain.objs.size()=1 2024-09-14T11:56:14.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.769+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1RcED7NHAVVPyoUpTBr_layAOgqA51T_0 2024-09-14T11:56:14.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.769+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11447127321214039071', time=2024-09-14T13:46:22.073569+0000, chain.objs.size()=1 2024-09-14T11:56:14.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.769+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OBVlrQxZ7hI_l9xa9YjzzyCmKf6PD9s_0 2024-09-14T11:56:14.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12293106270909115461', time=2024-09-14T13:46:22.122869+0000, chain.objs.size()=1 2024-09-14T11:56:14.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.67TVyiCF1uWfXLiVHs1W5vvM8zSsgqg_0 2024-09-14T11:56:14.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4829296373281661117', time=2024-09-14T13:46:22.262183+0000, chain.objs.size()=1 2024-09-14T11:56:14.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Umy7vbQ1zolVddo_ORqfVP_roR0cS8I_0 2024-09-14T11:56:14.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5845370497272528681', time=2024-09-14T13:46:22.264495+0000, chain.objs.size()=1 2024-09-14T11:56:14.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FA8RkjSStlFovN0awuoLXZu9f1bPRdh_0 2024-09-14T11:56:14.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7518449219811593298', time=2024-09-14T13:46:22.332224+0000, chain.objs.size()=1 2024-09-14T11:56:14.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.770+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2IB_dK-f2G2dQ8pvEWllPuI_Wb8L-d6_0 2024-09-14T11:56:14.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.774+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/42562 2024-09-14T11:56:14.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:56:14.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2902661690268701380', time=2024-09-14T13:46:22.348487+0000, chain.objs.size()=1 2024-09-14T11:56:14.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bTie0QvkmMXRr5t10bVzGTJpv3IgXPU_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4696365981415286198', time=2024-09-14T13:46:29.264268+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.340__shadow_.OU-mwlDP7RRWdpVB6NWEvbsIx0KObPU_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4598787787105857959', time=2024-09-14T13:46:43.855485+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.374__shadow_.PAWhdfiwpvEnM55pE1wulBuB3cro1Zc_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13872553456144056866', time=2024-09-14T13:46:57.082768+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.395__shadow:gB.hA8rfDqeGNgyTMnxoUVPEGF6yZdy_.jYlzjZrJFT4XSVJz6BLurl1GewGJW6p_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16436390556569357056', time=2024-09-14T13:47:30.020342+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.458__shadow_.2P-fNge6fE-qJXsxjUbn2rJBP6tU0GG_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1774543151781001854', time=2024-09-14T13:47:42.116316+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.Zt8IAJ0I2qswNEK9cCfhuiVKx3BUTNj_0 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10558952732120503491', time=2024-09-14T13:47:51.656697+0000, chain.objs.size()=1 2024-09-14T11:56:14.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7170440537187818231', time=2024-09-14T13:48:03.429555+0000, chain.objs.size()=1 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.521__shadow:RjxLuH5cbaHCYaQEGWxXzuq1Dad41Q2_.taK9YSNY-qnWcJnn_sqDQbtV0IM8xFt_0 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14341511131681076198', time=2024-09-14T13:48:12.612797+0000, chain.objs.size()=6 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.acuzJv-ZR55EpaEEitYqRqi7KTrTvvra.1 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.P7ZhgnGNjSK7lS76JGfR8-8sz3EZC6bG.2 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.RIhR1TCIY0kBr4H_57XDPjaNq2QX8Jxx.3 2024-09-14T11:56:14.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.776+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.rtzM3PULmgHPOndVUsdQU6SbRMp1TRE3.4 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.778+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.kPgCFqq5Uu-suPkTsIsEJ2FeuLN-qm-z.5 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.778+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.XqlL7O5NWdAWVqMKYX8LjigtEGaP05GQ.6 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.778+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15060955699631874016', time=2024-09-14T13:48:16.087284+0000, chain.objs.size()=3 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.778+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~GD4pKgcbwgIGXw0iM4RaemSmT8grnkX.1 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.778+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~GD4pKgcbwgIGXw0iM4RaemSmT8grnkX.2 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~GD4pKgcbwgIGXw0iM4RaemSmT8grnkX.3 2024-09-14T11:56:14.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11176969726232155264', time=2024-09-14T13:49:23.290150+0000, chain.objs.size()=1 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:DqW88jPYpXdHUQSJFQlO-OWLfDdOI6u_.Baevzzp0R7C8s6FRYtbZ1UlcnRMxLc1_0 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8336167297621008047', time=2024-09-14T13:52:23.205752+0000, chain.objs.size()=1 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.644__shadow_.KXgNgnK4FNEfNNeRm5AhpeDBpsktuyT_0 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4130459251891601737', time=2024-09-14T13:52:34.345524+0000, chain.objs.size()=1 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.779+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.664__shadow_.9Ph9SVz71R7YqHdssEdVT5VIIAq1MR5_0 2024-09-14T11:56:14.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.781+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18230862106677823325', time=2024-09-14T13:53:19.111619+0000, chain.objs.size()=1 2024-09-14T11:56:14.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.781+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.720__shadow_._B1f_dlNvUUnCOysLsyO0V1RRbmHMry_0 2024-09-14T11:56:14.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.783+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.785+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:56:14.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.787+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.787+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48386' 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2103745739141604801', time=2024-09-14T13:43:41.114609+0000, chain.objs.size()=1 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.182__shadow_.EV64sx6Xs_NtWbbG8qOHN1t8k4FVV7H_0 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18295460612538369699', time=2024-09-14T13:45:07.705536+0000, chain.objs.size()=1 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.235__shadow_.1qhBSmDt8aMn-wfS5gCAIBMKyA5Zz81_0 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1588381646120140396', time=2024-09-14T13:45:15.420383+0000, chain.objs.size()=1 2024-09-14T11:56:14.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.248__shadow_.mHwPSpHoly-JoEEOD9jwlNt3tS8Y8Nj_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6840935714908427358', time=2024-09-14T13:45:30.216606+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ek8zZuw_7R2WK44AbAKA2GbY4JxmEUQ_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15455203655484836260', time=2024-09-14T13:45:30.245366+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ejomdt_zvP7Ax5AOXiHXSk-HDJovJxW_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16688558349127810350', time=2024-09-14T13:45:30.254111+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.R2nlTUH0eICdS2Tp7TdfwTizh-0C4m1_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11323995177192640105', time=2024-09-14T13:45:30.301094+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZTAybPY6KgNRofxnIt8zofSd2WLrpJa_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7502775318384336940', time=2024-09-14T13:45:30.303529+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._pMrtEYLhZny_NQ2-d3YgRh1w_VC9wD_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15547692574370381798', time=2024-09-14T13:45:30.306808+0000, chain.objs.size()=1 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oUPnKOE4ncYPFEkJDxzxo12KJjDGb3l_0 2024-09-14T11:56:14.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7204071732176630782', time=2024-09-14T13:45:30.417427+0000, chain.objs.size()=1 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._eyM34d7UoivKCAoFmNb8185aOsh28X_0 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4784137352910412848', time=2024-09-14T13:45:30.465230+0000, chain.objs.size()=1 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.42CUntnHqTqalxEp4CZxUILb25X_ZSL_0 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7307195970961277108', time=2024-09-14T13:45:30.476508+0000, chain.objs.size()=1 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.788+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3K7LeqO-Ci5a3Kxh4T2bLfdv3DtAj_f_0 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18321740067360947812', time=2024-09-14T13:45:30.481180+0000, chain.objs.size()=1 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.p0SmM-fwSWHozAD6KaGmeE0_iqdYn1i_0 2024-09-14T11:56:14.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.791+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16308675824823507987', time=2024-09-14T13:45:30.486504+0000, chain.objs.size()=1 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.791+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.C6LH_GzQMDy2Thu78ED7li46ru1dDOv_0 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.792+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15621260062185925945', time=2024-09-14T13:45:30.496071+0000, chain.objs.size()=1 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.792+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5GzLRSGPhFceCCDRWE_-5CywPsiw5r4_0 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.792+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8479688908317164140', time=2024-09-14T13:45:30.593472+0000, chain.objs.size()=1 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.792+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Li6BFISF-4MKKjd8Q_nr8rKvXNe0fhB_0 2024-09-14T11:56:14.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4452581629043264372', time=2024-09-14T13:45:30.604121+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aGW-3dXYcPw7R8KQOYyLqnSg0Jmwr2G_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11379533329248914462', time=2024-09-14T13:45:30.608174+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V4QsanKYFV6TxNh2b2ASow-iUchz3Co_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9871946036106727960', time=2024-09-14T13:45:30.641456+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zzhbxQnuyQ1_cBv21ceCPQgAFgUFK6X_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3434697948155565964', time=2024-09-14T13:45:30.674006+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9998CplKPoqxKnz_mnuDAQemYlbaiBr_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.651356165546364025', time=2024-09-14T13:45:30.690540+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RJdtdUp1j0aRq_RKubVbpA8nh7lX-Y1_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5340574116540886912', time=2024-09-14T13:45:30.776517+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.diaUdgJSharTNvbRP0KRA9Q_uHKMg1N_0 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15060157969786048141', time=2024-09-14T13:45:30.801615+0000, chain.objs.size()=1 2024-09-14T11:56:14.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.793+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sqON3ceEF77VAfScmy8hljBZfFwGbPu_0 2024-09-14T11:56:14.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4636817904842894595', time=2024-09-14T13:45:30.845358+0000, chain.objs.size()=1 2024-09-14T11:56:14.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.thfIz2MCPBv_XdG_8RNBuBUW_2c7wr1_0 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6111718145127979055', time=2024-09-14T13:45:30.846682+0000, chain.objs.size()=1 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wOwvOrrmAVhd-SUs3Gm7wZgTcdW838L_0 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9914759513533049315', time=2024-09-14T13:45:30.976841+0000, chain.objs.size()=1 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zJKfSjhaY6WymIfVjoaiZqw88QDVC9f_0 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14788551739718501000', time=2024-09-14T13:45:30.990583+0000, chain.objs.size()=1 2024-09-14T11:56:14.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.795+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.i3_yTuFFFeFq2fyoO6NCf6xptQD2_po_0 2024-09-14T11:56:14.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.796+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2414614567521222037', time=2024-09-14T13:45:31.001087+0000, chain.objs.size()=1 2024-09-14T11:56:14.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.796+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QClht84rW0C9JsNVgTzHz7KO7oHIgnr_0 2024-09-14T11:56:14.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10267146079843076813', time=2024-09-14T13:45:31.020981+0000, chain.objs.size()=1 2024-09-14T11:56:14.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bmH3eCaMN6nr-nkBHR14glHedKp8jMr_0 2024-09-14T11:56:14.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18078224165430570511', time=2024-09-14T13:45:31.208753+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m4rRdgF98gUYmpW9BgTPBej_gWQfkAk_0 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3013972520758255383', time=2024-09-14T13:45:31.232317+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Yhx6GgJbF1f4veOjlqJ3Ci8QSOr21Ei_0 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10986310695339803839', time=2024-09-14T13:45:31.246267+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wIZkjRiyimyoO_kLOqO6kDg4An5e15c_0 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6408682857268781217', time=2024-09-14T13:45:31.252155+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m42kYy1aKW8z9eOzXSnb7fvawfGUPGr_0 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17437738612817957478', time=2024-09-14T13:45:31.502337+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.797+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-BzK47b29oeQ6Ca_l2G_GC4HIRC9cXp_0 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.798+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4510223159008365839', time=2024-09-14T13:45:31.528390+0000, chain.objs.size()=1 2024-09-14T11:56:14.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.798+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0nSchoKAh8LUsTD6EfJCD0FueY1JOoQ_0 2024-09-14T11:56:14.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4105430696755459271', time=2024-09-14T13:45:31.724537+0000, chain.objs.size()=1 2024-09-14T11:56:14.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zfYGhib-bxBp8qz8SF82w-WhwB4Nk2a_0 2024-09-14T11:56:14.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8573173032600208427', time=2024-09-14T13:45:31.745190+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lHYM7P6WXwCDX0kz5IBFSOSaVb2ZFaq_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5311850591452598245', time=2024-09-14T13:45:32.792245+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.800+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.265__shadow_.GvdTh0vvi-8RQG4be_irpvdKef7cVvZ_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11337349346482930962', time=2024-09-14T13:45:35.182965+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.270__shadow_.OHOSKk_2nt9Q3aoFTojhc_uO6tE2j99_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3747975292783393886', time=2024-09-14T13:45:36.670068+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.273__shadow_.llQId7N7Ca0b6Kd_8TkqT2-vESdLHKG_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8071281831284078531', time=2024-09-14T13:45:38.119125+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.276__shadow_.iitbjQHz80STDK5b4Vm_OWo6ykuW9pV_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.955974283684551700', time=2024-09-14T13:45:43.339928+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.286__shadow_.s-_Mr21M0spkgOCOOHsRc5B8Qp5Q0mi_0 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8994301689715111071', time=2024-09-14T13:45:48.184449+0000, chain.objs.size()=1 2024-09-14T11:56:14.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.xnv_iYi5S0Q9Zx640tO4ol0kSPmtNIP_0 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18030778918224441253', time=2024-09-14T13:45:50.659322+0000, chain.objs.size()=1 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.299__shadow_.FJMnzYqfiu85U0y1hUJ7DRzmYJXXomU_0 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14073921358826024329', time=2024-09-14T13:45:53.089263+0000, chain.objs.size()=1 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.304__shadow_.o39EV6pmynyU27aPhhciMCYciNzNSLa_0 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7629838202137632877', time=2024-09-14T13:46:10.944769+0000, chain.objs.size()=1 2024-09-14T11:56:14.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.801+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UJ2XImOojomrKosg42K9hlp5kbbx8vf_0 2024-09-14T11:56:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8694442585053589261', time=2024-09-14T13:46:10.971005+0000, chain.objs.size()=1 2024-09-14T11:56:14.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5b5DWiA4aXLUuO5uSgL-Tuv_w1onAZS_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15452166982469086744', time=2024-09-14T13:46:10.988279+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Q53GaXTDqyKqrFyXIOFTxmQrK3FQGiM_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.875671008225237546', time=2024-09-14T13:46:10.990888+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aDB39OFc9Io9tQJ1LPrYNfxBZ8_M7Um_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17805190120294251871', time=2024-09-14T13:46:10.992934+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.OxBCDRyqsHXCCxvVGZ6TXQvuoBgjsa3_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3086027193289581032', time=2024-09-14T13:46:11.005855+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JVw47IfBh-zvyfHP1u3cpShYEFLHtqt_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2666012659409778818', time=2024-09-14T13:46:11.025443+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mbbYeho7-xKiCVlaerm84W_tiKoo6Qw_0 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4221421461164997867', time=2024-09-14T13:46:11.111612+0000, chain.objs.size()=1 2024-09-14T11:56:14.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NLdO0V4dO7Du7BbtXdebS0HULdpLciK_0 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17382892887922779335', time=2024-09-14T13:46:11.122786+0000, chain.objs.size()=1 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HoEK-e-_TEhVUN-1Iiyp6IdlosC0Ib8_0 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17694459877289719101', time=2024-09-14T13:46:11.155233+0000, chain.objs.size()=1 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.804+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HEEZ_2Y3qTtbPBTuyTOoqAwO_Z2TbhK_0 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.805+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8927260234584073803', time=2024-09-14T13:46:11.187997+0000, chain.objs.size()=1 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.805+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xN0MXwRWFZEnHzcB51d5uYJb0Vy_0kY_0 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.805+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7466110040265304385', time=2024-09-14T13:46:11.301034+0000, chain.objs.size()=1 2024-09-14T11:56:14.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.805+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TeezRc3vSWWxk_h5VKcRCnjO24y0H70_0 2024-09-14T11:56:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1280692301683914435', time=2024-09-14T13:46:11.302031+0000, chain.objs.size()=1 2024-09-14T11:56:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.808+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Xlmn_lnV7ojoVLy2-yGRKyWw-jaxN2a_0 2024-09-14T11:56:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.808+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2717381974063914382', time=2024-09-14T13:46:11.308068+0000, chain.objs.size()=1 2024-09-14T11:56:14.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.808+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y-5Y6I_JKGOiJa6Btm8NpcxyZOaJ0wq_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5434278677450430743', time=2024-09-14T13:46:11.317911+0000, chain.objs.size()=1 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ak0C06wK0JVkL1j6I2RTpedDpvTG_oE_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11056310813385134945', time=2024-09-14T13:46:11.647010+0000, chain.objs.size()=1 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Gp1bgFUv3_InYQRqzDdUfM057AJztU8_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11914788138407411297', time=2024-09-14T13:46:11.671367+0000, chain.objs.size()=1 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WEMjCZiTLCrrXoNfa30hifEps9TkAXF_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4289357743227342952', time=2024-09-14T13:46:11.839738+0000, chain.objs.size()=1 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DvZ917-iZsY1956qKAIHXTqan-fAckA_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18404694870219750938', time=2024-09-14T13:46:11.854281+0000, chain.objs.size()=1 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BLLz9JabtuxB_6iWptnkbPbZpGIpBAe_0 2024-09-14T11:56:14.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7365475718733556516', time=2024-09-14T13:46:11.855835+0000, chain.objs.size()=1 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oVhDuQpT4CmtzLVf1ebcvdk1pCIvFMs_0 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17114952353081219905', time=2024-09-14T13:46:11.934140+0000, chain.objs.size()=1 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WWEkdvOG4ijHn8CbkF7sFcUcFSDxr8b_0 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17061695688326343572', time=2024-09-14T13:46:11.952536+0000, chain.objs.size()=1 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.C6976ecqX88Vg9i7IPiRxDlU2ImFPa3_0 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2575830093733376591', time=2024-09-14T13:46:12.036826+0000, chain.objs.size()=1 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.810+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6eax6Z4Mg53R9gOkHkHs3oeYtEjPab__0 2024-09-14T11:56:14.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.811+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8754899251887691958', time=2024-09-14T13:46:12.057531+0000, chain.objs.size()=1 2024-09-14T11:56:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.811+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SEKIgTDTfF-S7JxoyD0Emcs1KRcAs-e_0 2024-09-14T11:56:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.811+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10778608675646312748', time=2024-09-14T13:46:12.085665+0000, chain.objs.size()=1 2024-09-14T11:56:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.811+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.krUl9-mC8NOkYRrbH-DgHjMFFfGP-H8_0 2024-09-14T11:56:14.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.813+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6206183318485535915', time=2024-09-14T13:46:12.231176+0000, chain.objs.size()=1 2024-09-14T11:56:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.813+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Z06h_JppqIL2PYOZSA3PUBMr1zvoBuo_0 2024-09-14T11:56:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.813+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4619889599008446488', time=2024-09-14T13:46:12.432660+0000, chain.objs.size()=1 2024-09-14T11:56:14.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.813+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9VOex2cdUJRq1eil5fsoew-RilrdrWp_0 2024-09-14T11:56:14.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15706671255520538486', time=2024-09-14T13:46:12.441942+0000, chain.objs.size()=1 2024-09-14T11:56:14.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IpV0TPt06GEmqhVD_RWuWiqlRWQ20UP_0 2024-09-14T11:56:14.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2306122623436477008', time=2024-09-14T13:46:12.444050+0000, chain.objs.size()=1 2024-09-14T11:56:14.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iu0YFASnJYwYptXYmv7g4q6vBtEnx7J_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9775158594414170606', time=2024-09-14T13:46:12.447607+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Tl_EpbfhaErRHQBmnzEb06-_mjYToqj_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9966624501356777233', time=2024-09-14T13:46:12.457489+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dLk_z30VWfeZD1glLj2Ns3Mhu7_FVjG_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14759674515875290670', time=2024-09-14T13:46:12.618906+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.t7osD3vFy5-gQIDBVz5uoSizuoU27QU_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.895325185777340226', time=2024-09-14T13:46:12.645874+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z1tqO6Jnuh4Sh0a0WI5vv88J2MGPYV5_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12613584699956398059', time=2024-09-14T13:46:12.651597+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LnMcDFB3JiNWdAXANQyNTXClJKWyZ0R_0 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3772135166806227004', time=2024-09-14T13:46:12.678357+0000, chain.objs.size()=1 2024-09-14T11:56:14.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6e9dVneb5yD4iUKLLCvMt3eI_kaPM94_0 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.437083269063889703', time=2024-09-14T13:46:20.726053+0000, chain.objs.size()=1 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.815+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dSD2VVe66z1-Hgvg-oQQC1yF9UwazLc_0 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15260297177936263977', time=2024-09-14T13:46:20.734870+0000, chain.objs.size()=1 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LeaawpX45jh1tsZxQHH7pxvxqTnt-ii_0 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.816+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15645188551624933319', time=2024-09-14T13:46:20.755060+0000, chain.objs.size()=1 2024-09-14T11:56:14.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.816+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.24JBNBLySx2k26DO_PZXxWs_Pjy0MDZ_0 2024-09-14T11:56:14.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.819+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9573628877573069593', time=2024-09-14T13:46:20.787463+0000, chain.objs.size()=1 2024-09-14T11:56:14.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.819+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FPWpDXcEi36H_fwNA1eY4-NjcH1QAZK_0 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.819+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6803109581796953446', time=2024-09-14T13:46:20.789029+0000, chain.objs.size()=1 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.819+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fs2uoGZUWNHD7PAr3tRz9cDcne5TQ4h_0 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4088261190112631563', time=2024-09-14T13:46:20.801091+0000, chain.objs.size()=1 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2MF7dokt7MN143G4TtyJTaT8qnoJrIT_0 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2821047217605215439', time=2024-09-14T13:46:20.805802+0000, chain.objs.size()=1 2024-09-14T11:56:14.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mZMaoV8wmbrnhXdPCNdgXumisWKIw0a_0 2024-09-14T11:56:14.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14461550076179801782', time=2024-09-14T13:46:20.901489+0000, chain.objs.size()=1 2024-09-14T11:56:14.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8jlMbWNifQnw4-_rFNVf7g4OKWta1S7_0 2024-09-14T11:56:14.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.42811368580893315', time=2024-09-14T13:46:20.904961+0000, chain.objs.size()=1 2024-09-14T11:56:14.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HtqpCFDczz4LyjAC7Eigxjf2s4eXdKY_0 2024-09-14T11:56:14.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16719055533495340707', time=2024-09-14T13:46:20.925400+0000, chain.objs.size()=1 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bEvH9NI06uCVtCmRCZd_vlsvG4DSSBv_0 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1417832786583630730', time=2024-09-14T13:46:20.928549+0000, chain.objs.size()=1 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.M4XeOzqU6qRvHje8nLtYbMzgzzE00Hs_0 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11259119278698562915', time=2024-09-14T13:46:20.932493+0000, chain.objs.size()=1 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.y572sl_T4DlWo8-nM3yNZZP-0J3y4na_0 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1731311671981472249', time=2024-09-14T13:46:20.939154+0000, chain.objs.size()=1 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Jj-liegiiJAURHuLmL6LcmPr1re3zId_0 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8444521402241676818', time=2024-09-14T13:46:20.984073+0000, chain.objs.size()=1 2024-09-14T11:56:14.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.820+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vTVJSF6m7Ji33aKPcteIX1SNovFH0jn_0 2024-09-14T11:56:14.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.822+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2638564242780549273', time=2024-09-14T13:46:21.143731+0000, chain.objs.size()=1 2024-09-14T11:56:14.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.822+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IFD5eOnJ_AI1U4h0VHxS5iZgEeKcTXJ_0 2024-09-14T11:56:14.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.822+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6965939721257283251', time=2024-09-14T13:46:21.183182+0000, chain.objs.size()=1 2024-09-14T11:56:14.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.822+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.t1rAe92Ewd-uiMZXKlZSLeYcK5c8hkz_0 2024-09-14T11:56:14.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.823+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17011333512729707272', time=2024-09-14T13:46:21.198604+0000, chain.objs.size()=1 2024-09-14T11:56:14.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.823+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5WUTc6MSCoGHUvAfk_tzBefNpsyRb78_0 2024-09-14T11:56:14.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15003155185913236053', time=2024-09-14T13:46:21.203921+0000, chain.objs.size()=1 2024-09-14T11:56:14.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZomLcM0BaTDbhICq9oahqLOY9OMwl88_0 2024-09-14T11:56:14.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6314129196155058492', time=2024-09-14T13:46:21.295666+0000, chain.objs.size()=1 2024-09-14T11:56:14.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1hz1kNZPYoDgOFxA-iYaVm48zTdIrrc_0 2024-09-14T11:56:14.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.440567423191565800', time=2024-09-14T13:46:21.325159+0000, chain.objs.size()=1 2024-09-14T11:56:14.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.824+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.hwqUbJhVw6QancNkAJOf3TD-wiXAcb1_0 2024-09-14T11:56:14.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.827+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/48386 2024-09-14T11:56:14.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-14T11:56:14.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17446541419040384852', time=2024-09-14T13:46:21.329528+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JjXEX7q7PmxhTLaqgk0GQbZDWjBV6Me_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2911878319828455466', time=2024-09-14T13:46:21.374050+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ErQGU4J2Tr1CAoTlMLdNxDOrxsp2mVX_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7697426453834029811', time=2024-09-14T13:46:21.471973+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Hip5JH7PcPnMRwSgxjXvbcKE7TJ94bN_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9862036603573298385', time=2024-09-14T13:46:21.482491+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3pzOCXwI13uhQ-U5lFYXv1Bh01cs4Or_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11271233622962237440', time=2024-09-14T13:46:21.496565+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uCWmoSSRSBYObrQj-xuMXguLNUWOh44_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6451915013530936711', time=2024-09-14T13:46:21.501532+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZMPAj8EqH_gsP4uKTVOPrKIc5GJJP58_0 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17532992792874483321', time=2024-09-14T13:46:21.502654+0000, chain.objs.size()=1 2024-09-14T11:56:14.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-ygKwiARvLisL5MYxKNSvPWaHmHgLFJ_0 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2853713076780346824', time=2024-09-14T13:46:21.530098+0000, chain.objs.size()=1 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1cW8Qz5sr3AvAV3CbjAHI7rxKA6aUqh_0 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2313347197215886598', time=2024-09-14T13:46:21.531442+0000, chain.objs.size()=1 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ku4yJzGQosbz434v29OoYjib_4SJ-Sb_0 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17621704943515627888', time=2024-09-14T13:46:21.760159+0000, chain.objs.size()=1 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ba2maAQKNnwxXWWsNd5-1iH5Ju3q6n4_0 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18041139186265488189', time=2024-09-14T13:46:21.777563+0000, chain.objs.size()=1 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.w2V7L6i4aqC36iNQgD_5T00WlHkleYn_0 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6550905004703240715', time=2024-09-14T13:46:21.778367+0000, chain.objs.size()=1 2024-09-14T11:56:14.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.829+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tY8z3GucdIaTwMJdUER0MG2Yv2XNiIj_0 2024-09-14T11:56:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.832+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14758696514103937710', time=2024-09-14T13:46:21.855579+0000, chain.objs.size()=1 2024-09-14T11:56:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.832+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pAEy0kZSYScoGfiKvgHNshpGd_CGTlO_0 2024-09-14T11:56:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.832+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10190993931349665561', time=2024-09-14T13:46:21.892851+0000, chain.objs.size()=1 2024-09-14T11:56:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.832+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ilZKwt6KrR9o_B9V5SHo0e1kfu89Ygh_0 2024-09-14T11:56:14.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1920060754625815986', time=2024-09-14T13:46:21.894690+0000, chain.objs.size()=1 2024-09-14T11:56:14.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TWlZxDrYL3j1HzWN2sRZzVUheqPpIJj_0 2024-09-14T11:56:14.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13391267158748129056', time=2024-09-14T13:46:21.896139+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.m_dACVy32EObmhz7nHLuc7TN3f50zzG_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1731103574892558837', time=2024-09-14T13:46:22.041975+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.a5_uK7m1KENOwiTyPBRpn7N0QvKr6R__0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6613229816541533002', time=2024-09-14T13:46:22.082646+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bmO6Itk4z67Zaq0OXvEfAzXxXIEU9IQ_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11046125925263566354', time=2024-09-14T13:46:22.103277+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tuaNhxoyfC5SOb_lx74AHcTlzs6fYtB_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4000151269466073563', time=2024-09-14T13:46:22.138966+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.owj0UJqHLTka1LcGbyg298eLE2pLNrc_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1651094189165255445', time=2024-09-14T13:46:22.283583+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ED09Ac17VODuOCfauXtgFtKXonC2m7c_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13605677424392097235', time=2024-09-14T13:46:22.327902+0000, chain.objs.size()=1 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2Otp74rrMM5E6Qgxco5D5EziLVZE3o8_0 2024-09-14T11:56:14.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9107839701514590828', time=2024-09-14T13:46:22.339815+0000, chain.objs.size()=1 2024-09-14T11:56:14.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.833+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.q421wJIAevntjrbmPu0d2V3hNG0ot5-_0 2024-09-14T11:56:14.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.836+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1461352649923992799', time=2024-09-14T13:46:22.341526+0000, chain.objs.size()=1 2024-09-14T11:56:14.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.836+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jqLMA1ntGnvlvCuwlmdJVP4aoSCY7An_0 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15701620100377230601', time=2024-09-14T13:46:31.573119+0000, chain.objs.size()=1 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.345__shadow_.7k9M9bxZFtgCP8GqnOOhTnfc6iiN58q_0 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15622249888094789929', time=2024-09-14T13:46:47.425660+0000, chain.objs.size()=1 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.379__shadow_.gunpIUTIDbbPitAWJJkyw67kRVycN3A_0 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.350960449914131128', time=2024-09-14T13:47:35.503408+0000, chain.objs.size()=1 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466__shadow_.dY2GPEXFIT8go3TgyVqd8DLGmz7N0tt_0 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2639714791918316683', time=2024-09-14T13:47:36.111632+0000, chain.objs.size()=1 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.467__shadow_.xeDi7C3pmH9D8BjsYdv1gHsRbH0NOK1_0 2024-09-14T11:56:14.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17372278978603211763', time=2024-09-14T13:47:42.117426+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.FCwXJDYmm8eOP48N7mCEJHdg-jRB3tn_0 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12767757582185019824', time=2024-09-14T13:47:43.678682+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.487__shadow_.4o0Y5q9lNMkPKkvB-8y_PKzHVAUPAhp_0 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13190094412317345227', time=2024-09-14T13:47:59.369620+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.519__multipart_mymultipart.2~s5025MKF75cHXGuVCDYyC6c1VyyxLMn.1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7754580917811371354', time=2024-09-14T13:49:13.806797+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:5jyz5XK1FRNXIP7QFVbQqKfXapo9X3X_.c2zZBZT6RjV48wJDXdElIF6zTuE0pCX_0 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14941843266286156617', time=2024-09-14T13:49:17.867988+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:EgisZTV5lSEW.hKXLfI0TdUcuG8zqVX_.VSZxgnmI5mPKQItTTqnOY707d4XHtCR_0 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4444860334114041364', time=2024-09-14T13:49:25.311163+0000, chain.objs.size()=1 2024-09-14T11:56:14.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.837+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:71NmOiUQdRO9RzCY70tVQMcJTz6SSId_.JyQXOZD5QNCLhhQmUMcbLk5UqL2Lflj_0 2024-09-14T11:56:14.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.838+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1839036509576867989', time=2024-09-14T13:49:28.415014+0000, chain.objs.size()=1 2024-09-14T11:56:14.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.838+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:FgN4osoNdX4TNd53Ml6nyUSVUtgU-gV_.VN2K7kJgMMS6I3WyBPFX-Cw57en9lNf_0 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13296870166382471299', time=2024-09-14T13:49:29.761052+0000, chain.objs.size()=1 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:HcC60v8x4jvPcsJz0uMhYc9QuzwzLX2_.WduqMPVD0AiiAW5hKyJKkFuOIUXXsiD_0 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11071090899353780043', time=2024-09-14T13:49:37.468788+0000, chain.objs.size()=1 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:E0s8xZshWT8FTtbxm-jcgpj-aLTLtiI_.2q5xS1fjQT21FKZB-Wya3OUWONu-Zlv_0 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15335286328231781778', time=2024-09-14T13:49:49.535006+0000, chain.objs.size()=1 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:y1cd1lSKhKUPksZYlPif-YyUlHMGnsD_.dS8pm_seC3zNTs9tKXjoTzHVQAnCR2d_0 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13745260450537184742', time=2024-09-14T13:52:16.768710+0000, chain.objs.size()=1 2024-09-14T11:56:14.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.840+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.630__shadow_.uw2unsZmMcpShI4_sDyzfSL5Lp_f7js_0 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9405527389010449936', time=2024-09-14T13:52:19.167108+0000, chain.objs.size()=1 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.635__shadow_.G7uXLII3OuHOwAgaUwt3NG1OEQNMiX7_0 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16243967704097339134', time=2024-09-14T13:53:07.583503+0000, chain.objs.size()=1 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.716__shadow:2XNSs.IYQ5P2JS48mR6Oe9HihxBb18i_.B6cFBA59wBNZbveNG8cQVvpxg5IC9VB_0 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5443735414740850659', time=2024-09-14T13:53:29.485162+0000, chain.objs.size()=1 2024-09-14T11:56:14.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.842+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.740__shadow_.sahSGOGXu2mnlQob79goKrnPePPSXBZ_0 2024-09-14T11:56:14.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.845+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.847+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:56:14.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.849+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.849+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46887' 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_NZ_XemhyJJMSaG1eWm9zyzUOuCbVKy5', time=2024-09-14T13:43:20.450418+0000, chain.objs.size()=2 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.fMR8J7IGSKeEdYfTie86d96Wg3HGoCN_0 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.fMR8J7IGSKeEdYfTie86d96Wg3HGoCN_1 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14886675654695561951', time=2024-09-14T13:45:07.203669+0000, chain.objs.size()=1 2024-09-14T11:56:14.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.234__shadow_.tQdY_XofgIJZoDSYlAAuK-WjaTFp3UG_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.829256599891606860', time=2024-09-14T13:45:10.378944+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239__shadow_.FsOi2C79RvqWy5OUzb2TPq16fbdI4TO_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.572856481227605475', time=2024-09-14T13:45:13.096865+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244__shadow_.M1HP8krU5pcmxAJk1qGsQU-881HpxpW_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16355090048472116521', time=2024-09-14T13:45:13.934445+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.245__shadow_.jlhWlokwvfys8N3CFZsLNIvkM6LcwJq_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9187757560772604166', time=2024-09-14T13:45:18.326917+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.254__shadow_.HeYiK6YiPAj03lWmsqu_TwwcnwUwGU2_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1327425946697402642', time=2024-09-14T13:45:30.247423+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ss6MLD_J2lSpHHe__MKJK-g2720CbDg_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17725218249252361936', time=2024-09-14T13:45:30.260300+0000, chain.objs.size()=1 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YtRnr1WCZLmikAOxYmQX9gDLPdMSa4l_0 2024-09-14T11:56:14.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14418419299119031512', time=2024-09-14T13:45:30.278330+0000, chain.objs.size()=1 2024-09-14T11:56:14.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UhuqNpTHFLZ0v4CFlQvM_AClrlYiG-B_0 2024-09-14T11:56:14.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7658674887614791926', time=2024-09-14T13:45:30.301224+0000, chain.objs.size()=1 2024-09-14T11:56:14.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FB0E2jcvqOqL7otDwMyeQE0mr4VdE2X_0 2024-09-14T11:56:14.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1084573613817050947', time=2024-09-14T13:45:30.303459+0000, chain.objs.size()=1 2024-09-14T11:56:14.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.850+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.thAhLm2LPOExycZqKctuE7hk5_sYLKq_0 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8804276276683950455', time=2024-09-14T13:45:30.319692+0000, chain.objs.size()=1 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cNd2mkNVYKGBugk7Ik_5LzNJJglMjlZ_0 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5634113391511398903', time=2024-09-14T13:45:30.407631+0000, chain.objs.size()=1 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.A3b_sDEkTDefShFG5a5ltsTAMfQq799_0 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7281388571098309255', time=2024-09-14T13:45:30.444840+0000, chain.objs.size()=1 2024-09-14T11:56:14.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-RRDWh2edJPd6lFyc4QJ2axcYNewqq9_0 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1975640078560792065', time=2024-09-14T13:45:30.462724+0000, chain.objs.size()=1 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FFR23iMqj_aiNEhHNc2huAkexizU6jA_0 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8423801297807157193', time=2024-09-14T13:45:30.501456+0000, chain.objs.size()=1 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e4RQEgC8R9ZDd7yVVbsI9fKCM9fY8Iv_0 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6227770959415606633', time=2024-09-14T13:45:30.590849+0000, chain.objs.size()=1 2024-09-14T11:56:14.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.853+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.AaVXN2SGO1p2ZeKlyzAo-qdogBb8Qiq_0 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2743451461324684520', time=2024-09-14T13:45:30.625082+0000, chain.objs.size()=1 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Q6kYFJWUDnRle-hjqb56CUg9XP6wlyO_0 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3560989213521044053', time=2024-09-14T13:45:30.650209+0000, chain.objs.size()=1 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HbS0opXjnZcoI6rJyefHMYjBPuZqjPb_0 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17456465811061970025', time=2024-09-14T13:45:30.655901+0000, chain.objs.size()=1 2024-09-14T11:56:14.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uLzY6lOpcc2n2gaN6kQYLcKCX_BF_Ft_0 2024-09-14T11:56:14.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9088735017788433588', time=2024-09-14T13:45:30.656649+0000, chain.objs.size()=1 2024-09-14T11:56:14.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lNn5ooSypoSX01A-ln8ja7nt_EyX8cG_0 2024-09-14T11:56:14.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13297603634424741602', time=2024-09-14T13:45:30.698768+0000, chain.objs.size()=1 2024-09-14T11:56:14.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.855+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nO8yP0zD-mbgnf67Z0iorSSB1W0oaEE_0 2024-09-14T11:56:14.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7734237046866215517', time=2024-09-14T13:45:30.775984+0000, chain.objs.size()=1 2024-09-14T11:56:14.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.djY138I8a_54hA9kPFuVQ6xVAPFVeWW_0 2024-09-14T11:56:14.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.858+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15363631966255324235', time=2024-09-14T13:45:30.851800+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.858+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dpa1wSAN3SyZSX_Y3kmQ09Svpn7KyTr_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10366559558104746029', time=2024-09-14T13:45:30.960253+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._rWI7C0zgLNDShYC1vbxy6GhPyIjAAD_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13555220928428064722', time=2024-09-14T13:45:30.992647+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.s168Cx1yTlZ-6if0IZwtRbSWdwAEgBp_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13566752576361289974', time=2024-09-14T13:45:30.997950+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.X5YYVR2X0Zkxaj6HJiy5X4AnmIwjn1h_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17405853840360141218', time=2024-09-14T13:45:31.064272+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QgjNUZBZoAKSFfwxchs9DxK3CqmEeaP_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14697892336598996488', time=2024-09-14T13:45:31.069674+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1F-8pxAk6eOGEm_eM5lZrZXoKNk6p11_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2879077322744800891', time=2024-09-14T13:45:31.192705+0000, chain.objs.size()=1 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.F_ghwnCv9A3v0oGU90HUn8Gj7xigacU_0 2024-09-14T11:56:14.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1311843133649360732', time=2024-09-14T13:45:31.209350+0000, chain.objs.size()=1 2024-09-14T11:56:14.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.859+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.IW9C8v5ZiUxdyNWnfuEBQgEqQJDi-C2_0 2024-09-14T11:56:14.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7811348350667021007', time=2024-09-14T13:45:31.210323+0000, chain.objs.size()=1 2024-09-14T11:56:14.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.U5ibjQLrKyaho7kCYhAAFY9Qco4Zjip_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4802376606838963388', time=2024-09-14T13:45:31.424939+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.h6r7ZaIH58GUa08tvbSPyFnL4A7L9Ci_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4814131401544276676', time=2024-09-14T13:45:31.506822+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iW3eMXwHO83-13lZOjAOIEvu7KDMpjK_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9031858485467253370', time=2024-09-14T13:45:31.563775+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.861+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iPB03RoqbuMpcovJkLfrIQ893RdLL9X_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4550104870963567181', time=2024-09-14T13:45:31.695226+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.d5AUffDn2HyhhD4YZgzFOc_aoTKNOM8_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2590078497244850237', time=2024-09-14T13:45:31.767143+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Bt2DSkKmMt0dVexp8Td3ja86JIOO9DZ_0 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7194609351255037188', time=2024-09-14T13:45:31.771903+0000, chain.objs.size()=1 2024-09-14T11:56:14.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.z1UjHAI4veQp3MqrW924yCQ2UJP3d3w_0 2024-09-14T11:56:14.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12249534053655192899', time=2024-09-14T13:45:43.871217+0000, chain.objs.size()=1 2024-09-14T11:56:14.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.287__shadow_.r0bNQCDd7epLxZsaxboL_b6Euwobd-Y_0 2024-09-14T11:56:14.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5246216384778510901', time=2024-09-14T13:45:47.350970+0000, chain.objs.size()=1 2024-09-14T11:56:14.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.862+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.jej7V_osWgp7ff9BejBaJ2N23bp_ejG_0 2024-09-14T11:56:14.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.863+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17969695030932980428', time=2024-09-14T13:45:47.360330+0000, chain.objs.size()=1 2024-09-14T11:56:14.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.863+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.udges5BB_iSS3uQQ8eheY8R3ksEiZVC_0 2024-09-14T11:56:14.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.863+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9661749052534290668', time=2024-09-14T13:45:49.170488+0000, chain.objs.size()=1 2024-09-14T11:56:14.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.863+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.296__shadow_.VEl1q7VaP3yramEW0Ed95YGm_wSgwA1_0 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14430170460253561518', time=2024-09-14T13:46:10.923255+0000, chain.objs.size()=1 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LxZcr0jk7upxKjXWI-D9ObXriw8asiF_0 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13057593385249075381', time=2024-09-14T13:46:10.942842+0000, chain.objs.size()=1 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.G06Kz2ksNtXAQX5etDMCuj7kXAeTZhM_0 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6998312674255611348', time=2024-09-14T13:46:10.965169+0000, chain.objs.size()=1 2024-09-14T11:56:14.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JHJpSTZJmYmzDRnJsE30bDWwAdOXzZC_0 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1246388498815669601', time=2024-09-14T13:46:11.036024+0000, chain.objs.size()=1 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.865+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HFl0LH0CzaVY9-24z66hz4vGC9WQqlm_0 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.866+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11456275189956771744', time=2024-09-14T13:46:11.117119+0000, chain.objs.size()=1 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.866+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mWqPyqH9Oo1MbJU3hUN_Yo16-0X1-gU_0 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.866+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1172924857679531175', time=2024-09-14T13:46:11.160526+0000, chain.objs.size()=1 2024-09-14T11:56:14.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.866+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ztXTa-LBbQRc7uuiqvCltLeO6xaw4ik_0 2024-09-14T11:56:14.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.867+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17688949790562069239', time=2024-09-14T13:46:11.161760+0000, chain.objs.size()=1 2024-09-14T11:56:14.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.867+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.veVAEZrMmtFbJYzLnhi5WaGD_AODQG__0 2024-09-14T11:56:14.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3134647327256145161', time=2024-09-14T13:46:11.199658+0000, chain.objs.size()=1 2024-09-14T11:56:14.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RnCBQIbwZvd5OzW9OE2FLnSjDinE4u8_0 2024-09-14T11:56:14.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8784222679080059334', time=2024-09-14T13:46:11.221964+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vmx1dbQW_g0kV9adiSz_bDhuzRqpgt0_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11491508957158753187', time=2024-09-14T13:46:11.363172+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.X7IQ4klKZUDd81wfzFEO0sB6ILu7CVJ_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2114210360672197978', time=2024-09-14T13:46:11.372110+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oB2AnlST1QNaSxMVK4ZDqybWWm-e26D_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1229598895740496664', time=2024-09-14T13:46:11.572879+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cy8yKIfm6_SkUR3ffmPocZPUNzgfqIu_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11360916963503298051', time=2024-09-14T13:46:11.648520+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3kn39Iy5TrLHV66WOdlMpBd1IUtzLuz_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2285480651510938882', time=2024-09-14T13:46:11.651165+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.chaaGLhxBTTlNfoMpU42_jvRAiLppLp_0 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.338957887344036159', time=2024-09-14T13:46:11.651912+0000, chain.objs.size()=1 2024-09-14T11:56:14.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.868+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o-IOH2WcbK_nGjsHwxb-DqKxG_LHZs6_0 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.869+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7118334333523190735', time=2024-09-14T13:46:11.652848+0000, chain.objs.size()=1 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.869+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mq7hwDkVc29fZ-6fWiMr2Ly8gPFdET-_0 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.869+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14562023743202660721', time=2024-09-14T13:46:11.685868+0000, chain.objs.size()=1 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.869+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TErCcRQQPY2BCBfQj9EYwI4ovK-alqb_0 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.870+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9713181336196725904', time=2024-09-14T13:46:11.855016+0000, chain.objs.size()=1 2024-09-14T11:56:14.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.870+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6DHzYx54sBezA3GlAc_1vokCddnYq1L_0 2024-09-14T11:56:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.871+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12636368930286464860', time=2024-09-14T13:46:11.896027+0000, chain.objs.size()=1 2024-09-14T11:56:14.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.871+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ip5gXVuxaUAYiot7nu7PKmB41AFo0BK_0 2024-09-14T11:56:14.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.873+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1409555501639591957', time=2024-09-14T13:46:11.923410+0000, chain.objs.size()=1 2024-09-14T11:56:14.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.873+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EJ8a5sMr_ebMmm6axDy2dFqQZ0vY1Gs_0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17486778235228026527', time=2024-09-14T13:46:12.065036+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LjiLOyhDNpCkYTxpkWjh9Jp0V4REHre_0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8798310967105240947', time=2024-09-14T13:46:12.096897+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TwRqJaZLyQbRPC5ACuIJupL7iNlYz___0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4434264049330674757', time=2024-09-14T13:46:12.121651+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4NFaA7znLImfUr6YEp2-Vxe4EnKWLSD_0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9653749836686425406', time=2024-09-14T13:46:12.466625+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qvK-4dj9nYHE2F2--pK4i9GijdrU5MA_0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4055606751344909232', time=2024-09-14T13:46:12.498110+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.N2bpWCGf7abQW52E9LP8c-BGODfu1hp_0 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13223642829753696440', time=2024-09-14T13:46:12.522117+0000, chain.objs.size()=1 2024-09-14T11:56:14.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ICuPNd-ax2ptgkO_dLBwqQbyt_zxevG_0 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12670911487960090134', time=2024-09-14T13:46:12.522963+0000, chain.objs.size()=1 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jAT2hYyMNQcPaN6RqWihUCL1IAH6VU1_0 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5985057891939648794', time=2024-09-14T13:46:12.621156+0000, chain.objs.size()=1 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.874+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aJe2yadMiC3rHbAAPj13WembPx5_UOT_0 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.875+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6020980059739377076', time=2024-09-14T13:46:12.625926+0000, chain.objs.size()=1 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.875+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.p1gn00DSoBxA5NK9PUwCv4aprx2szkn_0 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.875+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2986551050964710082', time=2024-09-14T13:46:12.647812+0000, chain.objs.size()=1 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.875+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XzghkgKv5gBP6we-DolcDdmRUK64xyf_0 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.876+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1411988535900457738', time=2024-09-14T13:46:12.649861+0000, chain.objs.size()=1 2024-09-14T11:56:14.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.876+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pj1u00-5bZhbs8kTag5_HdIzqV-FAo3_0 2024-09-14T11:56:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12248997930167067837', time=2024-09-14T13:46:20.709531+0000, chain.objs.size()=1 2024-09-14T11:56:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.d_my_hnvo9fVa0kWjsC_K3YxJt6BCuT_0 2024-09-14T11:56:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17978588704342075591', time=2024-09-14T13:46:20.742023+0000, chain.objs.size()=1 2024-09-14T11:56:14.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WJ-BheEONQOwvOf_2p0sqc_6GuR-_Hx_0 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10551759264885155606', time=2024-09-14T13:46:20.746300+0000, chain.objs.size()=1 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.878+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EyIGa1qxcP-wgZZKcHy-80uPH26XiTg_0 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.879+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4436157472562696610', time=2024-09-14T13:46:20.792467+0000, chain.objs.size()=1 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.879+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cAc2Tl2W53HPgzSqC6Di9oB3FaN-gMj_0 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.879+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.302291692242310173', time=2024-09-14T13:46:20.815012+0000, chain.objs.size()=1 2024-09-14T11:56:14.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.879+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.n3jFvopDaJ6rVoVKVwy_AiDv0Qt7y0J_0 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6168426674193720177', time=2024-09-14T13:46:20.823579+0000, chain.objs.size()=1 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xavzIqcn-8mtSd2LoWynt9PLhOjUrcU_0 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2121157445180556367', time=2024-09-14T13:46:20.977200+0000, chain.objs.size()=1 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.PVzYdMV14qjOJiHmGYHAuPBzWoJRYL1_0 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16179672547708282181', time=2024-09-14T13:46:21.103612+0000, chain.objs.size()=1 2024-09-14T11:56:14.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.okvJku58IlzQCUOcsGHrt-WL_9Ch-JR_0 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13460886421883087906', time=2024-09-14T13:46:21.117828+0000, chain.objs.size()=1 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iHjp9FTLUTiiNjuWySBRINRZDVT9Z-x_0 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2032936148717987622', time=2024-09-14T13:46:21.121542+0000, chain.objs.size()=1 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3166lusgjyyIZp-ajpMn5cttVIKqM9v_0 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14933449803715110997', time=2024-09-14T13:46:21.135400+0000, chain.objs.size()=1 2024-09-14T11:56:14.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.880+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pL40gESKbXU9N5oB1yvz_9tz7zOzatJ_0 2024-09-14T11:56:14.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.882+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9236639943199504556', time=2024-09-14T13:46:21.170700+0000, chain.objs.size()=1 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.T_-jOvS7SYXraLID7rBecIq1YoKGwS8_0 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13691091186137251564', time=2024-09-14T13:46:21.174535+0000, chain.objs.size()=1 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7C39CVUb4vLzV_k7eupOG2HtiNBKqeH_0 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15633256184402162367', time=2024-09-14T13:46:21.191517+0000, chain.objs.size()=1 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.V9TpYYeuR955gD-tv-GMN7k1HG61Q1u_0 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2537486756612768547', time=2024-09-14T13:46:21.287357+0000, chain.objs.size()=1 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-HsbLS60G7iI26rZzYWGQs3PO4y7Di9_0 2024-09-14T11:56:14.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5251117874172747857', time=2024-09-14T13:46:21.299177+0000, chain.objs.size()=1 2024-09-14T11:56:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ROfnw0pPwaR7mbJ-BM8Qae-dITiwVVD_0 2024-09-14T11:56:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7608637452741690992', time=2024-09-14T13:46:21.309609+0000, chain.objs.size()=1 2024-09-14T11:56:14.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.883+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nplXT98jD_iLydVZ31avTsFIn-8fXcc_0 2024-09-14T11:56:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1366094069639038759', time=2024-09-14T13:46:21.323479+0000, chain.objs.size()=1 2024-09-14T11:56:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-YEg1RUa2Dxeuk2L6-W1c8OO1X5wVPX_0 2024-09-14T11:56:14.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15085815368889874397', time=2024-09-14T13:46:21.329619+0000, chain.objs.size()=1 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xdAfJkxVd5zPH9NYUoUH6ycSFME3XuZ_0 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2559452428490115826', time=2024-09-14T13:46:21.336599+0000, chain.objs.size()=1 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HOvSgFwIJ00qieuByJHCnHgfLMo0d5q_0 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17405133414088121984', time=2024-09-14T13:46:21.378548+0000, chain.objs.size()=1 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.P6RD8V1Vg6bUfhfh79mzwHeAiGSZlc0_0 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18163423829970562552', time=2024-09-14T13:46:21.470085+0000, chain.objs.size()=1 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cVaJGlSXph0i2hL0cULd7TDfzYCP4Th_0 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7039140478272951329', time=2024-09-14T13:46:21.474234+0000, chain.objs.size()=1 2024-09-14T11:56:14.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.885+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xIFVZB8-EAbSi387yXblYLneVIMHchY_0 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16763225812445453757', time=2024-09-14T13:46:21.482909+0000, chain.objs.size()=1 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Na7Lim9RYp5qL8Ld8Bin0SY7pwdpQVp_0 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18164103335621433065', time=2024-09-14T13:46:21.486256+0000, chain.objs.size()=1 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.s3D06kWMGDJCKZ5hqYXj7thujRwTLWD_0 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8294223392520667229', time=2024-09-14T13:46:21.762628+0000, chain.objs.size()=1 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5pyx-hVA0VebX4ulJVx5TP-Zngv_-___0 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18004666663492132814', time=2024-09-14T13:46:21.856703+0000, chain.objs.size()=1 2024-09-14T11:56:14.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.887+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.34mqOXaybjYWQLbx4bd1C5uD8jeAbJs_0 2024-09-14T11:56:14.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.891+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46887 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18195729029329598499', time=2024-09-14T13:46:22.044936+0000, chain.objs.size()=1 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ibkt8zw2wT6KybPkfyJexZ22FNbMCIB_0 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7717856499677363632', time=2024-09-14T13:46:22.056398+0000, chain.objs.size()=1 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Qs_WhyXVlfuKnJ6VgKFIIggDjyKC7A4_0 2024-09-14T11:56:14.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4150350925813819399', time=2024-09-14T13:46:22.067407+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JUD8CpOMhXQJzHSvROth3cyMyp5orw1_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14961269435125162475', time=2024-09-14T13:46:22.074629+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IhjOW-e9i7NodVP0vZllF9oxWdxiQ5f_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5383431362173940860', time=2024-09-14T13:46:22.111129+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EvHzOmx_AjDTutmUISbcOCtg0A80Kqv_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3144114071898659251', time=2024-09-14T13:46:22.321954+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1bTtQfRwSCiXruLYgsQeXUTmHNXtLV4_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16291017650157565611', time=2024-09-14T13:46:26.920524+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.335__shadow_.z9INhkxpuvpvezNwdgWEhJews16EKGK_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16781129373398175437', time=2024-09-14T13:47:22.228616+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.445__shadow_.oHEwvn1-J6UvSLOF4yYjPc1zcP8JxOn_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10779609391529973895', time=2024-09-14T13:47:33.691825+0000, chain.objs.size()=1 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.463__shadow_.5TqcqKCK8XyYSPXMq4WRfSx3WA-ndG3_0 2024-09-14T11:56:14.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2386334520604015559', time=2024-09-14T13:47:36.057588+0000, chain.objs.size()=1 2024-09-14T11:56:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.467__shadow_.CFBU1A0SJu7oQs4KS4W5o4H3aA7q2zc_0 2024-09-14T11:56:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4451231192710815369', time=2024-09-14T13:47:42.116717+0000, chain.objs.size()=1 2024-09-14T11:56:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_._egHSFm4j-IY4UMuHmAktq1-M4TgQBM_0 2024-09-14T11:56:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4326515000815171895', time=2024-09-14T13:47:48.082789+0000, chain.objs.size()=1 2024-09-14T11:56:14.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.894+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.497__shadow_.JyTD-UZW8BZOr0i0JHRjx9QsJKC_FRr_0 2024-09-14T11:56:14.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.897+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6352372541359557144', time=2024-09-14T13:47:49.691722+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.501__shadow_.QY1Ps_fZZAdmtKPHPSdewt4af2sP6xN_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4165205938073286473', time=2024-09-14T13:47:59.256370+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.518__shadow_.gaoHR-aMw1mxL_snEkIktY0tj6JNjhR_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5593179442989151685', time=2024-09-14T13:49:18.524744+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.571__shadow:JapfG59g8OTnL6N9F0GfD7mzswL59-G_.pdQicFKvKnrDX7pJnV-KcmK8GSHFwNC_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3880883475200067073', time=2024-09-14T13:49:22.266953+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:-G9n3C59Yx9LQaYR0urfabTVnxESRcI_.CaOA8HXg9YJ3q_EHtJpESZSxadiz3Wm_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8695550259344812526', time=2024-09-14T13:49:36.282527+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:pA-eQXUMjqt3RItiavvZOBkjpwHm6Dv_.FE0yR0rvWgp50vpB_logB9XbDAQb5HS_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18407871998355145272', time=2024-09-14T13:49:40.801498+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:SEEMmuOJW9-njRTVTHT2bRBcOkS.ucv_.DwnG9aXt-tYeZCNtFyWG6cz7J65KexP_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16229569312711709803', time=2024-09-14T13:49:44.414086+0000, chain.objs.size()=1 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:Nvs5ixZMWmlc5idgXkiilmTaHHcvpFE_.mzzucLrUMJj8RADyp5UQbLmn2XPJfe8_0 2024-09-14T11:56:14.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6348621704183126148', time=2024-09-14T13:52:10.703072+0000, chain.objs.size()=1 2024-09-14T11:56:14.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.898+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.621__shadow_.JsgdXwRgEGEwqzu_V_0J61ELYOGaEkt_0 2024-09-14T11:56:14.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4491218883813372261', time=2024-09-14T13:52:37.073967+0000, chain.objs.size()=1 2024-09-14T11:56:14.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.669__shadow_.4hVcverr7Q_gnNoIvaKsSjmxV9ItJau_0 2024-09-14T11:56:14.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.332456647552242359', time=2024-09-14T13:52:50.541856+0000, chain.objs.size()=1 2024-09-14T11:56:14.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.701__shadow:PWi4H3BgtizXf5Zu4kpjE.MiDDoSHV._.PyKtbKojGw1iBZqURthdCEo4t0mBQt9_0 2024-09-14T11:56:14.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6014033258701061677', time=2024-09-14T13:52:56.610507+0000, chain.objs.size()=1 2024-09-14T11:56:14.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.714__shadow:-com1EW3Hf.NNYFoAbovgt1VCMLkgYx_.LLFBpvMo9uPTVcUl4jSc2FQ-_4oO84N_0 2024-09-14T11:56:14.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6273753705125664342', time=2024-09-14T13:54:09.869853+0000, chain.objs.size()=1 2024-09-14T11:56:14.898 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.900+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.779__shadow_.sIUFeqi5teHxfn_uPCXbXXFkzkOe5D4_0 2024-09-14T11:56:14.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.903+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.905+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:56:14.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.906+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.907+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46942' 2024-09-14T11:56:14.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_eSZRAC1X8QaCiupWjI6VlB96jNYvxWH', time=2024-09-14T13:43:20.895924+0000, chain.objs.size()=2 2024-09-14T11:56:14.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.YZdRY1EuA36tyuPTEOHWTBFwtZtOsBt_0 2024-09-14T11:56:14.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.YZdRY1EuA36tyuPTEOHWTBFwtZtOsBt_1 2024-09-14T11:56:14.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17898590165639560302', time=2024-09-14T13:45:11.755708+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.242__shadow_.qwcxe4tr5-dMJSMkqyi59sfHxJrb2IX_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16645990850698393327', time=2024-09-14T13:45:12.225397+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.243__shadow_.ep3-ZbPQh1wVQw0S69vy_iGtgnj_J8y_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16537758663973442272', time=2024-09-14T13:45:16.882802+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.251__shadow_.mEhGF7gQ2ew-2Olt1uG2vU3oghYi2F3_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8301348738894145501', time=2024-09-14T13:45:30.246313+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lyR2Nwa-jZ-GrpgQEkHXAfUH9TDO-C5_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13136137640939735946', time=2024-09-14T13:45:30.262056+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.c-Ss5dGCr0raviVZnQYIq3box_mamcB_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.257722265972983019', time=2024-09-14T13:45:30.266034+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HeDgNWPdxb5MONOtSh_8FER_LDqf617_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.31170857407187328', time=2024-09-14T13:45:30.304308+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.k4MAfX9MmY7DyvWqjNpJEYa0hZkPbNa_0 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1314080558536480908', time=2024-09-14T13:45:30.321195+0000, chain.objs.size()=1 2024-09-14T11:56:14.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RUSsEMSmC56OwZPDLkd1yeb2DyABu7F_0 2024-09-14T11:56:14.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.939672169654744734', time=2024-09-14T13:45:30.408331+0000, chain.objs.size()=1 2024-09-14T11:56:14.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.pJgpyrRftmbsd9xlaAV9UL9_Rsv5wXu_0 2024-09-14T11:56:14.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1386553774611128963', time=2024-09-14T13:45:30.493737+0000, chain.objs.size()=1 2024-09-14T11:56:14.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.908+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UpqGnzrl6eST40B3xrqGObYJ5jD75mF_0 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2299910892475769850', time=2024-09-14T13:45:30.659377+0000, chain.objs.size()=1 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.A3VM159zYcIqFRwllO3Qi4ro92OzCK0_0 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1515804652086101116', time=2024-09-14T13:45:30.685847+0000, chain.objs.size()=1 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.prRrrrUZaS7chbhsOBFPdIyXxMN5NHm_0 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18251335907842870215', time=2024-09-14T13:45:30.689140+0000, chain.objs.size()=1 2024-09-14T11:56:14.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hNMt56hqZdhI4DmrMHaZiM2UZdAurqv_0 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14936945597295225548', time=2024-09-14T13:45:30.693170+0000, chain.objs.size()=1 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wUa-QUyA3UlwvRzi93j78bWmYoLRpaD_0 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5550988865249277022', time=2024-09-14T13:45:30.805601+0000, chain.objs.size()=1 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.911+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jKzNbtVvZSEJrAkQPUytEei5OKIpvgU_0 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11321486679765839098', time=2024-09-14T13:45:30.828883+0000, chain.objs.size()=1 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.xdZDvqm1_y71EX1fLF0e7algFAXnDX6_0 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6502323716872387709', time=2024-09-14T13:45:30.855428+0000, chain.objs.size()=1 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KhbXY8z7LSVdfJYjrP4CqZC_R0jgPQ2_0 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2710614096320858390', time=2024-09-14T13:45:30.990168+0000, chain.objs.size()=1 2024-09-14T11:56:14.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hPU4fhrGIlfHomFjt9LMcM34XaLJXEF_0 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6385668919552742465', time=2024-09-14T13:45:31.012830+0000, chain.objs.size()=1 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2sQJ_aHXHMFtxHA2ssu6CEaRtZCHCX5_0 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9930163684608391161', time=2024-09-14T13:45:31.017428+0000, chain.objs.size()=1 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JbBXlLqqgUqC2Ugjg1SjbK3Fpgf3fDa_0 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16231059581388672254', time=2024-09-14T13:45:31.149137+0000, chain.objs.size()=1 2024-09-14T11:56:14.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.912+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZpQEF5fQDrMCBtGfb0Uj8_wDzkiaA7N_0 2024-09-14T11:56:14.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.914+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15696014065476841152', time=2024-09-14T13:45:31.242187+0000, chain.objs.size()=1 2024-09-14T11:56:14.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.914+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.m50PHKiyDohWqBgRAWwmxPOxmBt1H5K_0 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14990809343248211775', time=2024-09-14T13:45:31.253576+0000, chain.objs.size()=1 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1gJ9FlwdwsVFsP-coM5vMweEPIsEozt_0 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16516837343041460647', time=2024-09-14T13:45:31.427883+0000, chain.objs.size()=1 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UVBNHTmfYJ7aDDAyAJtphCLeN9o3JmQ_0 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15247571957841179107', time=2024-09-14T13:45:31.566131+0000, chain.objs.size()=1 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QmX89I4y4tBq1V4EpK8AcSjy9cGxZFe_0 2024-09-14T11:56:14.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4937895486229012658', time=2024-09-14T13:45:31.587672+0000, chain.objs.size()=1 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.915+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lyVwn2R8GADcrN7hOUuQUYJtqQY4bD9_0 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13600816853471491741', time=2024-09-14T13:45:31.603499+0000, chain.objs.size()=1 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zaM62CKwRfqXNV9XBFB2cuu0umN1XLS_0 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1180459079549292447', time=2024-09-14T13:45:31.610060+0000, chain.objs.size()=1 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5bloip2I-_MlUnK9CanjqTaU0jypqps_0 2024-09-14T11:56:14.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1000009691016214538', time=2024-09-14T13:45:31.611423+0000, chain.objs.size()=1 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.916+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7OzF86ZvvLKLcE8bp21oZFy2QLuqp4M_0 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16479461341057472318', time=2024-09-14T13:45:31.712698+0000, chain.objs.size()=1 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4FG6elbf1LX-skfCixyM-AEf1xdZ4GU_0 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1149680611277393632', time=2024-09-14T13:45:31.743245+0000, chain.objs.size()=1 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WcFe48pCx1hvvKe_H2k81QmMe0Jzfw8_0 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17766506533201853701', time=2024-09-14T13:45:31.758752+0000, chain.objs.size()=1 2024-09-14T11:56:14.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.917+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EEl-Lv-ezAt13aL2CZiqkTWQV-ZuNbV_0 2024-09-14T11:56:14.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.918+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17239496697695596607', time=2024-09-14T13:45:47.347985+0000, chain.objs.size()=1 2024-09-14T11:56:14.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.918+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.WXq1JTqzKI4qxft7O_2DGg3PsQrVkZD_0 2024-09-14T11:56:14.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.918+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9538970378497487302', time=2024-09-14T13:45:47.359412+0000, chain.objs.size()=1 2024-09-14T11:56:14.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.918+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.uOe4WJs_VPYNUPyGnl8xtOgRjpD8E4N_0 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9947425329758171640', time=2024-09-14T13:45:50.122707+0000, chain.objs.size()=1 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.298__shadow_.L-xjvrLqK2m3LbCF7sRLd5L58V5SwWV_0 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7239152565133835024', time=2024-09-14T13:46:10.927362+0000, chain.objs.size()=1 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KLSyB9GS3euIYfJwxb-RyfOhe816N0O_0 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17508405937779064766', time=2024-09-14T13:46:11.003282+0000, chain.objs.size()=1 2024-09-14T11:56:14.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.919+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Ne4HKsYWwOP56f1rBUofe6G8IcRMkKS_0 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16556109791938108653', time=2024-09-14T13:46:11.159519+0000, chain.objs.size()=1 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QTDglppuqkPnFxJi8bphfdTr7qma1yI_0 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3383094942502118134', time=2024-09-14T13:46:11.172476+0000, chain.objs.size()=1 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HjloSXTz8VX6oFhjCRg_ObgwYnrbyXb_0 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17802533587071223762', time=2024-09-14T13:46:11.210383+0000, chain.objs.size()=1 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZKcNyboxpkmOyH4AkmuSNymVLAurhOB_0 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3175751226816725540', time=2024-09-14T13:46:11.220255+0000, chain.objs.size()=1 2024-09-14T11:56:14.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5-D5t_ogU4Ke4dGIH8n1Kf3UiTdZskM_0 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5750074217617105420', time=2024-09-14T13:46:11.308953+0000, chain.objs.size()=1 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bD_OhSAB6XmGGn2q66KR2vpAovN4jhc_0 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4916675132301435336', time=2024-09-14T13:46:11.392012+0000, chain.objs.size()=1 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.921+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MovHr7xjASDyB-wRpAcHCBDc3FKBD27_0 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.922+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13842273757737420437', time=2024-09-14T13:46:11.400526+0000, chain.objs.size()=1 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.922+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z74XhJ8Dk2a_QB4ByeAlsDAtenfp5Hy_0 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.922+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4908812372927354600', time=2024-09-14T13:46:11.406201+0000, chain.objs.size()=1 2024-09-14T11:56:14.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.922+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cTs16JD-0hauJPGfzSXqCU-eEVo-k60_0 2024-09-14T11:56:14.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16220717498381444516', time=2024-09-14T13:46:11.709082+0000, chain.objs.size()=1 2024-09-14T11:56:14.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.n-OEng-3Z_jMOx5nQeRrhxVljNTyN0w_0 2024-09-14T11:56:14.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7710672762766568290', time=2024-09-14T13:46:11.712780+0000, chain.objs.size()=1 2024-09-14T11:56:14.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Ed1extHGgwj3qFYwKA0j1qBs1jVzlnb_0 2024-09-14T11:56:14.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10226438821468681887', time=2024-09-14T13:46:11.713556+0000, chain.objs.size()=1 2024-09-14T11:56:14.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.923+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2PJ087CUc27HvEtSkib5cWHs_-10_ha_0 2024-09-14T11:56:14.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.925+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9129994082846761835', time=2024-09-14T13:46:11.728018+0000, chain.objs.size()=1 2024-09-14T11:56:14.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.925+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JYqlcryEFXOFZp8Zf_795VA7mcnmY5D_0 2024-09-14T11:56:14.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.925+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4835416552003039173', time=2024-09-14T13:46:11.730299+0000, chain.objs.size()=1 2024-09-14T11:56:14.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.925+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kMGqUQFk92-kTXtzqo_jbBUeCF56y11_0 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3605252154968220406', time=2024-09-14T13:46:11.842484+0000, chain.objs.size()=1 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iuYgm0xk4XdvFyj681YgSCv5VmM9Pk4_0 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13329831624699974034', time=2024-09-14T13:46:11.867580+0000, chain.objs.size()=1 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WMXIONp_u4Jmmz4tI_FvfZlNIpNxV-y_0 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14085367057348619162', time=2024-09-14T13:46:11.882078+0000, chain.objs.size()=1 2024-09-14T11:56:14.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.eZnTbNzMKQ_DMKlL3lCLrpt9LcdeaE__0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8080352147342952015', time=2024-09-14T13:46:11.903080+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4Q-mIsA8w7hnyQe43uggracK5WT4dbA_0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1424304375836653153', time=2024-09-14T13:46:11.936156+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gKSE6f2Bqf7IhTiLLLdSD6sorpW7zGt_0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11146731781676826514', time=2024-09-14T13:46:11.947804+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pUuXQM1kMMiDvplLV9wzq2Y-sYPCEJz_0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9014356689636798001', time=2024-09-14T13:46:12.042925+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.G_1pt9JcnATgkmIVOvDP9Ls0esCoaRA_0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7067876128148797634', time=2024-09-14T13:46:12.055716+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6O6lXlDl8ZzMyiwj9GkpgmLF28zPFMA_0 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.89747488527108980', time=2024-09-14T13:46:12.077313+0000, chain.objs.size()=1 2024-09-14T11:56:14.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.927+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0DG-4TcNZ9fNd6m8-AbpIxuaAPOZFVh_0 2024-09-14T11:56:14.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.929+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7193351871627196743', time=2024-09-14T13:46:12.078242+0000, chain.objs.size()=1 2024-09-14T11:56:14.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.929+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.FHx78rEpWgu3qdBSCxxPD5oNEVkWeUX_0 2024-09-14T11:56:14.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.930+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12901492464228629856', time=2024-09-14T13:46:12.084838+0000, chain.objs.size()=1 2024-09-14T11:56:14.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.930+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yMjQHb14U3cykI_Z83DtwI71qAejMcc_0 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4935997282660982427', time=2024-09-14T13:46:12.111890+0000, chain.objs.size()=1 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iOSJckfmmfTp6BzcUPwIF_zfFHjoCDh_0 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6057799397393407398', time=2024-09-14T13:46:12.115242+0000, chain.objs.size()=1 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yuw0BtZ4eLVkrCzwQm2kiy9mzrj7J6p_0 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15692844049862947154', time=2024-09-14T13:46:12.140012+0000, chain.objs.size()=1 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aar1_nnoeoZPKqUftCHeOTjROdtlXu6_0 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15344212757465303356', time=2024-09-14T13:46:12.141267+0000, chain.objs.size()=1 2024-09-14T11:56:14.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.u8UXZm6vMLi9YfoC1jjuFpJ4vKi7RqM_0 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6386647962861815130', time=2024-09-14T13:46:12.522329+0000, chain.objs.size()=1 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zFcYnuM9gIYtjJgEhDODqYIWeeZVLQT_0 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13628313749923447761', time=2024-09-14T13:46:12.599524+0000, chain.objs.size()=1 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7kNuS0GznQwm3jexweXUfI-ZfPvR6Ws_0 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17336141532473055237', time=2024-09-14T13:46:12.616520+0000, chain.objs.size()=1 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hFiukbd-42hqvzVRKFs68p_HpbiKe6O_0 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.230785972366815808', time=2024-09-14T13:46:12.629871+0000, chain.objs.size()=1 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hOTGVToOkHNvgNNYTqJHOfVHkSanAb7_0 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8529286290282422226', time=2024-09-14T13:46:12.649167+0000, chain.objs.size()=1 2024-09-14T11:56:14.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.931+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.B4ZGU0TofBxXVrF6uKGQ9bEXuKHJBRZ_0 2024-09-14T11:56:14.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.934+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2694471071272110117', time=2024-09-14T13:46:20.723871+0000, chain.objs.size()=1 2024-09-14T11:56:14.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.934+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.N38vCeAHhQhSLk6_Rv_XFH9B4Ekypro_0 2024-09-14T11:56:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16847695638218941065', time=2024-09-14T13:46:20.742705+0000, chain.objs.size()=1 2024-09-14T11:56:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wJXoTXF8h079FkPjZZCGK6FNjjCvyKf_0 2024-09-14T11:56:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13278919068359722011', time=2024-09-14T13:46:20.782132+0000, chain.objs.size()=1 2024-09-14T11:56:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.I_t-M4NZNbktKuoSF6mfNQ1hDkL7v_j_0 2024-09-14T11:56:14.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14895055188578686219', time=2024-09-14T13:46:20.788779+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.N-cCu6zXymky3XF2pJCBxXk3MW7Nh_K_0 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.228946097058589510', time=2024-09-14T13:46:20.821804+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Dw_kBTpe3oTUvIaaJKKlrnEERgu1Tzo_0 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15656319656363650017', time=2024-09-14T13:46:20.907983+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sTQjUHIryKEWQXFh5OanoryS4rVoMJe_0 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11293802070299269542', time=2024-09-14T13:46:20.945594+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pWDn9vXh4SQcGZrBLDmC5XEjeEXWcsE_0 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16750112672163523067', time=2024-09-14T13:46:20.954588+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YX_ByqD6diMcPpmufCOOSbHNtEHPWs-_0 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.814295791022305935', time=2024-09-14T13:46:20.986951+0000, chain.objs.size()=1 2024-09-14T11:56:14.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TV3G0lxR11eEMjn-OCovWyuq3l4jOhk_0 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9278225290886676617', time=2024-09-14T13:46:21.100973+0000, chain.objs.size()=1 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5amF03SDeHzUY0gwV1nJQwZGFjlNhiQ_0 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1536459571291870379', time=2024-09-14T13:46:21.124799+0000, chain.objs.size()=1 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.935+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Hlk_EjArqnKhyIry74IHajNo-c1UZgD_0 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.937+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17794743935055064505', time=2024-09-14T13:46:21.131605+0000, chain.objs.size()=1 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.937+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zTkl5XHuNUW71pfRd1wBGYRIzeM2N9c_0 2024-09-14T11:56:14.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18293598358127922688', time=2024-09-14T13:46:21.183427+0000, chain.objs.size()=1 2024-09-14T11:56:14.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1xlUhtqmCIhNd8Nm4Xp7GBaTbK9Njdd_0 2024-09-14T11:56:14.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.938+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17007704743774025702', time=2024-09-14T13:46:21.186599+0000, chain.objs.size()=1 2024-09-14T11:56:14.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.938+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GWYnDplhbzHZ3EPodY2DUjWVGay5t1p_0 2024-09-14T11:56:14.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12641602678803306329', time=2024-09-14T13:46:21.316228+0000, chain.objs.size()=1 2024-09-14T11:56:14.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uBV-oMa2yvlHK-xnW_r2bFns2g2Hnq1_0 2024-09-14T11:56:14.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14267058779188825701', time=2024-09-14T13:46:21.331940+0000, chain.objs.size()=1 2024-09-14T11:56:14.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pQe_lvxmUAVhGAkYgZmZtpp00pHYHtu_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3297101740037201280', time=2024-09-14T13:46:21.350616+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Mvv_WCiNN1AgKliVLbZEo7bNTjcDABP_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12735190782910784423', time=2024-09-14T13:46:21.378361+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VRkWMZcu1N7m5WrdcA61cX72bxQwQeS_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1702505923395839118', time=2024-09-14T13:46:21.385115+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.P2icsiFnubxmMMR61FKkr5syeA5Rncm_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12368370511717678462', time=2024-09-14T13:46:21.491598+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5SQn0G1HGj8XkwUsYUlj2Qy1C9IaMGr_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10778530049212227059', time=2024-09-14T13:46:21.493650+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KgUB9N5xzD1qONx-nLCUX_9Jl4dRTee_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7117315078268118839', time=2024-09-14T13:46:21.503178+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ngf9ZapDhrEn6xzt5kpbLWHPW67_sL8_0 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4055016873772945127', time=2024-09-14T13:46:21.732950+0000, chain.objs.size()=1 2024-09-14T11:56:14.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._SlDUIjgkuqF75N1_mbMelzaYX-3CBo_0 2024-09-14T11:56:14.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3097172866671370882', time=2024-09-14T13:46:21.870790+0000, chain.objs.size()=1 2024-09-14T11:56:14.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.940+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uX7kHjhDH-I7Q2DlUOjqzoiFrRobWcT_0 2024-09-14T11:56:14.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.941+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13820550302436167027', time=2024-09-14T13:46:21.904959+0000, chain.objs.size()=1 2024-09-14T11:56:14.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.941+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AnT7BNNcb0WptFH3gzHFl56TX0I29TL_0 2024-09-14T11:56:14.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6282252259926395229', time=2024-09-14T13:46:21.944422+0000, chain.objs.size()=1 2024-09-14T11:56:14.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.llxonacAnDr2hAp3jD1KFMX2ZnQ86Ut_0 2024-09-14T11:56:14.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.943+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1531809515545688375', time=2024-09-14T13:46:21.952977+0000, chain.objs.size()=1 2024-09-14T11:56:14.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.943+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qXtWsO8UQRIB1mIIdPB0z-RuSwTA5T2_0 2024-09-14T11:56:14.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.944+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3154051960960591529', time=2024-09-14T13:46:21.956215+0000, chain.objs.size()=1 2024-09-14T11:56:14.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.944+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.R0E03Ytzn5pF1Qw1M4SeskewVLnGDbU_0 2024-09-14T11:56:14.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.944+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15445895314770736356', time=2024-09-14T13:46:22.079585+0000, chain.objs.size()=1 2024-09-14T11:56:14.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.944+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ra-ot9NY-2iF2oE_5cJW66SpLCc9jNJ_0 2024-09-14T11:56:14.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.946+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46942 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2634288367513314795', time=2024-09-14T13:46:22.083354+0000, chain.objs.size()=1 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0sF3OVB7qQUyCSNYquk4QWMeVYA7ioH_0 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10396565718641164777', time=2024-09-14T13:46:22.094657+0000, chain.objs.size()=1 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6LEjFK8ONp-O4NMCZ8WV8CW1srkSVN8_0 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15667794578072409274', time=2024-09-14T13:46:22.119177+0000, chain.objs.size()=1 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ftHiDWOjBJQQqrPlur8nZSi0vtRohqD_0 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10933098475254302794', time=2024-09-14T13:46:22.145737+0000, chain.objs.size()=1 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.c51vA6P0hD6K6fp9r2acx2BYM6ioji1_0 2024-09-14T11:56:14.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13354652881617371604', time=2024-09-14T13:46:22.280599+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.msQJfTE2RLd9Kx0yYPJwQ8QOsOSYfVD_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1941373390942876430', time=2024-09-14T13:46:22.292938+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OpZ2AkjQ3gkWjVFVThLDG1WJRA3_jzb_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14174760944893604909', time=2024-09-14T13:46:22.295879+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.w3K85J0eFGQ1KxDGEEItEYYErpHIMv3_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3013859100521813382', time=2024-09-14T13:46:43.391569+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.373__shadow_.qqmw9080DboAKhvm08TxfT8ne87fhTk_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4001352916229619655', time=2024-09-14T13:46:47.798260+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.380__shadow_.i3T6KhM7cirAqzWou2pwEGaREA4F_yU_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2968621037101391542', time=2024-09-14T13:47:04.732724+0000, chain.objs.size()=1 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.411__shadow_.h4tvRdpNq8C9ZH2tnTbXuPCyrvsCq5s_0 2024-09-14T11:56:14.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10441443266128021530', time=2024-09-14T13:47:36.269605+0000, chain.objs.size()=1 2024-09-14T11:56:14.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.467__shadow_.vy4e3nnDKEEQhv4ZUg_aamOp6HsGFYc_0 2024-09-14T11:56:14.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14121659896611554768', time=2024-09-14T13:47:46.365780+0000, chain.objs.size()=1 2024-09-14T11:56:14.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.949+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.492__shadow_.hVK3ZhO51D-hkBi1c2o6QhpovehvXk4_0 2024-09-14T11:56:14.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12279735875105401736', time=2024-09-14T13:47:46.479807+0000, chain.objs.size()=1 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.492__shadow_.hVK3ZhO51D-hkBi1c2o6QhpovehvXk4_0 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15788552761275386777', time=2024-09-14T13:47:48.962943+0000, chain.objs.size()=1 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.499__shadow_.oOm17nMvxqtrcdqDgtqjcxC4E6tcP28_0 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18410873911928562530', time=2024-09-14T13:47:55.989065+0000, chain.objs.size()=1 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.513__shadow_.Qm8CHS7YIRmMagpZgm2WpqfnHo1I9qK_0 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12358279563855942709', time=2024-09-14T13:49:12.453095+0000, chain.objs.size()=1 2024-09-14T11:56:14.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:S259ngIAgjDYJHdgESldlmuL11wzUPk_.w_dhiIY31-DZS5lCF1eghy3gqFQjitY_0 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1443295250628803205', time=2024-09-14T13:49:13.660042+0000, chain.objs.size()=1 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.952+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:rm8s.EZ7xYOndhameMIhbwQdSyega2R_.KKrhpHvs13Se8zT-bAR1FmbK9hlRX5I_0 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14640829467810993107', time=2024-09-14T13:49:16.009955+0000, chain.objs.size()=1 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:kOuBunRASZ.r2obAOn4-SQB.9ORJHRd_.zMDiz-UheqUaCfh9WzLizE22Fxwva81_0 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10332019805066712373', time=2024-09-14T13:49:27.129875+0000, chain.objs.size()=1 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.577__shadow:FJH-BD7gDHXqWFVcrqOJ6aHZtbVN1zG_.1nh33frHRn5Gt0dxtN25xK1M7ta_IFX_0 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.222046158775176283', time=2024-09-14T13:49:30.447265+0000, chain.objs.size()=1 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:inXBK4z6cQlgz.HKImLYTHV6.y02zIf_.qv4IU77u-KmEKn2eYyMB3l9vBoz0c6j_0 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.439844707684063668', time=2024-09-14T13:49:44.377919+0000, chain.objs.size()=1 2024-09-14T11:56:14.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:T156bBh13fITZgt2o-zy2-ggQh9oqb2_.DM-H7pou75SDYawul1YxGPLnaiVxhF3_0 2024-09-14T11:56:14.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.452859973485348430', time=2024-09-14T13:49:45.750413+0000, chain.objs.size()=1 2024-09-14T11:56:14.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:.AV2575I-5qIuRXuSCulT8wAc6vQN7n_.C9u9_3KrghLcNvNrO11CZU5Ag13LeOy_0 2024-09-14T11:56:14.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8563558795479065038', time=2024-09-14T13:52:33.550694+0000, chain.objs.size()=6 2024-09-14T11:56:14.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.953+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.1 2024-09-14T11:56:14.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.955+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.2 2024-09-14T11:56:14.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.955+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.3 2024-09-14T11:56:14.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.955+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.4 2024-09-14T11:56:14.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.955+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.5 2024-09-14T11:56:14.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.661__multipart_bar.2~UTVktsw5st-tTpy6VP_D5oZnMjaqJ8Q.6 2024-09-14T11:56:14.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8744560061563574411', time=2024-09-14T13:52:36.368367+0000, chain.objs.size()=1 2024-09-14T11:56:14.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.667__shadow_.AFcrXZ5TRTBGizSFTQboeesaWS4AgBU_0 2024-09-14T11:56:14.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2842315153700329882', time=2024-09-14T13:52:37.753655+0000, chain.objs.size()=1 2024-09-14T11:56:14.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.671__shadow_.0ZLIhuaShp5_oF7oV5uYGORPeS9V1a8_0 2024-09-14T11:56:14.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1219181970194981423', time=2024-09-14T13:54:02.062751+0000, chain.objs.size()=1 2024-09-14T11:56:14.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.958+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.770__shadow_.YIRG2klbxPy1ZSO9FeB6fR_dqeZ4Ukl_0 2024-09-14T11:56:14.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.962+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.965+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:56:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.966+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.966+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:14.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49385' 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3284565504276998122', time=2024-09-14T13:43:20.094158+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.XTe8f92PK8qI8a8eZTb0b2s34N6n6mU_0 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6532304536903461057', time=2024-09-14T13:43:25.273602+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.172__shadow_.n-kb5hv0qzfoWh2F6epP5BwBkzP9pGV_0 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4399084893065229910', time=2024-09-14T13:45:06.245834+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.232__shadow_.K8I1A1uCiQ2DXUI3cwOV3Vv85AuY3AX_0 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10854175469203730719', time=2024-09-14T13:45:30.215467+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ODKWXoCmUGkyw9icwYgBdkgl5aNxT4M_0 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7063353438506982607', time=2024-09-14T13:45:30.219242+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HBy-reqiH2iSeYU2gNCK2KLK3Nadx-e_0 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12499849322127751725', time=2024-09-14T13:45:30.224701+0000, chain.objs.size()=1 2024-09-14T11:56:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7A5BeOBSjXmfrsxgUn-PKGMCYsh4CCr_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8222966707535221815', time=2024-09-14T13:45:30.261130+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZD5O9k0VE4DDNC5QChN2AJtASeTwo2z_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18134716748293242506', time=2024-09-14T13:45:30.267446+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5LzBBOzcRnkdNcdpzKDjOnnHNSMDTg5_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1284023296079265766', time=2024-09-14T13:45:30.272565+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8x2x_xvMb716h0iIRjSQJvmwD2UYtHD_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14204363334542317438', time=2024-09-14T13:45:30.274065+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.P3KR7e6TdastXvfzCl5QspIQ0--6hdN_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4971024617086901533', time=2024-09-14T13:45:30.276195+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SfpuuOXdJJU5tjGHlawXe2teQP0cXx4_0 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18270194079992027585', time=2024-09-14T13:45:30.279341+0000, chain.objs.size()=1 2024-09-14T11:56:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.967+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Wpvn6fv2_j0pkUR5HLLSyBwj4vUxn7k_0 2024-09-14T11:56:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.970+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12220887355395627113', time=2024-09-14T13:45:30.409597+0000, chain.objs.size()=1 2024-09-14T11:56:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.970+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oGiDOHmUQJC_lFcAnndXDhagJw1FhzF_0 2024-09-14T11:56:14.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2931727567731723660', time=2024-09-14T13:45:30.445171+0000, chain.objs.size()=1 2024-09-14T11:56:14.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.y-VbQjzB2Pk7ju2LFUzhWtil8OUZT2Y_0 2024-09-14T11:56:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7312040802851062565', time=2024-09-14T13:45:30.478279+0000, chain.objs.size()=1 2024-09-14T11:56:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.mtlbK1TdBrXAzkOSNVUGYiDNAeUaNi-_0 2024-09-14T11:56:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6298597654680331957', time=2024-09-14T13:45:30.619781+0000, chain.objs.size()=1 2024-09-14T11:56:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1iYbFyzexHPpxLvjn-Ajk2prdnYETDX_0 2024-09-14T11:56:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8386617149218638978', time=2024-09-14T13:45:30.698134+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WegHRIUj2GPlo40-BO8-57ksgbStx-Y_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11539731464236390324', time=2024-09-14T13:45:30.788029+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.R6g2s8LnV1Tcp8KVGH4-m5JtlNjeBJq_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5372803822668981291', time=2024-09-14T13:45:30.790820+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tt-nt5qj5jQowZm91OeHM9HJB51O5YX_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3411581933300494763', time=2024-09-14T13:45:30.980412+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Jiyc1FZZoVN2BoDI6UODkUmjdSlNECT_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17774130924320635537', time=2024-09-14T13:45:31.014219+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.F_u4q2OAjtqTvGMwXyeF_lrMdn2Jqfb_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3100675072687854897', time=2024-09-14T13:45:31.019904+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dbQ1zzpflV-oXDcu1Yv9ZrKpx7wTQwv_0 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11267971642788944170', time=2024-09-14T13:45:31.046241+0000, chain.objs.size()=1 2024-09-14T11:56:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.972+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BSSjHDjCjYNzz0A715Z98ccx0fLBWYb_0 2024-09-14T11:56:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.974+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16942504368698968865', time=2024-09-14T13:45:31.065251+0000, chain.objs.size()=1 2024-09-14T11:56:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.974+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tFl6RcL2okKaB3Vkd_IdI2BPL48J2Ic_0 2024-09-14T11:56:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.975+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6594199638196092144', time=2024-09-14T13:45:31.066664+0000, chain.objs.size()=1 2024-09-14T11:56:14.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.975+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.D-JfenEU-IFZD3rz8mCj-N1l__Iezux_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3202423672074735812', time=2024-09-14T13:45:31.158244+0000, chain.objs.size()=1 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qTkWRaiJ7zNJtOUMOJ9WdpRuQWEArxa_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17262839260963473396', time=2024-09-14T13:45:31.163848+0000, chain.objs.size()=1 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NGy4qbgvd8DMyglR0eN6pPA24OsvQMh_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7488407071462583176', time=2024-09-14T13:45:31.215390+0000, chain.objs.size()=1 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.a4UcQ7yQso6aS_uIO0h1BC4NFWry3dr_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3657022485266964184', time=2024-09-14T13:45:31.217989+0000, chain.objs.size()=1 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Tot3FBQzmwcEGh9mkWXsL0pLvXWEU-J_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3740967270802164363', time=2024-09-14T13:45:31.230150+0000, chain.objs.size()=1 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f4beBmSJ8TFKgThwTxeMNRjTkPgNkgl_0 2024-09-14T11:56:14.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16834926370742064712', time=2024-09-14T13:45:31.561892+0000, chain.objs.size()=1 2024-09-14T11:56:14.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DHQIhfm6HBkaqGSReonkNH11xqbUSTU_0 2024-09-14T11:56:14.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16239742920013381979', time=2024-09-14T13:45:31.564523+0000, chain.objs.size()=1 2024-09-14T11:56:14.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8bVJnP8fw3fEUf__wsuim4dz70iAJpU_0 2024-09-14T11:56:14.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3243830283299187877', time=2024-09-14T13:45:31.590324+0000, chain.objs.size()=1 2024-09-14T11:56:14.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.976+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._z7A833w17SPl9jDnDBhRvvIkVhrdT__0 2024-09-14T11:56:14.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.978+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6891908025448800912', time=2024-09-14T13:45:31.595678+0000, chain.objs.size()=1 2024-09-14T11:56:14.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.978+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JaVrJCEkJ195igS-ndNsr1yIH_LCJLq_0 2024-09-14T11:56:14.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.978+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239958352679719023', time=2024-09-14T13:45:31.600207+0000, chain.objs.size()=1 2024-09-14T11:56:14.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.978+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bZ6FwhKjRlyt6A_PZAT174DurAuFS4K_0 2024-09-14T11:56:14.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.979+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9180755019212530699', time=2024-09-14T13:45:31.702844+0000, chain.objs.size()=1 2024-09-14T11:56:14.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.979+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zyS8c-7-dsyIhkPTA-h3r5uWRK-JeKC_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6774430713980584914', time=2024-09-14T13:45:31.718145+0000, chain.objs.size()=1 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cSOqpoGV5tc6DW5dZp48zvwP-Evw2e-_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.812686647457767669', time=2024-09-14T13:45:31.721754+0000, chain.objs.size()=1 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FI4xoK2YO38vHADhtDiQi6wmOIi2_9w_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14638091555058281757', time=2024-09-14T13:45:38.612994+0000, chain.objs.size()=1 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.277__shadow_.T9s3xINrb9SzdyubgnS2igXhTlv5IHF_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16733931129546649786', time=2024-09-14T13:45:42.811162+0000, chain.objs.size()=1 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.285__shadow_.3HHtn-yd32J0PFvBAEbhtrZxs4vuZj9_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17379728062817497044', time=2024-09-14T13:45:47.348204+0000, chain.objs.size()=1 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.KBZF2HLn2bfSsLnbGT0Z9CTuIEqGiXy_0 2024-09-14T11:56:14.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8011437365289148874', time=2024-09-14T13:45:47.351043+0000, chain.objs.size()=1 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.5JK7Vt8_okR_HAjGegBtlnPhWbFtmeV_0 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1856497880858779280', time=2024-09-14T13:45:48.200467+0000, chain.objs.size()=1 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.z6p2x7tqGByD4-jCHB_LhVddATcHOrS_0 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5409164937413835932', time=2024-09-14T13:45:49.666776+0000, chain.objs.size()=1 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.980+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.297__shadow_.vtOZOff-KjpT1vNuC2KO1h0X8Y1IJW0_0 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.981+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7567521430541036622', time=2024-09-14T13:45:50.659381+0000, chain.objs.size()=1 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.981+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.299__shadow_.zz0IS0dhc19P7ihVYcstLk6mMZU6__y_0 2024-09-14T11:56:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.982+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5544912147642066780', time=2024-09-14T13:45:52.105895+0000, chain.objs.size()=1 2024-09-14T11:56:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.982+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.302__shadow_.aiRO1hpMJQsgS-DvCSsfy-5FZnW1Hog_0 2024-09-14T11:56:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.982+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6666113099687630325', time=2024-09-14T13:45:52.106843+0000, chain.objs.size()=1 2024-09-14T11:56:14.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.982+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.302__shadow_.yicAPOpr1nVZdtpVial5Qy7RujHUA4V_0 2024-09-14T11:56:14.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6367156059033942942', time=2024-09-14T13:45:53.586662+0000, chain.objs.size()=1 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.305__shadow_.HoMpg8JJK3ET4Px8Swo_IlgnQl_M23-_0 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10118122716868528951', time=2024-09-14T13:46:10.925186+0000, chain.objs.size()=1 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jdDhXU50gpVtBeNALIyiAFbuMLTIIvH_0 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4981150006560902500', time=2024-09-14T13:46:10.929074+0000, chain.objs.size()=1 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nvaF2hK-SrQE92Db-A--_lDnKFMrlyX_0 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10819795951912014464', time=2024-09-14T13:46:10.943299+0000, chain.objs.size()=1 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6rE9m2Esp0kcuHtmL_a2hmFnXzm2WSv_0 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9311771979585179971', time=2024-09-14T13:46:10.971427+0000, chain.objs.size()=1 2024-09-14T11:56:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MQeMWBbGP7KUfxTt0wCXzL6xz_H5EJy_0 2024-09-14T11:56:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17437608396980489370', time=2024-09-14T13:46:10.979819+0000, chain.objs.size()=1 2024-09-14T11:56:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aD0MvpRJuzAHUj6LyEURqf7v1axHFWM_0 2024-09-14T11:56:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18155387924077457785', time=2024-09-14T13:46:10.980833+0000, chain.objs.size()=1 2024-09-14T11:56:14.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.984+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qcfaewGa_fABlnxTfHOviEu_wAJlOA6_0 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6737620421598462628', time=2024-09-14T13:46:11.004489+0000, chain.objs.size()=1 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MWlTBMEKs5gZ1Bu7_bZH0a72XsSj7sg_0 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11030496303148150403', time=2024-09-14T13:46:11.023025+0000, chain.objs.size()=1 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4OZyUU17V7zu_13096JHom3XpmhuaCu_0 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9019549938442596343', time=2024-09-14T13:46:11.149388+0000, chain.objs.size()=1 2024-09-14T11:56:14.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.986+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mQx7O6IyXuMj_B-WCu23GN_M-MlSNIF_0 2024-09-14T11:56:14.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.988+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14203790151638874955', time=2024-09-14T13:46:11.174090+0000, chain.objs.size()=1 2024-09-14T11:56:14.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.988+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6agyED1bDxolykOrgQPL_rNunIcmwcz_0 2024-09-14T11:56:14.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.988+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14199867411346165409', time=2024-09-14T13:46:11.190453+0000, chain.objs.size()=1 2024-09-14T11:56:14.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.988+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-Fg4OeES-KcD7pz4dDPjBR-qi60iOkY_0 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16269076975185491252', time=2024-09-14T13:46:11.306832+0000, chain.objs.size()=1 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LwwWXXCrZnzQh-pC4_BkVYYAcyAyFlx_0 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3192037934678299490', time=2024-09-14T13:46:11.378603+0000, chain.objs.size()=1 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EV1sN7VM-0cn_mi4leclGmw6XWjVdH5_0 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6321735685710064120', time=2024-09-14T13:46:11.677433+0000, chain.objs.size()=1 2024-09-14T11:56:14.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.989+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5Nvkq0s2txcmgLakoBW17n430w7t31a_0 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13545842510479165716', time=2024-09-14T13:46:11.838822+0000, chain.objs.size()=1 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zM1bI9K5niLexl5R7w4YSCG2GIwJSGd_0 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13936309677966895780', time=2024-09-14T13:46:11.899980+0000, chain.objs.size()=1 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VYpAovEfDt4wH2d6ets0hq39En3zt3e_0 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4715161910411313816', time=2024-09-14T13:46:11.921563+0000, chain.objs.size()=1 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BdtNlA67cqxmMkloupvJ95MZn2aNh6W_0 2024-09-14T11:56:14.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.244580918272602174', time=2024-09-14T13:46:11.950336+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2Fk7hJjursUpJbgYVYAGtEMXE0xEygQ_0 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.685885208999638570', time=2024-09-14T13:46:12.027981+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yq6ORX4mKIWwhDrKHx5LBOHsvSDOJR1_0 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11160477524052233744', time=2024-09-14T13:46:12.049922+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.991+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EhT3yrtYW14D9sVr6IMxXcH7CqPBql5_0 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8774013912900970642', time=2024-09-14T13:46:12.056603+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2U0DTuq2Qngy6xUizasPkc6NO4KytqE_0 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7974241703950702126', time=2024-09-14T13:46:12.092742+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3roiFFkgUcufIxTA2KJAMBTrOmW5gjh_0 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57712305137547794', time=2024-09-14T13:46:12.103519+0000, chain.objs.size()=1 2024-09-14T11:56:14.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.993+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P1uDLYirjxer7kUvWkUNeZgjtIlDYST_0 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2112819929291312303', time=2024-09-14T13:46:12.107310+0000, chain.objs.size()=1 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RH57WPzsCSGv1F0LIu3CuNWXPGHYaZa_0 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3829805821172472057', time=2024-09-14T13:46:12.117795+0000, chain.objs.size()=1 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TgXAp2IC63ITQPcv1eiTDKpjiMmENnR_0 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11093147543645334114', time=2024-09-14T13:46:12.441244+0000, chain.objs.size()=1 2024-09-14T11:56:14.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GlSfyh7IDWkp6OdeVVTtQ6Ve9pBjrdz_0 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13148619214223408442', time=2024-09-14T13:46:12.463046+0000, chain.objs.size()=1 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xniOz7_Pa5Ncruo_q8LZZL9het1F_DS_0 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8392148960060871388', time=2024-09-14T13:46:12.636412+0000, chain.objs.size()=1 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hk76Lfqztvnbmoku4kDwB-0HZSVF2NC_0 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6185334291008804082', time=2024-09-14T13:46:12.651500+0000, chain.objs.size()=1 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dbsUBB-LONzVPK4EJsBYDpEqtq3WqPF_0 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14254673108980400085', time=2024-09-14T13:46:20.799526+0000, chain.objs.size()=1 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Mi_qPFUPHIV9XkPG0pg59gFO68PJUaj_0 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1581969347207124850', time=2024-09-14T13:46:20.814151+0000, chain.objs.size()=1 2024-09-14T11:56:14.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.994+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.l4O5T9bi-OQ0QUCn1oNYprtc2DPTjkS_0 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3863652300934214211', time=2024-09-14T13:46:20.902820+0000, chain.objs.size()=1 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.11C3VeZNGfsdXtVcivaLgOapalyEG0S_0 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6538365040882251149', time=2024-09-14T13:46:20.909647+0000, chain.objs.size()=1 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.b5zWmR494GtpSVmevoTPpC7ydHhQf36_0 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13128301553521298276', time=2024-09-14T13:46:20.929098+0000, chain.objs.size()=1 2024-09-14T11:56:14.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nXZj1QwKWom_war2U-xGDovQfz-vdEU_0 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18092955395763926665', time=2024-09-14T13:46:20.960411+0000, chain.objs.size()=1 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iVLUjFJurwd5NzbRT59rvrljG_6XxVT_0 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5496589159018200161', time=2024-09-14T13:46:20.971427+0000, chain.objs.size()=1 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WrmzsJgihQUtv5gwOU8ox9mA8tRrBFz_0 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12332519879305556869', time=2024-09-14T13:46:21.152818+0000, chain.objs.size()=1 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.998+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.m_-NldaV_qJlaPBpytnFiNS-obynZbh_0 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12082996441495062721', time=2024-09-14T13:46:21.197916+0000, chain.objs.size()=1 2024-09-14T11:56:14.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.U8U6kUXMW0sghGuZ3B34ygvCCltQC5-_0 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14547960357592732096', time=2024-09-14T13:46:21.201073+0000, chain.objs.size()=1 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WMFOSv3MSkmEVPJzTwhHj_RN4WMfmbO_0 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17888441574570665123', time=2024-09-14T13:46:21.202238+0000, chain.objs.size()=1 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:14.999+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jLtqe8ugvlqLaqLMS4LoEp-rxDy99PF_0 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15483686538114846300', time=2024-09-14T13:46:21.305606+0000, chain.objs.size()=1 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JCGYMqqZjAS0qEaxb0kVy2LH2YGNDUS_0 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14158816600144266837', time=2024-09-14T13:46:21.333920+0000, chain.objs.size()=1 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OqjHcmqV1dTGICMc4AJY8t7aOibO8NC_0 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2248052151730859709', time=2024-09-14T13:46:21.383745+0000, chain.objs.size()=1 2024-09-14T11:56:14.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.000+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qo9y8PrfA6KVHA6N5qWRsecImMKlsVc_0 2024-09-14T11:56:14.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.002+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11200320731324312796', time=2024-09-14T13:46:21.502243+0000, chain.objs.size()=1 2024-09-14T11:56:15.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.002+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1DyaPvPYv6djLFlsoj3rZa-1nNZb7Fb_0 2024-09-14T11:56:15.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6565277664738425394', time=2024-09-14T13:46:21.515187+0000, chain.objs.size()=1 2024-09-14T11:56:15.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qvCjiosh8Fc7kiPGKnelblEuZ_HYCOf_0 2024-09-14T11:56:15.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11998009031604861100', time=2024-09-14T13:46:21.919089+0000, chain.objs.size()=1 2024-09-14T11:56:15.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0uOfccUly0ohnDH3fkhWtLWGjln0Sbz_0 2024-09-14T11:56:15.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3186358064417318189', time=2024-09-14T13:46:21.954330+0000, chain.objs.size()=1 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5x8mEKnJWVQRylWPA5M-j1X7syGeE7F_0 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13018905415108252638', time=2024-09-14T13:46:22.065690+0000, chain.objs.size()=1 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.003+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.y7CZ5JyHbTNtCodH_ZUZnDXhlCCpz-u_0 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9033127224439952088', time=2024-09-14T13:46:22.069514+0000, chain.objs.size()=1 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qGbK1Ptxo5y4vhUZ27gXT4Gq0d7NDQZ_0 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10758020530819629067', time=2024-09-14T13:46:22.113651+0000, chain.objs.size()=1 2024-09-14T11:56:15.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._vdugbQq2H4rQbGv2Q9T8ua7916m7-z_0 2024-09-14T11:56:15.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9075550769471503162', time=2024-09-14T13:46:22.263624+0000, chain.objs.size()=1 2024-09-14T11:56:15.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.004+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wpDMnOv34367JC5BWK9JUvejK0nhQa8_0 2024-09-14T11:56:15.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.005+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13889843613657351826', time=2024-09-14T13:46:22.298569+0000, chain.objs.size()=1 2024-09-14T11:56:15.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.005+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pnQKMHcCd878wmmFgA9X84zEzkosXyG_0 2024-09-14T11:56:15.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.007+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/49385 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14341107154633343297', time=2024-09-14T13:46:42.926416+0000, chain.objs.size()=1 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.372__shadow_.1XzXTY-k3Aqujjl9nFSZ_SMQyoHOEWv_0 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14102148718967116905', time=2024-09-14T13:46:46.862123+0000, chain.objs.size()=1 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.378__shadow_.FeQmxlEzw6kJ1HiUzO4jElwDyPjO69m_0 2024-09-14T11:56:15.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8518771080083674534', time=2024-09-14T13:46:47.949376+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.380__shadow_.jYou0qpOvK_5X7QLOKHql0XJYkImr80_0 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6764418433355460263', time=2024-09-14T13:47:42.118769+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_._8vszsLvpbnrveo81kHWSMuiuEHEeWs_0 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10493550603672888210', time=2024-09-14T13:47:51.543987+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11918432678606419699', time=2024-09-14T13:48:03.424784+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.521__shadow:1KYBr.HmZX3cgrwK58m8UUPq7uQ5Mni_.4nHNDVHMndZFYoEPDqP8vrDjuwmV7tK_0 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~KOkE9wVgX4IKCp7stbWgu46SBj1CiFU', time=2024-09-14T13:48:22.712220+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.536__multipart_mymultipart.2~KOkE9wVgX4IKCp7stbWgu46SBj1CiFU.3 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16385293416122651518', time=2024-09-14T13:49:39.242932+0000, chain.objs.size()=1 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:ChBgY6xniyDhukcViy2XbPtJn12aVyK_.hCqssNpCpVK6_xk2HIWTAUBRNGnuDu-_0 2024-09-14T11:56:15.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11073170440007578853', time=2024-09-14T13:49:49.474879+0000, chain.objs.size()=1 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:gIAKoPv6AyaCbuW2yK5z7W51tTrtDNz_.Ash1CBKEW26RFfy0Gk68FzaQwXQVm0M_0 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47293335171601297', time=2024-09-14T13:52:30.096742+0000, chain.objs.size()=2 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.656__shadow_.IDpRrOlFsGkGdUaYNdByQ2QgcALfn1C_0 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.656__shadow_.IDpRrOlFsGkGdUaYNdByQ2QgcALfn1C_1 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18064977661075507615', time=2024-09-14T13:53:18.555890+0000, chain.objs.size()=1 2024-09-14T11:56:15.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.010+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.719__shadow_.s4uMFZllUptePH_NmuHCEflB0DvNwfj_0 2024-09-14T11:56:15.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.015+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.017+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:56:15.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.018+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.018+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47164' 2024-09-14T11:56:15.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_j01SUopE4oN-r3fpCpRxazEE0SB8R3G', time=2024-09-14T13:43:21.882384+0000, chain.objs.size()=2 2024-09-14T11:56:15.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.rUysfz4Z8WVaW7bNtUwnYGM4Zpji0FM_0 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.rUysfz4Z8WVaW7bNtUwnYGM4Zpji0FM_1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.757151667259662393', time=2024-09-14T13:43:22.304066+0000, chain.objs.size()=3 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-FROZEN.2~-90LMnLDftcTVNOOzXOFC0ctovb8iIr.1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-FROZEN.2~-90LMnLDftcTVNOOzXOFC0ctovb8iIr.2 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-FROZEN.2~-90LMnLDftcTVNOOzXOFC0ctovb8iIr.3 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7628556528769688934', time=2024-09-14T13:45:07.203604+0000, chain.objs.size()=1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.234__shadow_.quIk3-OvIaExIMMefQy1ssTRIGM429l_0 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5728800695873312724', time=2024-09-14T13:45:10.378253+0000, chain.objs.size()=1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239__shadow_.e9TnIxOM5Ujsb8J530aBM92KVtZp2u7_0 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16421271693814215784', time=2024-09-14T13:45:11.754709+0000, chain.objs.size()=1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.242__shadow_.v8c-_P90z6PTL6Rcx0KnrxVvEe_Juqa_0 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7708940492263540463', time=2024-09-14T13:45:16.882459+0000, chain.objs.size()=1 2024-09-14T11:56:15.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.251__shadow_.bn4wOrZYasM-NWQZGtXgRY00LJ4K3gQ_0 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17687622867212080133', time=2024-09-14T13:45:30.270211+0000, chain.objs.size()=1 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oMEudSetsAv8WzXno8vDhGCcK1YvbXh_0 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16840244958411819205', time=2024-09-14T13:45:30.591880+0000, chain.objs.size()=1 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.G24uvYRqixH2p7Ut9qnK8s3W_AXF3eU_0 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.414221672882503124', time=2024-09-14T13:45:30.645521+0000, chain.objs.size()=1 2024-09-14T11:56:15.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.019+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.32MFJqoELa9M4-DGGaj3TD09eljQYcL_0 2024-09-14T11:56:15.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.022+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5180478277737489705', time=2024-09-14T13:45:30.657821+0000, chain.objs.size()=1 2024-09-14T11:56:15.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.022+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8eNcUfulpMRlv3FsyoMtXqX4Wgvqhsm_0 2024-09-14T11:56:15.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.022+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14529131116569677542', time=2024-09-14T13:45:30.667188+0000, chain.objs.size()=1 2024-09-14T11:56:15.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.022+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wpL2jLNVO3l_6MoczTdQTs2MQE8J0T-_0 2024-09-14T11:56:15.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4454319635519985356', time=2024-09-14T13:45:30.776696+0000, chain.objs.size()=1 2024-09-14T11:56:15.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OANef6loPfSUx65u6QZj8YbIYkJ7vbZ_0 2024-09-14T11:56:15.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5721821680180701872', time=2024-09-14T13:45:30.788892+0000, chain.objs.size()=1 2024-09-14T11:56:15.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7i8dYeegOVeZC1YDhcH7ZCwwhcSzKoG_0 2024-09-14T11:56:15.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4849238421122004800', time=2024-09-14T13:45:30.791605+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5n-HLHoxlmhyyacvGBOCfFmH8XPmHl3_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8187183893187389156', time=2024-09-14T13:45:30.801419+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vHjpiMrxUHlznXqdsqIINxxpNp1bXOk_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1276086342712034333', time=2024-09-14T13:45:30.836915+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QIDTG-l8vBtD6v_ROXI6n7tEv6I10uu_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12725118404485465761', time=2024-09-14T13:45:30.841565+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JiM2326MBgUg-YS3mx_ZQ7m-37GC-21_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16101776036136792259', time=2024-09-14T13:45:30.842414+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PrXMYGOalpW4jvvlZu88PRUwmh6AWdV_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11758538805778159395', time=2024-09-14T13:45:30.976753+0000, chain.objs.size()=1 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tXzV7GAyO5LhXQ2oa_RAEEFUitQyMRL_0 2024-09-14T11:56:15.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15759784022712560648', time=2024-09-14T13:45:31.005884+0000, chain.objs.size()=1 2024-09-14T11:56:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.023+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.31b1c9wiVQomTifWmRDzMSnW-Xz22UV_0 2024-09-14T11:56:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.025+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4976092668763790428', time=2024-09-14T13:45:31.017639+0000, chain.objs.size()=1 2024-09-14T11:56:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.025+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rNIeWJaObMYwAmLofn89eRV8Z5k4dS5_0 2024-09-14T11:56:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.025+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7137003502009962316', time=2024-09-14T13:45:31.208591+0000, chain.objs.size()=1 2024-09-14T11:56:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.025+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bcZv2UqGc6jIwZNDazPq6xwMwoFTsUq_0 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.026+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5280065370673281706', time=2024-09-14T13:45:31.235287+0000, chain.objs.size()=1 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.026+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kE0HANivxnCQuFONPUYoFuA0jI-6ki1_0 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10782149923221032303', time=2024-09-14T13:45:31.679812+0000, chain.objs.size()=1 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yCz_dCI-8HlOh2Y1RxcssFfqgGGrz7r_0 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.027+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9094618056624771860', time=2024-09-14T13:45:31.708473+0000, chain.objs.size()=1 2024-09-14T11:56:15.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.027+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EijNol_7aNL2o6O6SKy_cgtap6bGumn_0 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8261482467467201229', time=2024-09-14T13:45:31.742119+0000, chain.objs.size()=1 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ws1KKQEQYmtLLgJ7IMEUOc3UwPOU8Du_0 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6361167036755231408', time=2024-09-14T13:45:38.118367+0000, chain.objs.size()=1 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.276__shadow_.RSwH5viyBeBmAEJHHSa9xw0EMn_5E9v_0 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3271104357251641070', time=2024-09-14T13:45:47.346048+0000, chain.objs.size()=1 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.UdCwKfYS7vjLAKkSHCfRJJ-1tj2AAnw_0 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5306377046592656631', time=2024-09-14T13:45:48.180904+0000, chain.objs.size()=1 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.JhI1Han0NF9rsp5FoXqobATS5EOW9va_0 2024-09-14T11:56:15.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10403029594072576830', time=2024-09-14T13:45:48.196516+0000, chain.objs.size()=1 2024-09-14T11:56:15.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.kY2aVR0vv2XnOkGBpuSlpNyH545ZHGs_0 2024-09-14T11:56:15.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13932992730371990716', time=2024-09-14T13:45:52.107083+0000, chain.objs.size()=1 2024-09-14T11:56:15.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.028+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.302__shadow_.C5gut4PoG8wtzMqFBVGJ7XNQQLasH2a_0 2024-09-14T11:56:15.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.029+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10872219553996111713', time=2024-09-14T13:45:53.089245+0000, chain.objs.size()=1 2024-09-14T11:56:15.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.029+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.304__shadow_.wZRC-MABkcIttWn_G1az-ciL6usieJN_0 2024-09-14T11:56:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2278091897026879730', time=2024-09-14T13:45:55.520550+0000, chain.objs.size()=1 2024-09-14T11:56:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.308__shadow:QyCOgG.pyjfdMPaZAUQvUqxgHhPr2Zc_.R2fqbo0EtCrSK4olDfgFrMlmMUiW37C_0 2024-09-14T11:56:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.031+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13455404811011444824', time=2024-09-14T13:46:10.960735+0000, chain.objs.size()=1 2024-09-14T11:56:15.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.031+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.P0DH9xlqX-Z7cfOpyBPjjhCwfuKnFSd_0 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16170644421443308335', time=2024-09-14T13:46:10.987518+0000, chain.objs.size()=1 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GoC3wfyPBBsordzfuc6YBySc5uGi0Qj_0 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5906463245150841778', time=2024-09-14T13:46:11.018659+0000, chain.objs.size()=1 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.C9GU4EERjsUjcpXQTqbWyFMVAA4zU6x_0 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14306055164754723298', time=2024-09-14T13:46:11.034865+0000, chain.objs.size()=1 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2i3amCyWOmoMS9IWEATcBU_BYh8zS8F_0 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12754154416659688170', time=2024-09-14T13:46:11.131799+0000, chain.objs.size()=1 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yOL6mrvsmK_G_8TcNDv4P-B8z3xtDj__0 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4768272429170344881', time=2024-09-14T13:46:11.160998+0000, chain.objs.size()=1 2024-09-14T11:56:15.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2WzEXMs0OvjbTVyL004dqzNl3fAyGJl_0 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2467385207826058151', time=2024-09-14T13:46:11.317471+0000, chain.objs.size()=1 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.032+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7sMH-1T157wqQLAlBnqXTFodcQkNML9_0 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3734698525851930508', time=2024-09-14T13:46:11.358746+0000, chain.objs.size()=1 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LgBMRcktsU55GBDZqfxpuA_-pnOdCo-_0 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9970715874122575410', time=2024-09-14T13:46:11.369634+0000, chain.objs.size()=1 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9AAa-B7pPQCPV2jMPDZotFO4tRon9FG_0 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7140060277777452365', time=2024-09-14T13:46:11.741999+0000, chain.objs.size()=1 2024-09-14T11:56:15.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.033+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vP1S0td54nDbanLhB6bgtLJ2CU2B07z_0 2024-09-14T11:56:15.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.035+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10053126785984114973', time=2024-09-14T13:46:11.744702+0000, chain.objs.size()=1 2024-09-14T11:56:15.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.035+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YvobHHpAqYyZ3oMwELaLwgW-GyG0A_R_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8986605784683743882', time=2024-09-14T13:46:11.760728+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VYkptBelnOJs3J_bPcpV7b5zgdgK46k_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5658921235140950229', time=2024-09-14T13:46:11.841418+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8qB3jIIaYOjL81Ps2z-O-4ofFhl7Pdn_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3425373350863036850', time=2024-09-14T13:46:12.042644+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rGgLJXL1n2wMWilqBTZd4JeNAP9a7SC_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9496164698645310790', time=2024-09-14T13:46:12.068945+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gvV21SrHa4-L6UOkMI4OXBVsbuUZEHS_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12368799578013220568', time=2024-09-14T13:46:12.213487+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ahTPNOS24r1bUkZdY4bkryjCmV4zjdE_0 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6736694494565594465', time=2024-09-14T13:46:12.216126+0000, chain.objs.size()=1 2024-09-14T11:56:15.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.036+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BqjSr3n8x0mBSigs1kKdSyoTIYJmrK3_0 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.610636153166778732', time=2024-09-14T13:46:12.218078+0000, chain.objs.size()=1 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5_fi8JJOZahkvs9xU3DGm2w74qy8SC2_0 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14599330295021999030', time=2024-09-14T13:46:12.602371+0000, chain.objs.size()=1 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gtNB3hYFkPLlaBezMiNfciWPUcuatAk_0 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8091820785465385794', time=2024-09-14T13:46:12.641517+0000, chain.objs.size()=1 2024-09-14T11:56:15.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.037+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ICXfqFCHzPJqBkqzTrtbnbcVM9a0sAu_0 2024-09-14T11:56:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9053073447021193209', time=2024-09-14T13:46:12.652243+0000, chain.objs.size()=1 2024-09-14T11:56:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iEbK78f0lLXhQDnkdQ6M5zkr75A_-Hz_0 2024-09-14T11:56:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12665257237379513123', time=2024-09-14T13:46:12.678310+0000, chain.objs.size()=1 2024-09-14T11:56:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kjw7_llSSzjd9x6rpc0S72mwzJDsm-e_0 2024-09-14T11:56:15.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11710493673647938246', time=2024-09-14T13:46:20.729052+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LJhA6aZPo6X5m5mvrRhfrK4yryfHy8z_0 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6021840009115827720', time=2024-09-14T13:46:20.824048+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vOKaFfWx6ffTtt32LnQcs21iBXCDmXy_0 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12612756499226644567', time=2024-09-14T13:46:20.902942+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FQeO-7x1nzrb30-pi64DrPaJKBSzgE4_0 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5591279042528174841', time=2024-09-14T13:46:20.921635+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rPJDZVvdgWRVVZkp0b1jYBNnPZ-vV1Q_0 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12495674542591859481', time=2024-09-14T13:46:20.951668+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.039+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.erBLI7_oQJMoe-uygdaduz8zyF-kvW3_0 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.040+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12658963102531423449', time=2024-09-14T13:46:20.957352+0000, chain.objs.size()=1 2024-09-14T11:56:15.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.040+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sCoxGpeycB7kaBlAaW906lhNjMNEbjN_0 2024-09-14T11:56:15.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.041+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1050549632405349272', time=2024-09-14T13:46:20.988582+0000, chain.objs.size()=1 2024-09-14T11:56:15.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.041+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SrlYoYFP28lykvI4oCJRYRUSCZoxzz__0 2024-09-14T11:56:15.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4152367905484421413', time=2024-09-14T13:46:21.170961+0000, chain.objs.size()=1 2024-09-14T11:56:15.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DOXs9rM0VLTWGN6KKKMY7PRdc6rFn9r_0 2024-09-14T11:56:15.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.042+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13819316093123235290', time=2024-09-14T13:46:21.205176+0000, chain.objs.size()=1 2024-09-14T11:56:15.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.042+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CT4zEgH4rwGCVeUY8ZUxKVq1ZgwhpqI_0 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3859020080179294372', time=2024-09-14T13:46:21.296245+0000, chain.objs.size()=1 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XZF2VAqC9gGfmyT1vZ9CB6_krj8zW40_0 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15507456318680358356', time=2024-09-14T13:46:21.307679+0000, chain.objs.size()=1 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EAo2dgaf4syk4MubRlREqPuSzy0ozyv_0 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6514100390312316161', time=2024-09-14T13:46:21.311114+0000, chain.objs.size()=1 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IJt-GZi3-QR9CBgtJSL4eVOjSjLRvYV_0 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4875448314109909337', time=2024-09-14T13:46:21.326114+0000, chain.objs.size()=1 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pPI5H8m2bPdYbyrrG7nlhJOPbTx0Op6_0 2024-09-14T11:56:15.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1416150097571078573', time=2024-09-14T13:46:21.347817+0000, chain.objs.size()=1 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.gqeFJJ-UmnKtHdCUo1cEfjeZXz0Xs_E_0 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15186810665920301101', time=2024-09-14T13:46:21.355999+0000, chain.objs.size()=1 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yEuDtU0Gqgrq_Q6J9HMXzz4YWMp_rH-_0 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16454403947137763321', time=2024-09-14T13:46:21.358886+0000, chain.objs.size()=1 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.54ZHeY44ef_ZJnNSRyXbE-5MIxsRm8I_0 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11887544277638848167', time=2024-09-14T13:46:21.364785+0000, chain.objs.size()=1 2024-09-14T11:56:15.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.043+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7hvMXNyztb2i7dP49ya1tSpoK5u_JIQ_0 2024-09-14T11:56:15.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.045+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6132553097886741926', time=2024-09-14T13:46:21.743292+0000, chain.objs.size()=1 2024-09-14T11:56:15.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.045+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TKXHI6yTa0QfNiKB77o6IMGfrM93Nj0_0 2024-09-14T11:56:15.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.046+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16460008828830409509', time=2024-09-14T13:46:21.753340+0000, chain.objs.size()=1 2024-09-14T11:56:15.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.046+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.k7PalTQwMNX6aZTlT6krTpDItPbxgok_0 2024-09-14T11:56:15.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1013325127988318281', time=2024-09-14T13:46:21.760036+0000, chain.objs.size()=1 2024-09-14T11:56:15.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DkXAlQQ9nRlF3SZO2VjQUrlPyL48uDS_0 2024-09-14T11:56:15.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11541049329429468676', time=2024-09-14T13:46:21.767613+0000, chain.objs.size()=1 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iBXh0u38gNSWMsUOxp2yqwELk8EWH_q_0 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18257557008348053812', time=2024-09-14T13:46:21.862756+0000, chain.objs.size()=1 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MTGTYItUAoJmY71oMPSFU6E5QBN_86q_0 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8032688308213178728', time=2024-09-14T13:46:21.867668+0000, chain.objs.size()=1 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fGpamAdcfCDRIUyJi1qDuWWCYRB5LA5_0 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7401902046624650602', time=2024-09-14T13:46:21.872873+0000, chain.objs.size()=1 2024-09-14T11:56:15.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IAPC2EQlIyf7MSIwKD05Y8Tvr7vi-0Q_0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12701260685923887002', time=2024-09-14T13:46:21.877691+0000, chain.objs.size()=1 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.f0CUbkQ1gHHJlM0-4WSWvnYnGCn2Y___0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12588772595685931175', time=2024-09-14T13:46:21.909555+0000, chain.objs.size()=1 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JoBa8eXZj-0X6B758wENZ0pmn86mu9C_0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9192705118346558878', time=2024-09-14T13:46:21.925471+0000, chain.objs.size()=1 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sLb7fp27aVdJB6KWcVWWlUoXIotP-Nf_0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11503506765162828408', time=2024-09-14T13:46:21.930301+0000, chain.objs.size()=1 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lJkSkLqhq9uu0_qpOEVxoEj9SDNffoW_0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18091277536479893305', time=2024-09-14T13:46:21.933828+0000, chain.objs.size()=1 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.048+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JeTILj2I4dhbaQgRw9ynJ2ndg24654w_0 2024-09-14T11:56:15.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.049+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.666334416414344216', time=2024-09-14T13:46:21.950577+0000, chain.objs.size()=1 2024-09-14T11:56:15.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.049+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DHHR7eBs3YiR2qUQcsN76QhwRDDvva5_0 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.051+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1095138467783787446', time=2024-09-14T13:46:21.960558+0000, chain.objs.size()=1 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.051+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qwCkOU5xO1KoOChX7r0IW0k4NFTvjoY_0 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.051+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13902978995601474237', time=2024-09-14T13:46:22.035823+0000, chain.objs.size()=1 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.051+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aAZ8v3tEuZ6Mk8y2pKALtIbjIHo0IFb_0 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.052+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8809364070332503779', time=2024-09-14T13:46:22.079047+0000, chain.objs.size()=1 2024-09-14T11:56:15.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.052+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.n9b7COLxP9hWs_Wg5GeGmGquUFOSPDu_0 2024-09-14T11:56:15.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.052+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15665842190920449400', time=2024-09-14T13:46:22.093143+0000, chain.objs.size()=1 2024-09-14T11:56:15.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.052+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OalNVFt8zQOjV6M41PHXx66JRZPRYWV_0 2024-09-14T11:56:15.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.053+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16805082333604861552', time=2024-09-14T13:46:22.286009+0000, chain.objs.size()=1 2024-09-14T11:56:15.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.053+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2of1xJkiYndeMLtELEJpVGfHTUj8QZs_0 2024-09-14T11:56:15.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3996116897804799365', time=2024-09-14T13:46:22.341315+0000, chain.objs.size()=1 2024-09-14T11:56:15.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lvy7wRjf7zvdQ2vLnwA28hSe7H1E6Ma_0 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16591003790208384636', time=2024-09-14T13:46:42.531949+0000, chain.objs.size()=1 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.371__shadow_.PmUmM8TWKUF_uzuo0E9rZ97GBTBfzSn_0 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3176885150005985824', time=2024-09-14T13:47:16.802408+0000, chain.objs.size()=1 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.435__shadow_.nUMj9usXJcI8wKSRIQ8oOjsk6atpR9H_0 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17573846852232361680', time=2024-09-14T13:47:31.478953+0000, chain.objs.size()=1 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.460__shadow_.w2Ve2aZAdTV8UipO8jCzEVHOrb-XPHG_0 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3344232442851962822', time=2024-09-14T13:47:48.849743+0000, chain.objs.size()=1 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.498__shadow_.FP4-mnCz5bSRWVA9JlOHgYZZFjTQlmo_0 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11290221506286256463', time=2024-09-14T13:48:03.536341+0000, chain.objs.size()=3 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~VUsgX6oPKrMhMI202Ko4s7_jSKO9qy4.1 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.054+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~VUsgX6oPKrMhMI202Ko4s7_jSKO9qy4.2 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.055+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~VUsgX6oPKrMhMI202Ko4s7_jSKO9qy4.3 2024-09-14T11:56:15.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.055+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3820484071465543621', time=2024-09-14T13:49:12.786042+0000, chain.objs.size()=1 2024-09-14T11:56:15.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.055+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:BFclrSFupDXEX7wvogpqymB15SypE4W_.ZVkTOEvxbgw4qP7RJRHdjif2g8As83p_0 2024-09-14T11:56:15.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.055+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11864111280979395095', time=2024-09-14T13:49:14.488057+0000, chain.objs.size()=1 2024-09-14T11:56:15.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.055+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:ET0OdF1cnG07mIlcs8YLk2HpkhYJIB3_.zsb6ZNubkPoFizLP9YfIAx7SyFnYsAV_0 2024-09-14T11:56:15.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11864308159525925229', time=2024-09-14T13:49:15.503760+0000, chain.objs.size()=1 2024-09-14T11:56:15.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:0fhNa1jMYldgJisJX0XcQ8zHh4URpfO_.UkyTMvG5HyGHWRjzUPCm-B1Px9nTj9P_0 2024-09-14T11:56:15.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.058+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16727123368425180678', time=2024-09-14T13:49:37.126001+0000, chain.objs.size()=1 2024-09-14T11:56:15.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.058+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:FJGGET0ptfKxqowojd1GlX538x2YmiX_.ocPyKWLgvIyUYzPtKk1qq5jSG2-NPYa_0 2024-09-14T11:56:15.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.060+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/47164 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4560948543504135288', time=2024-09-14T13:49:44.390199+0000, chain.objs.size()=1 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:f66rHs0I83qVTXkHQ2u6Y7vUYC-aUBD_.o4l42hfaYV_fREWhuwM4996GrX3ejcx_0 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15106760383194353971', time=2024-09-14T13:52:18.715951+0000, chain.objs.size()=1 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.634__shadow_.LxWbTJz5utC9NpIltfGCKLt1NgVm2sv_0 2024-09-14T11:56:15.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2514889616522183912', time=2024-09-14T13:52:50.113391+0000, chain.objs.size()=1 2024-09-14T11:56:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.700__shadow:3LjsMR9kZH8p7SNGjOtv4wVZIFEuaBu_.iBikTfNqhFKXM_1Kgd6QuCGtgVjfkvq_0 2024-09-14T11:56:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.773641251636531706', time=2024-09-14T13:53:18.025549+0000, chain.objs.size()=1 2024-09-14T11:56:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.718__shadow:-uXRzuSXTGBT9Rry4NIBrUST0T1CwQX_.XYEyQ8uydFKPS5c0NNa6dsTpJmqT1as_0 2024-09-14T11:56:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5101674103624484385', time=2024-09-14T13:53:58.777318+0000, chain.objs.size()=1 2024-09-14T11:56:15.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.062+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.766__shadow_.7vvthXOCJO2l4fe4mP2q9lCBZ011M0P_0 2024-09-14T11:56:15.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.064+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.067+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:56:15.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.068+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.068+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48718' 2024-09-14T11:56:15.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17034878177265232697', time=2024-09-14T13:43:21.297378+0000, chain.objs.size()=3 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-STANDARD.2~gsSNySMok3sfSJn2nzfByy9zO6H_VxY.1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-STANDARD.2~gsSNySMok3sfSJn2nzfByy9zO6H_VxY.2 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__multipart_foo-STANDARD.2~gsSNySMok3sfSJn2nzfByy9zO6H_VxY.3 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3546190665490987708', time=2024-09-14T13:45:06.245483+0000, chain.objs.size()=1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.232__shadow_.P8qASuKqib2OTetDaSC2uEMCXw286hH_0 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11856732263262389845', time=2024-09-14T13:45:07.203802+0000, chain.objs.size()=1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.234__shadow_.ekHj7ypFHkYOA1EfJW81TpZrcROm08G_0 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13251902256371553212', time=2024-09-14T13:45:12.224049+0000, chain.objs.size()=1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.243__shadow_.ADzPK8URk5PDz5KY-AlD-ziWne2yWD-_0 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3995639401079041203', time=2024-09-14T13:45:12.225050+0000, chain.objs.size()=1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.243__shadow_.o9jywZI_8ppAgssrxBTPB7YowHrT2S4_0 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6688422326539964897', time=2024-09-14T13:45:13.932177+0000, chain.objs.size()=1 2024-09-14T11:56:15.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.245__shadow_.Kp00ebAanzbByteXNOQgMHC4WTGpTQC_0 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17452238819347563992', time=2024-09-14T13:45:15.910267+0000, chain.objs.size()=1 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.249__shadow_.iTkEL-ZkaSLpyRbpjSdwca_AMuMMywX_0 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1653800778476359337', time=2024-09-14T13:45:19.732312+0000, chain.objs.size()=1 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.257__shadow_.ZYtSv47HUTRFrw_UI9bSVqdLXJTtorM_0 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16167421173588202179', time=2024-09-14T13:45:30.231419+0000, chain.objs.size()=1 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.59kewzjoCK-31-i-MLoqjHfpl7xzeJG_0 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5693652472204392889', time=2024-09-14T13:45:30.279937+0000, chain.objs.size()=1 2024-09-14T11:56:15.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.069+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.O0G6Iw2Y8tXh842c9X7fCWKGXs1AkVy_0 2024-09-14T11:56:15.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.073+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15077841998209960990', time=2024-09-14T13:45:30.290684+0000, chain.objs.size()=1 2024-09-14T11:56:15.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.073+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BR8vufnJXEJooGX0D9dSSVaNoBbnh39_0 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13571895053961361684', time=2024-09-14T13:45:30.291353+0000, chain.objs.size()=1 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tJNWw31IXK5TYZPd1QgiKsawLguqHQ9_0 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7493746805569281554', time=2024-09-14T13:45:30.296375+0000, chain.objs.size()=1 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RiepNSIviz7tnDzKWvRxPMcCE-rXOkl_0 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10569917768501672440', time=2024-09-14T13:45:30.318096+0000, chain.objs.size()=1 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hI8K2dw7yflwG7VPPAhJ9lsgaak76iJ_0 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4697585995750223605', time=2024-09-14T13:45:30.404129+0000, chain.objs.size()=1 2024-09-14T11:56:15.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.H8aQAP_ik6iMThx1D_MNDGtd7EsW4nE_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4774230757225081686', time=2024-09-14T13:45:30.494154+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tYims7NemyiwDTS17HYrtGDG5LDdOEY_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7766209437342530983', time=2024-09-14T13:45:30.512859+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.K-CJ7RTuvC-abXHvzJ43Lg4I6_FBIz-_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1959768366571792165', time=2024-09-14T13:45:30.606832+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UdLnYc6K4Pep6EUmesxmNHy2LAkSwGn_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6708959616408421085', time=2024-09-14T13:45:30.669913+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jShyVpZ2oIrn_-bKGXl0KaUjto6eUwq_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5611371619412788365', time=2024-09-14T13:45:30.671180+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TZlUyh-T80VjPgX4GXRA691N93TYulW_0 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7419638899264706345', time=2024-09-14T13:45:30.793770+0000, chain.objs.size()=1 2024-09-14T11:56:15.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.074+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hwoBHc3Zv_SHg7NHe6SOV2KICa6vfxA_0 2024-09-14T11:56:15.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.076+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3545606199620165163', time=2024-09-14T13:45:30.826553+0000, chain.objs.size()=1 2024-09-14T11:56:15.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.076+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.g3gBoUHEV_eyb8JCCMXSpt_TN7oivPP_0 2024-09-14T11:56:15.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.077+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15811593991574682706', time=2024-09-14T13:45:30.851072+0000, chain.objs.size()=1 2024-09-14T11:56:15.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.077+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kCKTP1Z0YUzwPmGfstcDZ-LvMNOk7Hb_0 2024-09-14T11:56:15.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.078+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12663934241807852554', time=2024-09-14T13:45:30.866746+0000, chain.objs.size()=1 2024-09-14T11:56:15.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.078+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Byhfgq40KgR96NRNMY91kvlVDrF8sbM_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11371373720887215536', time=2024-09-14T13:45:30.873507+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f4663OxmWoFbv2UZX328NoWodzT4ph1_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.942061914601495747', time=2024-09-14T13:45:30.875792+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W-8eICqT5FFiwAhgJvae1u9XdbWEa_1_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.134926944512651191', time=2024-09-14T13:45:31.009947+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Lyj1g6UXqwnl3iDXspurxTeR6ksugLt_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4340448668807737508', time=2024-09-14T13:45:31.027381+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bCWFKzl9qm3kFKezxvB9madHTT5A91F_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18128895490897436591', time=2024-09-14T13:45:31.057993+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.079+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KW9mcKD1-pmG2xszoXiAiRu_ROA_IRP_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16310166696948097731', time=2024-09-14T13:45:31.061390+0000, chain.objs.size()=1 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-S40r4lNeoH9IBjQM_IsxDU7C4T3LK6_0 2024-09-14T11:56:15.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14862704427850039424', time=2024-09-14T13:45:31.155319+0000, chain.objs.size()=1 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6sbgIQiFNXSgOt4nv4ZeAYDQbgwwksQ_0 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11009298820100397531', time=2024-09-14T13:45:31.180292+0000, chain.objs.size()=1 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TwDJzhDu280I2zs_tG8i7vzEHJJ-_vp_0 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14539640461944688091', time=2024-09-14T13:45:31.186096+0000, chain.objs.size()=1 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1ApmqDQTOLSoAH1cXoZNEX0p-fKCII8_0 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5260391773274582547', time=2024-09-14T13:45:31.211915+0000, chain.objs.size()=1 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LDcQVsmoFAT5R097QcAJ14hPq-gJqiY_0 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1594021478382675965', time=2024-09-14T13:45:31.506426+0000, chain.objs.size()=1 2024-09-14T11:56:15.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.080+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Y2oqB1DbGubTc20qski0AHxo125IfJs_0 2024-09-14T11:56:15.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12470604456944473254', time=2024-09-14T13:45:31.519392+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aSA8vSH9-1rclpxnyaYeSpXDzEYicz__0 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3046093067290823319', time=2024-09-14T13:45:31.541932+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6rMnozByDAEsBzDIc_BYYV0clsUCmtk_0 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18269336325361039907', time=2024-09-14T13:45:31.587366+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dLl3WvnRNxsOku5tShlVAc1tUMIsZhQ_0 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3822448278459996807', time=2024-09-14T13:45:31.598226+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.082+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uTJXS7QRjBe3oiaNUnRQnbgKVeL5Z1Q_0 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1371668562052774544', time=2024-09-14T13:45:31.740001+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9DIPgKJ6OjsQb4reXWd4-Q-e_l0rsqI_0 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16506316478474020206', time=2024-09-14T13:45:31.745138+0000, chain.objs.size()=1 2024-09-14T11:56:15.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RYfFPOy-IsBHCBHakam0gm5ozcLs8u4_0 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1515338320215198101', time=2024-09-14T13:45:31.769004+0000, chain.objs.size()=1 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.083+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.S9RsbCEXLw-R6pxWv4V_uqeEpwOAg6m_0 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1216655096606804095', time=2024-09-14T13:45:37.616678+0000, chain.objs.size()=1 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.275__shadow_.a6hPDx3l0wsoxY3SfbZBUB1Uzr9ecEp_0 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14316042536522093602', time=2024-09-14T13:45:38.118952+0000, chain.objs.size()=1 2024-09-14T11:56:15.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.276__shadow_.npLCbqcxfnz1Q4gA0LmS9apXWsI34Bx_0 2024-09-14T11:56:15.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6396462224617669104', time=2024-09-14T13:45:47.344063+0000, chain.objs.size()=1 2024-09-14T11:56:15.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.084+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.pMXttcTYAct4lXqRuHZ3rltExniQ7Hv_0 2024-09-14T11:56:15.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.085+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14164984532833235060', time=2024-09-14T13:45:47.347194+0000, chain.objs.size()=1 2024-09-14T11:56:15.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.085+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.5oLS1Y_Mt1HwIdHvWG9zbfsmstUP5-A_0 2024-09-14T11:56:15.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.087+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15789391023044762574', time=2024-09-14T13:45:47.349008+0000, chain.objs.size()=1 2024-09-14T11:56:15.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.087+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.n0GrCnijdKfFZEHaXuq7ahM5Flxb6OR_0 2024-09-14T11:56:15.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13717675371274127183', time=2024-09-14T13:45:47.354175+0000, chain.objs.size()=1 2024-09-14T11:56:15.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.WBUtofwcUscI8uCvbMHH75pwon5owzr_0 2024-09-14T11:56:15.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9030116770257233249', time=2024-09-14T13:45:48.185272+0000, chain.objs.size()=1 2024-09-14T11:56:15.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.aHH9dfBC7tGN8aLoz1DB76MyOpjPGwp_0 2024-09-14T11:56:15.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9263836535335596703', time=2024-09-14T13:45:48.199522+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.Z5ybtcGSMN9yw8DiNfsKvUypR_wqbYh_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12934707114997058550', time=2024-09-14T13:45:54.076229+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.306__shadow_.pLPFenaofq-2oaVpxYIJ5wczn-ZXsEP_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.637379118044647812', time=2024-09-14T13:46:10.968977+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AOoai-G5ivbLIotGg-ohPTlN22hLgmN_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13300222704502367126', time=2024-09-14T13:46:10.995126+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6nN10i1RNoMXtonrGwqdwKsojTauXWJ_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6417714189751914586', time=2024-09-14T13:46:11.024271+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iDtr39Mz1ELtWhXeDUjKb2Yk-VawlV7_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10797846480778084617', time=2024-09-14T13:46:11.030499+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.BbhdUIZyGIGWkXSQCWoY6ZFUH_lSgJz_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9309689503298261910', time=2024-09-14T13:46:11.208664+0000, chain.objs.size()=1 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wuSckA9e8cJAOZytwyC9JwKlf_Ik8aI_0 2024-09-14T11:56:15.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4833228221123791836', time=2024-09-14T13:46:11.212294+0000, chain.objs.size()=1 2024-09-14T11:56:15.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.088+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yaEcSUhW5EmhHyLsrhvw-unG1rqDRtp_0 2024-09-14T11:56:15.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.091+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3756975447854967407', time=2024-09-14T13:46:11.365238+0000, chain.objs.size()=1 2024-09-14T11:56:15.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.091+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XSwyB6XZQCvgffz-GiipYvHzwAXffal_0 2024-09-14T11:56:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.092+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11277815009618437653', time=2024-09-14T13:46:11.371653+0000, chain.objs.size()=1 2024-09-14T11:56:15.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.092+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2WwCX5i3Arg-MCf92oh-lPIygJYIxcV_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.092+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.701022499456167035', time=2024-09-14T13:46:11.569343+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.092+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TIhhbOjJE0TPQRH6EwCe9YEdJzFhHpw_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17601883114898126792', time=2024-09-14T13:46:11.574397+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1d0_ALI6dfID3UXoVC41z8y3alYJ1KO_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11903770503297647019', time=2024-09-14T13:46:11.654711+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Gfx9DdmkR10S6JWFTNRGOMY-dzIgmvF_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18040055830269394696', time=2024-09-14T13:46:11.689590+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5QZPqZqJFAYhBEo4pmJHc-XQeLNW3PB_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4655384611788052640', time=2024-09-14T13:46:11.730946+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.C-DvoqdpPztq18MbXMT9iO_-xaRpJH3_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.813455933660093559', time=2024-09-14T13:46:11.750040+0000, chain.objs.size()=1 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DL2rWHWjSFva8oqYy8Wrj_LxEgm5lhc_0 2024-09-14T11:56:15.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17136809771608231907', time=2024-09-14T13:46:11.842744+0000, chain.objs.size()=1 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.TZqNdkcCQiHcdIurmHMWCVH6bQV-uQe_0 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16213201878160607130', time=2024-09-14T13:46:11.845747+0000, chain.objs.size()=1 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WrUQErTYjs7zCj9yfCY6_YkNja2Dpd7_0 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3442032469663185054', time=2024-09-14T13:46:11.870991+0000, chain.objs.size()=1 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.093+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ITZd5wz5bhBdgrWEAvffIyIj96ycR6V_0 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.094+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6269201107245040384', time=2024-09-14T13:46:11.886988+0000, chain.objs.size()=1 2024-09-14T11:56:15.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.094+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IwgjW8RTs5PJVSQDC00AJD2fiekrb6M_0 2024-09-14T11:56:15.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.095+0000 7f1759f34640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x555eb7843a40 msgr2=0x7f1624093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:56:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.096+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16656793269755242498', time=2024-09-14T13:46:11.891680+0000, chain.objs.size()=1 2024-09-14T11:56:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.096+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bBN0gSMLtboPKeWSA9ez80OLLlU8qOx_0 2024-09-14T11:56:15.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.096+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13367042447391618962', time=2024-09-14T13:46:11.903739+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.096+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GQ2KfnjQy0CMSdC2NdvGBRWp06H3ACA_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5120745011463533647', time=2024-09-14T13:46:11.945252+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mYztaROZjMxl-MCfvWNkakaKELm4N50_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5271309510958257365', time=2024-09-14T13:46:12.081754+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1UWYvnSYwP11gyKJPxNUj6hRKKyxz2p_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3283295700144057910', time=2024-09-14T13:46:12.100989+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hC7nAZZuO7zWCDaTs4XojGeqZDZsISw_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16059001890181284405', time=2024-09-14T13:46:12.136484+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8UuSnEPuL9ahVbiu_2UIekcH-TGfCJV_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4821508286793332097', time=2024-09-14T13:46:12.451483+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ccLHWGwtn3OeoCFvY0i9t0R4kPlZY4C_0 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11681658302441056433', time=2024-09-14T13:46:12.471457+0000, chain.objs.size()=1 2024-09-14T11:56:15.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.097+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qqZrvTcMe1StLlx1oLByhVGiB4m4O5-_0 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5037217637738900337', time=2024-09-14T13:46:12.472680+0000, chain.objs.size()=1 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IY3dZv4HJwaPqiKbK12JZKU03uil5VD_0 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1098405093000560555', time=2024-09-14T13:46:12.477831+0000, chain.objs.size()=1 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dtl1ApcNqRglRfosX_im29wQlg7v7S9_0 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7172109630375002445', time=2024-09-14T13:46:12.488660+0000, chain.objs.size()=1 2024-09-14T11:56:15.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.098+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-yTMIQrGDYH29xrJXeSOT9SJgJJuic2_0 2024-09-14T11:56:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17409156608009538317', time=2024-09-14T13:46:12.496058+0000, chain.objs.size()=1 2024-09-14T11:56:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y0I2XrAhPR0VaMVgurxtpQt646HdQEn_0 2024-09-14T11:56:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.099+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8266319980675442862', time=2024-09-14T13:46:12.525561+0000, chain.objs.size()=1 2024-09-14T11:56:15.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.099+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ThFYWMaGUUCOU5OyDs9pHYRxS1P53wC_0 2024-09-14T11:56:15.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11542012075357620330', time=2024-09-14T13:46:12.595881+0000, chain.objs.size()=1 2024-09-14T11:56:15.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XPQ86010VtjOu5FTnYGrSkcewI3nldn_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1590014809477245467', time=2024-09-14T13:46:12.598196+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-aGr_rULPJ1vjF2XpKbVd9hewVy9Muz_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.79046820189223402', time=2024-09-14T13:46:12.603067+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.G2NX8w8Jq8_JFDv6wK3BYkhg6OTzyC4_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.404230579496847771', time=2024-09-14T13:46:12.608856+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ATysLR-x5_Eo_6bDFgbmTKDLuZO3rop_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5480192660195983392', time=2024-09-14T13:46:12.635873+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RtMyIc-5ei7GQ4M_GDhQrnEh-S_uRrZ_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14441895737565148321', time=2024-09-14T13:46:12.668253+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Qnvvo7-jz_1zo3BRK4bUgi2nmftMNIb_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10974731396519026970', time=2024-09-14T13:46:12.671698+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XsKUFoPuyUVkhx_2rlGdNzjttlrMqdn_0 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13304794097306955740', time=2024-09-14T13:46:12.689991+0000, chain.objs.size()=1 2024-09-14T11:56:15.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A6tZ57KwvsjjfNU0S0_7QTSQDAmbyzW_0 2024-09-14T11:56:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4679487828306434259', time=2024-09-14T13:46:20.752164+0000, chain.objs.size()=1 2024-09-14T11:56:15.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.101+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LNRF8jwZxnTL51qFavAU4O1C9iRTC9p_0 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9518488867805797336', time=2024-09-14T13:46:20.755024+0000, chain.objs.size()=1 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4IPtUeA_otiWGtvaSQ9UDmlNWvyJeqM_0 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9108082064120732308', time=2024-09-14T13:46:20.760677+0000, chain.objs.size()=1 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AWdeWPIKxivnFQiH_ZUSC2wStkxqi_r_0 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13195718456156533534', time=2024-09-14T13:46:20.907741+0000, chain.objs.size()=1 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EkBeIn-5jhuhGukefp9GGT5B47UHqQP_0 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12870623818117725471', time=2024-09-14T13:46:20.964795+0000, chain.objs.size()=1 2024-09-14T11:56:15.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.104+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BLcRVdNg1fWaJdnI-kyxc-qNDkOWK-s_0 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9897353466157808210', time=2024-09-14T13:46:20.966763+0000, chain.objs.size()=1 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Qxtp2VLLB2dOsYbMIU9-w1aF3tpZhL1_0 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7155227334737759863', time=2024-09-14T13:46:20.973006+0000, chain.objs.size()=1 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vi5GLtULHgpCB4WdFjr1rhd4ZdhmGNh_0 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8974445232652805350', time=2024-09-14T13:46:21.005595+0000, chain.objs.size()=1 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.asKUdeeBEAY0I9d9BsmWNxoVPYdDjDI_0 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f1759733640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x555eb783f730 msgr2=0x7f162408d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:56:15.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11078479129847728663', time=2024-09-14T13:46:21.008970+0000, chain.objs.size()=1 2024-09-14T11:56:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.105+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.46GN6OCaE89CkHTNxMS0X2a174xT2eC_0 2024-09-14T11:56:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.106+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12926710143287166673', time=2024-09-14T13:46:21.086664+0000, chain.objs.size()=1 2024-09-14T11:56:15.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.106+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Hn8paUtIRScnurOjNxcjC2P1kXooxek_0 2024-09-14T11:56:15.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.110+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/48718 2024-09-14T11:56:15.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.112+0000 7f1759733640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.94:6808/1380065119,v1:172.21.15.94:6809/1380065119] conn(0x7f1624090680 msgr2=0x7f1624093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7445424905728161412', time=2024-09-14T13:46:21.093545+0000, chain.objs.size()=1 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yc63f_QoN193ql8ouBJeptEQq2FkY_I_0 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15947823356457137467', time=2024-09-14T13:46:21.169499+0000, chain.objs.size()=1 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aW9z_NGO94lXG6kFUwAM8TdXHq2FgnX_0 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13451737475095127827', time=2024-09-14T13:46:21.316340+0000, chain.objs.size()=1 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0VF3KlP6PlrIujGozYV5nHHeNknv39b_0 2024-09-14T11:56:15.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12960570854534410858', time=2024-09-14T13:46:21.345586+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NFhopsoVTbQGm64gsUyHeeO0DFKW-Bx_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2995927613473200890', time=2024-09-14T13:46:21.346324+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.i3tiTNIOqJW4H4MGfhpLl147cUL6Ise_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10229517297728249501', time=2024-09-14T13:46:21.374503+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IEiL2TuZq4Y06tUAqcTzSiyG2lrcvXg_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17790388312358507872', time=2024-09-14T13:46:21.380418+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-f7KjhWv8HP2U58CbvmTGa0tZstTDwb_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12606616615041109783', time=2024-09-14T13:46:21.475157+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aTddWY6ZWhKLtQOgBnVLlNpXWtIrVTR_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11592853257372816445', time=2024-09-14T13:46:21.491194+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TgK2CdSeDhOGHBbS4gcpvrZwpXoj81l_0 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4941217385959945534', time=2024-09-14T13:46:21.528702+0000, chain.objs.size()=1 2024-09-14T11:56:15.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GVEBf2-ROQSRUPGbFPrfotHiW8x8nmG_0 2024-09-14T11:56:15.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.356516415841458882', time=2024-09-14T13:46:21.745731+0000, chain.objs.size()=1 2024-09-14T11:56:15.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.044cVbvNhf5GuKb4-R_V9fWGB9PcAj7_0 2024-09-14T11:56:15.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18129992056168816487', time=2024-09-14T13:46:21.919784+0000, chain.objs.size()=1 2024-09-14T11:56:15.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.113+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jS9ScQ7EUS7wgn5rML32CbHJt9v03jV_0 2024-09-14T11:56:15.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.116+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4080585694925569686', time=2024-09-14T13:46:21.922397+0000, chain.objs.size()=1 2024-09-14T11:56:15.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.116+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xx5eTNWifrcwiIS4dOTTP_Tq8aoptd0_0 2024-09-14T11:56:15.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.116+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14681121876342861593', time=2024-09-14T13:46:21.937830+0000, chain.objs.size()=1 2024-09-14T11:56:15.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.116+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0GqX5kd0fzPv8LgVLZMfO4mzZ3nXtOz_0 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16311220256375405849', time=2024-09-14T13:46:21.939919+0000, chain.objs.size()=1 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ynBr2HQLPHhwO2PTik-0CiLWHVkbKjU_0 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17901514541561604736', time=2024-09-14T13:46:22.056513+0000, chain.objs.size()=1 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.j05bOO0tLqjAD3u87Mz268BnpZFRzsd_0 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1746923353878103838', time=2024-09-14T13:46:22.271513+0000, chain.objs.size()=1 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.H7KymH7a3bM0FDrVk5FTY8DNZN9Bxoy_0 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5947676499729506629', time=2024-09-14T13:46:22.316588+0000, chain.objs.size()=1 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.koedwdRnbDI1hFLvZYZJeRYNJfYTjgi_0 2024-09-14T11:56:15.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11313122985846056158', time=2024-09-14T13:46:46.264591+0000, chain.objs.size()=1 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.377__shadow_.IIQ3hkhB7RXZJTYNVDbSDfzS7V-yRL__0 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18400813134300690974', time=2024-09-14T13:47:04.123775+0000, chain.objs.size()=1 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.410__shadow_.aIzPelcp5f75RUw7MBVz5DK4bfEm3SW_0 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5476176671138586874', time=2024-09-14T13:47:26.283026+0000, chain.objs.size()=1 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.452__shadow_.F24Kh0H85pOj1Ysw8fuHoFs5MZOyizt_0 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5347966916915799516', time=2024-09-14T13:47:35.449570+0000, chain.objs.size()=1 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466__shadow_.lC139XC0so5BwdcBQHn22kg-UIerFBw_0 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12989258144847556056', time=2024-09-14T13:47:42.656702+0000, chain.objs.size()=1 2024-09-14T11:56:15.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.117+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.485__shadow_.ohVmdsCDetjbRYvI1AHyyS95inwkxY-_0 2024-09-14T11:56:15.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2025674154743184507', time=2024-09-14T13:47:42.658202+0000, chain.objs.size()=1 2024-09-14T11:56:15.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.119+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.485__shadow_.QHhYH2Kb0Q6XiHweF9VUa-q7GG3Abp4_0 2024-09-14T11:56:15.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.119+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13627075711617225131', time=2024-09-14T13:48:38.621952+0000, chain.objs.size()=1 2024-09-14T11:56:15.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.120+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.537__multipart_mymultipart.2~uXqPa_PFpPIIo-dtHt4ZuubfJHbLx_H.1 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6194060674132593739', time=2024-09-14T13:49:15.691176+0000, chain.objs.size()=1 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:-p.l-qJw9asrdFp93FF4lCm4jN.fKsK_.763Da8wKTDtmuqhxZm1cRKFS5B4ITU-_0 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2785866218784365112', time=2024-09-14T13:49:18.377524+0000, chain.objs.size()=1 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.571__shadow:ZvtoUM7r8ufBqAQlzOFjR5umis0xj-i_.7YnlatbadSMN16jQFmBXpkFsnEX7KED_0 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18235909389877814451', time=2024-09-14T13:49:22.864342+0000, chain.objs.size()=1 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:nmCeqH7r3D8BudgLrknGiH5Ffax.ZVy_.enGKdlA4MmSoIYlrU6xgmUskxrmxm9D_0 2024-09-14T11:56:15.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13448834215545020936', time=2024-09-14T13:49:31.296061+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:5idv7fpqnm.acbMYyDUmdJwF0rj4rTI_.hPbdeQon1s_HeFiYJ-w6TbSDAe6DhLs_0 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16899227256662330269', time=2024-09-14T13:49:34.227930+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:cnELrtLrro0FSlqq1J2LAiyBY4zehBW_.bSGuol4uIY98VymoHGypMM45in745eE_0 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1552750919901906456', time=2024-09-14T13:49:44.376926+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:OAWR97oHU.E1vh3DCGmKPlr.E0GXD8y_.LlIINtHXm7wQkH1HsLiql_yI6ZWlwxQ_0 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2377309074419607057', time=2024-09-14T13:52:20.746808+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.638__shadow_.UANCT5-uro0NbfjJZ7gmsobJ3ymAsRi_0 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16406333699989727531', time=2024-09-14T13:52:35.625733+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.666__shadow_.LfPgwGZTWEeWqiEntBI_LANfw6QP18h_0 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15138143377138806804', time=2024-09-14T13:52:52.014762+0000, chain.objs.size()=1 2024-09-14T11:56:15.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.121+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.704__shadow:DYHZ-vM3-AoZcIwdM6d-1HpPmLX8MLw_.0o2P-xHHyqMZhMKnSKe7B_KBjtx62YA_0 2024-09-14T11:56:15.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.124+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18272602265525168509', time=2024-09-14T13:53:18.555544+0000, chain.objs.size()=1 2024-09-14T11:56:15.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.124+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.719__shadow_.s4uMFZllUptePH_NmuHCEflB0DvNwfj_0 2024-09-14T11:56:15.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.124+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7308756742078111549', time=2024-09-14T13:53:50.071109+0000, chain.objs.size()=1 2024-09-14T11:56:15.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.124+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.757__shadow_.oSHQo9rzU4voRFzaFr7xo3ABJunCCpC_0 2024-09-14T11:56:15.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.127+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.129+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:56:15.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.131+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.131+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/69648' 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17594091154318997366', time=2024-09-14T13:43:20.352386+0000, chain.objs.size()=2 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.ho6LkRVxGd1cd8qdYUJPKHGnIBAuBoz_0 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.ho6LkRVxGd1cd8qdYUJPKHGnIBAuBoz_1 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13482822503351693298', time=2024-09-14T13:43:24.002311+0000, chain.objs.size()=1 2024-09-14T11:56:15.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.167__shadow_.wCOR8QcIPfbSoHlh7wBu-e5NTXHlD3-_0 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3268555733778875758', time=2024-09-14T13:43:39.340460+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.178__shadow_.L3dbDj08eTAp9CwwlV1KwaTGVM0QvMA_0 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15057600893751499821', time=2024-09-14T13:43:44.734652+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.190__shadow_.TGhd1HRYD9qYfalGcA8XOro2kP7CoNA_0 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15177805459927662124', time=2024-09-14T13:43:55.442924+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.200__shadow_.teORNJcP3Cjk34DAKYril_ZSJnbqJMy_0 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~1iUP6RxQNfNIyEn4S6yvGjX3sDu2Ask', time=2024-09-14T13:43:57.112877+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.203__multipart_mymultipart.2~1iUP6RxQNfNIyEn4S6yvGjX3sDu2Ask.1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18185124236149437106', time=2024-09-14T13:45:17.337145+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.252__shadow_.X1gYwX9bUz9P9fW9hXAhB6873M2bouu_0 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14531359891324956228', time=2024-09-14T13:45:30.231723+0000, chain.objs.size()=1 2024-09-14T11:56:15.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.peXp7aHy48HIX7yFD09-ViBdwyRpAhT_0 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7521686072082086015', time=2024-09-14T13:45:30.248364+0000, chain.objs.size()=1 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zffDnW2sVINhbQxWEApenzhxWbfhRVx_0 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17451952059317057190', time=2024-09-14T13:45:30.257759+0000, chain.objs.size()=1 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CWQwR_0eJ8BpDT5n_uHOVdXLrRJQ5kR_0 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13521863621352026885', time=2024-09-14T13:45:30.269265+0000, chain.objs.size()=1 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.132+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Zk5mtJMxKkmc7kFC5LmqIBO3GC977Vu_0 2024-09-14T11:56:15.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15916996101269964204', time=2024-09-14T13:45:30.294465+0000, chain.objs.size()=1 2024-09-14T11:56:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QSruPYOsvnbnRVUzz4Q3B-rc0LSCQa4_0 2024-09-14T11:56:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17647499209265825193', time=2024-09-14T13:45:30.312503+0000, chain.objs.size()=1 2024-09-14T11:56:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.w5cLMwAJDBTP6D5O3Jm9Nc9zw_hWF5D_0 2024-09-14T11:56:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10475501538826956709', time=2024-09-14T13:45:30.412062+0000, chain.objs.size()=1 2024-09-14T11:56:15.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.mO1YAIqa11le6ZZmkfH87bv4_yTZxoQ_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9736119413459245625', time=2024-09-14T13:45:30.420865+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vzaGe_1U7QYF2C_DgNFykoUDJPj4eb9_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4226309636056426223', time=2024-09-14T13:45:30.446185+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SDkpOCasrJKeSiQVvDaqafiOsZu9dQf_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15452630995039500519', time=2024-09-14T13:45:30.615668+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dwREvLQBTxs32KeRoDW_CX6FJlAapkD_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2342505835960993019', time=2024-09-14T13:45:30.639216+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Of25b95JBLHIjdMvAQ-_35Ocpn_K5z9_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8604647269543908324', time=2024-09-14T13:45:30.649006+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3S-V07IYQrHtiITQDU3Bc6l8d48t6LD_0 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2948850645414757508', time=2024-09-14T13:45:30.795932+0000, chain.objs.size()=1 2024-09-14T11:56:15.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.135+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.fbMFAeU4zKnUYkSsobTgMlo7FN3iScD_0 2024-09-14T11:56:15.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.137+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11165702384064700246', time=2024-09-14T13:45:30.799236+0000, chain.objs.size()=1 2024-09-14T11:56:15.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.137+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.c2gp-JLk21ce7xou6BplIqyfQob43J6_0 2024-09-14T11:56:15.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.137+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13884048987414663564', time=2024-09-14T13:45:30.805993+0000, chain.objs.size()=1 2024-09-14T11:56:15.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.137+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SEtuMRWqRMwQhDNrly0ZTtxkk1zVGe__0 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11897257151603298299', time=2024-09-14T13:45:30.822488+0000, chain.objs.size()=1 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cLL0Wq6MXgfFl2M0MMRv6Jd_R-TTmsO_0 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17120257254730570623', time=2024-09-14T13:45:30.833623+0000, chain.objs.size()=1 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UCTs98Fe3AsBh-_d25O-laPTz9lc-z5_0 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15628291472594589091', time=2024-09-14T13:45:30.860418+0000, chain.objs.size()=1 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wVAw5YgwQLHxth71pA9i_BbqM0D-VKW_0 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11552445021256514951', time=2024-09-14T13:45:30.864671+0000, chain.objs.size()=1 2024-09-14T11:56:15.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.138+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YeJmaPq9RCVqceqIvDxO1yNSgEtPeKi_0 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1696957918252690635', time=2024-09-14T13:45:30.983641+0000, chain.objs.size()=1 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.U4g_ueVQCIAMGTtHm20OCU7GzjUSHS3_0 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11968901885625633519', time=2024-09-14T13:45:31.014368+0000, chain.objs.size()=1 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VT__FDxOFYwQ2fXZnPACUo221r8nraE_0 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15929246667929890684', time=2024-09-14T13:45:31.055927+0000, chain.objs.size()=1 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JwJn4QFc3KDme-Q9r52mUYnTD5ftPRU_0 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10649738292301636747', time=2024-09-14T13:45:31.144955+0000, chain.objs.size()=1 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cIuAiiQjG2fyeMYNXajSQeT7WE8e4iY_0 2024-09-14T11:56:15.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4430547537801467707', time=2024-09-14T13:45:31.146849+0000, chain.objs.size()=1 2024-09-14T11:56:15.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.139+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.z9Nv8_QTaaVnUDs4qHiePDBckwd4j-__0 2024-09-14T11:56:15.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.141+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3433556843724790848', time=2024-09-14T13:45:31.160824+0000, chain.objs.size()=1 2024-09-14T11:56:15.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.141+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.c50mn3yg24rvwjdga0qqITa6suezogU_0 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17682358080871191455', time=2024-09-14T13:45:31.200361+0000, chain.objs.size()=1 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gNmwORcmoyczY-GTsFVcbcxRI99W-iH_0 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4222315154216066500', time=2024-09-14T13:45:31.220224+0000, chain.objs.size()=1 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CuDcCyNnANuC8JIWKQ9loZsYc_T8bH6_0 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8626923115649201464', time=2024-09-14T13:45:31.222458+0000, chain.objs.size()=1 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.78L02I0gxvJbXa_mNCaQ5w9sNys54x0_0 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4026125564474246764', time=2024-09-14T13:45:31.236996+0000, chain.objs.size()=1 2024-09-14T11:56:15.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3aukj8vnq-mHJfux7S1a_1OmKrWgmb1_0 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7703440217465460358', time=2024-09-14T13:45:31.425842+0000, chain.objs.size()=1 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iHclQjuyyHi-Eijte1uqD7cCL3VYn3v_0 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15150097206481105038', time=2024-09-14T13:45:31.516325+0000, chain.objs.size()=1 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OIajS052PMs-OJZKeE4_OslGZlShwcF_0 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6780453142776343316', time=2024-09-14T13:45:31.523620+0000, chain.objs.size()=1 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TTMx6i2emLKo1Poza5hZa92b54E77pj_0 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18258589810035983232', time=2024-09-14T13:45:31.539298+0000, chain.objs.size()=1 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TCuxD0u8hm70k9YurzULe-RGxT6W_lg_0 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10415288005551641313', time=2024-09-14T13:45:31.547440+0000, chain.objs.size()=1 2024-09-14T11:56:15.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.142+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HdgMOG_4QvrZCsJaOA2a_9BEJ_T6yUf_0 2024-09-14T11:56:15.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.144+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14861731713224784944', time=2024-09-14T13:45:31.570277+0000, chain.objs.size()=1 2024-09-14T11:56:15.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.144+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1LNtL0DAeYIB6NgKGYXw5Kc0ZZS-jIi_0 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5905774002732917363', time=2024-09-14T13:45:31.591054+0000, chain.objs.size()=1 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.b8I_ZbVxL0_OdoVIqsdkFRjax_DjHVg_0 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10746034598493058936', time=2024-09-14T13:45:31.694841+0000, chain.objs.size()=1 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Fj1YAOm5ybOLcEtbm-Uizf0epjHRbad_0 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18197251839080908453', time=2024-09-14T13:45:31.715725+0000, chain.objs.size()=1 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.EaSYuWnbI98JUn9Ty3uw9Uvp0nduqlr_0 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3583437181787661949', time=2024-09-14T13:45:31.750340+0000, chain.objs.size()=1 2024-09-14T11:56:15.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.146+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.stL2UHED4B-IFUKW74VuZ2EuziL3MyF_0 2024-09-14T11:56:15.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3771597890110358681', time=2024-09-14T13:45:31.769492+0000, chain.objs.size()=1 2024-09-14T11:56:15.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VDcxhi-j9Xi_4VCTyrAMV4BaEcpF5N-_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8248156935095451127', time=2024-09-14T13:45:32.266815+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.264__shadow_.TB8JHOxjxM3wLiBO_kcOAeKBJFnAxwI_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14297816983646433202', time=2024-09-14T13:45:32.267730+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.264__shadow_.rliZvV9D3AaIyJC7Ggqj46AH0RGsbET_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10738800912869210461', time=2024-09-14T13:45:32.791234+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.265__shadow_.s-6-wvzvuciGGn7w_4TQCCUinitXBJY_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256939121950233920', time=2024-09-14T13:45:33.764459+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.267__shadow_.7shca697gAwtKQdDsnWly1qmS8y_q64_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16787165060861730661', time=2024-09-14T13:45:48.194585+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.DNcUwUU0qyQnxAgNM0pNmuxGLUe2qWJ_0 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2570668063141663510', time=2024-09-14T13:45:48.196161+0000, chain.objs.size()=1 2024-09-14T11:56:15.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.148+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.5IttxDG_M42G3n1NnUKGkGtQKzFoSnP_0 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6337314929612336338', time=2024-09-14T13:45:50.123483+0000, chain.objs.size()=1 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.298__shadow_.hTbPQXzQaoQAh875qVAbpIigfKPEMKy_0 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15244505262769096651', time=2024-09-14T13:46:01.462937+0000, chain.objs.size()=1 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.320__shadow:Pw64S4j0wHWQcgQIDQ3k.GDpcvFY4Nf_.U0E9hnVh7h05W-16NGjGyBREg4zdW2i_0 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.483291055641434994', time=2024-09-14T13:46:10.930487+0000, chain.objs.size()=1 2024-09-14T11:56:15.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.149+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7OAuONgfMFfEIE_ZucB_-FV1ytdzGD2_0 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10413935200526192651', time=2024-09-14T13:46:11.013332+0000, chain.objs.size()=1 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.co_1t-KqpfFLJuQaGYS668vs0W7RN4b_0 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14340422153528796751', time=2024-09-14T13:46:11.152517+0000, chain.objs.size()=1 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5m62S-SW2njD50JV-nJokoXvlV0VTmn_0 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8759361171561671185', time=2024-09-14T13:46:11.176430+0000, chain.objs.size()=1 2024-09-14T11:56:15.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.151+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.mEofz4pZN0-i_GszaVqqXHUpezKlNFv_0 2024-09-14T11:56:15.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.152+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7193297743878278878', time=2024-09-14T13:46:11.186459+0000, chain.objs.size()=1 2024-09-14T11:56:15.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.152+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Bf38Ek_M46fZyrUZTHtbwSwuBCTy0VF_0 2024-09-14T11:56:15.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5640674836478392558', time=2024-09-14T13:46:11.192050+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sw9D4JnIHsJiKP6HuKL6q5PhbWZMLtL_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7037546474586606713', time=2024-09-14T13:46:11.198567+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lfopaOdrjBKjGmtodQPYZUraHIMuP1W_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3311754807796552787', time=2024-09-14T13:46:11.211766+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bjZUKtyfPfZ9SOhcTPtmTNZ4Wd8rAW1_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16474138939426913297', time=2024-09-14T13:46:11.390766+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gdewtWIgT2XDR-aNbAWAO5I_Adtt7aW_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14861794516875532929', time=2024-09-14T13:46:11.648726+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.QNf8nuieM2EbzfJ7JicI-4iCQD2DduG_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12534290476977486792', time=2024-09-14T13:46:11.708377+0000, chain.objs.size()=1 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6aIygDA3vdweHSa54u7VtGAgnUz9vIu_0 2024-09-14T11:56:15.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.946496374187182463', time=2024-09-14T13:46:11.716775+0000, chain.objs.size()=1 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.154+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oEIFFMJf0R710oC8l0dhCV-dBjPgHbe_0 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17180812554112995963', time=2024-09-14T13:46:11.724085+0000, chain.objs.size()=1 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3BwnZhgBMj8Eg3NzJ5-dBm6sNghaw_G_0 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7298502000061807774', time=2024-09-14T13:46:11.730327+0000, chain.objs.size()=1 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.yYvEhbIOPfNdW79D3BKK3-gwdDZ6QG3_0 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10762852389659177951', time=2024-09-14T13:46:11.919490+0000, chain.objs.size()=1 2024-09-14T11:56:15.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.155+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YU-ccSoc9RI2nAg7j4VgPNdKiGqLwia_0 2024-09-14T11:56:15.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.156+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4271132471674225089', time=2024-09-14T13:46:12.033911+0000, chain.objs.size()=1 2024-09-14T11:56:15.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.156+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dQwl8dPpfXqu1H5sS9qcJbeEs-H3xMe_0 2024-09-14T11:56:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.157+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9384495315037605742', time=2024-09-14T13:46:12.041906+0000, chain.objs.size()=1 2024-09-14T11:56:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.157+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.C6yQW6YruqkokeOeXTrelmrzrQjtt92_0 2024-09-14T11:56:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.157+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.351942566296352036', time=2024-09-14T13:46:12.064473+0000, chain.objs.size()=1 2024-09-14T11:56:15.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.157+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.k_uRNGGNMQr-GueSCQty05JLCRQB487_0 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6683706286694864015', time=2024-09-14T13:46:12.080149+0000, chain.objs.size()=1 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ocPywRR7X0iYzIHbbz9urXQ5JMO66iI_0 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10157070674151710945', time=2024-09-14T13:46:12.115122+0000, chain.objs.size()=1 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rbY5g6-7_K26HjPsvohnr22-pZ5_jtw_0 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7227945258489044074', time=2024-09-14T13:46:12.223301+0000, chain.objs.size()=1 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.158+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6yc-PknJpsKya_DN87sPXf-fMkr6gOV_0 2024-09-14T11:56:15.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17626555992419207974', time=2024-09-14T13:46:12.456484+0000, chain.objs.size()=1 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KoHJZRfgde-uoMl1NMcF_4tXO0viiTG_0 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.981359298125903536', time=2024-09-14T13:46:12.483602+0000, chain.objs.size()=1 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ad1rG7jLMK3mjSoacrGrBKH7ZDZ4RWe_0 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7699919167132501268', time=2024-09-14T13:46:12.500131+0000, chain.objs.size()=1 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hrPwjx2dtQlHuHb_MFoNN0D5Mx4ZLs-_0 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5192397263884954820', time=2024-09-14T13:46:12.506380+0000, chain.objs.size()=1 2024-09-14T11:56:15.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.RKo68iZgbNVl2fzMmHLqoGrcTLWZ0N6_0 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10221595099836630631', time=2024-09-14T13:46:12.643888+0000, chain.objs.size()=1 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.OQIB3GLPobyMkaAR-D6L2VRapxRODLS_0 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16310921745222420231', time=2024-09-14T13:46:12.664973+0000, chain.objs.size()=1 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.159+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._1hX_ldcEMk7AAUmRUNbZgkpUKAiNTD_0 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.160+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8244556249003193438', time=2024-09-14T13:46:12.665697+0000, chain.objs.size()=1 2024-09-14T11:56:15.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.160+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vNlBG80_lFpTDT-ZOo26IST833DNAlh_0 2024-09-14T11:56:15.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.161+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11052437214345274592', time=2024-09-14T13:46:20.741984+0000, chain.objs.size()=1 2024-09-14T11:56:15.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.161+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Gq_k6drpbawXYadA4-GR0iVnHew_tk6_0 2024-09-14T11:56:15.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.161+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16957860996261781744', time=2024-09-14T13:46:20.800645+0000, chain.objs.size()=1 2024-09-14T11:56:15.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.161+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2sNltbIh7T27TxCGCAwab0xeYgkANPa_0 2024-09-14T11:56:15.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11244659485979981408', time=2024-09-14T13:46:20.914757+0000, chain.objs.size()=1 2024-09-14T11:56:15.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kA7ZofJ09TlxMLyFiGt_LEgAgMsAFxA_0 2024-09-14T11:56:15.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7620825391845889827', time=2024-09-14T13:46:20.971173+0000, chain.objs.size()=1 2024-09-14T11:56:15.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Da-NeXpLyzZmp9zUiXI7kjPBwcp4DT1_0 2024-09-14T11:56:15.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10685478961953062475', time=2024-09-14T13:46:20.972932+0000, chain.objs.size()=1 2024-09-14T11:56:15.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3PtISPDyyJ6HdXjmda4tqfCaIHbobd6_0 2024-09-14T11:56:15.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5980714879365752177', time=2024-09-14T13:46:21.007029+0000, chain.objs.size()=1 2024-09-14T11:56:15.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.162+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FaOlrLJL-jfd8QlcMuCYL3MP0N1jH4V_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11024316037364097407', time=2024-09-14T13:46:21.124256+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.954uWIPYNs8nC8o4sh0xxdvuAyMz6yk_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.321220579433884380', time=2024-09-14T13:46:21.188560+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.oKGwKU_V0kH9_9WDfd_n5L72TA_Wujf_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1745523821390298349', time=2024-09-14T13:46:21.284340+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aMoR_rKBgL6cDmEpiD62fcGxzgswOiA_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17297816043228712076', time=2024-09-14T13:46:21.355250+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.polSR6mgpyQkHQb6hU1R588f_7SucKQ_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6224781924402406016', time=2024-09-14T13:46:21.380702+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xKkXI_Z54uEEELm1zXeR3inGhYMeeYf_0 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4108508571714916851', time=2024-09-14T13:46:21.388896+0000, chain.objs.size()=1 2024-09-14T11:56:15.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NAmPgkvrL796QAG5VcSPHktpjP84Fg9_0 2024-09-14T11:56:15.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9451816643165180235', time=2024-09-14T13:46:21.472062+0000, chain.objs.size()=1 2024-09-14T11:56:15.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.165+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eqKTrXTtqMQ0anqt5L-R8TYQPNzDM_-_0 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4535734822288933350', time=2024-09-14T13:46:21.496234+0000, chain.objs.size()=1 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9PkCsntT5UnboxXxo-_3Aux09wiz1I8_0 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1112362295450573789', time=2024-09-14T13:46:21.877787+0000, chain.objs.size()=1 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RZUAyxq3PHqdnen_yvrTOvEUArKlaIx_0 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4391513313277588250', time=2024-09-14T13:46:21.887456+0000, chain.objs.size()=1 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.F76jgGxQyoB1zvRBzloabFeGCP8LJiV_0 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12101248148778757014', time=2024-09-14T13:46:21.891936+0000, chain.objs.size()=1 2024-09-14T11:56:15.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.167+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VGmGjhozL0LaN5PMop9jNhIB7CVtK2U_0 2024-09-14T11:56:15.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.171+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/69648 2024-09-14T11:56:15.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4384926658802776828', time=2024-09-14T13:46:21.938613+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.jXF_rieiT7pnegteD0FCG4hjz62yMw2_0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1386324215402688269', time=2024-09-14T13:46:22.060161+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.gd1NNM6AVAMxITOxjgn8WTyUkz35xoW_0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9020582205402896160', time=2024-09-14T13:46:22.069984+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.R2NxAkuQmB0YLnoHO3q0_K2IWYskw-S_0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.146222637981086715', time=2024-09-14T13:46:22.070844+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BWstecwvgAmjojEdMHSZnHKBlSfd8yZ_0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1203081603095231542', time=2024-09-14T13:46:22.074017+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2-oc7n_bmEgUUpgU03jKC-PjJ_-gD8__0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15660269476637071893', time=2024-09-14T13:46:22.085031+0000, chain.objs.size()=1 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SeE8_l5Qtg3AU6nO2wl-OYiyYIjPbRn_0 2024-09-14T11:56:15.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.737868534835845859', time=2024-09-14T13:46:22.096493+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DC4n2UAN9d5O7jNHXcuhCPiVE2jNJxv_0 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10212687955157193799', time=2024-09-14T13:46:22.109231+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sogAjTnTLhbGDJhA-XBNuU3GeUw7qbR_0 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7397238830995692614', time=2024-09-14T13:46:22.305167+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7_p8rXM_PXEaQ_I6HJAcaq6tLE_Nqsv_0 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10804375550028232038', time=2024-09-14T13:46:22.316022+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.D2SLCH_dgp3cBFBC7Dn_mfBsRYlv9hS_0 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15072411527914105650', time=2024-09-14T13:46:22.333860+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iIQDYLDUVY2YJiBXZA0bLJhJpEsQO00_0 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17692063125048989949', time=2024-09-14T13:46:25.014330+0000, chain.objs.size()=1 2024-09-14T11:56:15.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.173+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.331__shadow_.mTPVpwsE1cPgYPChQmOB4R1PoDUNP3x_0 2024-09-14T11:56:15.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.338581733312155520', time=2024-09-14T13:46:26.046291+0000, chain.objs.size()=1 2024-09-14T11:56:15.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.333__shadow_.1UHg55RL-u5JrxgdT0wV5R0Zp--Ga_N_0 2024-09-14T11:56:15.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1649241409526807070', time=2024-09-14T13:46:49.913679+0000, chain.objs.size()=1 2024-09-14T11:56:15.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.384__shadow_.5w_Np9ax36vaIhVLC_TN3GC78rpzSdW_0 2024-09-14T11:56:15.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16350449542660449008', time=2024-09-14T13:47:03.662185+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.409__shadow_.MjUYw9B9KzvShujEBtYqpdKr2NYHUcD_0 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4786359588526812149', time=2024-09-14T13:47:34.433114+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.464__shadow_.bsF1PXGheHu7iZs_2p2PsYwURWoM7Kp_0 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15825744660193023063', time=2024-09-14T13:47:46.947405+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.494__shadow_._DSXC7EJsiMjkaKg-IGQBD22o4u-vSX_0 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11831770430965338895', time=2024-09-14T13:47:47.697596+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.496__shadow_.tkMD_C1t9-MRNU2O5tHzzX5CdvU0_N9_0 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1685244117183524664', time=2024-09-14T13:47:48.275062+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.497__shadow_.JyTD-UZW8BZOr0i0JHRjx9QsJKC_FRr_0 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14457256129696255309', time=2024-09-14T13:47:56.101608+0000, chain.objs.size()=1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.514__multipart_mymultipart.2~8j9ratxKFjtxfPrarlp_UfZYEnaI7nx.1 2024-09-14T11:56:15.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2818296744122354492', time=2024-09-14T13:49:00.923269+0000, chain.objs.size()=1 2024-09-14T11:56:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.558__shadow_.8MdMbhK1KAsb5iwiqS4LuoFb_Enk7c7_0 2024-09-14T11:56:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13241609997522352333', time=2024-09-14T13:49:10.243823+0000, chain.objs.size()=1 2024-09-14T11:56:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.567__shadow_.0tFm5lbY31lSI_E6J32vCbjnspqKCD2_0 2024-09-14T11:56:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11052107186475640746', time=2024-09-14T13:49:14.823941+0000, chain.objs.size()=1 2024-09-14T11:56:15.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.176+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:ghgWnZ9TK0RJPEULYBeLTDotFBAll-j_.y8ey70xIreFB16S7CIJMV1Ghy_af4jl_0 2024-09-14T11:56:15.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9498013827532972259', time=2024-09-14T13:49:18.512305+0000, chain.objs.size()=1 2024-09-14T11:56:15.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.571__shadow:fXdd6ZRq3s.WlQEzU1-iObWjt5uL9.t_.OvAbhk_vP7c-sm1zIh-aD0n8geTJL5n_0 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15980999788160004120', time=2024-09-14T13:49:30.127003+0000, chain.objs.size()=1 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:hZHbRo4zKrJtClb6hdowcdEmbBCmjZI_.djH-QM03H9QciWgNZvaBNL0J2J8W-8p_0 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10797839411206593341', time=2024-09-14T13:49:44.366143+0000, chain.objs.size()=1 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:FH.cBqDrxTDPeKrInKhEKuI-kfeAE1E_.Safhl5y6f8W_dX7HLTHlNz7vLsYIuur_0 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18153088797207322013', time=2024-09-14T13:52:22.149747+0000, chain.objs.size()=1 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.642__shadow_.Xbd00sYattfZBgXGIZG_X1IoFcicYvq_0 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4679164665995731848', time=2024-09-14T13:54:01.319447+0000, chain.objs.size()=1 2024-09-14T11:56:15.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.180+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.769__shadow_.WbND1oFf_EIqPpEe4Ox1-SbXyQ7hUBR_0 2024-09-14T11:56:15.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.183+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.186+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:56:15.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.187+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.188+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49051' 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5329641689954096768', time=2024-09-14T13:43:19.926219+0000, chain.objs.size()=3 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-LUKEWARM.2~jOvt9oKbKjQ73HoLAX4Aj6dEpAzBYqn.1 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-LUKEWARM.2~jOvt9oKbKjQ73HoLAX4Aj6dEpAzBYqn.2 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-LUKEWARM.2~jOvt9oKbKjQ73HoLAX4Aj6dEpAzBYqn.3 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6464547970564042536', time=2024-09-14T13:45:15.909276+0000, chain.objs.size()=1 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.249__shadow_.969VCwcI_GKONiM-JZsv9nvjP7F9ZB__0 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8714061537155761382', time=2024-09-14T13:45:22.122130+0000, chain.objs.size()=1 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.262__shadow_.Y31eRntTRpKZhuViLKqoHO8nNaZkIWK_0 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18184403915104940069', time=2024-09-14T13:45:30.244207+0000, chain.objs.size()=1 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3zmKdUITMstexqe7uqH8iY6m091YyqU_0 2024-09-14T11:56:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4333267798810046921', time=2024-09-14T13:45:30.246177+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RkBVzP69ZSqkRZV2uOEWGBIBYBL4akM_0 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17110902609611703133', time=2024-09-14T13:45:30.284514+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2DZNU-a37-kVXBkGJezCMlCgs0mwN5r_0 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3279726431983427611', time=2024-09-14T13:45:30.293239+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lpeAEMzlnPyi1JzrDfUNBHKImWWKh4P_0 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7191286422871387325', time=2024-09-14T13:45:30.405745+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YhaG7bDiE12PcnPjYZPAFHK0f-vI-Z5_0 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15011744421068095318', time=2024-09-14T13:45:30.408865+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.u7qKrynG951nS9paEnG1LVCIlat7FSH_0 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10233091646874951598', time=2024-09-14T13:45:30.434044+0000, chain.objs.size()=1 2024-09-14T11:56:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.189+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aNNlATi5S9HW1mZpIh459Ioor2c6p-i_0 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14159748664733446480', time=2024-09-14T13:45:30.437320+0000, chain.objs.size()=1 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._2zidyuo1HhfT6skmi8OlBKKOvnHJUc_0 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.668348823379386730', time=2024-09-14T13:45:30.490158+0000, chain.objs.size()=1 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RE5rNgZg9h5E2p2ZFndMCmB6fFgaNp3_0 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6864522019477736453', time=2024-09-14T13:45:30.501895+0000, chain.objs.size()=1 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dqyDEc-i_P94DrMhMDhMxvYdfYbTcLy_0 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15996918695766459601', time=2024-09-14T13:45:30.596772+0000, chain.objs.size()=1 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DMbuZW2Xqt08zNU8wZ4WYCHGIsUCVnl_0 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7443235241251132762', time=2024-09-14T13:45:30.605037+0000, chain.objs.size()=1 2024-09-14T11:56:15.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1BEABIBrt8RWSYpqqCgKzmnGGLRJxYi_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14808330444379405403', time=2024-09-14T13:45:30.623245+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.192+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eKmFCqLiSZkAjsbzPNoRrdHNDYyZmmq_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17939545902701386852', time=2024-09-14T13:45:30.649379+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7eyvyfpcWdZGsJJGOi5pv6mKOMVkJ8X_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8533093297480718696', time=2024-09-14T13:45:30.671291+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.arCGdPJJFYqTqMD6nvlC3CAJZ5fzzlm_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10542952569539407849', time=2024-09-14T13:45:30.690733+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.dTNUpazupyD5jS11n8NmhQOQzSC4aO0_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6363961256969837224', time=2024-09-14T13:45:30.793717+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kRX-L2uW8fyEgeSze9Fg9hBM7j1UZIc_0 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14303303855894186134', time=2024-09-14T13:45:30.805414+0000, chain.objs.size()=1 2024-09-14T11:56:15.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.193+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yNUxO3CkozEhIJi2b1UcRg1LkcMb2p9_0 2024-09-14T11:56:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.195+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18332361398442097758', time=2024-09-14T13:45:30.807805+0000, chain.objs.size()=1 2024-09-14T11:56:15.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.195+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MunX6iv88ybNX5M3WgAzi7nofkEQduG_0 2024-09-14T11:56:15.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.196+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.971658100121416365', time=2024-09-14T13:45:30.841509+0000, chain.objs.size()=1 2024-09-14T11:56:15.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.196+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tTYB9ZKLiubhTLLliQqUfglvBK4-bUM_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.196+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10348466714314579670', time=2024-09-14T13:45:30.858907+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.196+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lajdLFhw0QE-kVkPDeCfGln24lkBX_n_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1306424773108576665', time=2024-09-14T13:45:30.879598+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hxuec38NOchV6BEYiodAXpId4njdryu_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8619294354366997773', time=2024-09-14T13:45:30.956161+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cEFQBLZ5RAoR-qYBAF5G7tEaWgsDmzr_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4106480976949575658', time=2024-09-14T13:45:30.959185+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-ZRMiRYdGat1NHqBGTNXNvNfkhBj9gi_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13782431619632965025', time=2024-09-14T13:45:30.960798+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YJ9fkr4e1vsPUjTRoZsj9HIB_zbh3IK_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14812746023141109343', time=2024-09-14T13:45:31.007334+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7fXWKCgjK6PIQ8osh7W0KhF97P58ptm_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10629969128985261829', time=2024-09-14T13:45:31.174074+0000, chain.objs.size()=1 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zPD7mfCxMzfYEtY8ARsVlSWzkTgjWZh_0 2024-09-14T11:56:15.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2389985204801836800', time=2024-09-14T13:45:31.177602+0000, chain.objs.size()=1 2024-09-14T11:56:15.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GxDRXnbN3p7eTSBzobUwUyZZCm0geAx_0 2024-09-14T11:56:15.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17479546067887015129', time=2024-09-14T13:45:31.199789+0000, chain.objs.size()=1 2024-09-14T11:56:15.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.197+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LqHUJeiYTXSDAZ1AZeDZaJTlLKPVuEm_0 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.960957670156081070', time=2024-09-14T13:45:31.204286+0000, chain.objs.size()=1 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sKr0hBKwONp-Du70G4P2oFn_DARwFef_0 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13541170747798404788', time=2024-09-14T13:45:31.223607+0000, chain.objs.size()=1 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.mlsGp-36usZxB14nOvg3jW5IMofu2na_0 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12993588957471379180', time=2024-09-14T13:45:31.252874+0000, chain.objs.size()=1 2024-09-14T11:56:15.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.200+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eju5UZeRJWGcqqni1GzhN-led32BBud_0 2024-09-14T11:56:15.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3934869295816304085', time=2024-09-14T13:45:31.519272+0000, chain.objs.size()=1 2024-09-14T11:56:15.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.h2owjgFBth0VLD4kiOWD6IhcajiJlDr_0 2024-09-14T11:56:15.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11717915559768986282', time=2024-09-14T13:45:31.610565+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ww7Gd5LMGU1OZJNvH3N2nXupzHY5xfn_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13245877645715334562', time=2024-09-14T13:45:31.680524+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WEL2fBgTIaQE228CXlMU3wSht5FTcup_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17713150602386037896', time=2024-09-14T13:45:31.749174+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rxP7qWGiFGsVgjwCfV9IhAPdNdjYCmr_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14462094864832254699', time=2024-09-14T13:45:33.764492+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.267__shadow_.eBa7AChJR8YaC-Zd2Yk4N97Jz5ukCw1_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14797367147473603384', time=2024-09-14T13:45:34.698782+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.269__shadow_.htYBjFHq59p8pn239AjZUff0ZlCnJOw_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9962950619859079492', time=2024-09-14T13:45:44.821989+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.289__shadow_.AjhMJEieWOhm_uacmCSawY8aWZ8lFBO_0 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1131780653830432086', time=2024-09-14T13:45:45.275961+0000, chain.objs.size()=1 2024-09-14T11:56:15.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.201+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.290__shadow_.CHcFB3hFXPBr-5xtaDhZqoPjoOU8_12_0 2024-09-14T11:56:15.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1050250829192302046', time=2024-09-14T13:45:54.075548+0000, chain.objs.size()=1 2024-09-14T11:56:15.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.306__shadow_.nAgR6F0YxFoNJr4zbmz9O01oNrnx7xw_0 2024-09-14T11:56:15.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9453946639342122280', time=2024-09-14T13:46:10.954832+0000, chain.objs.size()=1 2024-09-14T11:56:15.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tG8eWleLrDfiC2_pwgcR17RUFsxFpNC_0 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2731977480221123677', time=2024-09-14T13:46:10.960669+0000, chain.objs.size()=1 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.204+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.js9oYvj9Ent5Jn-TVXyE3IUhfcQo8C1_0 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2541070262701402236', time=2024-09-14T13:46:10.989337+0000, chain.objs.size()=1 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xYRlUSD-bVpSGT5YFSI37mQV9dGvLjo_0 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4708940885068646074', time=2024-09-14T13:46:11.001147+0000, chain.objs.size()=1 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ul-XeCkrTBZD-zhTCd6VYvgwRYft5m7_0 2024-09-14T11:56:15.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11096290694028544276', time=2024-09-14T13:46:11.007322+0000, chain.objs.size()=1 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.N1s9-8YlCx3fUWIBrbU4KXG89C7_YME_0 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11165764191275238039', time=2024-09-14T13:46:11.133240+0000, chain.objs.size()=1 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7wpQNCVz3yJ4fxxmiSZAOrifHsjpSNH_0 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2913891075365649623', time=2024-09-14T13:46:11.180261+0000, chain.objs.size()=1 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qqmO247-P8N652qH6bWSp_9WILWP1wn_0 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8720453039674406882', time=2024-09-14T13:46:11.207127+0000, chain.objs.size()=1 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aMLsdmeNsYY6KRGloVgpS7MIuplaY2M_0 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7995029972197117230', time=2024-09-14T13:46:11.307567+0000, chain.objs.size()=1 2024-09-14T11:56:15.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.205+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aRka3ronUfbpMNDKWVljVHV9vcQYSsp_0 2024-09-14T11:56:15.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.208+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13236473406221005490', time=2024-09-14T13:46:11.318593+0000, chain.objs.size()=1 2024-09-14T11:56:15.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.208+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o80Q672nkpExQHIbCqC8uQ4hFGXyCDg_0 2024-09-14T11:56:15.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.208+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8311244519767195355', time=2024-09-14T13:46:11.323698+0000, chain.objs.size()=1 2024-09-14T11:56:15.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.208+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jmMalkMEtDOvF1MzKY3rpOnjulmW4v7_0 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16246525939782132074', time=2024-09-14T13:46:11.325875+0000, chain.objs.size()=1 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CLuzYZw3BZqgBJsQjad7DpfN_pLzWQL_0 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4824927534867316722', time=2024-09-14T13:46:11.345524+0000, chain.objs.size()=1 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pGRhj6iCiqMirHBp8CodRZnD4FQaaA6_0 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8280437062386698299', time=2024-09-14T13:46:11.369581+0000, chain.objs.size()=1 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7dWkvszNHTA3LGnyn6vrOhEnQz2Q0nM_0 2024-09-14T11:56:15.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16851075466774593616', time=2024-09-14T13:46:11.683384+0000, chain.objs.size()=1 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.goI_29D8sNGfrZQP51372Xa7syCPs6W_0 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13460042623857544275', time=2024-09-14T13:46:11.856553+0000, chain.objs.size()=1 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bvUh0RYVEbRJbSsBiXyd8AQtye_e6kR_0 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9260180138786587288', time=2024-09-14T13:46:11.859106+0000, chain.objs.size()=1 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.209+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.urBpOhsj5fsigIq-Yjqpir8CQ71u3T8_0 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15923496269459031957', time=2024-09-14T13:46:11.922779+0000, chain.objs.size()=1 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XRGzzsJOSXx5FDPVujZLSN6Sx9rVN4D_0 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.19064759545252323', time=2024-09-14T13:46:12.049861+0000, chain.objs.size()=1 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LP3Z6ABlops1c_6bs2i3ilrQeKDRUlD_0 2024-09-14T11:56:15.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16851763135074702788', time=2024-09-14T13:46:12.089300+0000, chain.objs.size()=1 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.210+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MKJK-06k0ZMtvrJQBdGf-pxD5sBhIaz_0 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.211+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14810989004842861144', time=2024-09-14T13:46:12.091287+0000, chain.objs.size()=1 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.211+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.whv2JcF8L-AYFkQEN4_j6mOfAQV6F3a_0 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.211+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16782383773510366280', time=2024-09-14T13:46:12.094616+0000, chain.objs.size()=1 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.211+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3CNX2_yBz_vaAd-lr9I7MCVveUCZey9_0 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.212+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8850076413987971409', time=2024-09-14T13:46:12.096071+0000, chain.objs.size()=1 2024-09-14T11:56:15.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.212+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xX8rNp35jg0nbXMZ0pME9n8NfadvvTM_0 2024-09-14T11:56:15.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15603917585119094546', time=2024-09-14T13:46:12.104889+0000, chain.objs.size()=1 2024-09-14T11:56:15.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0oGiGWbSmvVfP_c0n13ZMJnIUDovSKU_0 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11607776311036636371', time=2024-09-14T13:46:12.121756+0000, chain.objs.size()=1 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3dk264LopZEoXeJuNloKmfF-vZNj_he_0 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526353935180382763', time=2024-09-14T13:46:12.432139+0000, chain.objs.size()=1 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vpnoZ1is7GvVStqpvpztDlDNJdCEsJD_0 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1260568201640151324', time=2024-09-14T13:46:12.490312+0000, chain.objs.size()=1 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5RhLMATykc1ijwiUBcjuv2ccEC-aHFO_0 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2727204065606419994', time=2024-09-14T13:46:12.499564+0000, chain.objs.size()=1 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.213+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tP6G9rig2Z7wk-lrM2eFeDEdyxz4H3Z_0 2024-09-14T11:56:15.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16882378646717193445', time=2024-09-14T13:46:12.512756+0000, chain.objs.size()=1 2024-09-14T11:56:15.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vlQhrxGB6TZKereUQ6X7FRSBsOf3UU0_0 2024-09-14T11:56:15.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17115881091192181045', time=2024-09-14T13:46:12.516419+0000, chain.objs.size()=1 2024-09-14T11:56:15.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ryGoidLB7NkMJ49RJM9K53q08TVMn2u_0 2024-09-14T11:56:15.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16034882509426993055', time=2024-09-14T13:46:12.605894+0000, chain.objs.size()=1 2024-09-14T11:56:15.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.214+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8CfmlV4qvyR-cOd9OOXqUH9YtoGE6Hd_0 2024-09-14T11:56:15.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.215+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3588232112209421045', time=2024-09-14T13:46:12.630617+0000, chain.objs.size()=1 2024-09-14T11:56:15.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.215+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ev0PtJv_gwwZzuAN4kB4ilVwu5cP8d4_0 2024-09-14T11:56:15.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.215+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11359042908577861805', time=2024-09-14T13:46:12.635982+0000, chain.objs.size()=1 2024-09-14T11:56:15.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.215+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hrofEQSQzCydu7OiifXv45Xcej8dTcE_0 2024-09-14T11:56:15.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15204663739137372751', time=2024-09-14T13:46:20.711867+0000, chain.objs.size()=1 2024-09-14T11:56:15.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.erV6Wu4LVQqPcB6Pyn_A16R3SHbL_UJ_0 2024-09-14T11:56:15.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15421414743767737677', time=2024-09-14T13:46:20.714469+0000, chain.objs.size()=1 2024-09-14T11:56:15.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.InerIwaGiEjlCz-7oUeWmeU7TfupaNG_0 2024-09-14T11:56:15.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15555286552587748248', time=2024-09-14T13:46:20.813515+0000, chain.objs.size()=1 2024-09-14T11:56:15.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.216+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zrqZbMjRNWVVSMYYQvckwoqv12s3Gq2_0 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5901005946131827109', time=2024-09-14T13:46:20.967983+0000, chain.objs.size()=1 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.v_2YLzqhb0Wr2uLUAvP7pCDDsFLo55t_0 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11669011395244991114', time=2024-09-14T13:46:20.984270+0000, chain.objs.size()=1 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CKAK3V82tc1KeIcmYg2x54IvfKNIiff_0 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9374679320248886197', time=2024-09-14T13:46:21.007116+0000, chain.objs.size()=1 2024-09-14T11:56:15.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.218+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XlGWluql8QVks42hyt2MWRfuxUmCBHL_0 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12347030660127377149', time=2024-09-14T13:46:21.013548+0000, chain.objs.size()=1 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rA97GMpNzpyI5LJAf2kwZLKQILAfa_m_0 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14434895356390547378', time=2024-09-14T13:46:21.092322+0000, chain.objs.size()=1 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LiDym9iXFca7Ex4U67Q2Su-bt5uzstq_0 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9828845940384929701', time=2024-09-14T13:46:21.097085+0000, chain.objs.size()=1 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZZoFPz_WDgb9_FfP9bDNlo9ra1o5Pvf_0 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7538292987293705436', time=2024-09-14T13:46:21.122139+0000, chain.objs.size()=1 2024-09-14T11:56:15.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1SsgFQQVTuhUXA4Px0SWnuJ8O82mDRr_0 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11538082067923361026', time=2024-09-14T13:46:21.153210+0000, chain.objs.size()=1 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Opbq-5pEDRZ9fgKjGvIARJ9Acme7zhv_0 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4269186436828605189', time=2024-09-14T13:46:21.168133+0000, chain.objs.size()=1 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.220+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Cfn4eu8UR5e89sUJFPUzm1z_z6ttmdE_0 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9022935595314478336', time=2024-09-14T13:46:21.291962+0000, chain.objs.size()=1 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2sbvve3mcLqt1sLQrd_LvE5XC4wCAME_0 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18275673403775688222', time=2024-09-14T13:46:21.312346+0000, chain.objs.size()=1 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eYqJFydeDXdl-0uvzeogBHEXZza2IAb_0 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9722289029500983853', time=2024-09-14T13:46:21.319441+0000, chain.objs.size()=1 2024-09-14T11:56:15.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.221+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aSn2R1MS3O8D61xDKDMkWVwRXj1RHuy_0 2024-09-14T11:56:15.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.222+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15874577431064441440', time=2024-09-14T13:46:21.388891+0000, chain.objs.size()=1 2024-09-14T11:56:15.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.222+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.C5f7cE-x_oLu3XamBMdGC2KDJlLDGXu_0 2024-09-14T11:56:15.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.222+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.530279767873744629', time=2024-09-14T13:46:21.496069+0000, chain.objs.size()=1 2024-09-14T11:56:15.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.222+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ys8xYUPHeOs62AbHSPiExOHkpszEALv_0 2024-09-14T11:56:15.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.223+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1714504427190077917', time=2024-09-14T13:46:21.881995+0000, chain.objs.size()=1 2024-09-14T11:56:15.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.223+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.NaFOy2oOSKw49BwQKsUe82Vbse339QJ_0 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.752943363094198366', time=2024-09-14T13:46:21.944221+0000, chain.objs.size()=1 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KS1y6tyADweb5a1rEAmHBNoxy_fb0MW_0 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9761625005756032505', time=2024-09-14T13:46:21.961208+0000, chain.objs.size()=1 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bYDEVkb8XJ6UBg9ZvEKc39xY5ZBweD5_0 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10253639770883193171', time=2024-09-14T13:46:22.042345+0000, chain.objs.size()=1 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lY5HO-1MoKB5gl20rsGQ2-v4vg0oPE6_0 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3205124441659595268', time=2024-09-14T13:46:22.087713+0000, chain.objs.size()=1 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Ehz28Szv6PcAUmrCMUrxQYnLRSz1IFT_0 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5419459945063616651', time=2024-09-14T13:46:22.097665+0000, chain.objs.size()=1 2024-09-14T11:56:15.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.224+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mi9mmcrSkchRbYclqyHN5eXdoNnAIEi_0 2024-09-14T11:56:15.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.227+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/49051 2024-09-14T11:56:15.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16184044895138366778', time=2024-09-14T13:46:22.105025+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kK9u7LiL41Ju2-l6NvUT7PVdRgFG_48_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5847194566977404093', time=2024-09-14T13:46:22.108477+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.oRC9TcIMxnyJJ1B2G6I__sBd0kFIpR5_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12081071026948792527', time=2024-09-14T13:46:22.112245+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qm9YMoH0afiHjtvIOoLfdoV7KbNG8k1_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3093648318060173855', time=2024-09-14T13:46:22.142960+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VkcHBg7MV5RvYxGZS53aNFNBuI5wgrL_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.71107523898997746', time=2024-09-14T13:46:22.283868+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8LQ-0XIakEziLSlmKPgJb4OGDooPOtF_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7663335416720683211', time=2024-09-14T13:46:26.347374+0000, chain.objs.size()=1 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.334__shadow_.i_CkBLzJuphI9TwwFLQvixjknuW7qro_0 2024-09-14T11:56:15.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15708587369242346737', time=2024-09-14T13:46:45.296437+0000, chain.objs.size()=1 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.375__shadow_.C9kdQgoxg7UExK2PuvIbaGyS74dWeot_0 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1831416780681569616', time=2024-09-14T13:47:16.465787+0000, chain.objs.size()=1 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.434__shadow_.kTPh4IA6LJJ7gF_YiKPM2uefBsWV90B_0 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14610292120889990744', time=2024-09-14T13:47:28.525553+0000, chain.objs.size()=1 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.456__shadow_.n0yiRlx8zHuLbFlgIX_Ue5cvub6aSef_0 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4272324523405763983', time=2024-09-14T13:48:06.986481+0000, chain.objs.size()=6 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.1 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.8RG-SDt6HVY71spD_5mSJewuo5v_bSdS.2 2024-09-14T11:56:15.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.230+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.3 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.4 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.5 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~KAbp5FIAUwXKW0vy4mzb8NZcnwDxcyI.6 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1958011367601048043', time=2024-09-14T13:48:56.109293+0000, chain.objs.size()=1 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.551__shadow_.jRHmctK0AB1WbD_e8V3EGlO3fMTsqnu_0 2024-09-14T11:56:15.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9178372129087242468', time=2024-09-14T13:49:21.309736+0000, chain.objs.size()=1 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow_.IQOkcsPHWCE3MvHPrPkwsW3lIaGf5ep_0 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2962965543118069050', time=2024-09-14T13:49:21.493963+0000, chain.objs.size()=1 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:VRzzpHcPeXcjTE8KBK-PfvCJGRLLAHr_.f5GVn3yE_8sLarYDDFHItgbOZRHkNco_0 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7457438862935659999', time=2024-09-14T13:49:37.879161+0000, chain.objs.size()=1 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.233+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:Lbfqy6FWXyo6W.EXZ4W2TEGQRgwFN9T_.7wg-vZCWPUPPwuNWLRnMGj7266ZB_4t_0 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9120870339124118164', time=2024-09-14T13:49:44.404544+0000, chain.objs.size()=1 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:EptnBwmdXi3QjUSog4o6UhLnHKJW4km_.jcnmiICtGx-NPZ1QEPyMM-JlQ3GMy1C_0 2024-09-14T11:56:15.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1782714305105136108', time=2024-09-14T13:49:48.346751+0000, chain.objs.size()=1 2024-09-14T11:56:15.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.586__shadow:svwdOHeUkPjXOEhlpQ-VXAJnphKuRqN_.rZW24EPKibxc5Jk2MTeJ0AnPJfV7x7w_0 2024-09-14T11:56:15.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.98693593159764138', time=2024-09-14T13:49:57.731246+0000, chain.objs.size()=1 2024-09-14T11:56:15.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.607__shadow_.aOLOTf8Zm7KRnJ-OER8tAF4pmyb62H5_0 2024-09-14T11:56:15.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5571658277935603582', time=2024-09-14T13:49:58.168035+0000, chain.objs.size()=1 2024-09-14T11:56:15.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.234+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.608__shadow_.5qQrWrw1UogMG9eQEZfOimkosExTtPZ_0 2024-09-14T11:56:15.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.237+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14631736274429793814', time=2024-09-14T13:52:46.605489+0000, chain.objs.size()=1 2024-09-14T11:56:15.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.237+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.692__shadow_.a9aepbXJHP1NntMgkMkJzTOz-Vs7llN_0 2024-09-14T11:56:15.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.240+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.242+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:56:15.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.243+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46159' 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17769920352394693142', time=2024-09-14T13:43:14.319431+0000, chain.objs.size()=1 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.148__shadow_.2I7prJxpduNdbT28rUzgknlmRFJMFDf_0 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_ElwXdc9Hnv6R_RBOGYOEb6ibHoSssB8', time=2024-09-14T13:43:23.124593+0000, chain.objs.size()=1 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.164__shadow_.T0cTmGLvNGF8adbxqKbOeTOvwOqBocW_0 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10995217120606605722', time=2024-09-14T13:45:18.782313+0000, chain.objs.size()=1 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.255__shadow_.a7HjGGmwQdr1JfVs1PKAf7JpkVqJxW5_0 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2925150650023966140', time=2024-09-14T13:45:22.122721+0000, chain.objs.size()=1 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.262__shadow_.f43Cq3DncJ7zoz2nVgnP2WZfbV-_Set_0 2024-09-14T11:56:15.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3388270431479170166', time=2024-09-14T13:45:30.228510+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KbWr2hm4YGUXgVcii_OJ_mzI_R_ds3w_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12472053914522810087', time=2024-09-14T13:45:30.243469+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ao2hMcgEncRwsczNJuZORjJUGawpKT4_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10511457942078906717', time=2024-09-14T13:45:30.426643+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WBwdFyLY7PsF9UhjtDFswaOoirlkmLx_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17670800718767541981', time=2024-09-14T13:45:30.443467+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.l1TNi2u-YMb6XcNyifBmUbt92oBF4wR_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16229782379116671457', time=2024-09-14T13:45:30.452783+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Mkpp_YG_cXsHUfTr7fEKHZ1tLOtll6p_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5307573659615157697', time=2024-09-14T13:45:30.471930+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lQU_LXBYJobDFDQDPo1tByJbNWaw3Ew_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7277179687107722918', time=2024-09-14T13:45:30.479640+0000, chain.objs.size()=1 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uLezyXw5YcpGYm7AbCO5wiuDvjwRt3r_0 2024-09-14T11:56:15.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10735158086375563553', time=2024-09-14T13:45:30.481129+0000, chain.objs.size()=1 2024-09-14T11:56:15.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.244+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6w-cG819elva6_zxPRNylDsSxVPHsO2_0 2024-09-14T11:56:15.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.541028759266823613', time=2024-09-14T13:45:30.500581+0000, chain.objs.size()=1 2024-09-14T11:56:15.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.YYfJYXGlZJC6RE0Neep3SRknkLi9uLg_0 2024-09-14T11:56:15.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2234817235288241201', time=2024-09-14T13:45:30.618733+0000, chain.objs.size()=1 2024-09-14T11:56:15.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Wp_6-purZMparpCAqfLP0wJZFlVcqm1_0 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12714617973384835615', time=2024-09-14T13:45:30.628279+0000, chain.objs.size()=1 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oaa35V2xHA3rD_4hJHcRIQoDWqnMHkS_0 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14488114338954974920', time=2024-09-14T13:45:30.643357+0000, chain.objs.size()=1 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ea7e1Tibzv0fJCtbo4T6QgSvotfd6nZ_0 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8840386705110907788', time=2024-09-14T13:45:30.678991+0000, chain.objs.size()=1 2024-09-14T11:56:15.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.248+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4NUHw4GL38YcxOiyiHCAjbhN3YCdPpM_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.466596765078867556', time=2024-09-14T13:45:30.681572+0000, chain.objs.size()=1 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KpFo8S0pIEmTTvK2eQKs3n-MtJtXekj_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6362655310404273022', time=2024-09-14T13:45:30.794433+0000, chain.objs.size()=1 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Dq2N0NIgBsdzyWbieyQasdwg8y5oszI_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1048130120954819226', time=2024-09-14T13:45:30.874214+0000, chain.objs.size()=1 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GksEKRYkSZh1UxIg5I_RlVR7ttZlFyM_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3464832340239051054', time=2024-09-14T13:45:30.876372+0000, chain.objs.size()=1 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.K-j_G077LJ4_Bf0aUj_12bKQjVUVa3m_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13006036982502958104', time=2024-09-14T13:45:30.961624+0000, chain.objs.size()=1 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1GO3_Xjd7IuWVXq_suYBZZUMpfBhEfH_0 2024-09-14T11:56:15.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13712245238135842964', time=2024-09-14T13:45:30.999735+0000, chain.objs.size()=1 2024-09-14T11:56:15.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.249+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hciTW0W_Q6HF9pLMgmmxP_caXj-bmfF_0 2024-09-14T11:56:15.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.251+0000 7f1759f34640 0 -- 172.21.15.94:0/4146541551 >> [v2:172.21.15.131:6800/2577403967,v1:172.21.15.131:6801/2577403967] conn(0x7f1754068b70 msgr2=0x7f16240984a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.252+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.153225093641142062', time=2024-09-14T13:45:31.000665+0000, chain.objs.size()=1 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.252+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kliNVuyVAL9ma7Fig1pjAb74ALPqJZH_0 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.252+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4980844664208975889', time=2024-09-14T13:45:31.030010+0000, chain.objs.size()=1 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.252+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.JZBn7a2EOVmEWQiI6_e8kjOpiBCl9uO_0 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9242738329086285568', time=2024-09-14T13:45:31.031687+0000, chain.objs.size()=1 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.yBCtUKPfWMYEW3ne3l2CUacRvb_ThXR_0 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16282576017003841942', time=2024-09-14T13:45:31.048317+0000, chain.objs.size()=1 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.NRIqulG6PDHonrR2CywyskDftLauToN_0 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3525279873753727142', time=2024-09-14T13:45:31.051567+0000, chain.objs.size()=1 2024-09-14T11:56:15.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vC_0peuzOU8ezA_WGBUchwbBbXoiQZV_0 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13704740119192237554', time=2024-09-14T13:45:31.175129+0000, chain.objs.size()=1 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.USg3gwFBIzDCJ7omL88rrbJHlQg6ik7_0 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9222629867140804396', time=2024-09-14T13:45:31.182859+0000, chain.objs.size()=1 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.UGrSObUPR80XE7ioeybiavw-yGe102N_0 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15006095756136196560', time=2024-09-14T13:45:31.227699+0000, chain.objs.size()=1 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kjdssjT3QeGEcicxzYmrQBYPuFVd9fZ_0 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11138576034520925276', time=2024-09-14T13:45:31.525525+0000, chain.objs.size()=1 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.253+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GSJzufoCFApHvlEcg272ucN997yi41h_0 2024-09-14T11:56:15.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.254+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7388622921737706636', time=2024-09-14T13:45:31.543661+0000, chain.objs.size()=1 2024-09-14T11:56:15.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.254+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VFqtyTuYWcRYZLX3MSoYTnzmEYarDU8_0 2024-09-14T11:56:15.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.254+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3242502105808951025', time=2024-09-14T13:45:31.609099+0000, chain.objs.size()=1 2024-09-14T11:56:15.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.254+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4r-mRzKgSn9RrICb5QubWEJu3RKrEma_0 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16725260001609515819', time=2024-09-14T13:45:31.724698+0000, chain.objs.size()=1 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.k43jNmR2-0mMSyCdx_kvWOf2n_xfJrd_0 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.121910100298550280', time=2024-09-14T13:45:31.757719+0000, chain.objs.size()=1 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f5cSnT4wBdet6EvFmgh7koBY6R0r9z2_0 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3083764288309602817', time=2024-09-14T13:45:31.772451+0000, chain.objs.size()=1 2024-09-14T11:56:15.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.256+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FdGf7Y0-5kfhIALPFJxkrZhdyPr0PZK_0 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7883838813317823911', time=2024-09-14T13:45:39.804529+0000, chain.objs.size()=1 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.279__shadow_.g36laqKXcCJKwyjp_aZiX7S6koWNHjs_0 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3292163421010195374', time=2024-09-14T13:45:41.782011+0000, chain.objs.size()=1 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.283__shadow_.1-f0N_QepgxCX8fx5R64Z-5z63Cbzwi_0 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12235559286798957772', time=2024-09-14T13:45:43.872052+0000, chain.objs.size()=1 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.287__shadow_.rbIWYo7GT-Xlqa3-y-grNY8qu6GgBIN_0 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11799449548410494689', time=2024-09-14T13:45:45.733585+0000, chain.objs.size()=1 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.291__shadow_.fJdb390twO8poJWHWAO3akad_TFQV66_0 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12228162528580710289', time=2024-09-14T13:45:48.184323+0000, chain.objs.size()=1 2024-09-14T11:56:15.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.JxKaJGXc-JcMK5aEm_b3CaPzonzteok_0 2024-09-14T11:56:15.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4429727602800957812', time=2024-09-14T13:45:49.170887+0000, chain.objs.size()=1 2024-09-14T11:56:15.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.257+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.296__shadow_.p17b4WoY4Fc0cMs4mwrWlcEa6EDTPi-_0 2024-09-14T11:56:15.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.258+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9353197639138666952', time=2024-09-14T13:45:52.635842+0000, chain.objs.size()=1 2024-09-14T11:56:15.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.258+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.303__shadow_.cBAbRbyy10LP4fzT2cx4vNMHk9yJLd0_0 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11704565977539663033', time=2024-09-14T13:45:54.731272+0000, chain.objs.size()=1 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.307__shadow_.T7yWv7XNY2PcFdgSxYRcAQyBm-Cq8nT_0 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2814200938915621323', time=2024-09-14T13:46:10.938694+0000, chain.objs.size()=1 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9BTkA6V80L08AnQ9AYgNf7vj2UHgt33_0 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9996138321644323489', time=2024-09-14T13:46:10.944310+0000, chain.objs.size()=1 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vZ2nyImerspU52BoETDWmeSSMdMRQ37_0 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1976365718963894377', time=2024-09-14T13:46:10.999472+0000, chain.objs.size()=1 2024-09-14T11:56:15.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.259+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iSMuPYUWIb4wkYx8es2zwq5_FNSaXEG_0 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.260+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.465941721605657166', time=2024-09-14T13:46:11.008774+0000, chain.objs.size()=1 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.260+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9KyTlpBhOKlZ5ErMiUO24JqUFZxZ4QJ_0 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.260+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8492435154589184333', time=2024-09-14T13:46:11.150325+0000, chain.objs.size()=1 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.260+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.03ufnkdEIwk1ML3D8E181ehpzub_ooB_0 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12285259076618318069', time=2024-09-14T13:46:11.163248+0000, chain.objs.size()=1 2024-09-14T11:56:15.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.S4q6-NqKrTtLGjCbeVy7vsI75dbz6Hk_0 2024-09-14T11:56:15.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17757032669595337916', time=2024-09-14T13:46:11.192934+0000, chain.objs.size()=1 2024-09-14T11:56:15.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VgeM2HyZO5_1-JoGnr1Ts9E1r4XIOzA_0 2024-09-14T11:56:15.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10807306761444235177', time=2024-09-14T13:46:11.319413+0000, chain.objs.size()=1 2024-09-14T11:56:15.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.261+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.f7TEQJyhxjRc9IVgZLP00phrn4XgGm1_0 2024-09-14T11:56:15.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.263+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5167184085987367491', time=2024-09-14T13:46:11.324818+0000, chain.objs.size()=1 2024-09-14T11:56:15.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.263+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IeQ_6GoAXihxb3gwEKxzys4raoKFBk8_0 2024-09-14T11:56:15.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.263+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8577699209782742320', time=2024-09-14T13:46:11.370921+0000, chain.objs.size()=1 2024-09-14T11:56:15.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.263+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.H_12hlTM7jOunLBzoU3PGl9lnrsmGNa_0 2024-09-14T11:56:15.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.264+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3335153736508819467', time=2024-09-14T13:46:11.379014+0000, chain.objs.size()=1 2024-09-14T11:56:15.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.264+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DUu7L-fOfU-BOkmRmv4MATUNuGRTY7Q_0 2024-09-14T11:56:15.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2166124257818742971', time=2024-09-14T13:46:11.384208+0000, chain.objs.size()=1 2024-09-14T11:56:15.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.i5rZ0OTF6UIhEnfIUytfdnImLTKMcaP_0 2024-09-14T11:56:15.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8584371873798213651', time=2024-09-14T13:46:11.570543+0000, chain.objs.size()=1 2024-09-14T11:56:15.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.J0n1yfpag1VlQAIlUuuzGbBdMQzMwi0_0 2024-09-14T11:56:15.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7770869573455839369', time=2024-09-14T13:46:11.656987+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.te-JnFF1K5EasrPSuimgMnlV8Oy0Vb3_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6752075395326027603', time=2024-09-14T13:46:11.669000+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._aStcXV8_QfX-WEnRmSKvIFLCoYrPPI_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17140790928208263959', time=2024-09-14T13:46:11.707751+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xg5vSTKKrA-gJAWy8Ei1iGllUELaLPf_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2624111549698465384', time=2024-09-14T13:46:11.719654+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7FsHSJwS7Y5F3gn9XgH9T-4NTbOOhEf_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5961340768085227492', time=2024-09-14T13:46:11.728351+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LhiJFfJRiFN5gXqsuEs8Hw7lou7OSSC_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17712065038759478719', time=2024-09-14T13:46:11.744704+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dfTvCnpijDXkSjsBhU-S5k8hRdZhwj5_0 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3236228112367610038', time=2024-09-14T13:46:11.746624+0000, chain.objs.size()=1 2024-09-14T11:56:15.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.pdUXAqELwj8OjId6-JPr5AiYztEFg37_0 2024-09-14T11:56:15.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.274298736070680259', time=2024-09-14T13:46:11.756310+0000, chain.objs.size()=1 2024-09-14T11:56:15.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.265+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xidE0LekJNYAbAO-tHgEc3ndEAWqNOO_0 2024-09-14T11:56:15.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.268+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8893558773380439092', time=2024-09-14T13:46:11.855596+0000, chain.objs.size()=1 2024-09-14T11:56:15.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.268+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DQB0lN7PCSd7TC4vNsmxQZbgC5rBL-U_0 2024-09-14T11:56:15.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.269+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16074699278820995224', time=2024-09-14T13:46:11.864857+0000, chain.objs.size()=1 2024-09-14T11:56:15.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.269+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Y1ZcTrkkeVGCuitSbpIXMD1yMF8ap_M_0 2024-09-14T11:56:15.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.269+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13195523379362883467', time=2024-09-14T13:46:11.926549+0000, chain.objs.size()=1 2024-09-14T11:56:15.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.269+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aBxFNYUm7A7ramiTUAtfhPbmCBR5y6J_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8836334262233321595', time=2024-09-14T13:46:12.026981+0000, chain.objs.size()=1 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ByLqsggP9FDekGroruErzsuDQTFqsyG_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13032187625953347565', time=2024-09-14T13:46:12.048479+0000, chain.objs.size()=1 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.U-rJMlexxj2H-VCPMDSWutduJRtSz3b_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14695070480201077821', time=2024-09-14T13:46:12.084457+0000, chain.objs.size()=1 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.30mhddqAEXXkqo5n6VD06_LFd6AxT6J_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14427827328951660129', time=2024-09-14T13:46:12.092601+0000, chain.objs.size()=1 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5PBXYgDzg1gwscE1l8rsTBdHQYxsFM5_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17393798810058978553', time=2024-09-14T13:46:12.118861+0000, chain.objs.size()=1 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-0nsBwPquq7-HGki5dEFWNrtd_B0Tx8_0 2024-09-14T11:56:15.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8265818285914580296', time=2024-09-14T13:46:12.457212+0000, chain.objs.size()=1 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2FNdCA813W00jFDNHWQmEzbLf2UBnXs_0 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9791392959099703134', time=2024-09-14T13:46:12.467267+0000, chain.objs.size()=1 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5BKQbDnrKZWbl_rerQP-dsmD-enP7hZ_0 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10786820257813991986', time=2024-09-14T13:46:12.505828+0000, chain.objs.size()=1 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.270+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.dR7W4q_nDTPxKP8v08x5ydZKelJGrRf_0 2024-09-14T11:56:15.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.272+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2877077739975385436', time=2024-09-14T13:46:12.522721+0000, chain.objs.size()=1 2024-09-14T11:56:15.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.272+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y_tNkg9thvayx_BH7wUDLAqdGT02IQ7_0 2024-09-14T11:56:15.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.272+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13891136619385186250', time=2024-09-14T13:46:12.680178+0000, chain.objs.size()=1 2024-09-14T11:56:15.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.272+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Pnym0QjxirRCTgPbuM1GMmyTZLle8NY_0 2024-09-14T11:56:15.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.273+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9443711723050017407', time=2024-09-14T13:46:20.903673+0000, chain.objs.size()=1 2024-09-14T11:56:15.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.273+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.sjZGV4yQLlWPTGz4o65ah6uP2YpXshq_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.226983659604509596', time=2024-09-14T13:46:20.976596+0000, chain.objs.size()=1 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Rt1vVn8wcajP_XbvqoKmtjOvKGROEib_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9669750025037526484', time=2024-09-14T13:46:21.092768+0000, chain.objs.size()=1 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.gmr2niiNBLY8o-HzLW3FWv1Z1nomeVZ_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9373830329567247212', time=2024-09-14T13:46:21.197737+0000, chain.objs.size()=1 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.s-ywSWtwc-fmVNCqi4nj6_3qAC2pjiF_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3261755778821553305', time=2024-09-14T13:46:21.284186+0000, chain.objs.size()=1 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VpJLGq2Op7OAOifTvZNUT0ULgQPR76e_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15404640362175775604', time=2024-09-14T13:46:21.739338+0000, chain.objs.size()=1 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CVhnSO610nZpOQfZWmct93NteeoYfFZ_0 2024-09-14T11:56:15.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9648985411508617981', time=2024-09-14T13:46:21.771270+0000, chain.objs.size()=1 2024-09-14T11:56:15.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YmazeHD-Q3S5-8w7C8W334H9Tapkr7d_0 2024-09-14T11:56:15.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14356941652586976354', time=2024-09-14T13:46:21.775698+0000, chain.objs.size()=1 2024-09-14T11:56:15.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IilGlduE-Vo-SDqOJCXQ86Idrk06dAj_0 2024-09-14T11:56:15.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.260249414441218331', time=2024-09-14T13:46:21.896879+0000, chain.objs.size()=1 2024-09-14T11:56:15.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.274+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VC6FyooGRZZF_oyB74vt7OcEufencpL_0 2024-09-14T11:56:15.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.276+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16823391106418076608', time=2024-09-14T13:46:21.912815+0000, chain.objs.size()=1 2024-09-14T11:56:15.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.276+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yNRjcUjRAp6bYyDPygbfSYMPpO-5WgP_0 2024-09-14T11:56:15.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.276+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9605246769412072472', time=2024-09-14T13:46:21.950094+0000, chain.objs.size()=1 2024-09-14T11:56:15.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.276+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9i81LW_GxYjo0NqhQQUVbVI0drjIzBL_0 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7067543967811213959', time=2024-09-14T13:46:22.040722+0000, chain.objs.size()=1 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lnhYjwwqYxLCw_1fW6NGWJKxjjWgzAK_0 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15989389091022689085', time=2024-09-14T13:46:22.045064+0000, chain.objs.size()=1 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.FMmP45wWbDdHxxf_mEUx3XBbxrC4REs_0 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12905320048776266972', time=2024-09-14T13:46:22.088715+0000, chain.objs.size()=1 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._OTZ9KjTI-Y2DB_YhAb_ezYh04YK8mV_0 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7840350507496601871', time=2024-09-14T13:46:22.116570+0000, chain.objs.size()=1 2024-09-14T11:56:15.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.277+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.E5sQoJm9U-hfHNiOViDkI-poSH9R4Lr_0 2024-09-14T11:56:15.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.278+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10727361414180440245', time=2024-09-14T13:46:22.141517+0000, chain.objs.size()=1 2024-09-14T11:56:15.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.278+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZmK5Vz67-B5EzRvI6t0hp0PqLm8Xhwj_0 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.278+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12244664237745137240', time=2024-09-14T13:46:22.264792+0000, chain.objs.size()=1 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.278+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0o2bmacuPK1k01zIcBoxyTYS3gR9jmg_0 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7104845054241899383', time=2024-09-14T13:47:21.542356+0000, chain.objs.size()=1 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.444__shadow_.HcBNWARLVh-Cm-5XmfA80Sv85d9RTMY_0 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6319304642182101464', time=2024-09-14T13:47:27.796111+0000, chain.objs.size()=1 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.455__shadow_.YI2E_D75JUCVxdxIrxQpF15gKWnkMmI_0 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11428202460585814239', time=2024-09-14T13:47:42.120689+0000, chain.objs.size()=1 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.279+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.QCV_dmjISDhtOkBv7aDtcT59-P9eJTC_0 2024-09-14T11:56:15.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.280+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5843056011479153053', time=2024-09-14T13:48:03.122032+0000, chain.objs.size()=3 2024-09-14T11:56:15.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.280+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~PS1CQABLAGRTSY0HmF7LYqDZFwbUhb9.1 2024-09-14T11:56:15.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.280+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~PS1CQABLAGRTSY0HmF7LYqDZFwbUhb9.2 2024-09-14T11:56:15.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.281+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~PS1CQABLAGRTSY0HmF7LYqDZFwbUhb9.3 2024-09-14T11:56:15.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.284+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/46159 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12899086293050913846', time=2024-09-14T13:48:13.535710+0000, chain.objs.size()=2 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~Hun5dX3YZyR8bBE7F7CVWn9A6q_Tg9P.1 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~Hun5dX3YZyR8bBE7F7CVWn9A6q_Tg9P.2 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2954967787570511828', time=2024-09-14T13:49:13.979231+0000, chain.objs.size()=1 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:ikYFlpot4DsjG5Ff6Je8vVE0Z8WPmZb_.h7JLVtHeMfc8fLwV0j5inR2lSl5mU_W_0 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14832725497619347910', time=2024-09-14T13:49:33.797525+0000, chain.objs.size()=1 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:Js8ZvPRBzSejMxbkUdIpyDsk6jXBDVn_._u2MlaOV1jRIJoHLD0VNvyld1s-37fG_0 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16866993981388466198', time=2024-09-14T13:49:46.872322+0000, chain.objs.size()=1 2024-09-14T11:56:15.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.584__shadow:2Wiu3csjUG.TUdKAQPCzhNBtRNoaz4R_.u8q2NP9SmGXfWi28Jq3Y4yMfrmM1jjo_0 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14772751195894530326', time=2024-09-14T13:50:06.462059+0000, chain.objs.size()=6 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.1 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.2 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.3 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.4 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.5 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.616__multipart_multipart_enc.2~tJLNxClZTpg6ot1M400S2eCX7zCsZM3.6 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6301798390288206120', time=2024-09-14T13:51:08.509775+0000, chain.objs.size()=1 2024-09-14T11:56:15.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.286+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.618__shadow_.03f6tAMNKCL9nBuxq9r4i-71PTXRVmm_0 2024-09-14T11:56:15.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.288+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10320317692842512081', time=2024-09-14T13:52:22.723873+0000, chain.objs.size()=1 2024-09-14T11:56:15.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.288+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.643__shadow_.SyDXpOH_TpoHL2DxUUGpi53kycQxUhM_0 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8355836316548758216', time=2024-09-14T13:52:38.454015+0000, chain.objs.size()=1 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.673__shadow_.FxduCYU9Z1aaAz65Z44U06Sf5asSwD5_0 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5543313432339728282', time=2024-09-14T13:52:47.100907+0000, chain.objs.size()=1 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.693__shadow:BhbkPTPNmIx.LPAITAHs1djV-gzjsAq_.N2EObYlHxL6bzLJg-cPvHOKSWBB9r3e_0 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8852527910310248437', time=2024-09-14T13:53:58.181229+0000, chain.objs.size()=1 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.765__shadow_.X7VQqfiVjNWitjZ4UWdDSKs-5UCFoac_0 2024-09-14T11:56:15.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15154332356549748824', time=2024-09-14T13:54:00.509948+0000, chain.objs.size()=1 2024-09-14T11:56:15.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.768__shadow_.MpZm_8MFHbOymeUhh4OUXTZ1lA8qQLl_0 2024-09-14T11:56:15.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17262689891569448175', time=2024-09-14T13:54:03.663936+0000, chain.objs.size()=1 2024-09-14T11:56:15.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.772__shadow_.OVaPLWUjtKKzuBPBtqcOixS4Ta1HDuz_0 2024-09-14T11:56:15.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2028406874839800503', time=2024-09-14T13:55:37.620214+0000, chain.objs.size()=1 2024-09-14T11:56:15.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.289+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.783__shadow_.TqgDP3uLkIgXJvXPgspUy5TnJm8K5Yv_0 2024-09-14T11:56:15.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.294+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.296+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:56:15.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.297+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49558' 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11920861022726312934', time=2024-09-14T13:45:08.683244+0000, chain.objs.size()=1 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.237__shadow_.uayz-XOpafXKSwkvCJmqDSO6NQDt5v__0 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.525543500721876940', time=2024-09-14T13:45:10.378919+0000, chain.objs.size()=1 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.239__shadow_.s0JVGWhtH0RaRDtinCSuvQQRbqTgt0j_0 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6736082663096499341', time=2024-09-14T13:45:14.436214+0000, chain.objs.size()=1 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.298+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.246__shadow_.DcbOkgtx1XpFBp9daT4-S5-5X9ZkQ-c_0 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3391649879927242536', time=2024-09-14T13:45:15.908664+0000, chain.objs.size()=1 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.249__shadow_.eeVMURuQ0m2nvkejD5QrwV2t3gMj3_U_0 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3314791916754894262', time=2024-09-14T13:45:16.416866+0000, chain.objs.size()=1 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.250__shadow_.jTpqrCbUtnm89P29qz1ESnxRrWtY5-1_0 2024-09-14T11:56:15.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6790701433701286279', time=2024-09-14T13:45:17.825068+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.253__shadow_.lZk-ku1rtsO0NFmewABzjzT6DYM1L6l_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13079707305525211415', time=2024-09-14T13:45:18.782426+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.255__shadow_.lCES26YgF4LCNMZx46c1EYv0xdo-tnv_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6002714020037659461', time=2024-09-14T13:45:21.130510+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.260__shadow_.PNGKCojX2EH0m9NWUMqN6-Ys2eJl6tq_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8542738024813293779', time=2024-09-14T13:45:30.213894+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.94lCwcTYiXBnNYZNRpuwQlrwUwTR4v1_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3045343860217732979', time=2024-09-14T13:45:30.224581+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Piwc6jVgOcuqSjtMMNB3VDejVGkCHyc_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16441952645020476313', time=2024-09-14T13:45:30.229685+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KTW11nPgv65EvoMMdsFMKq0tfgGPZPc_0 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17485951037380984586', time=2024-09-14T13:45:30.255964+0000, chain.objs.size()=1 2024-09-14T11:56:15.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.299+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sd6a84gNJ6Uc0EM0ZG--t-3I8HldnF2_0 2024-09-14T11:56:15.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.301+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.842788966621987204', time=2024-09-14T13:45:30.285570+0000, chain.objs.size()=1 2024-09-14T11:56:15.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.301+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Xjr06ejdJ_3o4f4UyWHv5E9U9N3vGFI_0 2024-09-14T11:56:15.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.301+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6295164565965944553', time=2024-09-14T13:45:30.420152+0000, chain.objs.size()=1 2024-09-14T11:56:15.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.301+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-dLsJ-14jLYAYOfzdAbEUMcrq42MZ2k_0 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7765109743162991066', time=2024-09-14T13:45:30.493066+0000, chain.objs.size()=1 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.eFbtkkn5lFaQy5VxakKLnyGtQpsHH_V_0 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2675265304699613361', time=2024-09-14T13:45:30.613407+0000, chain.objs.size()=1 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wrHWRKtPdUBgKW2utgZ3malv5tWAQd7_0 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2241905292463853581', time=2024-09-14T13:45:30.624975+0000, chain.objs.size()=1 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PRjfxSRebXaDkh33HXqss0sJsR2K3MA_0 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4869084754867175079', time=2024-09-14T13:45:30.636507+0000, chain.objs.size()=1 2024-09-14T11:56:15.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V_bA3KS377V7MNlcltTFGY9vibY-EGc_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5588665478641694003', time=2024-09-14T13:45:30.682526+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.GMJosmnnJe1oUtz9Z1-yWk1--360Y38_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7725280754491411327', time=2024-09-14T13:45:30.685935+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PnLiTQjViIlsQUZ0c_kV9H-m8hucXPW_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3054457175678176882', time=2024-09-14T13:45:30.776056+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.cs2MjX4CRtL_yeZuDJZ_ZeGmGZRigqP_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7123951058680835218', time=2024-09-14T13:45:30.776793+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9bBalz7jqE3ZibA6vr4_HS5CRrxJGhj_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7322165487944914948', time=2024-09-14T13:45:30.824057+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oh8k_OeRh_zH4ypGZx8rx0DWUgLi1e1_0 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17345774540895658299', time=2024-09-14T13:45:30.869086+0000, chain.objs.size()=1 2024-09-14T11:56:15.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.303+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XMtuhlntqjOLntlKgQ3Yp_nFwM8y5VA_0 2024-09-14T11:56:15.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.305+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12736521408551554501', time=2024-09-14T13:45:30.975760+0000, chain.objs.size()=1 2024-09-14T11:56:15.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.305+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.K8JDQ2fZb8G4PjjuXc1QJewOWITKMWf_0 2024-09-14T11:56:15.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9179289371628278699', time=2024-09-14T13:45:31.028289+0000, chain.objs.size()=1 2024-09-14T11:56:15.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e-8JPzKfADIeS8RAY1glYVn14s6XhVa_0 2024-09-14T11:56:15.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2168182849605605960', time=2024-09-14T13:45:31.192619+0000, chain.objs.size()=1 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.X-zbUza9OT-Bt1Jxcr_hbo-Bi-sTPUP_0 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5821934580012442723', time=2024-09-14T13:45:31.194277+0000, chain.objs.size()=1 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vBTVaj7jPb9uuEEESwB22ilAuI77sY__0 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9220175203255359193', time=2024-09-14T13:45:31.425388+0000, chain.objs.size()=1 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ncZPRT3DeiQ_QyUHOSfTeGTrgxtZ8XQ_0 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12577747354129562371', time=2024-09-14T13:45:31.426504+0000, chain.objs.size()=1 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.TBfYv5LqGsMqHoHV5gli8fgf5ZS4fKa_0 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13315648790819848643', time=2024-09-14T13:45:31.503702+0000, chain.objs.size()=1 2024-09-14T11:56:15.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.306+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2NxYKIE5Mw-zxqgby4Pf3DJDHG9WH-u_0 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.542628627776905372', time=2024-09-14T13:45:31.558891+0000, chain.objs.size()=1 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.63y8fyQTqvBkI4r12kzNtAomNPFnOIi_0 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.756370193992265728', time=2024-09-14T13:45:31.582483+0000, chain.objs.size()=1 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.CQ090paSzqMavOBTeHswv-bWrfZb7OY_0 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17803653091942442604', time=2024-09-14T13:45:31.597992+0000, chain.objs.size()=1 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-gDc4qYhHVX_3EGs485sIaD5lBA6xcj_0 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1559217488298886571', time=2024-09-14T13:45:31.603053+0000, chain.objs.size()=1 2024-09-14T11:56:15.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.308+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WYdRp_1t2mreW2oYEqIGqmxDq7-wtkn_0 2024-09-14T11:56:15.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15452433974757923681', time=2024-09-14T13:45:31.681594+0000, chain.objs.size()=1 2024-09-14T11:56:15.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.jYw8Z_ZbJz6rPSlmvp4ZnyuJ-Iws86m_0 2024-09-14T11:56:15.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.309+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9800645821287083430', time=2024-09-14T13:45:31.691683+0000, chain.objs.size()=1 2024-09-14T11:56:15.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.309+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2wISxAX3ixOcveicKts5oPCcAbWqB9D_0 2024-09-14T11:56:15.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11042112889019309517', time=2024-09-14T13:45:31.723791+0000, chain.objs.size()=1 2024-09-14T11:56:15.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0gQdyVLoHDhJI8CVEjgQbqI0O9aJpES_0 2024-09-14T11:56:15.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16401713762937415658', time=2024-09-14T13:45:31.728536+0000, chain.objs.size()=1 2024-09-14T11:56:15.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.p6GM9Fb5EnsBAmUbQiMEkV5G2TyZ19L_0 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16471192983272816666', time=2024-09-14T13:45:31.729633+0000, chain.objs.size()=1 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lVwQNwQpDs5ziogbGbk2_7FBmHsPFpn_0 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2482039553348179193', time=2024-09-14T13:45:31.737451+0000, chain.objs.size()=1 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tX-Sr9vqcSMop9PaoPeP0qsUIylMYkq_0 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1710447669984081647', time=2024-09-14T13:45:31.753435+0000, chain.objs.size()=1 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.vajaHcnkyxQ_HvXFAnEcew1rfOFXWMc_0 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6395344508614327611', time=2024-09-14T13:45:31.759510+0000, chain.objs.size()=1 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HCqzJXiGy5djzrEB-hqa_kqHyvvlh3__0 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1130963349517977116', time=2024-09-14T13:45:31.764085+0000, chain.objs.size()=1 2024-09-14T11:56:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.311+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZLbVv1LmPrtGQKFrz1AtuFIF-6JAfy__0 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.312+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12495533836214678468', time=2024-09-14T13:45:34.698055+0000, chain.objs.size()=1 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.312+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.269__shadow_.5osv68Y9wubYvXNMi7Tk9Bxcbe6VpJ__0 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11551924132136603471', time=2024-09-14T13:45:39.106337+0000, chain.objs.size()=1 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.278__shadow_.TMBCu6jqVP2Kv8uWWpWTFkD76ngMcnH_0 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13462314050119319994', time=2024-09-14T13:45:40.295852+0000, chain.objs.size()=1 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.280__shadow_.jq-8V-telAPCGf5P8NWH1wVAq1e31fP_0 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.881317693161701832', time=2024-09-14T13:45:40.795762+0000, chain.objs.size()=1 2024-09-14T11:56:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.313+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.281__shadow_.cja8wpnkwP2Nqwn3E00stHuJ_TVIklQ_0 2024-09-14T11:56:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15025743149734385019', time=2024-09-14T13:45:41.781023+0000, chain.objs.size()=1 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.283__shadow_.Wq_9_1uvgx6rca0TPFbdFAEATO4gL5Q_0 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7693911599039877626', time=2024-09-14T13:45:48.195755+0000, chain.objs.size()=1 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.m_0S2IRQ_PLqIhn7DVGOS8IL7dr-dHR_0 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12417057864595921944', time=2024-09-14T13:45:51.158185+0000, chain.objs.size()=1 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.315+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.300__shadow_.SUXHDhRNr99M2i3fkJAnj54psHAZHr3_0 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9106851007338482381', time=2024-09-14T13:46:10.935042+0000, chain.objs.size()=1 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jvMFKsCtnbKlidj-jRBKZ2f_UPIvJry_0 2024-09-14T11:56:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4190993690454609829', time=2024-09-14T13:46:10.976984+0000, chain.objs.size()=1 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aoAYb4Y2dU6GAVi3VHHLMd0hcjF5pyU_0 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7693232305991551960', time=2024-09-14T13:46:10.978346+0000, chain.objs.size()=1 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cvap6TFH1allVow62y6CmsNWHcGHCXi_0 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11826508975397636014', time=2024-09-14T13:46:11.113654+0000, chain.objs.size()=1 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MLpB0enbT52_o297JN54A80wLSPgZok_0 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15071209982083080849', time=2024-09-14T13:46:11.134798+0000, chain.objs.size()=1 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.gMW0Cxm1Fj5OqPFQ8Bjdp9R99AfIG-f_0 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10284558889697261221', time=2024-09-14T13:46:11.138598+0000, chain.objs.size()=1 2024-09-14T11:56:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.316+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XbKRmxdyKT1YMOcQ74oQcMxrVAeukZC_0 2024-09-14T11:56:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17736408756001109067', time=2024-09-14T13:46:11.152710+0000, chain.objs.size()=1 2024-09-14T11:56:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3n9vsY_gQubWQWOUTl3CAJa4h7tEKBH_0 2024-09-14T11:56:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6105165283720296041', time=2024-09-14T13:46:11.163651+0000, chain.objs.size()=1 2024-09-14T11:56:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LejSswRX-5V2b-ERFCEHPqPzecqfk4y_0 2024-09-14T11:56:15.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13077652332276594925', time=2024-09-14T13:46:11.170856+0000, chain.objs.size()=1 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JBOnNtTPjfWND8nH5kH02M8biir10tA_0 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10437902759440958260', time=2024-09-14T13:46:11.186916+0000, chain.objs.size()=1 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XwVP5PnnAslorYn-JwS1OlfmUaoHGNz_0 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15814332028882420330', time=2024-09-14T13:46:11.325129+0000, chain.objs.size()=1 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MAv8hI2TSsPSVbrn_MFKQ1dxSrynTNs_0 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15519890309796493731', time=2024-09-14T13:46:11.380958+0000, chain.objs.size()=1 2024-09-14T11:56:15.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.318+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DOd3MQlfSbRw72xw54NIE3d2f3Bx-0A_0 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1368460655940904620', time=2024-09-14T13:46:11.667173+0000, chain.objs.size()=1 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jMT3XjghXYGL-j8moteWWnvx5KP9fou_0 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4179973330166770694', time=2024-09-14T13:46:11.688974+0000, chain.objs.size()=1 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.z4L0HeDmLkbGj_rYJqhCMbMCKkSSOHn_0 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6352794731358648744', time=2024-09-14T13:46:11.736435+0000, chain.objs.size()=1 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.319+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9NAI9UzGpxBBqRBCAsw-CyIRTQZrFsk_0 2024-09-14T11:56:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.321+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17435941154938695642', time=2024-09-14T13:46:11.756719+0000, chain.objs.size()=1 2024-09-14T11:56:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.321+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wnhKNOpy1TqudWQrNdoeHFyEpM8r0aA_0 2024-09-14T11:56:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.321+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6857142585145643321', time=2024-09-14T13:46:11.840087+0000, chain.objs.size()=1 2024-09-14T11:56:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.321+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bUJ4AlVBS-cfcJpJbzUY8mGEHNcxcYy_0 2024-09-14T11:56:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5440540503154205032', time=2024-09-14T13:46:11.861416+0000, chain.objs.size()=1 2024-09-14T11:56:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.q6Sm8gW_MSusn8mRMMYgl3EGgEKyrk-_0 2024-09-14T11:56:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14766978025328867987', time=2024-09-14T13:46:11.864841+0000, chain.objs.size()=1 2024-09-14T11:56:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2UVv24X5rqjRo9EqauMDR-2HqyDg6iF_0 2024-09-14T11:56:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3790350229142174499', time=2024-09-14T13:46:11.914716+0000, chain.objs.size()=1 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.umr5dQSl908W-qQjci-JErFJqfadNJh_0 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1096542301715000294', time=2024-09-14T13:46:12.032288+0000, chain.objs.size()=1 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.94xNfIVyWw_PYOZS4m33lPMvrs_avb6_0 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10459729322681444752', time=2024-09-14T13:46:12.047469+0000, chain.objs.size()=1 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rEiDyPhWAElt7oJMPiPVEHXjvv-j8n6_0 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6804992364164230684', time=2024-09-14T13:46:12.057668+0000, chain.objs.size()=1 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.322+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2sIwMqcH9jz5aLnkaIes2eEqBAb426c_0 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.323+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11225222951156288919', time=2024-09-14T13:46:12.075918+0000, chain.objs.size()=1 2024-09-14T11:56:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.323+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jsC8MIXM2cUpI0Dx48uDJlwSzd1Px7j_0 2024-09-14T11:56:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.324+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1824370228247212367', time=2024-09-14T13:46:12.077727+0000, chain.objs.size()=1 2024-09-14T11:56:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.324+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iKkmDa9cJEMPIQ7oX7qR0-F58t65p6O_0 2024-09-14T11:56:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.324+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5912830562519368786', time=2024-09-14T13:46:12.127323+0000, chain.objs.size()=1 2024-09-14T11:56:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.324+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LJliKO3LApe9qFWHmsFN0mF88xfdUB-_0 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10248939944666512439', time=2024-09-14T13:46:12.449228+0000, chain.objs.size()=1 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PFS4mk_jpCLD_ZeDFPwwnj-pzTctwfv_0 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12231430667785302763', time=2024-09-14T13:46:12.456268+0000, chain.objs.size()=1 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fsF5G7KCPgTpJtAYYzxmLvUcLGXMVnJ_0 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13057966369570270586', time=2024-09-14T13:46:12.612061+0000, chain.objs.size()=1 2024-09-14T11:56:15.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.325+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rCbg4L2kYUaGPRcnceHXrXQ_X-39WeA_0 2024-09-14T11:56:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.326+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17212029378767379756', time=2024-09-14T13:46:12.668968+0000, chain.objs.size()=1 2024-09-14T11:56:15.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.326+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2mulRsqmVAr19K9xpX9rJLaAXV-t46D_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16698191344665410694', time=2024-09-14T13:46:12.673064+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b4KNLNTyyini6ZF57QmPS1XtchX5WLM_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.995079377870897416', time=2024-09-14T13:46:20.726941+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DkNdCpmDFVXfRizhu0wJijYFGAkVQx2_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4058535705737936268', time=2024-09-14T13:46:20.729426+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ALdcBD7TVsT9s517uZIr5ed3roOg8xH_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16498675903791824562', time=2024-09-14T13:46:20.738796+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DTSZ1m3VE9Rbq5zvcejfy_LdMGoLJpG_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3064662699131581544', time=2024-09-14T13:46:20.776462+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dbLXRvIpW7OTG0tsNJF_VezoD1GIdOt_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11730744205633371279', time=2024-09-14T13:46:20.801828+0000, chain.objs.size()=1 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xQ-2clDBpOyRGOmzbFB8IBEWkw0HnGK_0 2024-09-14T11:56:15.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6762306003732223758', time=2024-09-14T13:46:20.916753+0000, chain.objs.size()=1 2024-09-14T11:56:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.327+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HAQbgluUBpORuhyj2amv04RquhnL4Up_0 2024-09-14T11:56:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.329+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15633342022142769230', time=2024-09-14T13:46:20.952808+0000, chain.objs.size()=1 2024-09-14T11:56:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.329+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.tRMXHs3emsomCR7AgGvE6Efffl7bayC_0 2024-09-14T11:56:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.329+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4897801002076411723', time=2024-09-14T13:46:20.970240+0000, chain.objs.size()=1 2024-09-14T11:56:15.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.329+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.CsRRhPZb-3wA_1XzDbvxORYbJhIEdmX_0 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10436395703752954708', time=2024-09-14T13:46:20.984602+0000, chain.objs.size()=1 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TEGS2g74yLD3kytCdB_A9W7kQidhjvK_0 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7405600212057487673', time=2024-09-14T13:46:21.000604+0000, chain.objs.size()=1 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nTIOn0iBJyIqQmu4bo1AWuD_AFdnbO3_0 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8156092456789471933', time=2024-09-14T13:46:21.127320+0000, chain.objs.size()=1 2024-09-14T11:56:15.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZIJhuT5NZRCIGEm4cCjDW5WZoTlpZMl_0 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16536919581871145', time=2024-09-14T13:46:21.153016+0000, chain.objs.size()=1 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Zw1kofYdP59NouLpwu7wzKQ1q--M2zR_0 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15076631140816955175', time=2024-09-14T13:46:21.165009+0000, chain.objs.size()=1 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.330+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.F_BJtd5w0Bt81olUWmi4F27aQH9xLnU_0 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1817522328194776236', time=2024-09-14T13:46:21.474415+0000, chain.objs.size()=1 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kYrctLKrSxqnG2jDYynWksf3qkehkch_0 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2723183158772986106', time=2024-09-14T13:46:21.746695+0000, chain.objs.size()=1 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aKf-UFHKHM3Qbl_6L8jLHx7lrUNKZa3_0 2024-09-14T11:56:15.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13368675591421219956', time=2024-09-14T13:46:21.762798+0000, chain.objs.size()=1 2024-09-14T11:56:15.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7f48xhVpAwD6dqwQeXiZgQhf8lEzHhi_0 2024-09-14T11:56:15.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10168860569751928518', time=2024-09-14T13:46:21.868194+0000, chain.objs.size()=1 2024-09-14T11:56:15.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.331+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BN_PI6-2NwDl9C-PBC5kP1enh1utj4U_0 2024-09-14T11:56:15.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.333+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5908082344527480152', time=2024-09-14T13:46:21.961819+0000, chain.objs.size()=1 2024-09-14T11:56:15.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.333+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eUmh0tTrvktHRiHGAHhuArgvDzbSTQH_0 2024-09-14T11:56:15.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.336+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/49558 2024-09-14T11:56:15.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:56:15.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14948963600393577587', time=2024-09-14T13:46:22.054364+0000, chain.objs.size()=1 2024-09-14T11:56:15.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JAvwJZrZJP65Ejeb4MJ3cqS28nvvRXj_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10585986047649636789', time=2024-09-14T13:46:22.128310+0000, chain.objs.size()=1 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TT5_VhiHtokAj008tCTfbII1xxLxfet_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10973036350788868251', time=2024-09-14T13:46:22.262213+0000, chain.objs.size()=1 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KqmOkFoGI9NEjtPw3CqYKoIlSnZt3iB_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16170058658482212178', time=2024-09-14T13:46:22.277382+0000, chain.objs.size()=1 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZpxMTcbrAzwKkKiIPkQoaX1JZM9_BEc_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7593636330993886351', time=2024-09-14T13:46:22.318903+0000, chain.objs.size()=1 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bjJJ6tkJJVQEBFq2PVNOBC3dS6JvlF4_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.301299121827884061', time=2024-09-14T13:46:22.350992+0000, chain.objs.size()=1 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3lUyVMkVAe2U57tChCDAhYVRexImZ_b_0 2024-09-14T11:56:15.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15018881256568997140', time=2024-09-14T13:47:03.242580+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.408__shadow_.YMQjpvTER0x1LeYCWFYJw0hQVgrH2Hu_0 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4729787530967375530', time=2024-09-14T13:47:14.561527+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.430__shadow_.U_wPn5rCYvmCIR2r5VU_yk9KCcbU1LS_0 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4988084042856508461', time=2024-09-14T13:47:32.960650+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.462__shadow_.6ix3qET91ctiTlSVsYqlH_jqN_QwY7k_0 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4309307077536723664', time=2024-09-14T13:47:48.274435+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.497__shadow_.JyTD-UZW8BZOr0i0JHRjx9QsJKC_FRr_0 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2279737395626586833', time=2024-09-14T13:47:51.543596+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17750498452786587848', time=2024-09-14T13:48:03.435762+0000, chain.objs.size()=1 2024-09-14T11:56:15.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.338+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.521__shadow:hHZbKFl4n.JXDLtgDY9.P5QPa963oOH_.xNRC-NlxhH_5uBlqLAVq0tEvXLN7X28_0 2024-09-14T11:56:15.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.341+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL', time=2024-09-14T13:48:04.221031+0000, chain.objs.size()=1 2024-09-14T11:56:15.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.341+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~k_W4kQYwg7ooaSAQn9tBtQIeKHAebFL.1 2024-09-14T11:56:15.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.341+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10420683316970080137', time=2024-09-14T13:48:36.529549+0000, chain.objs.size()=4 2024-09-14T11:56:15.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.341+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.536__multipart_mymultipart.2~KOkE9wVgX4IKCp7stbWgu46SBj1CiFU.1 2024-09-14T11:56:15.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.341+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.536__multipart_mymultipart.2~KOkE9wVgX4IKCp7stbWgu46SBj1CiFU.2 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.536__multipart_mymultipart.qLLxff7X6_k1f-e-skbPlPewQ3fZ8Z8z.3 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.536__multipart_mymultipart.2~KOkE9wVgX4IKCp7stbWgu46SBj1CiFU.4 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3212636608699704230', time=2024-09-14T13:48:59.713852+0000, chain.objs.size()=1 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.556__shadow_.i7q9LOqoGoJ3uP5HeHOP_jFNyXYS-B7_0 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14415182633681078206', time=2024-09-14T13:49:00.312120+0000, chain.objs.size()=1 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.557__shadow_.KM6NajVl6BXBAaz1rARkqJHIjqA5dbX_0 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17665757788550952280', time=2024-09-14T13:49:01.462584+0000, chain.objs.size()=1 2024-09-14T11:56:15.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.559__shadow_.QfohMiaHJTuk1UNd-ATGht4WDaHuwkz_0 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8618456915090295475', time=2024-09-14T13:49:09.800348+0000, chain.objs.size()=1 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.566__shadow_.NI0VWW8hKtcZEIIkdEEtZiphSa0Vl9c_0 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12891047419312183033', time=2024-09-14T13:49:13.465947+0000, chain.objs.size()=1 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:2lW1NvUw2K7n2iHXf3RSZHm82B2ku7g_.kfX5dh1l6Gx2SFJ25aaUjSOc_KOSeau_0 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3984397199699389456', time=2024-09-14T13:49:19.673995+0000, chain.objs.size()=1 2024-09-14T11:56:15.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.342+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.573__shadow:QQPK0KHLvdxfO1k2-idNfjtZO2Z9yTP_.mayCCkIFeyNEUy7vgABaB_cHo9GHZNJ_0 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.345+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16375067304582387139', time=2024-09-14T13:49:24.152796+0000, chain.objs.size()=1 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.345+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.576__shadow_.-oVeVVBYkrzTDIxsXpH3jZMaqayMXIM_0 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.346+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9439856427156517973', time=2024-09-14T13:52:09.840659+0000, chain.objs.size()=1 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.346+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.619__shadow_.0ygOznK8LKBU-aLE9KDduSWpkaMdbGL_0 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.346+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12577430410980188654', time=2024-09-14T13:52:33.659761+0000, chain.objs.size()=6 2024-09-14T11:56:15.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.346+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.1 2024-09-14T11:56:15.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.346+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.2 2024-09-14T11:56:15.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.3 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.4 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.5 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.662__multipart_baz.2~Z6-hKA1z_xaydinQdR0exPlQgjdu3wK.6 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7497442767666637041', time=2024-09-14T13:52:33.777271+0000, chain.objs.size()=6 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.1 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.2 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.347+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.3 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.4 2024-09-14T11:56:15.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.349+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.5 2024-09-14T11:56:15.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.350+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.663__multipart_foo.2~w7G1ctcfPgjLmDAIPFuwbgZ4F3gxzpK.6 2024-09-14T11:56:15.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.350+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14046143144109709409', time=2024-09-14T13:52:38.338467+0000, chain.objs.size()=1 2024-09-14T11:56:15.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.350+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.672__shadow_.BHrIGjacV_VlLOE_PZWNQMP6cGBM86r_0 2024-09-14T11:56:15.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.350+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13434117472249720720', time=2024-09-14T13:52:41.654997+0000, chain.objs.size()=1 2024-09-14T11:56:15.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.350+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.680__shadow_.XnhwQjL3MkJRrpUd98QAfPNWdTARPvZ_0 2024-09-14T11:56:15.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.351+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11111621725533457848', time=2024-09-14T13:53:57.540244+0000, chain.objs.size()=1 2024-09-14T11:56:15.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.351+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.764__shadow_.0f_BT-JEQUhaRt38USiWSfFaU2ZSbth_0 2024-09-14T11:56:15.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.355+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.357+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:56:15.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.359+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.359+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44624' 2024-09-14T11:56:15.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7989011058859600389', time=2024-09-14T13:43:20.661377+0000, chain.objs.size()=2 2024-09-14T11:56:15.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.Qbe9ydIFM6rcyKETaGM1DxjweFvYDw6_0 2024-09-14T11:56:15.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.161__shadow_.Qbe9ydIFM6rcyKETaGM1DxjweFvYDw6_1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_45Ij0gZpmDVMPCfYXBI8HTla0WPObpk', time=2024-09-14T13:43:22.555573+0000, chain.objs.size()=2 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.ZhkO0S8LThj21ZN1EfomoS_3Yd1FfCn_0 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.162__shadow_.ZhkO0S8LThj21ZN1EfomoS_3Yd1FfCn_1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2464025153454560018', time=2024-09-14T13:45:17.338073+0000, chain.objs.size()=1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.252__shadow_.BMpY5ofRIo43PYSVPPiijjHGQfygSyb_0 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13494187415054729918', time=2024-09-14T13:45:30.239908+0000, chain.objs.size()=1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.zG2PP-2U8pfMRp_rCEFD8Fphk2K3zeQ_0 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3598279109326868894', time=2024-09-14T13:45:30.310194+0000, chain.objs.size()=1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sy647GuIWd3Fj655PTzNq_gMXneKLRt_0 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12044879914782315531', time=2024-09-14T13:45:30.423229+0000, chain.objs.size()=1 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.W-Kcj8g95-V1Qs_svhKTm-ZlMqwUBog_0 2024-09-14T11:56:15.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14281232080314457031', time=2024-09-14T13:45:30.432925+0000, chain.objs.size()=1 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.J3qdZCDuiOgPdOzYJqSJZFaIJ0B6TW9_0 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15041457793540235693', time=2024-09-14T13:45:30.482574+0000, chain.objs.size()=1 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.C5Poqe7R_rdXY4r5hRqiDGnDXLEP4H-_0 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1383495751145875721', time=2024-09-14T13:45:30.487599+0000, chain.objs.size()=1 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8QWz3-GDL8onyHbgTM8kFJ-3cvui1jB_0 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3909649048347225480', time=2024-09-14T13:45:30.511264+0000, chain.objs.size()=1 2024-09-14T11:56:15.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.360+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.BuoiFrsF9a0DPjNlHH9_oiIp6ZD3b2w_0 2024-09-14T11:56:15.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7537224741110799251', time=2024-09-14T13:45:30.592096+0000, chain.objs.size()=1 2024-09-14T11:56:15.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.G5mWXrZSYtjTGnFRRiK3fbcyqwbeOqd_0 2024-09-14T11:56:15.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13961205498247505157', time=2024-09-14T13:45:30.645368+0000, chain.objs.size()=1 2024-09-14T11:56:15.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PxOWdKwSa70P1Z7btrVcjY4ut6BRwOB_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8023212705131296013', time=2024-09-14T13:45:30.654985+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3yEFRcXeTLDtF-9Tmqz2ugoDucewUx9_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6746281136305916804', time=2024-09-14T13:45:30.675011+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nSrNvCTHHC1905D-wlpQQQKuy3iCLiC_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3458168493860456547', time=2024-09-14T13:45:30.825710+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9TkvQyZ0NFP4cZdlq8Y7-BydFsTwnpW_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9641575044579999837', time=2024-09-14T13:45:30.845646+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.c60MRu5E20-tTZ4VoQFfN57gwAoVcLV_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9908108285867116636', time=2024-09-14T13:45:30.850990+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RENfclSUApK8zok3d1-mv1kCgabbwzD_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2676091972114043411', time=2024-09-14T13:45:30.971828+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Pp1YoLDsj_ZmxBnPc5lZo7IiLBzmYf8_0 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2428667988729065548', time=2024-09-14T13:45:31.174193+0000, chain.objs.size()=1 2024-09-14T11:56:15.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LUFf6r53LcaACIFbrK7JkeUY58EE-p2_0 2024-09-14T11:56:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17280807901917423241', time=2024-09-14T13:45:31.216546+0000, chain.objs.size()=1 2024-09-14T11:56:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QwoVVGo9coE0ukmJdZdzfyhF8zxIPDz_0 2024-09-14T11:56:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5419526811785238518', time=2024-09-14T13:45:31.231527+0000, chain.objs.size()=1 2024-09-14T11:56:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.364+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.La8PPJjIW5oF1ofzhqLZlkAMTg2QdOy_0 2024-09-14T11:56:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3591666504456583420', time=2024-09-14T13:45:31.252623+0000, chain.objs.size()=1 2024-09-14T11:56:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XwAiIFn9rqqr2CCUEqFwBFA1QV7GcrW_0 2024-09-14T11:56:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.146820622367277701', time=2024-09-14T13:45:31.686816+0000, chain.objs.size()=1 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ni93lHUBbLeucsDVWXdJUyoJnxIb_ft_0 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4193461436912814708', time=2024-09-14T13:45:31.713398+0000, chain.objs.size()=1 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kc59r6x_nSkoIaPz0NqUp1Tz7LhidYn_0 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3792160812544221877', time=2024-09-14T13:45:31.766026+0000, chain.objs.size()=1 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.DpWbNRAsRJfkPLGAEWecTSlI37qz3P1_0 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.521005331896796689', time=2024-09-14T13:45:35.673772+0000, chain.objs.size()=1 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.271__shadow_.8r9bEZtPE9WGXqdPE86iv4BtP15_gXN_0 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588916142456268741', time=2024-09-14T13:45:36.176835+0000, chain.objs.size()=1 2024-09-14T11:56:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.272__shadow_.mKRoHuGTYtWHQyu0Js9GnBWDqqtOjuo_0 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12224098914405767590', time=2024-09-14T13:45:41.288851+0000, chain.objs.size()=1 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.282__shadow_.NrIOuS8sUnsrsPfmoZotsQh2MFPFqQj_0 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13617909928425696726', time=2024-09-14T13:45:42.283170+0000, chain.objs.size()=1 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.284__shadow_.8SguLtl200xhLB9xMnFmvlSpAznGSt__0 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12335340775770773045', time=2024-09-14T13:45:44.333906+0000, chain.objs.size()=1 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.288__shadow_.6VE3mU8nFvHFU2UtR8PW7rQPXu74cPg_0 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12115488181333464866', time=2024-09-14T13:45:47.363853+0000, chain.objs.size()=1 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.1xR8JTMWLufmURlAOCNCS4lrHHpLPS7_0 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8972374866120958562', time=2024-09-14T13:45:49.666311+0000, chain.objs.size()=1 2024-09-14T11:56:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.368+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.297__shadow_.L1hL8cw9cC1-wI79WBdMuq1HnDiUt_v_0 2024-09-14T11:56:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.370+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17134578555144921354', time=2024-09-14T13:45:52.107513+0000, chain.objs.size()=1 2024-09-14T11:56:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.370+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.302__shadow_.VWc7bHwRSY3AlmdaEYHmdHKQv4p23h0_0 2024-09-14T11:56:15.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6888646081783015343', time=2024-09-14T13:46:01.461509+0000, chain.objs.size()=1 2024-09-14T11:56:15.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.320__shadow:3d8Xqu6BgB.3rzsWnU-b45KW3v73.ey_.IrpehiOZoIu_8ClTFGiXgC419ahBtWg_0 2024-09-14T11:56:15.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13849271826054033499', time=2024-09-14T13:46:10.941210+0000, chain.objs.size()=1 2024-09-14T11:56:15.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xo3HP1uzd3SnGaAPDYt4Sr_ZfcXkjgl_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3951715762555972009', time=2024-09-14T13:46:10.950602+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Jlpuz6gbwEqUAe8zRrOVE9g2u4OYpWj_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6597813228618571910', time=2024-09-14T13:46:10.976212+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ECAD56P3iieIh0YUsmqsnYaNZQKOrml_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4431982705911807084', time=2024-09-14T13:46:10.994537+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lTvsYU92q4tN672Bj0mpq1xz9Te0bGn_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.773253518282225297', time=2024-09-14T13:46:11.021224+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.4-e7dJ_QCOvMoDZi-P3EQxduejVc9Rj_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9308188860046627822', time=2024-09-14T13:46:11.178588+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b6kVfDa8gXCXx2CiHtfiI3PzJHW2O_G_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14733825768038600755', time=2024-09-14T13:46:11.179241+0000, chain.objs.size()=1 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hqjF4sDTMJkuS6gmip1ojc0jwkJz_sx_0 2024-09-14T11:56:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12196031951073526390', time=2024-09-14T13:46:11.200278+0000, chain.objs.size()=1 2024-09-14T11:56:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AqeFLMH3E3_M7uAP619WeqUcRijAJUi_0 2024-09-14T11:56:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17699328926542113039', time=2024-09-14T13:46:11.217702+0000, chain.objs.size()=1 2024-09-14T11:56:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.372+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SyDyvFtCKLcx6ny8P4NFD8TtkEh5bGI_0 2024-09-14T11:56:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.373+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4785628115512462683', time=2024-09-14T13:46:11.304583+0000, chain.objs.size()=1 2024-09-14T11:56:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.373+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.haruCXW8WiInor3rTwauG3R2rlfjgjR_0 2024-09-14T11:56:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4785063765278383389', time=2024-09-14T13:46:11.307026+0000, chain.objs.size()=1 2024-09-14T11:56:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.J7WR1W6hiLNgrA1ex0cULM_Zwi5EM4h_0 2024-09-14T11:56:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.375+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9700244952382080738', time=2024-09-14T13:46:11.308635+0000, chain.objs.size()=1 2024-09-14T11:56:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.375+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M_O4ma325WKgIcKOQ5H5cGkYD1y42vt_0 2024-09-14T11:56:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16282297273592526189', time=2024-09-14T13:46:11.324222+0000, chain.objs.size()=1 2024-09-14T11:56:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5ksPCrMw8lF5l1fg4hFqxd8SbmTgyvO_0 2024-09-14T11:56:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1755070337084656383', time=2024-09-14T13:46:11.343853+0000, chain.objs.size()=1 2024-09-14T11:56:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.S6wHErq0MnzTbm9eShH4Fph_GddeF-N_0 2024-09-14T11:56:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18417542695410698484', time=2024-09-14T13:46:11.346159+0000, chain.objs.size()=1 2024-09-14T11:56:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5bD7hXygMmAZvst5JAZwL268gFgwSLw_0 2024-09-14T11:56:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3137916883811019809', time=2024-09-14T13:46:11.352496+0000, chain.objs.size()=1 2024-09-14T11:56:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.376+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NwWWN-cvRH-PdZ4xzehMoo_XTDVW8Zt_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6765822497069221582', time=2024-09-14T13:46:11.353470+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zfJ_qbDIxSe7iSqS2r2YrVxkWKEQ6tn_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14019058441042219468', time=2024-09-14T13:46:11.354592+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.D7VGLZuh0C1F4zkBNm9x8pKkaMfRG-H_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9669936902674463803', time=2024-09-14T13:46:11.378324+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M9jLk_4SSZLLi6o3WYDs44VHY4ZWKII_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11614361580373655608', time=2024-09-14T13:46:11.397580+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IGVNIhEtY9LCYWdUJcpAVaMrX_Kzx4c_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13916826570300879080', time=2024-09-14T13:46:11.668634+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.imwefuDOh96V6GBPSkcJNiFndhXYizt_0 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6456887984625252225', time=2024-09-14T13:46:11.699567+0000, chain.objs.size()=1 2024-09-14T11:56:15.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.378+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iKlNwJ1jAJTmAYyCIVWzPmo2L5Zv-rm_0 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9826225349876983453', time=2024-09-14T13:46:11.733168+0000, chain.objs.size()=1 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._56JkOMa96yaBcSdP8WPuOY8wZsxSCu_0 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9179703379650627563', time=2024-09-14T13:46:11.840337+0000, chain.objs.size()=1 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Q-Byz2ZXmo5xDPQ2OAPfk8ZQxiVgZrz_0 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16738396126588794968', time=2024-09-14T13:46:11.877929+0000, chain.objs.size()=1 2024-09-14T11:56:15.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.379+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Y7aCPTbMYbkT5BV7gtMFVNgg3anwf3m_0 2024-09-14T11:56:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.381+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2229299750421530754', time=2024-09-14T13:46:11.885955+0000, chain.objs.size()=1 2024-09-14T11:56:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.381+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HtVvuccq0apLCaymRDJqX_7QrDdZfHn_0 2024-09-14T11:56:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.381+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9238095012196525078', time=2024-09-14T13:46:11.887463+0000, chain.objs.size()=1 2024-09-14T11:56:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.381+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Z20Pl0xglIxwkQAOJJJEKCej-utY4xb_0 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6816790076666097177', time=2024-09-14T13:46:11.921166+0000, chain.objs.size()=1 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NxTe4weUOMDg7Qk5ZYVg7EuClA5s2M6_0 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6783259661726043463', time=2024-09-14T13:46:11.927617+0000, chain.objs.size()=1 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qPI5p8aJ26oqyWqtnEkzM9r5BxpjPxP_0 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1076188629577793771', time=2024-09-14T13:46:11.951821+0000, chain.objs.size()=1 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.1S5eIINgIbG9Hgx-sJnWYnhKjpYCGIX_0 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2322924849519312679', time=2024-09-14T13:46:12.084180+0000, chain.objs.size()=1 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.KEGYj25i4DN_WZBIlfbEoBEz5bUeFQr_0 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.780396755481977512', time=2024-09-14T13:46:12.105896+0000, chain.objs.size()=1 2024-09-14T11:56:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.uWrbIo3pV0Z3YXPYPOyJ-wqsocm9ZuT_0 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10340060257218276141', time=2024-09-14T13:46:12.223236+0000, chain.objs.size()=1 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ki_Soa8P8gG6tCR47GbznPm25v1I0xM_0 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11563027562036965552', time=2024-09-14T13:46:12.491147+0000, chain.objs.size()=1 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZDgI4gqKRzITyhWD5NPbaQq8mbrMmZ8_0 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1348002746279193124', time=2024-09-14T13:46:12.683702+0000, chain.objs.size()=1 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.2cFvVRn3zsTJYmrQRX7yexOJr10X93q_0 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4409179858900296420', time=2024-09-14T13:46:20.723258+0000, chain.objs.size()=1 2024-09-14T11:56:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.383+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SHqx1i8GXgxSZ-AulydWdzhf7Dni6NV_0 2024-09-14T11:56:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.385+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7534021922427502484', time=2024-09-14T13:46:20.731948+0000, chain.objs.size()=1 2024-09-14T11:56:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.385+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kWSifu4EC3gbSBN0-ld31onpy2BJ0RQ_0 2024-09-14T11:56:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.385+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15184297935770107231', time=2024-09-14T13:46:20.774878+0000, chain.objs.size()=1 2024-09-14T11:56:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.385+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZN-5dAisISiTpvAy-7uWbLwS-vr8kfk_0 2024-09-14T11:56:15.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6573876404730306443', time=2024-09-14T13:46:20.781224+0000, chain.objs.size()=1 2024-09-14T11:56:15.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.J3sQr6jHyKaK8sLVphSi03q5vCgE_sP_0 2024-09-14T11:56:15.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14789977645659386588', time=2024-09-14T13:46:20.929839+0000, chain.objs.size()=1 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0SG3aHPq-Nrua5CnCxxRZqSDDZ_Jhct_0 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1465732240873105365', time=2024-09-14T13:46:21.010474+0000, chain.objs.size()=1 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.386+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nhcLuTHiJ956xo3bKWfBdgAsWKM-Ga-_0 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17975575121251196731', time=2024-09-14T13:46:21.088733+0000, chain.objs.size()=1 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.C4z-Pi_zc15l1YeX2LYwG3fS4_QqnlW_0 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14666256272611160323', time=2024-09-14T13:46:21.114054+0000, chain.objs.size()=1 2024-09-14T11:56:15.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.krybCi8sVma92PU8cdiOUvzw9xaHI9h_0 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6263728591037815757', time=2024-09-14T13:46:21.196990+0000, chain.objs.size()=1 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.TYMkCLeRSsluD3leSB3tKEJgShDEOYD_0 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17628748979079437415', time=2024-09-14T13:46:21.285246+0000, chain.objs.size()=1 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pHjuB0yB8CfqqO6NpoZ2OG372RwHDp5_0 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15468109851885596799', time=2024-09-14T13:46:21.534364+0000, chain.objs.size()=1 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kkRuj_T74IWkSwdUi_ahOWtG-Aesmh7_0 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14939317414908194917', time=2024-09-14T13:46:21.543941+0000, chain.objs.size()=1 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.387+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uaP2emKUT1D1Qi-GIZE6rtQ2bXxwuGn_0 2024-09-14T11:56:15.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.389+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9599438184416439710', time=2024-09-14T13:46:21.770271+0000, chain.objs.size()=1 2024-09-14T11:56:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.389+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lv4V-WJy3J_RyjxVe-8vqRgEV-1nQdJ_0 2024-09-14T11:56:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.389+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7622298961559312944', time=2024-09-14T13:46:21.853852+0000, chain.objs.size()=1 2024-09-14T11:56:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.389+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Pt37oKkLd8hhcv1kOzB75h4fRzfD4KL_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15554887531971044065', time=2024-09-14T13:46:21.877077+0000, chain.objs.size()=1 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Bwt8jzcNc2vMvKDpjNQLSj4N7EHuirs_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17567053464331441307', time=2024-09-14T13:46:22.083799+0000, chain.objs.size()=1 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pelm4HTsL9BIcfvHe3Y7SWpu49gygu0_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17509692256190471742', time=2024-09-14T13:46:22.118077+0000, chain.objs.size()=1 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.feVJqg-TaQ8mEK_Sl3dPefbyqdOjVGO_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13760217275793145352', time=2024-09-14T13:46:22.123967+0000, chain.objs.size()=1 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6KmBUMzH_UJlaRPFAXIgqlJlU7VNi3h_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12011752203422242895', time=2024-09-14T13:46:22.284062+0000, chain.objs.size()=1 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Wn19atSgzHv1XrWzroRnZRJAAXirZ3b_0 2024-09-14T11:56:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14410899813397378726', time=2024-09-14T13:46:27.388155+0000, chain.objs.size()=1 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.336__shadow_.-t9nAYasH--nuWnpGUa74WClDQqPGU3_0 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8563521598623718625', time=2024-09-14T13:46:29.691887+0000, chain.objs.size()=1 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.341__shadow_.z2bKzg_niXdV_A0QFXkEIV1asVe-Cd-_0 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9434168817303920866', time=2024-09-14T13:46:49.479629+0000, chain.objs.size()=1 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.391+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.383__shadow_.NbnnGGzeidTCoFQJRb5Hhch2mOzNctD_0 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14064945352397044793', time=2024-09-14T13:47:29.293070+0000, chain.objs.size()=1 2024-09-14T11:56:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.457__shadow_.q_SpCkczDGKKnvlisYLSwy7INHsUCaA_0 2024-09-14T11:56:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12147410923746790619', time=2024-09-14T13:47:57.321838+0000, chain.objs.size()=1 2024-09-14T11:56:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.516__shadow_.QC5bWUOa8HTGLS852-fzyBbH5GQ_lyR_0 2024-09-14T11:56:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.836395673087980708', time=2024-09-14T13:48:13.730343+0000, chain.objs.size()=3 2024-09-14T11:56:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.393+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~cXy61AuHzJWHwT7p8T8V0D6R1Hz9KSW.1 2024-09-14T11:56:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.395+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~cXy61AuHzJWHwT7p8T8V0D6R1Hz9KSW.2 2024-09-14T11:56:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.395+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~cXy61AuHzJWHwT7p8T8V0D6R1Hz9KSW.3 2024-09-14T11:56:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.395+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3001712116398753710', time=2024-09-14T13:49:18.500197+0000, chain.objs.size()=1 2024-09-14T11:56:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.395+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.571__shadow:IxLnBfn.i6enpZLdg2iB0vZQ416b1JN_._WQ6jYwKYFRPk9I4gXQomcMtK6UWpdv_0 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17710444032402438081', time=2024-09-14T13:49:21.283783+0000, chain.objs.size()=1 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow_.bWkQtgFa_6AwBq7yiIlQqkY_WefZO1B_0 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17011439040901984498', time=2024-09-14T13:49:34.564076+0000, chain.objs.size()=1 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:WcVzfQLLvbaxyIsWPGocKHf378JmtCb_.UIcvN5qc9_x1TX9NXmN9PuKC2p8G7dR_0 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6039467893287880531', time=2024-09-14T13:49:44.403190+0000, chain.objs.size()=1 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:jCiiQfjCnELvNaRkGxFW3xxGLOpkNqy_.5JDdUW0_0N3s8xpikGiO7YENuaJcd2c_0 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2154008199849706952', time=2024-09-14T13:49:45.643344+0000, chain.objs.size()=1 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:.AV2575I-5qIuRXuSCulT8wAc6vQN7n_.C9u9_3KrghLcNvNrO11CZU5Ag13LeOy_0 2024-09-14T11:56:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3348127392341326901', time=2024-09-14T13:49:45.751130+0000, chain.objs.size()=1 2024-09-14T11:56:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.396+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:KLjwikWVcH.nJrXuX9tmxGlIsCl.84U_.GrmbmGgem-qgfEO4tCgUqKjXukS2MG5_0 2024-09-14T11:56:15.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.399+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/44624 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.401+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.401+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3906836224336212131', time=2024-09-14T13:52:18.160716+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.401+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.633__shadow_.NVt47hbnwquYjJ0gXXVNw4wtcxtRsHl_0 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.401+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14910777524731159539', time=2024-09-14T13:52:26.848664+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.650__shadow_.FyBG_A3tobSwAEFYzhLURW0skTvvGl__0 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4170385822983765796', time=2024-09-14T13:52:29.519675+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.655__shadow_.FcrCnFL4KWqWf3r8jRK4ryBAkiyXKO4_0 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17537965338763725947', time=2024-09-14T13:52:30.676233+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.657__shadow_.4lSycu6588cxBYLwRJM60fKjN87q8Xe_0 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13998565129835540267', time=2024-09-14T13:52:41.655416+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.680__shadow_.KWf30XIbj4ufgfCRVH5QZCuIIBkLY3t_0 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17609029060095967046', time=2024-09-14T13:52:54.835606+0000, chain.objs.size()=1 2024-09-14T11:56:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.710__shadow_.g7oxqEi_Kb7fIw1kEnUE3bUh6itG8jX_0 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18303275336622317731', time=2024-09-14T13:53:38.037378+0000, chain.objs.size()=1 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.746__shadow_.cRywGyDalkadaKWAVaATJfp7z6jS2wH_0 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15602638967644295222', time=2024-09-14T13:53:49.215117+0000, chain.objs.size()=1 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.756__shadow_.AUc0ymBZQKXWBM-5yr2Edklp61gIpWR_0 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.871311346080328820', time=2024-09-14T13:53:56.655870+0000, chain.objs.size()=1 2024-09-14T11:56:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.402+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.763__shadow_.kDCcDIx1sGmsu3T2xImCLnniwO-AiCo_0 2024-09-14T11:56:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.405+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.407+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:56:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.409+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.409+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43680' 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16162667784415205915', time=2024-09-14T13:43:18.278944+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.158__shadow:aETZH4AE-7ZFYrlAFuAZeAqsdZfjmDt_.WE8rQ7iG7GJFhlEK9du4Q2l6vO6W5-E_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12154500943737817041', time=2024-09-14T13:43:18.859662+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.159__shadow_.3RTq35RQEjdJTbzCLHCDZpw9YqJwBTF_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9723851647468191068', time=2024-09-14T13:45:05.735944+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.231__shadow_.wTKHSZ-KnjJYzeAH_YMVuzmemCf7bF-_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504130221796086651', time=2024-09-14T13:45:09.561797+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.238__shadow_.nxNbZ9ryKMzIs3BJqTmVRjH5zqMIdnE_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10165221484204070736', time=2024-09-14T13:45:10.846572+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.240__shadow_.o7rV_RLPZB0TXMxeIN6_lqMMdL9L0PP_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8694077230801503565', time=2024-09-14T13:45:13.933808+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.245__shadow_.2s5M857ImW6Rc0pGXcD8Dg7YCXm1u0J_0 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.636666929584383092', time=2024-09-14T13:45:19.237351+0000, chain.objs.size()=1 2024-09-14T11:56:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.256__shadow_.Z35yMwa50EsIZkq_gpEnqy6ZwZ5MKd8_0 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17705211679760891062', time=2024-09-14T13:45:30.212944+0000, chain.objs.size()=1 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6KcBG2li0qkUJ42BSP6R-v7DwPtkg0z_0 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14756599200736389872', time=2024-09-14T13:45:30.228333+0000, chain.objs.size()=1 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.u87mUUXMFXn3rRT7JtnqP29XE9CLarL_0 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.414821686656605389', time=2024-09-14T13:45:30.243216+0000, chain.objs.size()=1 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.G8NIMA1HHpXsgzM516ggASb7CaUD0jV_0 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4962194975698813471', time=2024-09-14T13:45:30.272763+0000, chain.objs.size()=1 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.i6viJHIxBLizGogGax7_1wc0lySidPI_0 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14399163223053405519', time=2024-09-14T13:45:30.286432+0000, chain.objs.size()=1 2024-09-14T11:56:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.410+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wYrrW1kkDxuWcLGgf0_271B6_EyN88t_0 2024-09-14T11:56:15.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.413+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6398879049545132447', time=2024-09-14T13:45:30.404063+0000, chain.objs.size()=1 2024-09-14T11:56:15.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.413+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.U01X0yM-RT1eMTlnal0eyiDo8IxtvLV_0 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8147853283535972551', time=2024-09-14T13:45:30.422021+0000, chain.objs.size()=1 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MIYcCwSvWw44aVTdB9Ul8tBGu_2mycW_0 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3473224175004753300', time=2024-09-14T13:45:30.451034+0000, chain.objs.size()=1 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OgXISkzZyQh4WPKIBOV8L-n7qaqzupy_0 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5138820531367545655', time=2024-09-14T13:45:30.495588+0000, chain.objs.size()=1 2024-09-14T11:56:15.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5-zOAwkm8yDCbFlDzw35qMwPL08dFY1_0 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8252471196933282980', time=2024-09-14T13:45:30.504630+0000, chain.objs.size()=1 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.414+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MbqNlo-vVQ6TTh_Z9kpN5wGkV8mS98__0 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.170606910768771968', time=2024-09-14T13:45:30.512202+0000, chain.objs.size()=1 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.R-CHRtWUL0shPhDbwZ-pDyBgRJ-xiPh_0 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10300672023687204187', time=2024-09-14T13:45:30.628433+0000, chain.objs.size()=1 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6EHVxruRw6gX5HCNBDG4jHD7QlpKWEr_0 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10770521397247371315', time=2024-09-14T13:45:30.663049+0000, chain.objs.size()=1 2024-09-14T11:56:15.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7MlgTWW3j3S7AnCKUyPB-KY-bpI2hwQ_0 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11033334040311935811', time=2024-09-14T13:45:30.685608+0000, chain.objs.size()=1 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.mw3NLsHW-WUKDl39GnwlbUqD5fpKMDe_0 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12644107710164376194', time=2024-09-14T13:45:30.791418+0000, chain.objs.size()=1 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.VLagZ9aAe4QAlbj1Mhb8H5OiRhMETbG_0 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5223584403640576794', time=2024-09-14T13:45:30.801515+0000, chain.objs.size()=1 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.415+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5jlferZUbuT6STLOaui8WBYi09QtbsR_0 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.416+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6600564219649042030', time=2024-09-14T13:45:30.809340+0000, chain.objs.size()=1 2024-09-14T11:56:15.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.416+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.nfJP5BuQOKtUV5K2HEL-D0rlbB-cKSQ_0 2024-09-14T11:56:15.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3707710249849797979', time=2024-09-14T13:45:30.830000+0000, chain.objs.size()=1 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.z59MSAsHK0zjBos_kVGhwQgm_zb9ls5_0 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17499072069727080051', time=2024-09-14T13:45:30.830568+0000, chain.objs.size()=1 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ns4GWhpAFxvYgrH-3X-ODhpNjM6JmWa_0 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5100235965521035315', time=2024-09-14T13:45:30.872376+0000, chain.objs.size()=1 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4SPbWuhFzMjyI3C3Fibk-mXoswHNaf-_0 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12972114588600202400', time=2024-09-14T13:45:31.045918+0000, chain.objs.size()=1 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.P06WGFBUjj6kf41nbzrbzJ0sssUR9hs_0 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11786598164811296522', time=2024-09-14T13:45:31.062030+0000, chain.objs.size()=1 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.OolcSXfx5xhfX5xKVaNh-dzI_KBeH9s_0 2024-09-14T11:56:15.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10372701244043160880', time=2024-09-14T13:45:31.151132+0000, chain.objs.size()=1 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2StFi36Zn753xX6Ce6ZE_p5A3OacTZl_0 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13117394042234763838', time=2024-09-14T13:45:31.161391+0000, chain.objs.size()=1 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.418+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.che931Hg66XpnKtq3TvSYb1wrCNIn2r_0 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.916188470509579526', time=2024-09-14T13:45:31.162138+0000, chain.objs.size()=1 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bmDG9jz9otnwqYsAuaIGzMJfNC1JbVX_0 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18176196569955671406', time=2024-09-14T13:45:31.181505+0000, chain.objs.size()=1 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.llEtoC1X_xworJ3SxtrxPIfLo3YUsLe_0 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12003133092241064688', time=2024-09-14T13:45:31.194513+0000, chain.objs.size()=1 2024-09-14T11:56:15.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.419+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f2sur60JbHO1MzuQW6yDJQsslouMIC8_0 2024-09-14T11:56:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.420+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4415891558031501932', time=2024-09-14T13:45:31.518474+0000, chain.objs.size()=1 2024-09-14T11:56:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.420+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.tQNeXPR5D1rFW1TRp8LiYkA5bSQtBm1_0 2024-09-14T11:56:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.420+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6371491353491211477', time=2024-09-14T13:45:31.523562+0000, chain.objs.size()=1 2024-09-14T11:56:15.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.420+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SY4QT-v8f52aiVNclIcSW-nLFMf3tzf_0 2024-09-14T11:56:15.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.729575467910961183', time=2024-09-14T13:45:31.553313+0000, chain.objs.size()=1 2024-09-14T11:56:15.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.AhMUvemC2-kJBKfhqMHrEMV-Leip_g-_0 2024-09-14T11:56:15.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7657087523999847986', time=2024-09-14T13:45:31.557291+0000, chain.objs.size()=1 2024-09-14T11:56:15.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.L7Y0Ea_AGODzhmdWswlWqHAVyuEI8gA_0 2024-09-14T11:56:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6632999690680557863', time=2024-09-14T13:45:31.577963+0000, chain.objs.size()=1 2024-09-14T11:56:15.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.422+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.AQbkwJ-njQgziJimkmKSiYZTsRfuLhS_0 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18209321706462700895', time=2024-09-14T13:45:31.580047+0000, chain.objs.size()=1 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ob8WPHFZR7fmDhGS5cgIg7JsgokTMZD_0 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3740488577918653880', time=2024-09-14T13:45:31.580857+0000, chain.objs.size()=1 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.FiN89y_G2csE_QTz56tXt-fS3S8Ij0W_0 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17496553156923081994', time=2024-09-14T13:45:31.585115+0000, chain.objs.size()=1 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.SmVwZB-KsQj0C2kN3H7IchEpMqNiYGg_0 2024-09-14T11:56:15.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.909664531638014322', time=2024-09-14T13:45:31.695035+0000, chain.objs.size()=1 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gP11s0vlWGGdeTrEhIo03W9QOJJe4ni_0 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2116963759050675911', time=2024-09-14T13:45:31.696782+0000, chain.objs.size()=1 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.06qjJX-aNGVNvNwb3Mis8k8YhJj-s-W_0 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4120895077301018684', time=2024-09-14T13:45:39.803343+0000, chain.objs.size()=1 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.423+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.279__shadow_.78_bEVg0N1MEPmxrh8jzeAoFTcsEah__0 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.424+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13061669841476727020', time=2024-09-14T13:45:41.781468+0000, chain.objs.size()=1 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.424+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.283__shadow_.aJ1XB1dOm7GF1mge9vjp0bcJZTw7lAj_0 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.424+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7611425054359883856', time=2024-09-14T13:45:44.333666+0000, chain.objs.size()=1 2024-09-14T11:56:15.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.424+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.288__shadow_.Q6f_RBGNegvWjCJgd-0rern5mHJ_UMb_0 2024-09-14T11:56:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14867589823875864792', time=2024-09-14T13:45:48.185098+0000, chain.objs.size()=1 2024-09-14T11:56:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.6hKo-NuOJikDHhXJadwTuCknGi4CdKP_0 2024-09-14T11:56:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13067267105985266417', time=2024-09-14T13:45:54.730824+0000, chain.objs.size()=1 2024-09-14T11:56:15.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.307__shadow_.aJeUNkAJiAjGc4ACqVw64o4rpWO34Vp_0 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7927975973515950795', time=2024-09-14T13:46:10.931397+0000, chain.objs.size()=1 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7lkCtfh-YRBmaVYTS0IRFJNDD751DBP_0 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9026479181517191208', time=2024-09-14T13:46:10.975380+0000, chain.objs.size()=1 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.426+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hRB8fkoEBICc55ijYNyeliyS9tDKGVe_0 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.427+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5500039494308742414', time=2024-09-14T13:46:10.980602+0000, chain.objs.size()=1 2024-09-14T11:56:15.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.427+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.atM1ETNChoLe3HGUWtrmkS6WikpS2Zm_0 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17700900452341199298', time=2024-09-14T13:46:10.993348+0000, chain.objs.size()=1 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Wn4UOSLotWBbIV6tDXeEU-NTx37k2K1_0 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.50931617554289657', time=2024-09-14T13:46:11.008632+0000, chain.objs.size()=1 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PJ-xF_4KjUr3ec-2Bx3wISIimzFiHqR_0 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12255555453798234314', time=2024-09-14T13:46:11.012010+0000, chain.objs.size()=1 2024-09-14T11:56:15.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._M4kHyHLNfn9oN8l9A5I9W2g2rp6ObE_0 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8590503404206986265', time=2024-09-14T13:46:11.030652+0000, chain.objs.size()=1 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Jet35TCgJs81j0z6VNpPa6-d2QC7_43_0 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14469751983857940255', time=2024-09-14T13:46:11.177783+0000, chain.objs.size()=1 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.a34cHT8nDD-NVHvhf8kb0VrVCGZKCaC_0 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11436630137134093861', time=2024-09-14T13:46:11.221312+0000, chain.objs.size()=1 2024-09-14T11:56:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.428+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.E9XKim1gQ76GzRj9LNTARm1lMjJ_JJt_0 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18385741946055606302', time=2024-09-14T13:46:11.344509+0000, chain.objs.size()=1 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A06zOFb8X-wI3yH1oB7_th_yY7yYYeK_0 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16981671830593470607', time=2024-09-14T13:46:11.360084+0000, chain.objs.size()=1 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8oznffzkD6r48X3ew-gbuDx38WKfyEj_0 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.878463540504470498', time=2024-09-14T13:46:11.398527+0000, chain.objs.size()=1 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9iwQOq2nZZzoheQpIr3TBMbrQvS3lLU_0 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4942729552699027226', time=2024-09-14T13:46:11.415144+0000, chain.objs.size()=1 2024-09-14T11:56:15.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.430+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.McY9xPxurHQYsHvOvD0Lu42_32MZWvV_0 2024-09-14T11:56:15.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.432+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10462241479449017671', time=2024-09-14T13:46:11.569843+0000, chain.objs.size()=1 2024-09-14T11:56:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.432+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.k8J72LjbnX6qKH50QWUApNZWbUn14DH_0 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14658625391746009521', time=2024-09-14T13:46:11.670075+0000, chain.objs.size()=1 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hPHc2qKOTd-Q3NIq-RlXOttEuLjuPpC_0 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5030116901720613445', time=2024-09-14T13:46:11.675534+0000, chain.objs.size()=1 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Hk-YXEU_JQC6GMT9Z7k4LU5Pf7z_wbe_0 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11685553372190429074', time=2024-09-14T13:46:11.718786+0000, chain.objs.size()=1 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MloBJXQKQnUjfOyNjruvgkL854zkO86_0 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16028918389563534509', time=2024-09-14T13:46:11.750381+0000, chain.objs.size()=1 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.3v4Dpli5BXOkWQMoNmhbINlnRSWi7H8_0 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2166849573949276880', time=2024-09-14T13:46:11.846265+0000, chain.objs.size()=1 2024-09-14T11:56:15.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8ZQayd0zZpoR5_mXtQN418Kp0tmNXz1_0 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9866417242502632015', time=2024-09-14T13:46:11.851217+0000, chain.objs.size()=1 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o2dEYyGuLG6RZVOjZGg1RVPSDCajsnn_0 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9909165154592622827', time=2024-09-14T13:46:11.892611+0000, chain.objs.size()=1 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aHZwQC2XciCb9Id3t7n2SNHmLw1Qp_Z_0 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4748274299355654297', time=2024-09-14T13:46:11.922948+0000, chain.objs.size()=1 2024-09-14T11:56:15.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.433+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.lVfTyJaUrxLXh7dFZMfyDZw9Sfemc2F_0 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2502231374818744465', time=2024-09-14T13:46:11.939244+0000, chain.objs.size()=1 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tBo4P-r2j8jEquG0U86RTj_P_uWg1vx_0 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14710909691918205213', time=2024-09-14T13:46:12.054701+0000, chain.objs.size()=1 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sQSzPxuf0ZXPjvyNLt_uY-1cNvBBZyO_0 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2382886614136502455', time=2024-09-14T13:46:12.139102+0000, chain.objs.size()=1 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HHSitNCWI7-yKfUv_5YnU81jPm2InM__0 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4051798273108802457', time=2024-09-14T13:46:12.218927+0000, chain.objs.size()=1 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.436+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.7gfWdKnqPnLgl5TuMkv6yk0gX0OusDW_0 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.437+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12444860365394859841', time=2024-09-14T13:46:12.222863+0000, chain.objs.size()=1 2024-09-14T11:56:15.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.437+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IkBjO2wwc6yeQw4PIR17SI_gKsDT6RU_0 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11254709249078029527', time=2024-09-14T13:46:12.498369+0000, chain.objs.size()=1 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.izo0pv6Y9vuwiUYicvGbK1LJa6_RHW1_0 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16717815431441182744', time=2024-09-14T13:46:12.500832+0000, chain.objs.size()=1 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SPfopY9TzRvBJfCC0bLnlK5SLRBBcMo_0 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2826386148546744395', time=2024-09-14T13:46:12.509523+0000, chain.objs.size()=1 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b2XPmC_5KV13eUAxQlRqYmLKSVGVzBy_0 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16690077213920788143', time=2024-09-14T13:46:12.604035+0000, chain.objs.size()=1 2024-09-14T11:56:15.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.To6eE8JW_y49kbf-iTJFHk8qvxApdAl_0 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14639699309190026932', time=2024-09-14T13:46:12.619710+0000, chain.objs.size()=1 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.arRy8V9h9bY_RXDRqz48ptYCFqdpasd_0 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2887797027142198524', time=2024-09-14T13:46:20.732083+0000, chain.objs.size()=1 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.440+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.STJIabbCTgtl6CFEaCZUT8gI9YTv0J8_0 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2551682161960562606', time=2024-09-14T13:46:20.782671+0000, chain.objs.size()=1 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4QEXTlB6sGND55TbKGGXdtm2A2gs627_0 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.789574240403457508', time=2024-09-14T13:46:20.786873+0000, chain.objs.size()=1 2024-09-14T11:56:15.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JGIoG6ow3Z6edr4pxEdDE9ulkOvp5vm_0 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11310788088060891571', time=2024-09-14T13:46:20.817345+0000, chain.objs.size()=1 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lNAc-g-RgbhaEns9u3oUqAAvo0Pe7wf_0 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1227447224841482490', time=2024-09-14T13:46:20.922835+0000, chain.objs.size()=1 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.KwV_HVWxcoFNQNHdh_oWrWQ5_D_UCWq_0 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9115407323458897609', time=2024-09-14T13:46:20.954227+0000, chain.objs.size()=1 2024-09-14T11:56:15.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.441+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mKcLiP7AADw-U70LNgPIOzsX83YRFaj_0 2024-09-14T11:56:15.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18136190229959163856', time=2024-09-14T13:46:20.980842+0000, chain.objs.size()=1 2024-09-14T11:56:15.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.h2vEkKQ1D0HQXQnArg7__npLm4_EkTs_0 2024-09-14T11:56:15.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.443+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14210932602853461372', time=2024-09-14T13:46:20.981851+0000, chain.objs.size()=1 2024-09-14T11:56:15.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.443+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8dvHMoKuYn4dci9HfIe69qJjX4_pMTI_0 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9824577830479350077', time=2024-09-14T13:46:20.986209+0000, chain.objs.size()=1 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XBe04aiM-yVn0gGU-OLsCnkhpOLTqyP_0 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7842745009156856279', time=2024-09-14T13:46:21.011491+0000, chain.objs.size()=1 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fkwZaEqesRAAXPmtl5jSVXKpCbGwtZO_0 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3025822065331055484', time=2024-09-14T13:46:21.109504+0000, chain.objs.size()=1 2024-09-14T11:56:15.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.K7t2Cmen3d6ztA9hmtSTUYE7pEkLZ5B_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15191006108705552111', time=2024-09-14T13:46:21.138326+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cJJJUEp_n4xEXkKyamlLSxTTd2W9QBf_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14764236509070396503', time=2024-09-14T13:46:21.166769+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JrPZ24ZI83aXGdtgFGy9Mv3bKsmc7Ko_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13527511614116283854', time=2024-09-14T13:46:21.184807+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.matc6q86V9Apn594cRtOu0uPutGMtKc_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6121492343115381861', time=2024-09-14T13:46:21.201593+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YootkjfL2V7pxMUhSlecM_Gy_7hl71o_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8425187726247198476', time=2024-09-14T13:46:21.288001+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.u-Bfr4mlOAhT_Zi78R2oQFxJ7aXonNp_0 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8172695755610328502', time=2024-09-14T13:46:21.324371+0000, chain.objs.size()=1 2024-09-14T11:56:15.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.445+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DDQ8wUw6YTx_YCYVVnhzqX4X3hDlBwO_0 2024-09-14T11:56:15.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.446+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1115685775741856879', time=2024-09-14T13:46:21.351475+0000, chain.objs.size()=1 2024-09-14T11:56:15.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.446+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.K0EtRJwqLkVx979P0MaDRFAon51zS40_0 2024-09-14T11:56:15.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.449+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7875673080284816223', time=2024-09-14T13:46:21.360638+0000, chain.objs.size()=1 2024-09-14T11:56:15.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.449+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zoF1KiEmUNm2GK5ojCYak94OdWr5kk3_0 2024-09-14T11:56:15.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.451+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43680 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7121771206133376325', time=2024-09-14T13:46:21.365580+0000, chain.objs.size()=1 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.P5R5eRFfQFNnSTH_8NsXXS_qcHboWr4_0 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6254270760669682070', time=2024-09-14T13:46:21.379619+0000, chain.objs.size()=1 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.kgVd2-djfzaGQ3BUh3Pc9lbY58OdPp2_0 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8615928806689357672', time=2024-09-14T13:46:21.392492+0000, chain.objs.size()=1 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RwPepoU7xzJ4fYr6AQ7g4NYHw9uAPp0_0 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4035642893489948075', time=2024-09-14T13:46:21.394125+0000, chain.objs.size()=1 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.x-zUA_WuGYpdK1omWCIY1HpzyyfDsUd_0 2024-09-14T11:56:15.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10728650389049907582', time=2024-09-14T13:46:21.472817+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.1X_3-1dtLc5ZKFX5yL_ljbCBhcytwX8_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2895265142505498291', time=2024-09-14T13:46:21.516715+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.g8mX9BSAgbqApJleguYW0M9sMpyqdUu_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17016664300349535258', time=2024-09-14T13:46:21.527289+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AkV1Me2IvIWMmorUSfqw4dTht8ozCSf_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9679516874278379124', time=2024-09-14T13:46:21.774386+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RzlNtU6NmJg2Eld2h3hT-VVlm6U0QQr_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5349751640117375062', time=2024-09-14T13:46:21.869636+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.E_AoH6PO6JLb5arMamPXS1Jc7cgUXpd_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1148185291679382531', time=2024-09-14T13:46:21.892250+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EqeFYLvJXNXg4hfbnAIdKn8bOc6y4u6_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1976832299944849940', time=2024-09-14T13:46:21.905227+0000, chain.objs.size()=1 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HvbSxVALpXJcnrEqZkX4mlDXlGTNKyV_0 2024-09-14T11:56:15.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4819971868331651482', time=2024-09-14T13:46:21.934656+0000, chain.objs.size()=1 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.454+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.0XJ9wUfZg_e-YZUbm3unIJA9vMBN0Xq_0 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14464859221905544291', time=2024-09-14T13:46:21.938717+0000, chain.objs.size()=1 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.M1Z7A5wZvQnpsUgQMOGNnp3lB2H0HmS_0 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14920352454004011216', time=2024-09-14T13:46:21.962553+0000, chain.objs.size()=1 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5nhAdOarqXSerIXp0-C433Xg2pb9CfG_0 2024-09-14T11:56:15.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7383585843459868166', time=2024-09-14T13:46:22.038940+0000, chain.objs.size()=1 2024-09-14T11:56:15.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.456+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fOmC88vedK68lnPhwYN8Tc89N136Cpd_0 2024-09-14T11:56:15.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1564233222569722674', time=2024-09-14T13:46:22.054239+0000, chain.objs.size()=1 2024-09-14T11:56:15.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ofDpDfq5BmpjZMKI4RgRyzS9CH0Oxs2_0 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2374786701992379217', time=2024-09-14T13:46:22.107525+0000, chain.objs.size()=1 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.o-k5hYbfVn3JnLBWVhCDRaXvaiuyFQm_0 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3320510424844025939', time=2024-09-14T13:46:22.142897+0000, chain.objs.size()=1 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zR3JwImE6ykb5kmCiLyWU-pfiLO9J2I_0 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9386624091434273677', time=2024-09-14T13:46:22.301845+0000, chain.objs.size()=1 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.S6rTq3BN6DO7lm0DaXpWpwyI2a2tUkW_0 2024-09-14T11:56:15.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4672697322351105006', time=2024-09-14T13:46:22.307288+0000, chain.objs.size()=1 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yYpjz1GpDFhV8afVzRDgD8eDkFtdA57_0 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5803013945665109395', time=2024-09-14T13:46:22.335403+0000, chain.objs.size()=1 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.457+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.BRx2w6p2nyYICb0fjCH_JFSNyLPh-G5_0 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9323935901044312454', time=2024-09-14T13:46:22.348430+0000, chain.objs.size()=1 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.YFVyHVNgAs0xsT1QIu39N93d7ZGWamZ_0 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.458+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7207572087047724311', time=2024-09-14T13:46:24.062102+0000, chain.objs.size()=1 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.458+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.329__shadow_.eVcLNRwFXR8uFzFTagRnbSQexd2yJvd_0 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.459+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14219427167598350585', time=2024-09-14T13:47:34.432867+0000, chain.objs.size()=1 2024-09-14T11:56:15.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.459+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.464__shadow_.1B-o_3iy3Dfg_2lIiDaLStHzL47yZ9I_0 2024-09-14T11:56:15.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12385294093051129969', time=2024-09-14T13:47:42.116584+0000, chain.objs.size()=1 2024-09-14T11:56:15.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.GbRgRypTK03T1OKvV63KwfvFuU6iBWq_0 2024-09-14T11:56:15.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3257006315279385125', time=2024-09-14T13:47:45.286466+0000, chain.objs.size()=1 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.490__shadow_.jvGj3B2JSBWlKAmPTimLqtFNH_uN9CB_0 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.422401420503467090', time=2024-09-14T13:47:51.544604+0000, chain.objs.size()=1 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9978580746637101898', time=2024-09-14T13:47:54.016341+0000, chain.objs.size()=6 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.1 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.2 2024-09-14T11:56:15.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.3 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.4 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.461+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.5 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.508__multipart_srcmultipart.2~kU-BtRgycDObYaoApIC_rwwApQUNc1A.6 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8031264912700339503', time=2024-09-14T13:47:56.584416+0000, chain.objs.size()=1 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.515__shadow_.6M6GXMhBvIaIerEYAiBYtG3bEdU8jFZ_0 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.462+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4410356349843552876', time=2024-09-14T13:47:57.436558+0000, chain.objs.size()=1 2024-09-14T11:56:15.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.462+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.517__multipart_mymultipartcopy.2~MfeKWT6NfM7Mk5_odneun6re23nkc6d.1 2024-09-14T11:56:15.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9484630200978984407', time=2024-09-14T13:47:59.256137+0000, chain.objs.size()=1 2024-09-14T11:56:15.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.518__shadow_.e1PiWTDOqwKUkmVXi-Zn8ToOCcIQbvL_0 2024-09-14T11:56:15.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.465+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1808965732899302118', time=2024-09-14T13:47:59.257088+0000, chain.objs.size()=2 2024-09-14T11:56:15.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.518__shadow_.ZDSAtkTS9zzIX-4yUsIS8o2gHuKIlv3_0 2024-09-14T11:56:15.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.465+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.518__shadow_.ZDSAtkTS9zzIX-4yUsIS8o2gHuKIlv3_1 2024-09-14T11:56:15.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.466+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16455815990963207988', time=2024-09-14T13:48:18.791338+0000, chain.objs.size()=2 2024-09-14T11:56:15.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.466+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.529__multipart_mymultipart.2~-9vyCvpHx6eIbm17qVyVPCzCc4na4f5.1 2024-09-14T11:56:15.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.529__multipart_mymultipart.2~-9vyCvpHx6eIbm17qVyVPCzCc4na4f5.2 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12740700332763321035', time=2024-09-14T13:49:01.643170+0000, chain.objs.size()=2 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.559__shadow_.jepACtxyMRJn_WrUECn1JkLaYSCJSfo_0 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.559__shadow_.jepACtxyMRJn_WrUECn1JkLaYSCJSfo_1 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10249468687195580540', time=2024-09-14T13:49:11.944398+0000, chain.objs.size()=1 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:.r5bzYaRKRPe9vL3ABywg.7lUS4Z1mV_.dirXmIA5S8jtl2owzHkhAF5tvws0XUo_0 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2455570564430620206', time=2024-09-14T13:49:18.487740+0000, chain.objs.size()=1 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.571__shadow:99hx0HvMhoao91ZNd85Hq5vsYPUa57I_.FqXod5-BgsyyLjDPAeZWI2ZM7xqchAh_0 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9277543055762730341', time=2024-09-14T13:49:20.504193+0000, chain.objs.size()=1 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.574__shadow_.l1eifvCSD4TWDoLyfc2Mf69b_Ks614T_0 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3872689105248518630', time=2024-09-14T13:49:49.485792+0000, chain.objs.size()=1 2024-09-14T11:56:15.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.467+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.588__shadow:qaHsuuedsMIJuN0Xssg.lfgfF8EG-QE_.ZyRxx5tXYNYSuS14e0ASK-QDvhAadXe_0 2024-09-14T11:56:15.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.468+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12498117579909852142', time=2024-09-14T13:52:20.179568+0000, chain.objs.size()=1 2024-09-14T11:56:15.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.468+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.637__shadow_.cnp-E05vg-LItS4Qmkcgj_EKnrftVxa_0 2024-09-14T11:56:15.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15597959731661957854', time=2024-09-14T13:52:36.368118+0000, chain.objs.size()=1 2024-09-14T11:56:15.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.667__shadow_.iZnawF5F9ZHGHG2lwR5VuPTrRZxFSd6_0 2024-09-14T11:56:15.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4647170441882327537', time=2024-09-14T13:52:37.190788+0000, chain.objs.size()=1 2024-09-14T11:56:15.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.669__shadow_.4hVcverr7Q_gnNoIvaKsSjmxV9ItJau_0 2024-09-14T11:56:15.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~IAZ3sYNkN-rAPTSBnM0w5_BJq_vtvjW', time=2024-09-14T13:53:31.279271+0000, chain.objs.size()=1 2024-09-14T11:56:15.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.469+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.743__multipart_mymultipart.2~IAZ3sYNkN-rAPTSBnM0w5_BJq_vtvjW.1 2024-09-14T11:56:15.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.473+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.476+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:56:15.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.477+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.477+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51082' 2024-09-14T11:56:15.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13809279002425377130', time=2024-09-14T13:43:18.853387+0000, chain.objs.size()=2 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.159__shadow_.i5rFSWAKCnb1RaqvuLzq1JcXYRvUX99_0 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.159__shadow_.i5rFSWAKCnb1RaqvuLzq1JcXYRvUX99_1 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3140553505409864508', time=2024-09-14T13:43:19.920328+0000, chain.objs.size()=3 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-FROZEN.2~5g7XB5MopVjQK39SpuZdr7CiC7-rupf.1 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-FROZEN.2~5g7XB5MopVjQK39SpuZdr7CiC7-rupf.2 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.160__multipart_mymultipart-FROZEN.2~5g7XB5MopVjQK39SpuZdr7CiC7-rupf.3 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='_Y2ymtudE4lSsT28aHrq4zPYT1NUVDjs', time=2024-09-14T13:43:23.885611+0000, chain.objs.size()=1 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.166__shadow_.7zy4_bY6KO7NsE0utWJoJswRBm1Gwdk_0 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16201238131661216942', time=2024-09-14T13:45:14.925132+0000, chain.objs.size()=1 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.247__shadow_.Riso-wSY9CL6K7BZLg_FJnApn1JaauH_0 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7049294012887889314', time=2024-09-14T13:45:15.421171+0000, chain.objs.size()=1 2024-09-14T11:56:15.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.248__shadow_.IrjLSZgFnwKhjsZU0SIN22w2hnqJWC7_0 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17723852522716687573', time=2024-09-14T13:45:30.214116+0000, chain.objs.size()=1 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KtQ5VbF7sSt4o3gqNQqkVGmJsQv4Cvm_0 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6536069092312802623', time=2024-09-14T13:45:30.232975+0000, chain.objs.size()=1 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.6e3Vk4uyDrwvkOef8mAp40o175v_kkz_0 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14935103544421556714', time=2024-09-14T13:45:30.432532+0000, chain.objs.size()=1 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.XW1_S1NQXkNlS3LmwVc3pGN-ZBYk2Se_0 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4481893094658091732', time=2024-09-14T13:45:30.439626+0000, chain.objs.size()=1 2024-09-14T11:56:15.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.478+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oCtZR69SukEpXCFyre19uL3dt5geAYs_0 2024-09-14T11:56:15.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.481+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12215616989848561541', time=2024-09-14T13:45:30.443734+0000, chain.objs.size()=1 2024-09-14T11:56:15.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.481+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.36EDcFvem1hG_F5aot4dVHaIBH8b0cp_0 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16380010485550418637', time=2024-09-14T13:45:30.469066+0000, chain.objs.size()=1 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._ZB4xuxCX7jr7dXIcSqdl6lWpvqoQg7_0 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6422212662031121132', time=2024-09-14T13:45:30.484334+0000, chain.objs.size()=1 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e2CB2hmRZoCQSddLLsBZ_188cgCylk8_0 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3163867506921716397', time=2024-09-14T13:45:30.504605+0000, chain.objs.size()=1 2024-09-14T11:56:15.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KpjRuDn4-iVqMjBfev6V2YVyZG2eeSb_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15228647084327951557', time=2024-09-14T13:45:30.590586+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f5aog4-0IbfqPqs5p2JpVnWjW4qX11A_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15195394177986453121', time=2024-09-14T13:45:30.680649+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.5DxKP6RtEemm2T0vEjDRMa9eAMG4fld_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15670416940268229247', time=2024-09-14T13:45:30.689314+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.oNMNfKntuAWzqIrVToFUFcDMTjGhmng_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16026483194917196204', time=2024-09-14T13:45:30.696866+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.8JPMLOIfL-7oNlk52Ll3ltq_bMAwC5E_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.252080445125027972', time=2024-09-14T13:45:30.788960+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.KAHlkJH7LEbSjPQ_N2Zdgu6Hd9zl4F9_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8749557778305626650', time=2024-09-14T13:45:30.807561+0000, chain.objs.size()=1 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.1hUM2zYAeCn3rn0eM4yaX8H1Ce3-x_f_0 2024-09-14T11:56:15.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3782048451955469261', time=2024-09-14T13:45:30.808983+0000, chain.objs.size()=1 2024-09-14T11:56:15.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.482+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.f9q4xGb8rfb5BBFrcv3evJABUTJ0MlQ_0 2024-09-14T11:56:15.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.484+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6491227320035992397', time=2024-09-14T13:45:30.880579+0000, chain.objs.size()=1 2024-09-14T11:56:15.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.485+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kiLroyx4Ek_2Z1zmgp6sXUU23xV1I3H_0 2024-09-14T11:56:15.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.554994137251078224', time=2024-09-14T13:45:30.962028+0000, chain.objs.size()=1 2024-09-14T11:56:15.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Q7CQ25cwmYP2pag1Gnc9dlcP4cL2Gtf_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11664657778313874389', time=2024-09-14T13:45:31.006722+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-eUYpVmIIm_w7r_LK4b26a8fGvr3wUE_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14770885026590757496', time=2024-09-14T13:45:31.012760+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0EtLd8ALmB6XM4WiQ_0qRPMgiK6UKZs_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10792653337199808472', time=2024-09-14T13:45:31.013693+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.PETMAE1InQIMsrGj1tz41JOCu66lZ16_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.388332979389886956', time=2024-09-14T13:45:31.020171+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I7Two35hnfEgFTAlo-NyG2Iu9BPxGoM_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6709661026563912198', time=2024-09-14T13:45:31.022750+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LZ3IHnZEY5IQo9yLq2ugcU_18p01TJJ_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16409510965565150857', time=2024-09-14T13:45:31.163249+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.y2S0cldatwpayWT_RXMBh3Xy5kYGD1Y_0 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17326558968836093145', time=2024-09-14T13:45:31.503122+0000, chain.objs.size()=1 2024-09-14T11:56:15.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ctut4CzPPKsAAO797dmbWSANGyfBuJc_0 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5442458992011514301', time=2024-09-14T13:45:31.505828+0000, chain.objs.size()=1 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.wkmhSMsIcbK-myOusi_HnBTqM-bKe_t_0 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.600050983845756853', time=2024-09-14T13:45:31.517791+0000, chain.objs.size()=1 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0sNZ79SmOkcK5GilBXCuAp0QJaNIuPL_0 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.486+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1397954717076766017', time=2024-09-14T13:45:31.582111+0000, chain.objs.size()=1 2024-09-14T11:56:15.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.487+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.0tJxfhPHwcB7XGmyqyb65QGU4sR_xXk_0 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13855215231128122407', time=2024-09-14T13:45:31.596698+0000, chain.objs.size()=1 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uSV_A5_WUv6sgcrXE7Pg5p8MOvi_jZx_0 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4397693003531536648', time=2024-09-14T13:45:31.719390+0000, chain.objs.size()=1 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gPM_ZtGh2d7tuJGCiqh6_eMiGn0lLqv_0 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14410806165197624302', time=2024-09-14T13:45:31.767977+0000, chain.objs.size()=1 2024-09-14T11:56:15.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._e1pB6piTFY483CR3JWs3xMxiYEFZxp_0 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6035098019778317790', time=2024-09-14T13:45:37.617330+0000, chain.objs.size()=1 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.275__shadow_.pRN04Tih1jLmWBFE7CKV2To0dnwN1_H_0 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3442745480616123273', time=2024-09-14T13:45:39.105295+0000, chain.objs.size()=1 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.278__shadow_.6nBTxwB6wij3NcPlI7gB-qwI8tgquYC_0 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10764896281805440155', time=2024-09-14T13:45:54.076335+0000, chain.objs.size()=1 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.490+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.306__shadow_.KUBDJyV9IKffjbNEBPKWgmRe7uvhwIw_0 2024-09-14T11:56:15.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13006468685929056494', time=2024-09-14T13:46:01.987849+0000, chain.objs.size()=1 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.322__shadow_.1CoNOkXOhyHdxz2fvAixPTxkhJj_PhR_0 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17613986416714488797', time=2024-09-14T13:46:10.927941+0000, chain.objs.size()=1 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.DmztU95AQvccZNDqolnmHuG-2-Ifdbs_0 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7064151013732775866', time=2024-09-14T13:46:10.945784+0000, chain.objs.size()=1 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cKSkTB2W4Rgo8OoMHz-RO5vgUTRoRS8_0 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16987947194140100608', time=2024-09-14T13:46:10.950305+0000, chain.objs.size()=1 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.r7ZPPuLuI-gOTn9RyxkvOSgujwZ4Tx9_0 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3506796610086187671', time=2024-09-14T13:46:10.960959+0000, chain.objs.size()=1 2024-09-14T11:56:15.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.491+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.O8SL850zZshaWkSKzQHkbSmaITSyltb_0 2024-09-14T11:56:15.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.493+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14471359759464673154', time=2024-09-14T13:46:10.966121+0000, chain.objs.size()=1 2024-09-14T11:56:15.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.493+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nkP4Nuqg5nzWOih7jbsmqoykET_wQwk_0 2024-09-14T11:56:15.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.494+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.117050669700685329', time=2024-09-14T13:46:10.982534+0000, chain.objs.size()=1 2024-09-14T11:56:15.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.494+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Lq7XHQTUbME5ARd-NEHiZZIL_4MdjPM_0 2024-09-14T11:56:15.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.494+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4075048616264726067', time=2024-09-14T13:46:10.991863+0000, chain.objs.size()=1 2024-09-14T11:56:15.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.494+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.WPCtrCCLhA0j0EoO2IAh3pWs6tUhBAu_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11719915803968541261', time=2024-09-14T13:46:11.116084+0000, chain.objs.size()=1 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XY3BBD5DQytQCIJ1pa-e_noA57irs15_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11299173544462680066', time=2024-09-14T13:46:11.116791+0000, chain.objs.size()=1 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.n6oViw5VkohCtmNTSAHzbyTlYtDd2pw_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4245604955545313532', time=2024-09-14T13:46:11.172342+0000, chain.objs.size()=1 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.5Kw48Lq-Xe_8onuPO84SbTtBl8a_p2K_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7404590513179431627', time=2024-09-14T13:46:11.199118+0000, chain.objs.size()=1 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.XgESDnOhrdDd81iWUYrU3sdrL4SqYgc_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8126237325664911769', time=2024-09-14T13:46:11.203898+0000, chain.objs.size()=1 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kkCz73QQh4QSoPukPUHlhT_peSRIfes_0 2024-09-14T11:56:15.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10670937937882345790', time=2024-09-14T13:46:11.220172+0000, chain.objs.size()=1 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.fLA2qRo-q-dv0qfOtfvGOR-1mwV2Y7R_0 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12353826401688810816', time=2024-09-14T13:46:11.327445+0000, chain.objs.size()=1 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vBhdgnFrneYaa9YoHQ672692GHzPUr6_0 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4109558229133901868', time=2024-09-14T13:46:11.336059+0000, chain.objs.size()=1 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.M0VAH8RfAsz6eOpBkQy634hwLVxOdpM_0 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15772098191893403629', time=2024-09-14T13:46:11.367728+0000, chain.objs.size()=1 2024-09-14T11:56:15.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.496+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LcXk4Yb_fmsLF3rONq-seR8VSLK9Nj7_0 2024-09-14T11:56:15.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.498+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4747467872132993772', time=2024-09-14T13:46:11.676819+0000, chain.objs.size()=1 2024-09-14T11:56:15.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.498+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.oSM7-Pj1DjQQ6o2m_eTHZio2UX9Z_St_0 2024-09-14T11:56:15.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.498+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4720930586258528026', time=2024-09-14T13:46:11.680661+0000, chain.objs.size()=1 2024-09-14T11:56:15.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.498+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.MMRpUe2RdqM9ZLltI-KB5xTVHEY47ZT_0 2024-09-14T11:56:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.499+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14749527539726736147', time=2024-09-14T13:46:11.720050+0000, chain.objs.size()=1 2024-09-14T11:56:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.499+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.I4H0P5S1ji41tyArIzp-tlq1ooWiuvV_0 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.499+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.558852465415200488', time=2024-09-14T13:46:11.750215+0000, chain.objs.size()=1 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.499+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nDQiCxt3i1MmsiTz2rKwejiXQe27WxP_0 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3949027830728803781', time=2024-09-14T13:46:11.760922+0000, chain.objs.size()=1 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hUJYAVaqFz8SrQIOAgGx0tWLpSyirzw_0 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12229428411377823323', time=2024-09-14T13:46:11.840840+0000, chain.objs.size()=1 2024-09-14T11:56:15.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rWWWl1M0F9TleKXtVcV_g97kpeYj4AU_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4051645182096492187', time=2024-09-14T13:46:11.859010+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nvhkIXnVwD8cqBLq24UKWu8n9LFAphD_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13299725482984964965', time=2024-09-14T13:46:11.923601+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Pm1mf0gKPgAC3h7p18-iXnGMrZLxGfR_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17383271773575236190', time=2024-09-14T13:46:11.933338+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hFjQcPmPLRTw0fn-U1e3_rIcT70TlJz_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7178880278393626001', time=2024-09-14T13:46:12.065523+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._O0VjNWyZcg29c7UsKWU5plfDMNUni2_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9805274414913738152', time=2024-09-14T13:46:12.086397+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.cl3OojWPGOKuget4dbdoJ_fRuwrJmM4_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1437357828490993161', time=2024-09-14T13:46:12.092436+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.500+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ZoiAn5NGHZ7sgUQdbHIPjbCtHtZFwZ-_0 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.501+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13416967894411096852', time=2024-09-14T13:46:12.129488+0000, chain.objs.size()=1 2024-09-14T11:56:15.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.501+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8U5LvN5HKLBYQ3z_xeWxWYsiAR2DOq8_0 2024-09-14T11:56:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.503+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15597668863463084463', time=2024-09-14T13:46:12.491933+0000, chain.objs.size()=1 2024-09-14T11:56:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.503+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.A1eTJC6uB_pZMjj0ft_1jDfdkFnFU04_0 2024-09-14T11:56:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1623832888545496696', time=2024-09-14T13:46:12.518442+0000, chain.objs.size()=1 2024-09-14T11:56:15.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.iwtT29xrohWeimgjQ5zdR1gHd41ZmCA_0 2024-09-14T11:56:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5837752039697498484', time=2024-09-14T13:46:12.595215+0000, chain.objs.size()=1 2024-09-14T11:56:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bzpYKtyg9ZcIoaxtvI6SAogcli8phov_0 2024-09-14T11:56:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10018213157412198117', time=2024-09-14T13:46:12.599046+0000, chain.objs.size()=1 2024-09-14T11:56:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.504+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JgvcLeUytNw775rpZEruY6-2h7r-ivE_0 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10503400419446225246', time=2024-09-14T13:46:12.624565+0000, chain.objs.size()=1 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sFOWu5Q78D0T9o1WIh9o9o1j62aSFas_0 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9210892514434170374', time=2024-09-14T13:46:12.646719+0000, chain.objs.size()=1 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.6mkvVobShToRDyyM48vDgi6iKsQ6dkH_0 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16140787754855941082', time=2024-09-14T13:46:12.653621+0000, chain.objs.size()=1 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tYC125p5FWGm0yx-x7u7Hbhqgxbid-f_0 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16793025950378413497', time=2024-09-14T13:46:20.710566+0000, chain.objs.size()=1 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xNlz77I9v9l5P8gENkwjJtCyCV22Yyw_0 2024-09-14T11:56:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11303360347853608657', time=2024-09-14T13:46:20.712666+0000, chain.objs.size()=1 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VwDb-IDoMn2TzXLua3p1EfEAbITdeFk_0 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4522660624780217362', time=2024-09-14T13:46:20.749966+0000, chain.objs.size()=1 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Xp2CgisESKl-EEvDhVI3zh6EWRRXGOe_0 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3191047161721735733', time=2024-09-14T13:46:20.793085+0000, chain.objs.size()=1 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.505+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nlEDvyRTjyxozbeJL7cVb5ecvNiArsC_0 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.506+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17931334769361302291', time=2024-09-14T13:46:20.812927+0000, chain.objs.size()=1 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.506+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dnSEoZCxaiSeHGicc-n7aXWSKMLTU41_0 2024-09-14T11:56:15.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.507+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6043272149538096708', time=2024-09-14T13:46:20.903405+0000, chain.objs.size()=1 2024-09-14T11:56:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.507+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5xpejO0XvfQgZKzBATrHOeslCssLjLF_0 2024-09-14T11:56:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.507+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2076438331687136948', time=2024-09-14T13:46:20.943024+0000, chain.objs.size()=1 2024-09-14T11:56:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.507+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5LMbVdsbVoSfK6QM-LaxDqnLIvmyhaO_0 2024-09-14T11:56:15.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.508+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7152846158317833126', time=2024-09-14T13:46:20.960895+0000, chain.objs.size()=1 2024-09-14T11:56:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.508+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.T6pO_bb1On753er1a-issgsIP3YsEq6_0 2024-09-14T11:56:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8665591144100817649', time=2024-09-14T13:46:20.965629+0000, chain.objs.size()=1 2024-09-14T11:56:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MQ8Hso88S12PF-0sYwK7W89vJbGWvLM_0 2024-09-14T11:56:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6993202132134776201', time=2024-09-14T13:46:20.999432+0000, chain.objs.size()=1 2024-09-14T11:56:15.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.m63skXUhrIff4gpgpaIZMXzk4tKLcUp_0 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4938518175460414956', time=2024-09-14T13:46:21.119573+0000, chain.objs.size()=1 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3Z8n-MKYhEx0SryLxZY86__dwBwbs8F_0 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14355772078742695817', time=2024-09-14T13:46:21.172957+0000, chain.objs.size()=1 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.QTd_oRme2NfOVO8zcmweb5DHjZXUmI__0 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13271539326935064100', time=2024-09-14T13:46:21.326241+0000, chain.objs.size()=1 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.JvYuCMw5pgA1wy7gG_HMdLBc5zQHXKT_0 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7116344399473310609', time=2024-09-14T13:46:21.369753+0000, chain.objs.size()=1 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.e0HZxO-JtcweuBfG8oUKWa_IQnRcXHI_0 2024-09-14T11:56:15.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10561381531510492762', time=2024-09-14T13:46:21.376610+0000, chain.objs.size()=1 2024-09-14T11:56:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.4qR7fZgsk_HjWO0lMDgcCzSUytFLun3_0 2024-09-14T11:56:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10069663039840845688', time=2024-09-14T13:46:21.381750+0000, chain.objs.size()=1 2024-09-14T11:56:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.509+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ggJovbsYgum59uHGfY58Hn2jsv597eZ_0 2024-09-14T11:56:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.510+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9364494298982306326', time=2024-09-14T13:46:21.390125+0000, chain.objs.size()=1 2024-09-14T11:56:15.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.510+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.aI0ASpRJFxySS64Z3y9gOVyIJtS4HPj_0 2024-09-14T11:56:15.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.511+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14867274046819237054', time=2024-09-14T13:46:21.486711+0000, chain.objs.size()=1 2024-09-14T11:56:15.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.511+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.vm63HC4LnzT2T58td6ONedRn1PaRcFl_0 2024-09-14T11:56:15.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.511+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7119746027306061563', time=2024-09-14T13:46:21.488888+0000, chain.objs.size()=1 2024-09-14T11:56:15.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.511+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.E_5lB8QPe1LcA-Dzfhlq1VYzw05XP6C_0 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.512+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8038693494727799993', time=2024-09-14T13:46:21.868375+0000, chain.objs.size()=1 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.512+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ePKSRN3gMxCPCpM8pWZpxJcKjXvK64J_0 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9573812164589249496', time=2024-09-14T13:46:21.884655+0000, chain.objs.size()=1 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MDsYZhBqdt9EJwnjnO2GHtfnBY0Vs0S_0 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6106668237682434363', time=2024-09-14T13:46:21.918517+0000, chain.objs.size()=1 2024-09-14T11:56:15.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ntkXvMrj4QTdMdWAlIME9EvRuEEEm8U_0 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13103844358060730502', time=2024-09-14T13:46:21.926164+0000, chain.objs.size()=1 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XAUTGBoAyob3_B1OhPNlL7hKvNCEPV1_0 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15532384426630295394', time=2024-09-14T13:46:22.065628+0000, chain.objs.size()=1 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.spfXyrEqRKhtVfIh-SJl_XBdb6J6n_8_0 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15895170719154710056', time=2024-09-14T13:46:22.082007+0000, chain.objs.size()=1 2024-09-14T11:56:15.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.513+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ZXl9yb5i8ZGaMllaoM0EQhf8GVe7I3d_0 2024-09-14T11:56:15.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.517+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/51082 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15689497234831758572', time=2024-09-14T13:46:22.127680+0000, chain.objs.size()=1 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._vuQHcnq2f1bciNsqbfylmBj3l_1IPR_0 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8588472328343427565', time=2024-09-14T13:46:22.265577+0000, chain.objs.size()=1 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.p1C2HESSIeL7_PU2LDvE-Ww7kHn-FzW_0 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6057468851976164379', time=2024-09-14T13:46:22.282280+0000, chain.objs.size()=1 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7fAc49_F4C3uuN5eCwmXgOGDYb_QF_R_0 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10446717209410841800', time=2024-09-14T13:46:22.313096+0000, chain.objs.size()=1 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wY6NboDFtac8ZnWtVNkTcjjIM5aa4fx_0 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5887154759336677126', time=2024-09-14T13:46:24.452320+0000, chain.objs.size()=1 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.330__shadow_.tFV-RfCQzJEcpoKAzsqYZUCN7cn9YnL_0 2024-09-14T11:56:15.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9555507800594447643', time=2024-09-14T13:47:44.754762+0000, chain.objs.size()=1 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.489__shadow_.AOWDMEsEGlTxMwz6c1REKsHca74l5Yc_0 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17355305341181701279', time=2024-09-14T13:47:51.765473+0000, chain.objs.size()=1 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.504__shadow:GhtDa1Pqsdd1SoWHf0GLcwRnbQG9IPk_.KWdY1ISNkJeTWHq5OXH3ifG8nQwFXAZ_0 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12430757852326677556', time=2024-09-14T13:48:08.780625+0000, chain.objs.size()=6 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.1 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.2 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.kJo41IcZojKDqblAaKh0GiKwP5F6KsWy.3 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.4 2024-09-14T11:56:15.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.520+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.5 2024-09-14T11:56:15.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~UDggqSjdK6vRCpBg3Rr3Mft6lyO7UPI.6 2024-09-14T11:56:15.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.522+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6891032818081614897', time=2024-09-14T13:48:13.989533+0000, chain.objs.size()=2 2024-09-14T11:56:15.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.522+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~9b9-mH_d2Gis-gyqFMpb_ExDNXH1D7r.1 2024-09-14T11:56:15.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.523+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~9b9-mH_d2Gis-gyqFMpb_ExDNXH1D7r.2 2024-09-14T11:56:15.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.523+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4129652837553943930', time=2024-09-14T13:49:02.148832+0000, chain.objs.size()=1 2024-09-14T11:56:15.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.523+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.560__shadow_.YqDR5Fywy7q-WseC5MQaVKrBxnpyXTJ_0 2024-09-14T11:56:15.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.523+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~c91ZSpVDlLfA691jek_x_cdNNH6S0Jf', time=2024-09-14T13:49:03.248659+0000, chain.objs.size()=1 2024-09-14T11:56:15.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.523+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.562__multipart_mymultipart.2~c91ZSpVDlLfA691jek_x_cdNNH6S0Jf.1 2024-09-14T11:56:15.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.524+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13588664526367305005', time=2024-09-14T13:49:17.298801+0000, chain.objs.size()=1 2024-09-14T11:56:15.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.524+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:EDm1TWfs3beKr3eoO8a1TPj4AoQ.5El_.QTLeidLNpyyVjfaQepAyPBUJTXytly__0 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13195626154439563141', time=2024-09-14T13:49:39.610537+0000, chain.objs.size()=1 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:mn7gu0cbHIZ6WHhBNYaERbpXO8QKO8J_.jSBtUPcF5o2H5FoofEU_7yzW10ZSAei_0 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7547111719379492258', time=2024-09-14T13:49:44.414428+0000, chain.objs.size()=1 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:QTRXzAXZh3X1mWb7CsS0wVX7H23xVwa_.p7cnXucmtfBJKG5RdhsYUGHVtSC1Eu5_0 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5023882085130053343', time=2024-09-14T13:49:45.652096+0000, chain.objs.size()=1 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:YffzSNWiqnK6xw.eMu-NfhgJm5kMeJd_.8_3hIjmLpfaEQtp3Pt6A2tbMZ3U-3MG_0 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5516125449532952212', time=2024-09-14T13:49:56.405517+0000, chain.objs.size()=1 2024-09-14T11:56:15.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.604__shadow_.UaUajLAHDT1UYnqVoESUqSVrC-RHmTQ_0 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6065678385428394649', time=2024-09-14T13:52:10.253775+0000, chain.objs.size()=1 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.620__shadow_.3dzqiA1XpGeoOMW3mf3lWAnf8WRgFuY_0 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6718866710313857343', time=2024-09-14T13:52:15.356154+0000, chain.objs.size()=1 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.627__shadow_.Kku9CRETZ8YmVm54PQN65njI7fGIPsC_0 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11213953089970802532', time=2024-09-14T13:52:27.958528+0000, chain.objs.size()=1 2024-09-14T11:56:15.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.526+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.652__shadow_.JZ-MsopRzzUOwOBual9Qy_iWF_S5lPl_0 2024-09-14T11:56:15.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.530+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.532+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:56:15.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.533+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.534+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43913' 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7545393192879380437', time=2024-09-14T13:43:23.811388+0000, chain.objs.size()=2 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.165__multipart_foo.2~RxMFUeZB2aKNjtQbgB0yi4xTGfvBKqt.1 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.165__multipart_foo.2~RxMFUeZB2aKNjtQbgB0yi4xTGfvBKqt.2 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8840127772391270960', time=2024-09-14T13:43:44.271874+0000, chain.objs.size()=1 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.189__shadow_.1-oO6aGcJQY9X2VLJemRTQ2YQJ6Ed5O_0 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1937943551396657609', time=2024-09-14T13:43:58.119829+0000, chain.objs.size()=1 2024-09-14T11:56:15.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.205__shadow_.UxBAgENaifdffhqJ7O7P5ZdmotrAFVB_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11275391366377036035', time=2024-09-14T13:45:07.204593+0000, chain.objs.size()=1 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.234__shadow_.ePlWi5FL3kvD2IjU-pIFWPHI0WyQ_4Y_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.57922558316916018', time=2024-09-14T13:45:08.194954+0000, chain.objs.size()=1 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.236__shadow_.L7UEkACWNUDUB-knVYIhXRTZx1Dn6MQ_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5350826212836615785', time=2024-09-14T13:45:18.325352+0000, chain.objs.size()=1 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.254__shadow_.6KkGcWlu3M7HWZoxNtp0c9GgFD_c3zs_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2021741956858479949', time=2024-09-14T13:45:20.680097+0000, chain.objs.size()=1 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.259__shadow_.kFmUNmrMneJTZMDXuG37Oz2Z_yn7WDH_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11622463474660696965', time=2024-09-14T13:45:21.130629+0000, chain.objs.size()=1 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.260__shadow_.gZGYbiMBS3Kg8QfrdkaIX4T1gy35Aqv_0 2024-09-14T11:56:15.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16492335073693884856', time=2024-09-14T13:45:30.241121+0000, chain.objs.size()=1 2024-09-14T11:56:15.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qpcNXIUlAB-yaqHdOpkDIiWACwOdqZC_0 2024-09-14T11:56:15.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18092116210569356078', time=2024-09-14T13:45:30.256662+0000, chain.objs.size()=1 2024-09-14T11:56:15.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.aQop9dvYJqJRE2IgLy-RanJ5UJAVOxP_0 2024-09-14T11:56:15.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15273401343813784774', time=2024-09-14T13:45:30.295554+0000, chain.objs.size()=1 2024-09-14T11:56:15.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.535+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.61OHaYlJROwbtvGl-cGGfuj5yI2yWgf_0 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1366611479808216379', time=2024-09-14T13:45:30.452870+0000, chain.objs.size()=1 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.K2Oy0lHD6yl-mI64qCuEJ3wpbDVTuIP_0 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13615495678351276530', time=2024-09-14T13:45:30.639790+0000, chain.objs.size()=1 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Gd737DCaO25qu_a3idl47mMda777Ixi_0 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12929697314269974086', time=2024-09-14T13:45:30.776170+0000, chain.objs.size()=1 2024-09-14T11:56:15.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.538+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.r2pWSdGc7S1_m5LQjxDZSH7B-YvREwo_0 2024-09-14T11:56:15.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11015988614726982443', time=2024-09-14T13:45:30.779662+0000, chain.objs.size()=1 2024-09-14T11:56:15.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ATj7aobN2Iy7-85pNfHKZYLukhvYKcS_0 2024-09-14T11:56:15.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10200024570190169417', time=2024-09-14T13:45:30.817360+0000, chain.objs.size()=1 2024-09-14T11:56:15.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RwIaHbhp1zsxS5_0wZWKbcv5x2FTQ_9_0 2024-09-14T11:56:15.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14225991374250926798', time=2024-09-14T13:45:30.962497+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.V29m6TWkahsZgczbjYsFuLZ992It7ad_0 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7947112298513782537', time=2024-09-14T13:45:30.970663+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.MjHxSHcWcXp9Ogqaaso88JugLDi2Bhx_0 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.691889553694082259', time=2024-09-14T13:45:30.985417+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_._E4bSqbKoiU5eDaPoDLttgW0SZ7FREk_0 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.52181149282953549', time=2024-09-14T13:45:30.989160+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gVseNUoSQaeS_UQMwdj41kMblO8er04_0 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15226190021684500353', time=2024-09-14T13:45:31.002478+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lI5m9-l0hW8hb32wzbzOojXnGtRG_z1_0 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17243320902077520701', time=2024-09-14T13:45:31.033209+0000, chain.objs.size()=1 2024-09-14T11:56:15.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.539+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.RMAxMNnUexCGASR0Oty1pvYrfSeuqVa_0 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.797592785902900223', time=2024-09-14T13:45:31.163495+0000, chain.objs.size()=1 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.kuYNcZw4Tq-lT2oZEdzpXXaJFKmVMAO_0 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13267764867253633298', time=2024-09-14T13:45:31.174482+0000, chain.objs.size()=1 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.QPTpQEkRVvjkBM9SS2Sir763zff2VSU_0 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13342977080568721468', time=2024-09-14T13:45:31.175997+0000, chain.objs.size()=1 2024-09-14T11:56:15.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.542+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lT527t6MveeEEgHwZRTEYIDAn8Z1hav_0 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3642325419518331613', time=2024-09-14T13:45:31.250447+0000, chain.objs.size()=1 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.9URmSNwi5qi0aCXXYOpCXk09QoqWxZR_0 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11726829056754763088', time=2024-09-14T13:45:31.251451+0000, chain.objs.size()=1 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.4ja_TTje5Vzz8e82UCCoMiVHzFEszsU_0 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8116239525635341697', time=2024-09-14T13:45:31.534171+0000, chain.objs.size()=1 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.hzqJCDYV9fPGI7T9BiZzuzlSU18n7Ao_0 2024-09-14T11:56:15.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13232396277825712062', time=2024-09-14T13:45:31.535389+0000, chain.objs.size()=1 2024-09-14T11:56:15.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.sxtzTG25ORsd7RdmoNZXtD8cZ56sjnK_0 2024-09-14T11:56:15.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6990903859969820723', time=2024-09-14T13:45:31.552196+0000, chain.objs.size()=1 2024-09-14T11:56:15.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.543+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.duqfSzGfQrn4N3CUQM8RaUL5s0w1gDF_0 2024-09-14T11:56:15.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7969689252100125778', time=2024-09-14T13:45:31.710419+0000, chain.objs.size()=1 2024-09-14T11:56:15.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.iPN3YocwSf6iiAGanm6KrFVs9r1VD8v_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12032135947008292777', time=2024-09-14T13:45:31.738828+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.pAhUxeOCqnkVexdNmjRJt-F_uUyJC_v_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11008267328387744441', time=2024-09-14T13:45:47.361334+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.0qVvJO8FD2q0T2qwF8-827Pq7XG1hfw_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9064308355489306568', time=2024-09-14T13:45:48.180121+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.yRvuPcVZamaxEB7oyR_lr0qAvki5v4L_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15724373312210754270', time=2024-09-14T13:45:59.745673+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.316__shadow_.hiI8vj1EL27JcMD39B0KRP0W0z8KrjR_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7090132855057557715', time=2024-09-14T13:46:02.566623+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.323__shadow_.-fZllpb2suQf6k7x0GDK6Y-hc8IzfjJ_0 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7946831006019429073', time=2024-09-14T13:46:10.984071+0000, chain.objs.size()=1 2024-09-14T11:56:15.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.545+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tPTTdWwPK9ecO3FG6uNynSNUrUbpSNM_0 2024-09-14T11:56:15.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6503991869454373509', time=2024-09-14T13:46:11.005792+0000, chain.objs.size()=1 2024-09-14T11:56:15.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.tes8UWGE0jPQj2XAMUNwRLCqIg5kkWA_0 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14424453210599712105', time=2024-09-14T13:46:11.030095+0000, chain.objs.size()=1 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xhptyLJzoxZDtOrInmwFMKCzCenigYy_0 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2642830419935721197', time=2024-09-14T13:46:11.113230+0000, chain.objs.size()=1 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.9CvgPD3Tn9jG1BEC9KbaLeaLUOoTriR_0 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8178226797647415544', time=2024-09-14T13:46:11.130104+0000, chain.objs.size()=1 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JaiefQyiwyXfG66GW4k7udEoxmv2J27_0 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.538290571634054279', time=2024-09-14T13:46:11.141751+0000, chain.objs.size()=1 2024-09-14T11:56:15.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.548+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.sKBPwZ-7DbeDBiIWGSUYcT5kiXbx8BJ_0 2024-09-14T11:56:15.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.549+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6898314783810647718', time=2024-09-14T13:46:11.155925+0000, chain.objs.size()=1 2024-09-14T11:56:15.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.549+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.GqJMU1g3k0Vo4C9NHk_3n_1rtswY5ug_0 2024-09-14T11:56:15.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.549+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4140618142372669504', time=2024-09-14T13:46:11.160348+0000, chain.objs.size()=1 2024-09-14T11:56:15.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.549+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HpHMXmHiTTPiC_xVEg0H9rhjf9Ll5w1_0 2024-09-14T11:56:15.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15041125066262532426', time=2024-09-14T13:46:11.352673+0000, chain.objs.size()=1 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.o-y94LQhMPpQO96qQuVNit3giDY_Cdc_0 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.95491279139073826', time=2024-09-14T13:46:11.395788+0000, chain.objs.size()=1 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.VhEZd4rMb1Hxya60zGrYEkwKhtrsqGL_0 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13102100325697721594', time=2024-09-14T13:46:11.408610+0000, chain.objs.size()=1 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.kW_7sGkt91r8MOYHBEmHGAGu7T0MQl-_0 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10386061965357333840', time=2024-09-14T13:46:11.702735+0000, chain.objs.size()=1 2024-09-14T11:56:15.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.550+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.wsmf34IqCKrZGfZ-Nqw5927p9LBQbXq_0 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10852504187713584898', time=2024-09-14T13:46:11.731537+0000, chain.objs.size()=1 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bNXRf9RjQrFkuOLC3NZIHslh35bmZxJ_0 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11632636515022249549', time=2024-09-14T13:46:11.756703+0000, chain.objs.size()=1 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.T8jAeMSf7xoNVezXokMZEpoOdeEy6b9_0 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15833621320337536068', time=2024-09-14T13:46:11.761230+0000, chain.objs.size()=1 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aOW83ZFqMzo1AXNncC00r98UNItZCe8_0 2024-09-14T11:56:15.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8085461630746063833', time=2024-09-14T13:46:11.854445+0000, chain.objs.size()=1 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.jZqHrn3ZEFrLEhUUTo7YyxomhTeLR8h_0 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1627836821535350072', time=2024-09-14T13:46:11.880902+0000, chain.objs.size()=1 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.551+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.UWxrT8mOUx3B9ha8nkmz2dtWfOXDWMK_0 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5420330320554783416', time=2024-09-14T13:46:11.939276+0000, chain.objs.size()=1 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.-UuoRZ2eMY2IluNbBrKm9Y0nlVW1xMa_0 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15567319135066675704', time=2024-09-14T13:46:12.069463+0000, chain.objs.size()=1 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.SiDdV1g-Ln8GMQLK1YWub5Y3eBzL59P_0 2024-09-14T11:56:15.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13586424271074587775', time=2024-09-14T13:46:12.101583+0000, chain.objs.size()=1 2024-09-14T11:56:15.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.552+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.05gQzQFRhxGm2d24Otls1ibjIPyL_eN_0 2024-09-14T11:56:15.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.554+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18392458358950306149', time=2024-09-14T13:46:12.114394+0000, chain.objs.size()=1 2024-09-14T11:56:15.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.554+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hEzrY85qejK8Y9KRfUW-j_WfjUs66xV_0 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17684931295371644070', time=2024-09-14T13:46:12.115585+0000, chain.objs.size()=1 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.66rw4jamosdyOPfc9u-YIMsH3jxB_x4_0 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.47112311620898856', time=2024-09-14T13:46:12.122182+0000, chain.objs.size()=1 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.hjXEN__dDqZmi5YutU4cfSV_H_EDoFQ_0 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11973860077621831487', time=2024-09-14T13:46:12.438507+0000, chain.objs.size()=1 2024-09-14T11:56:15.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.555+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.nkNuoOZ0MyW6uxzpfHZnoPDjwZGdu_c_0 2024-09-14T11:56:15.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17067786444144015075', time=2024-09-14T13:46:12.478531+0000, chain.objs.size()=1 2024-09-14T11:56:15.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.T5_4UA_iBQ81ZCy3tm_1o0glReyaJlu_0 2024-09-14T11:56:15.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17653348162974973449', time=2024-09-14T13:46:12.492508+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.S8KsDL-wgRECzmnugI9bog7wlMP48t6_0 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17370351182478939192', time=2024-09-14T13:46:12.599432+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PN-CIkpWy2OKts6ryvpx3oVy4iT5ChX_0 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9344338095954254512', time=2024-09-14T13:46:12.608434+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Iz868n_HZUcGGf-0AiFYGRBjuNCBkdA_0 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.614434551035759125', time=2024-09-14T13:46:12.615498+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xc3X2z1Kpoa7NurPhHS_z4LS_Z_juis_0 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2393475045510695635', time=2024-09-14T13:46:12.635117+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LsxSAA4XYNgXjIc9y3ONfqvwe1r8NBF_0 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17561680375247690127', time=2024-09-14T13:46:12.666039+0000, chain.objs.size()=1 2024-09-14T11:56:15.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.557+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.y36fLfvVUZ6pfAyHAaSx2jUhv8C8rUF_0 2024-09-14T11:56:15.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.558+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2636698502976867043', time=2024-09-14T13:46:12.682727+0000, chain.objs.size()=1 2024-09-14T11:56:15.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.558+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rdILMxJD4AawDypVNT_2MmKH3G1jf-y_0 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14906138060457211731', time=2024-09-14T13:46:12.686354+0000, chain.objs.size()=1 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.CZsq2MuqFWLLh5bHF1q9--CEkbZg88V_0 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14935351887816442993', time=2024-09-14T13:46:20.734457+0000, chain.objs.size()=1 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wWaJ2mY81SBY0rNzxXoXyLbGxn2x8fU_0 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4871290177702527843', time=2024-09-14T13:46:20.737513+0000, chain.objs.size()=1 2024-09-14T11:56:15.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.559+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.k6_Ou1zVIhjWUDCrrPiW5z68bIstCmH_0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12563744966122500758', time=2024-09-14T13:46:20.816022+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.J9uVU7ijOQeftNdqEityN2T__gool8T_0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11164072319550748854', time=2024-09-14T13:46:20.817945+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.msfl42v-FK-ftmb3Dbceu9Z6m-mnIIL_0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8996011937600976577', time=2024-09-14T13:46:20.958177+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.562+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RgWM0eG0MqzDNR0BWACE9ZiKf0QbL6__0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6665009022459665835', time=2024-09-14T13:46:21.096547+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AVWMa-_LYtKAXV43jRvNEs_L88xu4sN_0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8635793164405813174', time=2024-09-14T13:46:21.103610+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Rhlgdt6pUkId1S3VheSYvOfRlC2xI4q_0 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6250965405282239106', time=2024-09-14T13:46:21.195015+0000, chain.objs.size()=1 2024-09-14T11:56:15.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DWINrhB_hPef2k37DgCFQQu8Zqgf1dy_0 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8466127891783240323', time=2024-09-14T13:46:21.282648+0000, chain.objs.size()=1 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_._wrE_ksiNsKBG5_Od9hXkTbmLTm0z1C_0 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4678771291157735408', time=2024-09-14T13:46:21.328514+0000, chain.objs.size()=1 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.h2_vl6_gz5k-4HUZYNk7oow5r4GYOw6_0 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15565681715363672787', time=2024-09-14T13:46:21.340239+0000, chain.objs.size()=1 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uwKsq6bWrvEGH3baI9mbB1MV6-nyXIn_0 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12885578450775706762', time=2024-09-14T13:46:21.381791+0000, chain.objs.size()=1 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nWS1g6cIPkgV36SP8753az-XI_3UWB2_0 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16068173035681427145', time=2024-09-14T13:46:21.519907+0000, chain.objs.size()=1 2024-09-14T11:56:15.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.563+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bgNKLPrO89CbdXUCXfB52hRS_FSei6I_0 2024-09-14T11:56:15.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15638209544522341085', time=2024-09-14T13:46:21.524655+0000, chain.objs.size()=1 2024-09-14T11:56:15.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.dJh9zLTWth525vHnWi2fAOvioDRzBaZ_0 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16355169448006365290', time=2024-09-14T13:46:21.732821+0000, chain.objs.size()=1 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.DhGrVtKzQwY99o9J9gZIegTFmT2fggz_0 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4320189667080501037', time=2024-09-14T13:46:21.742439+0000, chain.objs.size()=1 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lX-EO-HtSnPENidiqPn8Pk0WXeT87So_0 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7090581869484807738', time=2024-09-14T13:46:21.743922+0000, chain.objs.size()=1 2024-09-14T11:56:15.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.5TYiRj-BNB8oS47AmJNiBsHWjL_1srl_0 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3557085042664751598', time=2024-09-14T13:46:21.749137+0000, chain.objs.size()=1 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.9yn6Yq9N6nrDoXzg34NaAL4QZoMxnj9_0 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1572241788634560298', time=2024-09-14T13:46:21.876708+0000, chain.objs.size()=1 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.566+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.cSHWex5P8Fzym7pEFs8UP8DX_Q8QtqO_0 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.567+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7151373245739531821', time=2024-09-14T13:46:21.884782+0000, chain.objs.size()=1 2024-09-14T11:56:15.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.GT0RML_mu4qslvjOyQzc5e1GKq-Oqe9_0 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15420929610530368647', time=2024-09-14T13:46:21.923385+0000, chain.objs.size()=1 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.SkdUraRCkqEdBcajQdqOT7hBCvta2l7_0 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2749694335336961084', time=2024-09-14T13:46:21.924656+0000, chain.objs.size()=1 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.ybvyJZf8rG5JrSt8X0gbbxE_I51IoT7_0 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1198354293167753316', time=2024-09-14T13:46:21.925515+0000, chain.objs.size()=1 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.nZE0UZyNW5p9PFv9j5PZTqt6lr070DE_0 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13241549961999671459', time=2024-09-14T13:46:21.940859+0000, chain.objs.size()=1 2024-09-14T11:56:15.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.568+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LovK5E2Mj9IoorDhvoykvBNoIQW0dIP_0 2024-09-14T11:56:15.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3687285207682536454', time=2024-09-14T13:46:21.953161+0000, chain.objs.size()=1 2024-09-14T11:56:15.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.XpPtIO8R-7IIdGPIxL3xrXUj7y9Q29R_0 2024-09-14T11:56:15.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7636715306048729355', time=2024-09-14T13:46:21.956503+0000, chain.objs.size()=1 2024-09-14T11:56:15.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RN-1mraslCLytEbUoU5orxavxnULkx__0 2024-09-14T11:56:15.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12743404720886460602', time=2024-09-14T13:46:22.086335+0000, chain.objs.size()=1 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.569+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LesdZwhCA_icNXkJSBgFdnOZVdTJ77n_0 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18389362511559557412', time=2024-09-14T13:46:22.126462+0000, chain.objs.size()=1 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.zbHmaeR4y20bWircCIO07moyBfSRv_Q_0 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5960819561135248968', time=2024-09-14T13:46:22.280045+0000, chain.objs.size()=1 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.MjNGSn740CZwCO0uLk8n-FVGJCJJPnC_0 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9041971116641046258', time=2024-09-14T13:46:22.308718+0000, chain.objs.size()=1 2024-09-14T11:56:15.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.570+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.LAJjkhRhgZJEyHqOcB2z2PikAnHN9UT_0 2024-09-14T11:56:15.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.571+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17012699140480360797', time=2024-09-14T13:46:22.327696+0000, chain.objs.size()=1 2024-09-14T11:56:15.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.571+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rFFtyNVm8ffieeZlQzwMU9JuKdKK3x8_0 2024-09-14T11:56:15.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.574+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/43913 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15220301197481941699', time=2024-09-14T13:46:22.331582+0000, chain.objs.size()=1 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7m7e9tLMY0xkFvoFIREtBoB8sFNdri9_0 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16811061165993906795', time=2024-09-14T13:46:22.333757+0000, chain.objs.size()=1 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-nXlj0hLWTVfsI7VQukiapM90vVEBex_0 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9174861762569037053', time=2024-09-14T13:46:25.497584+0000, chain.objs.size()=1 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.332__shadow_.YWuJPs-75YJOauoyja-s4OGNwczcwZY_0 2024-09-14T11:56:15.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15317958898700624550', time=2024-09-14T13:46:41.072370+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.368__shadow_.ecZMsLgyUcrKb5rZ5qGttk58rmg2P8O_0 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9642230942758390521', time=2024-09-14T13:47:33.692224+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.463__shadow_.Ap5-MQx9MABiQikxsP1HzuhUUtkuf_0_0 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.804395665755839662', time=2024-09-14T13:47:45.629522+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.491__shadow_.b2Wo0j7R1RIPVqpPWlF8S2YzpixDU4l_0 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.804395665755839662', time=2024-09-14T13:47:45.778904+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.491__shadow_.b2Wo0j7R1RIPVqpPWlF8S2YzpixDU4l_0 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6065831089890623379', time=2024-09-14T13:47:58.611041+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.519__multipart_mymultipart.2~m7iIsK6utSSjwJJjL8o-9JejIMHw_5w.1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.561276+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.563143+0000, chain.objs.size()=1 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.2 2024-09-14T11:56:15.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.564645+0000, chain.objs.size()=1 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.3 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.566125+0000, chain.objs.size()=1 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.577+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.4 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.579+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.567338+0000, chain.objs.size()=1 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.579+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.5 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN', time=2024-09-14T13:48:10.568521+0000, chain.objs.size()=1 2024-09-14T11:56:15.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.523__multipart_mymultipart.2~SwcUgPWQlhOoB8hfHrkvzwqdYg2FQsN.6 2024-09-14T11:56:15.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7735888330832143002', time=2024-09-14T13:49:16.287944+0000, chain.objs.size()=1 2024-09-14T11:56:15.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:0rkqZhgxB2q8OA6pF4bud696wBbfKRO_.61jc_NQjacbI_gYy_pu5WovhlsyX6hd_0 2024-09-14T11:56:15.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15467281887380893137', time=2024-09-14T13:49:24.234772+0000, chain.objs.size()=1 2024-09-14T11:56:15.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.576__shadow:u2J7rWtMXlyWFLSji0g44NvD69l.lj3_.k5UHjw8PQwvF8rCUj2HayxlHGsFYJQh_0 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17800874952211245658', time=2024-09-14T13:49:31.150089+0000, chain.objs.size()=1 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:f8DA2g10jYXouW7Ux5TfuK2jcmCCiFR_.TLQEJJUBjrNNDcBrTphB8E8cgj3MD_V_0 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10975282069322721107', time=2024-09-14T13:49:31.483443+0000, chain.objs.size()=1 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:Wm1IWeG9vp71l05UIByKLJczefsfUTD_.-10yHrBzFkV1-RxE7xz06kshrr2gJ0L_0 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5772619706026794499', time=2024-09-14T13:49:32.831034+0000, chain.objs.size()=1 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.580+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:pESyhcjcFBsDnya.aDadw7-yycEs2TC_.zMhFBTPYExZ1B4BU8Me6dS2XYQU42aV_0 2024-09-14T11:56:15.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15462888045618774463', time=2024-09-14T13:49:37.318278+0000, chain.objs.size()=1 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:JwUAtSn0EZPFf09RwVySsOHc6CLTjuO_.gsvtqIPkE4xCX4bQbnhvaBCILQ5MYgE_0 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4336024014709119190', time=2024-09-14T13:49:40.456172+0000, chain.objs.size()=1 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:WrKHe2nvziPHc7K5TeZYY-YKs1Rzg3V_.m8mudGyWsOaup3ee6nTOHCjj9VTx0d-_0 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14447951847758011575', time=2024-09-14T13:49:45.750409+0000, chain.objs.size()=1 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.581__shadow:YffzSNWiqnK6xw.eMu-NfhgJm5kMeJd_.8_3hIjmLpfaEQtp3Pt6A2tbMZ3U-3MG_0 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2658557686749234605', time=2024-09-14T13:52:19.666936+0000, chain.objs.size()=1 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.636__shadow_.d7pC1YVSb1t8grrQmrrsAogA75Qlq5C_0 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13040895136843173064', time=2024-09-14T13:52:36.367798+0000, chain.objs.size()=1 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.581+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.667__shadow_.PHqc3twD3KC-2xfzzhgOkHyJe4mVXto_0 2024-09-14T11:56:15.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.583+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7909559368262455638', time=2024-09-14T13:52:37.074105+0000, chain.objs.size()=1 2024-09-14T11:56:15.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.583+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.669__shadow_.uDb7GJueUZAO2eKnSnm5XpMJ0dkWwN8_0 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15395776362927923189', time=2024-09-14T13:52:46.091133+0000, chain.objs.size()=1 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.691__shadow:giAns.QMbA8c0MPYW6z3omdXdV7ko9p_.e8t9GpihLVCsRhutyaQqYoDCR-uyonu_0 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12645891494908270585', time=2024-09-14T13:52:52.977372+0000, chain.objs.size()=1 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.706__shadow:GS5lnH7kqyJlkVNUx.xapSi89rrmFKN_.c0tgoA0-Zkh_b0O6xlvxAnQYcwJT90b_0 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14344682113670174046', time=2024-09-14T13:52:53.880812+0000, chain.objs.size()=1 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.708__shadow:O2eyFp5QOYuGMx-g3PO6Uz0Im4jX5D7_.Y4xfb32RInGzXqdIJmr75XIFKCEnHTV_0 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12194612614336543335', time=2024-09-14T13:52:55.325538+0000, chain.objs.size()=1 2024-09-14T11:56:15.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.711__shadow:UKE4g17dRzG9pC5egXufNXMXyaw9hte_.CCWqg0FyaO4yLRMhyxRKSu0YIcsXmty_0 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14862128906318603624', time=2024-09-14T13:53:08.073550+0000, chain.objs.size()=1 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.717__shadow:oUlktIDKIXhctib-AqgE6n25NbUrNDH_.DHJ5jHmQKyEJsTi2mjERY8l1NdECw1T_0 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13979757106116978159', time=2024-09-14T13:53:30.492951+0000, chain.objs.size()=1 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.742__shadow_.S5b2DUrDt3sGbMQw7XX98_A7KAKn5CZ_0 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8880813935868716067', time=2024-09-14T13:53:44.509409+0000, chain.objs.size()=1 2024-09-14T11:56:15.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.585+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.749__shadow_.Cew0AbqwmTLDAhrOsZONqtFm1ubTM-z_0 2024-09-14T11:56:15.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.588+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.591+0000 7f175db25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:56:15.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.592+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:56:15.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.592+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51055' 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2155730248250561693', time=2024-09-14T13:45:07.704655+0000, chain.objs.size()=1 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.235__shadow_.mYBieL-M3TH-mIXTF4cpCc6V65y5PVP_0 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3949772044863340896', time=2024-09-14T13:45:09.559713+0000, chain.objs.size()=1 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.238__shadow_.NSMmRxx8yyyxuKgfZsZXC51yWejL6nv_0 2024-09-14T11:56:15.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6503197927799346726', time=2024-09-14T13:45:18.781521+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.255__shadow_.7AfVlNkwf3OFyJKeBT5sdqV67oQHGPy_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17324671852812901753', time=2024-09-14T13:45:20.680299+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.259__shadow_.xQeHBrskK-uWmRbG7pYpF5MUHVXkuIo_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8678031021515677891', time=2024-09-14T13:45:30.231178+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bCEssKiY-fcyuGDXiwcqF_7vZt1wUJV_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14378246472002387878', time=2024-09-14T13:45:30.259415+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.WMEsFpJ-OQTWk9R0N8ae-aADau1Yhrc_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16156132749408800060', time=2024-09-14T13:45:30.288114+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.7w4Tm0_fMcJjIHg8bjfUfD9WX8t9jUd_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4387517961699561868', time=2024-09-14T13:45:30.293572+0000, chain.objs.size()=1 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.I0zHVo-m0u19G904YaNpsneoHEHQDdF_0 2024-09-14T11:56:15.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14226024898880498581', time=2024-09-14T13:45:30.406059+0000, chain.objs.size()=1 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.e_xpg18XpiS0SHJJqhS31nfGeFlneOH_0 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1684154788988671378', time=2024-09-14T13:45:30.433717+0000, chain.objs.size()=1 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.J3fiXW4gT1Wr5d3zo3UsTNgCIPlDRc-_0 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12545071315802283766', time=2024-09-14T13:45:30.450175+0000, chain.objs.size()=1 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.LLFWh00GZiHOO5lHnenKNv6sJt5zrYG_0 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14306516739912122918', time=2024-09-14T13:45:30.474283+0000, chain.objs.size()=1 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.593+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.ZGChyg8yNBCMVJvPdXuJc-_UVrE5snf_0 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.595+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7569390505412922361', time=2024-09-14T13:45:30.632220+0000, chain.objs.size()=1 2024-09-14T11:56:15.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.595+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Ux642pW6grn0ubI9Nf8ZXUnI4fvuS_W_0 2024-09-14T11:56:15.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17159120987045985957', time=2024-09-14T13:45:30.636812+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.gMsDm-_ahIdJSuSFIxH3-lHLgJ9ZIdJ_0 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1164357857744362272', time=2024-09-14T13:45:30.674601+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.qaepcCcP84ev1c85kNoaqzu-OwMBfEi_0 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14507047720864997256', time=2024-09-14T13:45:30.788750+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.J2OTGqvMFKB5gPygZIQEwuk1Oo-uTCw_0 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13483618637604682594', time=2024-09-14T13:45:30.795777+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bLxylTC_2rd9G2L42WDV55phXvoMxls_0 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4648819133815208251', time=2024-09-14T13:45:30.820027+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.Fc61S9hWDuq-lKWAbbwRQrf99BXy_-h_0 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.37118931147261058', time=2024-09-14T13:45:30.847701+0000, chain.objs.size()=1 2024-09-14T11:56:15.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.bYluMIKiPdig1-fbdK8LKdVhGLJOo9M_0 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.275523438399106565', time=2024-09-14T13:45:30.956238+0000, chain.objs.size()=1 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.rxsXfRnAd79K8O-SzFQdQIN_-Q0-oqa_0 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11891606145895922577', time=2024-09-14T13:45:30.991573+0000, chain.objs.size()=1 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.3rdClBg41oxbeHeEm2DpWzAJU3kR9Q3_0 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2586063712935207852', time=2024-09-14T13:45:31.005002+0000, chain.objs.size()=1 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lcoN2dIHr7StNoO_SQ8z9BC9RUnwnIQ_0 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18278803649828676307', time=2024-09-14T13:45:31.032178+0000, chain.objs.size()=1 2024-09-14T11:56:15.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.597+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-My20DpYhfWgbEmf0Jz0rEDDTQUqbmG_0 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4335107886720818066', time=2024-09-14T13:45:31.161127+0000, chain.objs.size()=1 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.uFPrMtclthgsyZTXb1-Jj_5x2F8GaNp_0 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12855762453551918423', time=2024-09-14T13:45:31.162917+0000, chain.objs.size()=1 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.2iM3OE_79vP6N53aJrCvhr1US-ONV_Z_0 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10758339191969381990', time=2024-09-14T13:45:31.189367+0000, chain.objs.size()=1 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.lmlJST5akuVVBXoRt8SnBtd3GsiA2X2_0 2024-09-14T11:56:15.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10608543282886820584', time=2024-09-14T13:45:31.229506+0000, chain.objs.size()=1 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.X12_f_nK_9Mx4jnrZFsPdIMyzX1K1Ai_0 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13167510848724624458', time=2024-09-14T13:45:31.242799+0000, chain.objs.size()=1 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.HNalqgGe3Sv1cUX3o8VZV5CoYVOWMde_0 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9515126330923792341', time=2024-09-14T13:45:31.523359+0000, chain.objs.size()=1 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.601+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.263__shadow_.-SCDa9WwPnjQkOYu44ouZdbT337VPXS_0 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16202590013261470814', time=2024-09-14T13:45:32.791070+0000, chain.objs.size()=1 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.265__shadow_.63-eC7lk2eSimgZBBN_znKq2lMxq5MT_0 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9522795918337108015', time=2024-09-14T13:45:35.183414+0000, chain.objs.size()=1 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.270__shadow_.SeTga5Zy6s1oXb1NDZmbFgZ2zUS_HOe_0 2024-09-14T11:56:15.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12745731911292516178', time=2024-09-14T13:45:38.612251+0000, chain.objs.size()=1 2024-09-14T11:56:15.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.277__shadow_.1XRom3EGNR0lWIAZ4AR51rLka1U650Q_0 2024-09-14T11:56:15.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16477072251098359470', time=2024-09-14T13:45:39.106234+0000, chain.objs.size()=1 2024-09-14T11:56:15.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.278__shadow_.rCdXkg23HXSKI78dedTyOPCd9ixEzMK_0 2024-09-14T11:56:15.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7148810047181191998', time=2024-09-14T13:45:44.821713+0000, chain.objs.size()=1 2024-09-14T11:56:15.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.602+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.289__shadow_.W536VlpbfZ5bYYzoA6C3COeNeFZym_1_0 2024-09-14T11:56:15.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.605+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5497219327993680258', time=2024-09-14T13:45:47.350278+0000, chain.objs.size()=1 2024-09-14T11:56:15.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.605+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.-MXoyJqvcKxTzWkrtPpmbYIcgXgw2qa_0 2024-09-14T11:56:15.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6059888945399300382', time=2024-09-14T13:45:47.363425+0000, chain.objs.size()=1 2024-09-14T11:56:15.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.293__shadow_.9f6mysK-BijEvGT3inclo6BFztdOKWx_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12409411068604913959', time=2024-09-14T13:45:48.177029+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.294__shadow_.GTrG8y8AujuhPFkfCncva8wVgMmeCiJ_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2202884955825403675', time=2024-09-14T13:45:48.679087+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.295__shadow_.P_75QEQhEZHlyUH_UFeWpScTheSd0Gq_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.164915935782965010', time=2024-09-14T13:45:51.158655+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.300__shadow_.T9dAcy4ZQG-1jkPSJy8sWQbMSaIM8fH_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11772209763597791353', time=2024-09-14T13:46:10.945977+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YmL3wk4swH-sO3H1RZBsL3JDBqaPDMV_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10686465721231279575', time=2024-09-14T13:46:10.958082+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.AH1AaTBpVoymP-HDMk3M78tnKSmW5Cw_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9004865461341602452', time=2024-09-14T13:46:10.981789+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.xPz3Ej8fZeW9L6x-8oZm1-MoF12j1iB_0 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16177330936836701516', time=2024-09-14T13:46:11.014921+0000, chain.objs.size()=1 2024-09-14T11:56:15.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.U8eYBlNm2iD1jcbBXJeBK3ibLGDGp4q_0 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2663029940195410474', time=2024-09-14T13:46:11.032611+0000, chain.objs.size()=1 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._pDOhmL6ZYWWGCqqZyetvrPh_FluYQP_0 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3377150004112705784', time=2024-09-14T13:46:11.111775+0000, chain.objs.size()=1 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.606+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.b8Z299knBGJz7hr0aeYkCE-v1lexLAm_0 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.607+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6918782406616908133', time=2024-09-14T13:46:11.128260+0000, chain.objs.size()=1 2024-09-14T11:56:15.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.607+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.f1PN9DxozCptiIS6berftYtUeytcipX_0 2024-09-14T11:56:15.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11046720157966465949', time=2024-09-14T13:46:11.192846+0000, chain.objs.size()=1 2024-09-14T11:56:15.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.HYGOac3GwVd84BgsycUD8tmMAoBHaw4_0 2024-09-14T11:56:15.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7316618831432034143', time=2024-09-14T13:46:11.224146+0000, chain.objs.size()=1 2024-09-14T11:56:15.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.PojjKk5F-8gg_pptJyrTQN8lvp21WQu_0 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8293422458604165478', time=2024-09-14T13:46:11.311433+0000, chain.objs.size()=1 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.610+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Jwck6LmWxBafwpPNevY-t7B5-G1efLT_0 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10674282053505464951', time=2024-09-14T13:46:11.323835+0000, chain.objs.size()=1 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JgEwSGQJT2b67kRgfmp_-dLc0mTP5ng_0 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14644392576940324202', time=2024-09-14T13:46:11.332291+0000, chain.objs.size()=1 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.peml31qEESZKxeC5EM0g4WFkeFBMnUQ_0 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10809704254572620614', time=2024-09-14T13:46:11.340541+0000, chain.objs.size()=1 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.JvrxL5Iv3A7US7pQx0zizjHEeCSRiWp_0 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2125673267115905894', time=2024-09-14T13:46:11.366254+0000, chain.objs.size()=1 2024-09-14T11:56:15.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.611+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.LcMxzJc_Ta39iVIo_CDHi8Frbj2G1lO_0 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18102135391113453024', time=2024-09-14T13:46:11.409113+0000, chain.objs.size()=1 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.NPprMDRxo4GR1CUN2JQHgsEjBsKuO-A_0 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12710400761387492544', time=2024-09-14T13:46:11.678128+0000, chain.objs.size()=1 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.IZVNs2VRxP7OU1C7-KWvDx3td7xfstQ_0 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9337112106972046395', time=2024-09-14T13:46:11.748393+0000, chain.objs.size()=1 2024-09-14T11:56:15.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.0xlbaiWVk-pZly0YH_YtwMPb3l_h7kM_0 2024-09-14T11:56:15.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17740595834272095642', time=2024-09-14T13:46:11.837829+0000, chain.objs.size()=1 2024-09-14T11:56:15.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EC1GpHEFaeCwDTiiDVmcye4n6s1QvQb_0 2024-09-14T11:56:15.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11822911699536097689', time=2024-09-14T13:46:11.842409+0000, chain.objs.size()=1 2024-09-14T11:56:15.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.612+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_._GRvPIvIq9pWsmqrk4CR2ffB8W46PjP_0 2024-09-14T11:56:15.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11770023889459062248', time=2024-09-14T13:46:11.860782+0000, chain.objs.size()=1 2024-09-14T11:56:15.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.Vw2GbIV_ECP6bD6l0yOI_1C2X9Zprrd_0 2024-09-14T11:56:15.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16338563058932340048', time=2024-09-14T13:46:11.885970+0000, chain.objs.size()=1 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.qzYRa_zXcIeMPjQR3UoaVMLPHmGRZ3J_0 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9403550732955870709', time=2024-09-14T13:46:11.901512+0000, chain.objs.size()=1 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.aH8aK0K0_o7Vm-7pypGJ7BuSm4nuzyI_0 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13652065358340143337', time=2024-09-14T13:46:11.906981+0000, chain.objs.size()=1 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.614+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.bd1RweynMO0tyJoc_w-DwCLtqXzLHLH_0 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.615+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.2866137975379547391', time=2024-09-14T13:46:11.915585+0000, chain.objs.size()=1 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.615+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.g1UBvP2MSdoGdq5CINA-zv8APt3c4xN_0 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.615+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16472202304190776178', time=2024-09-14T13:46:11.941796+0000, chain.objs.size()=1 2024-09-14T11:56:15.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.615+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.ul2_9_vYBZ3-o36oKyNPysB0hkuDjrI_0 2024-09-14T11:56:15.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11502435452349275339', time=2024-09-14T13:46:12.033756+0000, chain.objs.size()=1 2024-09-14T11:56:15.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.k2JM4yRzqjf5edU6iG9wB_spt8buuza_0 2024-09-14T11:56:15.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1340608032481376897', time=2024-09-14T13:46:12.121591+0000, chain.objs.size()=1 2024-09-14T11:56:15.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.EPE5YOJi28xVAHIjzud44dVBpyCuJJM_0 2024-09-14T11:56:15.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15028056359912474759', time=2024-09-14T13:46:12.131170+0000, chain.objs.size()=1 2024-09-14T11:56:15.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.vMOXBo1sAfo1tosFgHnFVg7Kytbwa-y_0 2024-09-14T11:56:15.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6272107826418377058', time=2024-09-14T13:46:12.437871+0000, chain.objs.size()=1 2024-09-14T11:56:15.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.m2jZVu6ElPL6827A3CoHVe0TG1_Iy14_0 2024-09-14T11:56:15.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6793246728548349441', time=2024-09-14T13:46:12.476553+0000, chain.objs.size()=1 2024-09-14T11:56:15.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.616+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.YTWngvIMMhvpxMrhQH2OZXTaLZaTzx5_0 2024-09-14T11:56:15.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14619502121115829613', time=2024-09-14T13:46:12.487975+0000, chain.objs.size()=1 2024-09-14T11:56:15.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.rV62MEHhL2LOGj11YPjUE4xXbT_2Xzj_0 2024-09-14T11:56:15.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1276674717033681338', time=2024-09-14T13:46:12.523324+0000, chain.objs.size()=1 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.zILuK15LOcgqnkNip6c_bAqK3LVoaeV_0 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11151765973714056152', time=2024-09-14T13:46:12.638776+0000, chain.objs.size()=1 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.8-aaM9F8HCd5urucIRxznPLUCG7fMav_0 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8729041632726630700', time=2024-09-14T13:46:12.649976+0000, chain.objs.size()=1 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.J7v04nb8-b6woM_D7WVXoeKcSF5gPTx_0 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8931032557502553870', time=2024-09-14T13:46:12.683348+0000, chain.objs.size()=1 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.39M3faOXpQCOmTOr8GNZMR-PT-1USDc_0 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15655737353025783643', time=2024-09-14T13:46:12.684692+0000, chain.objs.size()=1 2024-09-14T11:56:15.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.620+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.324__shadow_.68rSaptqlP6vUgXKeG6qGGpdddCn9AK_0 2024-09-14T11:56:15.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7178175258289873395', time=2024-09-14T13:46:20.714248+0000, chain.objs.size()=1 2024-09-14T11:56:15.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-vQVmLpRScHWZBgl96mHIx4DndRzixO_0 2024-09-14T11:56:15.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.12734865174597082851', time=2024-09-14T13:46:20.723093+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.I0S3LuZJsIduCOraF1D1WAwm-_WO-8N_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4775107742722625979', time=2024-09-14T13:46:20.740472+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Wja0JZvsjb4puIPB19Z-0V-0LrMd6Pa_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4548930241903220282', time=2024-09-14T13:46:20.769041+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2DH-pyQmMZzFjYsfP7o8KWyYloxeA1E_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9449049936726395061', time=2024-09-14T13:46:20.782571+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.8bJk6aqsgj9hIIAU67pKNMn0-ZkRo3p_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1915858809209193292', time=2024-09-14T13:46:20.805245+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.lM289EVf41bOGyRqIdKXDv1wjWJx2N1_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.591239993499103096', time=2024-09-14T13:46:20.904387+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.xvSV9XEO12Ck88ze0AnBhiGesJlSlc6_0 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18052320392189773377', time=2024-09-14T13:46:20.951532+0000, chain.objs.size()=1 2024-09-14T11:56:15.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.623+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.6vA405EqfBHlGEX2UVdym2WUBlminW9_0 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4333993688323201781', time=2024-09-14T13:46:20.968455+0000, chain.objs.size()=1 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2HHhbgXG_Ouk1DkUvwL_A4S1SY1UehJ_0 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16484625821947202272', time=2024-09-14T13:46:20.973067+0000, chain.objs.size()=1 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.2pCZ0wmNR5an4ke_E5L0EnYsvaXItKZ_0 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4600081041943744931', time=2024-09-14T13:46:20.992186+0000, chain.objs.size()=1 2024-09-14T11:56:15.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.624+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.Xr9k8mJKXRU0n_40GXHHihj_PX88L3f_0 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8694629138417958177', time=2024-09-14T13:46:21.110286+0000, chain.objs.size()=1 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.rYIMXIuwjJ2-23MBfhuxo8WLJMa5AmJ_0 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5767573887422112319', time=2024-09-14T13:46:21.128777+0000, chain.objs.size()=1 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.iKzJfNVr6_YM38OzE6arA1PDj-0rPdo_0 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10095481847226219877', time=2024-09-14T13:46:21.133134+0000, chain.objs.size()=1 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.fd5nv1Hx4RjFs_PttompAVwJt5qYpmI_0 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8778810941430655513', time=2024-09-14T13:46:21.134564+0000, chain.objs.size()=1 2024-09-14T11:56:15.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.627+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.qZ6YwdLxgdEcd-4PooNWvurO1RZJqry_0 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10975862053360098241', time=2024-09-14T13:46:21.150664+0000, chain.objs.size()=1 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UlxXK293NM1IToV42UkymNVAjcGlE6s_0 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8041453331312636020', time=2024-09-14T13:46:21.160489+0000, chain.objs.size()=1 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.faZebDM7R6ERtewEgt6UuxGgeGjBetM_0 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.671394640452065120', time=2024-09-14T13:46:21.163051+0000, chain.objs.size()=1 2024-09-14T11:56:15.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.-yq9vrcsfZ_RdQrn6Xq0O6nq9_BOtWh_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13710329006301509798', time=2024-09-14T13:46:21.171685+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.7s6z2b4XYwrYvdv6GOE0rM2jfxwDh1E_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13844571645499778022', time=2024-09-14T13:46:21.317062+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.3_pVjZAB8MPFb4ZGc18HynrDXvNza1A_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10864466027232572822', time=2024-09-14T13:46:21.346164+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.izRG95n_EtIKHfBUn88glSFgs2jINj3_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.8852515618017655465', time=2024-09-14T13:46:21.475450+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yn9pg4lqoXptqCzvH1sGdplm4T9VoAs_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14602789241789341007', time=2024-09-14T13:46:21.498489+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.mevIfybPjK_J2dyqvaBj4xMk5qiFAJw_0 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16684014858796607565', time=2024-09-14T13:46:21.520202+0000, chain.objs.size()=1 2024-09-14T11:56:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.629+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IAyon4yVjfROF7vxFIf0I6nZ10oL_f6_0 2024-09-14T11:56:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.630+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4843102514107308972', time=2024-09-14T13:46:21.538617+0000, chain.objs.size()=1 2024-09-14T11:56:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.630+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.UI5ZJWrDosFxpVGrHs-SfGi8cI_WbwW_0 2024-09-14T11:56:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.634+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 0/51055 2024-09-14T11:56:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T11:56:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10711642808236236980', time=2024-09-14T13:46:21.539253+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.VLRRh6yJECc104mrpnNMqeOgSLgzQy0_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1965828385215479879', time=2024-09-14T13:46:21.776358+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.HORjut_Pa0OJua0k_e3KlN7A17rf9o-_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9497832346564690135', time=2024-09-14T13:46:21.868366+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.IVLrdEMtqI1jFjRdofz2l0b--F78Bzi_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14007919119966769592', time=2024-09-14T13:46:21.880867+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.RCBtAxH5v_tTTSnWnZQqDvOdi0YjDpy_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.3437362547390312347', time=2024-09-14T13:46:21.914128+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.EEa_IxO_HCi0iAWY-gsY_Wrx1eipEWM_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11823805414062187658', time=2024-09-14T13:46:21.940745+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.yVr3Gw04fFYeQkHkvpwO_YE47KuKEs__0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.9340745134421126264', time=2024-09-14T13:46:21.948656+0000, chain.objs.size()=1 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.uJL-RFkFcVCzBWwG522QE1phWySo6jQ_0 2024-09-14T11:56:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11500891728091053618', time=2024-09-14T13:46:22.054220+0000, chain.objs.size()=1 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.pL_dCNGxip-Lb6cTQoLqKz-p_Bjxu5Z_0 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18085159546061476856', time=2024-09-14T13:46:22.129739+0000, chain.objs.size()=1 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.eg5hfDJ5uCZsbZE_5RKmCMTHk4fE0jf_0 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.14978863109614998996', time=2024-09-14T13:46:22.297330+0000, chain.objs.size()=1 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.OqZbYpGVV4i79Dhh2_MQeKG0v2Hp-ot_0 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1996313019590362904', time=2024-09-14T13:46:22.310546+0000, chain.objs.size()=1 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.wgS-6dk7WlRFkE6JMnjWiyRMAljDhuZ_0 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.17473926258918703332', time=2024-09-14T13:46:22.318951+0000, chain.objs.size()=1 2024-09-14T11:56:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.636+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.bVCGGr8i-9r1ysePJU2QjTFFL_4eWz5_0 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.1433892351174756805', time=2024-09-14T13:46:22.323366+0000, chain.objs.size()=1 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.AONiRcdjMBi43OybgTCmC-i2zhTpYNj_0 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11024078330538938031', time=2024-09-14T13:46:22.327258+0000, chain.objs.size()=1 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.emaCoxtfxitpP0I5u_iZ0U_tCnfHqlO_0 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.4622892609954595229', time=2024-09-14T13:46:22.335156+0000, chain.objs.size()=1 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.WegtSI_nv_V71xQtTdSo0ayCWWr10TQ_0 2024-09-14T11:56:15.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.6372414636951021997', time=2024-09-14T13:46:22.337690+0000, chain.objs.size()=1 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.325__shadow_.V0Zn3jIQ_jUUN8uBRkLzueSlCK9eJAc_0 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16179198602948290087', time=2024-09-14T13:46:32.572830+0000, chain.objs.size()=1 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.347__shadow_.Eknxap3vhQ6Eh6RPjVyZ3QP0s3q2bQs_0 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5186169499685865564', time=2024-09-14T13:47:42.116434+0000, chain.objs.size()=1 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.639+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.VGfLHBAl9lAdjcFfvzIMUdCGX9Yw0fb_0 2024-09-14T11:56:15.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16310449030980170900', time=2024-09-14T13:47:42.117424+0000, chain.objs.size()=1 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.484__shadow_.Tb_N2OPbZEY4iD4IZJitY2mNp4tkU7h_0 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5297996344469302737', time=2024-09-14T13:48:02.701539+0000, chain.objs.size()=3 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~NtwwTb1wyhmM34tymX8qbffTdGm8X_B.1 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~NtwwTb1wyhmM34tymX8qbffTdGm8X_B.2 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.522__multipart_mymultipart.2~NtwwTb1wyhmM34tymX8qbffTdGm8X_B.3 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13524997481648294175', time=2024-09-14T13:48:13.206007+0000, chain.objs.size()=1 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.524__multipart_mymultipart.2~Io5nw1jqzfuZYf3fBRFQ9VL6azGlv1m.1 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15349099064031320796', time=2024-09-14T13:48:14.914349+0000, chain.objs.size()=1 2024-09-14T11:56:15.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.641+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~d-WHZ_AVyJsOW7JzFYgcTkDRIjqnU4S.1 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.15090923591710220304', time=2024-09-14T13:48:15.249970+0000, chain.objs.size()=2 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~opz2x8JOKN4v-PkqwQKLlQD66qyCJ0W.1 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.526__multipart_mymultipart.2~opz2x8JOKN4v-PkqwQKLlQD66qyCJ0W.2 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10443783573466827224', time=2024-09-14T13:48:18.576888+0000, chain.objs.size()=1 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.529__shadow_.EnvzZpQjMJy-tNLJuokm3VpsSkEMGET_0 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.16642573565439822744', time=2024-09-14T13:49:15.271860+0000, chain.objs.size()=1 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.570__shadow:nJop9sZJPhESsJzDrF2TAJ2EjhsvE.8_.m2sNPVkNxotjvyT8xBu5PX-tyS8lmNz_0 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.18337876048608210245', time=2024-09-14T13:49:22.584893+0000, chain.objs.size()=1 2024-09-14T11:56:15.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.575__shadow:t9Gv5aXkzkqG9wDkjVA8hz.ATLybkk5_.IhL-8q570ScEkOYA-ZrpAe9ze9rMaUF_0 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.13764071046961306350', time=2024-09-14T13:49:30.722292+0000, chain.objs.size()=1 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.578__shadow:ILErsdfdlCuI89TXVQwSNdGp9XFlePD_.6lnNB6zqF_8aCeTd23AN4vMCXK3IlOq_0 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.5890474490092152472', time=2024-09-14T13:49:44.368335+0000, chain.objs.size()=1 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.644+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.580__shadow:cQsRJ4gpeumelgFJl9l4m.QiSa3M.Lf_.SM-zoZZLyVmztWBjoz5-kzNDa7e6tmi_0 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.10250392681478041003', time=2024-09-14T13:52:24.348508+0000, chain.objs.size()=1 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.646__shadow_.uNooH0GMYttNwC6y9L8x8lsBWK80VoW_0 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.11401911430735794456', time=2024-09-14T13:52:28.944559+0000, chain.objs.size()=1 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.654__shadow_.0qTjTXF1-P-VC-0Hn3KWeHwC42OWpaN_0 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.214117022309593770', time=2024-09-14T13:52:52.438462+0000, chain.objs.size()=1 2024-09-14T11:56:15.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.705__shadow:pzv5CzY2s27rekxUMsvkh5VgVHAmxlv_.RxpALypdeFV08JlRk5g_nBgOJT8i2BQ_0 2024-09-14T11:56:15.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 20 garbage collection: RGWGC::process iterating over entry tag='3aea5d71-db92-43f3-82b7-23225f4a0092.4614.7911345809464410390', time=2024-09-14T13:53:30.004914+0000, chain.objs.size()=1 2024-09-14T11:56:15.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.645+0000 7f175db25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3aea5d71-db92-43f3-82b7-23225f4a0092.4614.741__shadow_.e0qqjJLGMyaY8BXuOUqW0A--_L4FsSu_0 2024-09-14T11:56:15.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.651+0000 7f175db25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:56:15.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.654+0000 7f160ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:56:15.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.656+0000 7f175db25800 20 remove_watcher() i=0 2024-09-14T11:56:15.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.656+0000 7f175db25800 2 removed watcher, disabling cache 2024-09-14T11:56:15.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.658+0000 7f175db25800 20 remove_watcher() i=1 2024-09-14T11:56:15.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.659+0000 7f175db25800 20 remove_watcher() i=2 2024-09-14T11:56:15.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.660+0000 7f175db25800 20 remove_watcher() i=3 2024-09-14T11:56:15.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.660+0000 7f175db25800 20 remove_watcher() i=4 2024-09-14T11:56:15.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.661+0000 7f175db25800 20 remove_watcher() i=5 2024-09-14T11:56:15.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.662+0000 7f175db25800 20 remove_watcher() i=6 2024-09-14T11:56:15.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-14T11:56:15.663+0000 7f175db25800 20 remove_watcher() i=7 2024-09-14T11:56:15.673 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:56:15.682 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T11:56:15.741 DEBUG:teuthology.orchestra.run.smithi094:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:56:15.810 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T11:56:15.879 DEBUG:teuthology.orchestra.run.smithi094:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:56:15.947 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:56:16.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-ca-trust 2024-09-14T11:56:17.306 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:56:17.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:56:17.318 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:56:17.645 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:17.663 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:56:17.667 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1532,"stamp":"2024-09-14T11:56:15.914085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":379540072,"num_objects":2623,"num_object_clones":0,"num_object_copies":7392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2623,"num_whiteouts":0,"num_read":308215,"num_read_kb":2856381,"num_write":161703,"num_write_kb":2485815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12754,"ondisk_log_size":12754,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2372424,"kb_used_data":791068,"kb_used_omap":12,"kb_used_meta":1580531,"kb_avail":752602296,"statfs":{"total":773094113280,"available":770664751104,"internally_reserved":0,"allocated":810053632,"data_stored":794196462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1618464304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-353330352,"num_objects":-2210,"num_object_clones":0,"num_object_copies":-6611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2210,"num_whiteouts":0,"num_read":2485,"num_read_kb":2196,"num_write":2359,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004760"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:16.017765+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:51:16.017765+0000","last_peered":"2024-09-14T11:51:16.017765+0000","last_clean":"2024-09-14T11:51:16.017765+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:51:16.017765+0000","last_undegraded":"2024-09-14T11:51:16.017765+0000","last_fullsized":"2024-09-14T11:51:16.017765+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.036465+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:53:21.036465+0000","last_peered":"2024-09-14T11:53:21.036465+0000","last_clean":"2024-09-14T11:53:21.036465+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:53:21.036465+0000","last_undegraded":"2024-09-14T11:53:21.036465+0000","last_fullsized":"2024-09-14T11:53:21.036465+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.763337+0000","last_change":"2024-09-14T11:41:15.877777+0000","last_active":"2024-09-14T11:51:19.763337+0000","last_peered":"2024-09-14T11:51:19.763337+0000","last_clean":"2024-09-14T11:51:19.763337+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:51:19.763337+0000","last_undegraded":"2024-09-14T11:51:19.763337+0000","last_fullsized":"2024-09-14T11:51:19.763337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.018964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.917468+0000","last_change":"2024-09-14T11:30:44.720933+0000","last_active":"2024-09-14T11:55:44.917468+0000","last_peered":"2024-09-14T11:55:44.917468+0000","last_clean":"2024-09-14T11:55:44.917468+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:55:44.917468+0000","last_undegraded":"2024-09-14T11:55:44.917468+0000","last_fullsized":"2024-09-14T11:55:44.917468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:46.706797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777983+0000","last_change":"2024-09-14T11:29:10.325552+0000","last_active":"2024-09-14T11:53:14.777983+0000","last_peered":"2024-09-14T11:53:14.777983+0000","last_clean":"2024-09-14T11:53:14.777983+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:53:14.777983+0000","last_undegraded":"2024-09-14T11:53:14.777983+0000","last_fullsized":"2024-09-14T11:53:14.777983+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:26.043474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.787081+0000","last_change":"2024-09-14T11:41:15.870239+0000","last_active":"2024-09-14T11:53:20.787081+0000","last_peered":"2024-09-14T11:53:20.787081+0000","last_clean":"2024-09-14T11:53:20.787081+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:53:20.787081+0000","last_undegraded":"2024-09-14T11:53:20.787081+0000","last_fullsized":"2024-09-14T11:53:20.787081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:07.125369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902783+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:53:44.902783+0000","last_peered":"2024-09-14T11:53:44.902783+0000","last_clean":"2024-09-14T11:53:44.902783+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:53:44.902783+0000","last_undegraded":"2024-09-14T11:53:44.902783+0000","last_fullsized":"2024-09-14T11:53:44.902783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.774451+0000","last_change":"2024-09-14T11:30:44.718407+0000","last_active":"2024-09-14T11:52:49.774451+0000","last_peered":"2024-09-14T11:52:49.774451+0000","last_clean":"2024-09-14T11:52:49.774451+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:52:49.774451+0000","last_undegraded":"2024-09-14T11:52:49.774451+0000","last_fullsized":"2024-09-14T11:52:49.774451+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:51.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.075756+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:53:31.075756+0000","last_peered":"2024-09-14T11:53:31.075756+0000","last_clean":"2024-09-14T11:53:31.075756+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:53:31.075756+0000","last_undegraded":"2024-09-14T11:53:31.075756+0000","last_fullsized":"2024-09-14T11:53:31.075756+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:51.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896093+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:52:54.896093+0000","last_peered":"2024-09-14T11:52:54.896093+0000","last_clean":"2024-09-14T11:52:54.896093+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:52:54.896093+0000","last_undegraded":"2024-09-14T11:52:54.896093+0000","last_fullsized":"2024-09-14T11:52:54.896093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:47.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.884913+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:51:39.884913+0000","last_peered":"2024-09-14T11:51:39.884913+0000","last_clean":"2024-09-14T11:51:39.884913+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:51:39.884913+0000","last_undegraded":"2024-09-14T11:51:39.884913+0000","last_fullsized":"2024-09-14T11:51:39.884913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:06.934022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.328043+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:52:32.328043+0000","last_peered":"2024-09-14T11:52:32.328043+0000","last_clean":"2024-09-14T11:52:32.328043+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:52:32.328043+0000","last_undegraded":"2024-09-14T11:52:32.328043+0000","last_fullsized":"2024-09-14T11:52:32.328043+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.704261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.780910+0000","last_change":"2024-09-14T11:30:47.742222+0000","last_active":"2024-09-14T11:52:35.780910+0000","last_peered":"2024-09-14T11:52:35.780910+0000","last_clean":"2024-09-14T11:52:35.780910+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:52:35.780910+0000","last_undegraded":"2024-09-14T11:52:35.780910+0000","last_fullsized":"2024-09-14T11:52:35.780910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:53.632539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.773815+0000","last_change":"2024-09-14T11:29:10.322697+0000","last_active":"2024-09-14T11:51:40.773815+0000","last_peered":"2024-09-14T11:51:40.773815+0000","last_clean":"2024-09-14T11:51:40.773815+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:51:40.773815+0000","last_undegraded":"2024-09-14T11:51:40.773815+0000","last_fullsized":"2024-09-14T11:51:40.773815+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.258272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771084+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:51:19.771084+0000","last_peered":"2024-09-14T11:51:19.771084+0000","last_clean":"2024-09-14T11:51:19.771084+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:51:19.771084+0000","last_undegraded":"2024-09-14T11:51:19.771084+0000","last_fullsized":"2024-09-14T11:51:19.771084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.063452+0000","last_change":"2024-09-14T11:30:47.735777+0000","last_active":"2024-09-14T11:56:14.063452+0000","last_peered":"2024-09-14T11:56:14.063452+0000","last_clean":"2024-09-14T11:56:14.063452+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:14.063452+0000","last_undegraded":"2024-09-14T11:56:14.063452+0000","last_fullsized":"2024-09-14T11:56:14.063452+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:09.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771151+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:51:19.771151+0000","last_peered":"2024-09-14T11:51:19.771151+0000","last_clean":"2024-09-14T11:51:19.771151+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:51:19.771151+0000","last_undegraded":"2024-09-14T11:51:19.771151+0000","last_fullsized":"2024-09-14T11:51:19.771151+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918751+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:55:49.918751+0000","last_peered":"2024-09-14T11:55:49.918751+0000","last_clean":"2024-09-14T11:55:49.918751+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:55:49.918751+0000","last_undegraded":"2024-09-14T11:55:49.918751+0000","last_fullsized":"2024-09-14T11:55:49.918751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17456,"num_write":12,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899090+0000","last_change":"2024-09-14T11:29:10.322726+0000","last_active":"2024-09-14T11:53:19.899090+0000","last_peered":"2024-09-14T11:53:19.899090+0000","last_clean":"2024-09-14T11:53:19.899090+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:53:19.899090+0000","last_undegraded":"2024-09-14T11:53:19.899090+0000","last_fullsized":"2024-09-14T11:53:19.899090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:47.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892752+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:52:34.892752+0000","last_peered":"2024-09-14T11:52:34.892752+0000","last_clean":"2024-09-14T11:52:34.892752+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:52:34.892752+0000","last_undegraded":"2024-09-14T11:52:34.892752+0000","last_fullsized":"2024-09-14T11:52:34.892752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022348+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:51:46.022348+0000","last_peered":"2024-09-14T11:51:46.022348+0000","last_clean":"2024-09-14T11:51:46.022348+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:51:46.022348+0000","last_undegraded":"2024-09-14T11:51:46.022348+0000","last_fullsized":"2024-09-14T11:51:46.022348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:09.499277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.775890+0000","last_change":"2024-09-14T11:41:15.871132+0000","last_active":"2024-09-14T11:52:59.775890+0000","last_peered":"2024-09-14T11:52:59.775890+0000","last_clean":"2024-09-14T11:52:59.775890+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:52:59.775890+0000","last_undegraded":"2024-09-14T11:52:59.775890+0000","last_fullsized":"2024-09-14T11:52:59.775890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:52.619076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.887227+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:51:54.887227+0000","last_peered":"2024-09-14T11:51:54.887227+0000","last_clean":"2024-09-14T11:51:54.887227+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:51:54.887227+0000","last_undegraded":"2024-09-14T11:51:54.887227+0000","last_fullsized":"2024-09-14T11:51:54.887227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.766752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.772338+0000","last_change":"2024-09-14T11:30:44.715477+0000","last_active":"2024-09-14T11:52:29.772338+0000","last_peered":"2024-09-14T11:52:29.772338+0000","last_clean":"2024-09-14T11:52:29.772338+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:52:29.772338+0000","last_undegraded":"2024-09-14T11:52:29.772338+0000","last_fullsized":"2024-09-14T11:52:29.772338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:47.193927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.905463+0000","last_change":"2024-09-14T11:29:10.321195+0000","last_active":"2024-09-14T11:53:26.905463+0000","last_peered":"2024-09-14T11:53:26.905463+0000","last_clean":"2024-09-14T11:53:26.905463+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:53:26.905463+0000","last_undegraded":"2024-09-14T11:53:26.905463+0000","last_fullsized":"2024-09-14T11:53:26.905463+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:38.747021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893830+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:52:29.893830+0000","last_peered":"2024-09-14T11:52:29.893830+0000","last_clean":"2024-09-14T11:52:29.893830+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:52:29.893830+0000","last_undegraded":"2024-09-14T11:52:29.893830+0000","last_fullsized":"2024-09-14T11:52:29.893830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887752+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:51:49.887752+0000","last_peered":"2024-09-14T11:51:49.887752+0000","last_clean":"2024-09-14T11:51:49.887752+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:51:49.887752+0000","last_undegraded":"2024-09-14T11:51:49.887752+0000","last_fullsized":"2024-09-14T11:51:49.887752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:48.649434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.795879+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.795879+0000","last_peered":"2024-09-14T11:56:13.795879+0000","last_clean":"2024-09-14T11:56:13.795879+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.795879+0000","last_undegraded":"2024-09-14T11:56:13.795879+0000","last_fullsized":"2024-09-14T11:56:13.795879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:13.281310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887721+0000","last_change":"2024-09-14T11:30:47.735047+0000","last_active":"2024-09-14T11:51:49.887721+0000","last_peered":"2024-09-14T11:51:49.887721+0000","last_clean":"2024-09-14T11:51:49.887721+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:51:49.887721+0000","last_undegraded":"2024-09-14T11:51:49.887721+0000","last_fullsized":"2024-09-14T11:51:49.887721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:04.517023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.904880+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:54:04.904880+0000","last_peered":"2024-09-14T11:54:04.904880+0000","last_clean":"2024-09-14T11:54:04.904880+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:54:04.904880+0000","last_undegraded":"2024-09-14T11:54:04.904880+0000","last_fullsized":"2024-09-14T11:54:04.904880+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:06.177114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.886468+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:51:49.886468+0000","last_peered":"2024-09-14T11:51:49.886468+0000","last_clean":"2024-09-14T11:51:49.886468+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:51:49.886468+0000","last_undegraded":"2024-09-14T11:51:49.886468+0000","last_fullsized":"2024-09-14T11:51:49.886468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:39.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.774516+0000","last_change":"2024-09-14T11:30:44.718710+0000","last_active":"2024-09-14T11:51:45.774516+0000","last_peered":"2024-09-14T11:51:45.774516+0000","last_clean":"2024-09-14T11:51:45.774516+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:51:45.774516+0000","last_undegraded":"2024-09-14T11:51:45.774516+0000","last_fullsized":"2024-09-14T11:51:45.774516+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:50.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.288212+0000","last_change":"2024-09-14T11:29:10.311886+0000","last_active":"2024-09-14T11:53:31.288212+0000","last_peered":"2024-09-14T11:53:31.288212+0000","last_clean":"2024-09-14T11:53:31.288212+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:53:31.288212+0000","last_undegraded":"2024-09-14T11:53:31.288212+0000","last_fullsized":"2024-09-14T11:53:31.288212+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:59.142362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794592+0000","last_change":"2024-09-14T11:30:47.739387+0000","last_active":"2024-09-14T11:54:10.794592+0000","last_peered":"2024-09-14T11:54:10.794592+0000","last_clean":"2024-09-14T11:54:10.794592+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:54:10.794592+0000","last_undegraded":"2024-09-14T11:54:10.794592+0000","last_fullsized":"2024-09-14T11:54:10.794592+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022300+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:51:46.022300+0000","last_peered":"2024-09-14T11:51:46.022300+0000","last_clean":"2024-09-14T11:51:46.022300+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:51:46.022300+0000","last_undegraded":"2024-09-14T11:51:46.022300+0000","last_fullsized":"2024-09-14T11:51:46.022300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:44.955288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.770544+0000","last_change":"2024-09-14T11:41:15.868312+0000","last_active":"2024-09-14T11:52:14.770544+0000","last_peered":"2024-09-14T11:52:14.770544+0000","last_clean":"2024-09-14T11:52:14.770544+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:52:14.770544+0000","last_undegraded":"2024-09-14T11:52:14.770544+0000","last_fullsized":"2024-09-14T11:52:14.770544+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:13.069995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777960+0000","last_change":"2024-09-14T11:30:44.719858+0000","last_active":"2024-09-14T11:53:14.777960+0000","last_peered":"2024-09-14T11:53:14.777960+0000","last_clean":"2024-09-14T11:53:14.777960+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:53:14.777960+0000","last_undegraded":"2024-09-14T11:53:14.777960+0000","last_fullsized":"2024-09-14T11:53:14.777960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.415891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.041236+0000","last_change":"2024-09-14T11:29:10.324751+0000","last_active":"2024-09-14T11:53:56.041236+0000","last_peered":"2024-09-14T11:53:56.041236+0000","last_clean":"2024-09-14T11:53:56.041236+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:53:56.041236+0000","last_undegraded":"2024-09-14T11:53:56.041236+0000","last_fullsized":"2024-09-14T11:53:56.041236+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:56.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.777049+0000","last_change":"2024-09-14T11:41:15.865744+0000","last_active":"2024-09-14T11:52:05.777049+0000","last_peered":"2024-09-14T11:52:05.777049+0000","last_clean":"2024-09-14T11:52:05.777049+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:52:05.777049+0000","last_undegraded":"2024-09-14T11:52:05.777049+0000","last_fullsized":"2024-09-14T11:52:05.777049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:25.011776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792258+0000","last_change":"2024-09-14T11:29:10.325256+0000","last_active":"2024-09-14T11:53:55.792258+0000","last_peered":"2024-09-14T11:53:55.792258+0000","last_clean":"2024-09-14T11:53:55.792258+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:53:55.792258+0000","last_undegraded":"2024-09-14T11:53:55.792258+0000","last_fullsized":"2024-09-14T11:53:55.792258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.015196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.778952+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:52:09.778952+0000","last_peered":"2024-09-14T11:52:09.778952+0000","last_clean":"2024-09-14T11:52:09.778952+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:52:09.778952+0000","last_undegraded":"2024-09-14T11:52:09.778952+0000","last_fullsized":"2024-09-14T11:52:09.778952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:30.781685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898417+0000","last_change":"2024-09-14T11:30:44.717178+0000","last_active":"2024-09-14T11:53:14.898417+0000","last_peered":"2024-09-14T11:53:14.898417+0000","last_clean":"2024-09-14T11:53:14.898417+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:53:14.898417+0000","last_undegraded":"2024-09-14T11:53:14.898417+0000","last_fullsized":"2024-09-14T11:53:14.898417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.604554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.782090+0000","last_change":"2024-09-14T11:29:10.320629+0000","last_active":"2024-09-14T11:53:54.782090+0000","last_peered":"2024-09-14T11:53:54.782090+0000","last_clean":"2024-09-14T11:53:54.782090+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:53:54.782090+0000","last_undegraded":"2024-09-14T11:53:54.782090+0000","last_fullsized":"2024-09-14T11:53:54.782090+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:20.168734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892148+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:52:29.892148+0000","last_peered":"2024-09-14T11:52:29.892148+0000","last_clean":"2024-09-14T11:52:29.892148+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:52:29.892148+0000","last_undegraded":"2024-09-14T11:52:29.892148+0000","last_fullsized":"2024-09-14T11:52:29.892148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:38.823344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912541+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:14.912541+0000","last_peered":"2024-09-14T11:56:14.912541+0000","last_clean":"2024-09-14T11:56:14.912541+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:14.912541+0000","last_undegraded":"2024-09-14T11:56:14.912541+0000","last_fullsized":"2024-09-14T11:56:14.912541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.014650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893118+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:52:24.893118+0000","last_peered":"2024-09-14T11:52:24.893118+0000","last_clean":"2024-09-14T11:52:24.893118+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:52:24.893118+0000","last_undegraded":"2024-09-14T11:52:24.893118+0000","last_fullsized":"2024-09-14T11:52:24.893118+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:57.259600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785620+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:52:29.785620+0000","last_peered":"2024-09-14T11:52:29.785620+0000","last_clean":"2024-09-14T11:52:29.785620+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:52:29.785620+0000","last_undegraded":"2024-09-14T11:52:29.785620+0000","last_fullsized":"2024-09-14T11:52:29.785620+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:58.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891569+0000","last_change":"2024-09-14T11:30:44.713694+0000","last_active":"2024-09-14T11:52:24.891569+0000","last_peered":"2024-09-14T11:52:24.891569+0000","last_clean":"2024-09-14T11:52:24.891569+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:52:24.891569+0000","last_undegraded":"2024-09-14T11:52:24.891569+0000","last_fullsized":"2024-09-14T11:52:24.891569+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:40.066993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.790581+0000","last_change":"2024-09-14T11:29:10.321325+0000","last_active":"2024-09-14T11:53:04.790581+0000","last_peered":"2024-09-14T11:53:04.790581+0000","last_clean":"2024-09-14T11:53:04.790581+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:53:04.790581+0000","last_undegraded":"2024-09-14T11:53:04.790581+0000","last_fullsized":"2024-09-14T11:53:04.790581+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:02.452550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.915942+0000","last_change":"2024-09-14T11:30:47.737000+0000","last_active":"2024-09-14T11:55:34.915942+0000","last_peered":"2024-09-14T11:55:34.915942+0000","last_clean":"2024-09-14T11:55:34.915942+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:55:34.915942+0000","last_undegraded":"2024-09-14T11:55:34.915942+0000","last_fullsized":"2024-09-14T11:55:34.915942+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:03.413738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893146+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:52:24.893146+0000","last_peered":"2024-09-14T11:52:24.893146+0000","last_clean":"2024-09-14T11:52:24.893146+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:52:24.893146+0000","last_undegraded":"2024-09-14T11:52:24.893146+0000","last_fullsized":"2024-09-14T11:52:24.893146+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:33.383073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786619+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:52:34.786619+0000","last_peered":"2024-09-14T11:52:34.786619+0000","last_clean":"2024-09-14T11:52:34.786619+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:52:34.786619+0000","last_undegraded":"2024-09-14T11:52:34.786619+0000","last_fullsized":"2024-09-14T11:52:34.786619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:02.318969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784088+0000","last_change":"2024-09-14T11:29:10.322148+0000","last_active":"2024-09-14T11:53:00.784088+0000","last_peered":"2024-09-14T11:53:00.784088+0000","last_clean":"2024-09-14T11:53:00.784088+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:53:00.784088+0000","last_undegraded":"2024-09-14T11:53:00.784088+0000","last_fullsized":"2024-09-14T11:53:00.784088+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.995810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795341+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:53:39.795341+0000","last_peered":"2024-09-14T11:53:39.795341+0000","last_clean":"2024-09-14T11:53:39.795341+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:53:39.795341+0000","last_undegraded":"2024-09-14T11:53:39.795341+0000","last_fullsized":"2024-09-14T11:53:39.795341+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.795943+0000","last_change":"2024-09-14T11:30:44.720970+0000","last_active":"2024-09-14T11:55:49.795943+0000","last_peered":"2024-09-14T11:55:49.795943+0000","last_clean":"2024-09-14T11:55:49.795943+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:55:49.795943+0000","last_undegraded":"2024-09-14T11:55:49.795943+0000","last_fullsized":"2024-09-14T11:55:49.795943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:44.416082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784182+0000","last_change":"2024-09-14T11:29:10.322645+0000","last_active":"2024-09-14T11:53:00.784182+0000","last_peered":"2024-09-14T11:53:00.784182+0000","last_clean":"2024-09-14T11:53:00.784182+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:53:00.784182+0000","last_undegraded":"2024-09-14T11:53:00.784182+0000","last_fullsized":"2024-09-14T11:53:00.784182+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:51.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785838+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:52:29.785838+0000","last_peered":"2024-09-14T11:52:29.785838+0000","last_clean":"2024-09-14T11:52:29.785838+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:52:29.785838+0000","last_undegraded":"2024-09-14T11:52:29.785838+0000","last_fullsized":"2024-09-14T11:52:29.785838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:07.281823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:26.027889+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:52:26.027889+0000","last_peered":"2024-09-14T11:52:26.027889+0000","last_clean":"2024-09-14T11:52:26.027889+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:52:26.027889+0000","last_undegraded":"2024-09-14T11:52:26.027889+0000","last_fullsized":"2024-09-14T11:52:26.027889+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:34.901574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3201,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":4102,"num_write":11,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.402107+0000","last_change":"2024-09-14T11:29:10.323320+0000","last_active":"2024-09-14T11:52:33.402107+0000","last_peered":"2024-09-14T11:52:33.402107+0000","last_clean":"2024-09-14T11:52:33.402107+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:52:33.402107+0000","last_undegraded":"2024-09-14T11:52:33.402107+0000","last_fullsized":"2024-09-14T11:52:33.402107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:18.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.799375+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:54:40.799375+0000","last_peered":"2024-09-14T11:54:40.799375+0000","last_clean":"2024-09-14T11:54:40.799375+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:54:40.799375+0000","last_undegraded":"2024-09-14T11:54:40.799375+0000","last_fullsized":"2024-09-14T11:54:40.799375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.613026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.784752+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:52:24.784752+0000","last_peered":"2024-09-14T11:52:24.784752+0000","last_clean":"2024-09-14T11:52:24.784752+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:52:24.784752+0000","last_undegraded":"2024-09-14T11:52:24.784752+0000","last_fullsized":"2024-09-14T11:52:24.784752+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:46.872224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905103+0000","last_change":"2024-09-14T11:29:10.321492+0000","last_active":"2024-09-14T11:54:09.905103+0000","last_peered":"2024-09-14T11:54:09.905103+0000","last_clean":"2024-09-14T11:54:09.905103+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:54:09.905103+0000","last_undegraded":"2024-09-14T11:54:09.905103+0000","last_fullsized":"2024-09-14T11:54:09.905103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:01.698920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.770106+0000","last_change":"2024-09-14T11:41:15.869275+0000","last_active":"2024-09-14T11:52:09.770106+0000","last_peered":"2024-09-14T11:52:09.770106+0000","last_clean":"2024-09-14T11:52:09.770106+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:52:09.770106+0000","last_undegraded":"2024-09-14T11:52:09.770106+0000","last_fullsized":"2024-09-14T11:52:09.770106+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:58.504841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902212+0000","last_change":"2024-09-14T11:30:47.734644+0000","last_active":"2024-09-14T11:53:44.902212+0000","last_peered":"2024-09-14T11:53:44.902212+0000","last_clean":"2024-09-14T11:53:44.902212+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:53:44.902212+0000","last_undegraded":"2024-09-14T11:53:44.902212+0000","last_fullsized":"2024-09-14T11:53:44.902212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:00.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.788562+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:52:49.788562+0000","last_peered":"2024-09-14T11:52:49.788562+0000","last_clean":"2024-09-14T11:52:49.788562+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:52:49.788562+0000","last_undegraded":"2024-09-14T11:52:49.788562+0000","last_fullsized":"2024-09-14T11:52:49.788562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:27.988666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.025271+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:52:06.025271+0000","last_peered":"2024-09-14T11:52:06.025271+0000","last_clean":"2024-09-14T11:52:06.025271+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:52:06.025271+0000","last_undegraded":"2024-09-14T11:52:06.025271+0000","last_fullsized":"2024-09-14T11:52:06.025271+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.891635+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:52:09.891635+0000","last_peered":"2024-09-14T11:52:09.891635+0000","last_clean":"2024-09-14T11:52:09.891635+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:52:09.891635+0000","last_undegraded":"2024-09-14T11:52:09.891635+0000","last_fullsized":"2024-09-14T11:52:09.891635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:47.380694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032130+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:52:51.032130+0000","last_peered":"2024-09-14T11:52:51.032130+0000","last_clean":"2024-09-14T11:52:51.032130+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:52:51.032130+0000","last_undegraded":"2024-09-14T11:52:51.032130+0000","last_fullsized":"2024-09-14T11:52:51.032130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.117139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794642+0000","last_change":"2024-09-14T11:29:10.319801+0000","last_active":"2024-09-14T11:54:10.794642+0000","last_peered":"2024-09-14T11:54:10.794642+0000","last_clean":"2024-09-14T11:54:10.794642+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:54:10.794642+0000","last_undegraded":"2024-09-14T11:54:10.794642+0000","last_fullsized":"2024-09-14T11:54:10.794642+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:43.613741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790704+0000","last_change":"2024-09-14T11:30:47.742418+0000","last_active":"2024-09-14T11:53:45.790704+0000","last_peered":"2024-09-14T11:53:45.790704+0000","last_clean":"2024-09-14T11:53:45.790704+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:53:45.790704+0000","last_undegraded":"2024-09-14T11:53:45.790704+0000","last_fullsized":"2024-09-14T11:53:45.790704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:46.735010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.901661+0000","last_change":"2024-09-14T11:30:44.713119+0000","last_active":"2024-09-14T11:53:39.901661+0000","last_peered":"2024-09-14T11:53:39.901661+0000","last_clean":"2024-09-14T11:53:39.901661+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:53:39.901661+0000","last_undegraded":"2024-09-14T11:53:39.901661+0000","last_fullsized":"2024-09-14T11:53:39.901661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:45.277861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794558+0000","last_change":"2024-09-14T11:29:10.321339+0000","last_active":"2024-09-14T11:54:10.794558+0000","last_peered":"2024-09-14T11:54:10.794558+0000","last_clean":"2024-09-14T11:54:10.794558+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:54:10.794558+0000","last_undegraded":"2024-09-14T11:54:10.794558+0000","last_fullsized":"2024-09-14T11:54:10.794558+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:57.698726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790015+0000","last_change":"2024-09-14T11:30:44.721204+0000","last_active":"2024-09-14T11:53:40.790015+0000","last_peered":"2024-09-14T11:53:40.790015+0000","last_clean":"2024-09-14T11:53:40.790015+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:53:40.790015+0000","last_undegraded":"2024-09-14T11:53:40.790015+0000","last_fullsized":"2024-09-14T11:53:40.790015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.676688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792100+0000","last_change":"2024-09-14T11:29:10.324357+0000","last_active":"2024-09-14T11:53:14.792100+0000","last_peered":"2024-09-14T11:53:14.792100+0000","last_clean":"2024-09-14T11:53:14.792100+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:53:14.792100+0000","last_undegraded":"2024-09-14T11:53:14.792100+0000","last_fullsized":"2024-09-14T11:53:14.792100+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:35.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'303","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.793622+0000","last_change":"2024-09-14T11:14:04.132821+0000","last_active":"2024-09-14T11:56:14.793622+0000","last_peered":"2024-09-14T11:56:14.793622+0000","last_clean":"2024-09-14T11:56:14.793622+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:14.793622+0000","last_undegraded":"2024-09-14T11:56:14.793622+0000","last_fullsized":"2024-09-14T11:56:14.793622+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:20.604907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901394,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":578,"num_read_kb":2359,"num_write":1120,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1592","reported_seq":3377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461746+0000","last_change":"2024-09-14T11:14:06.121950+0000","last_active":"2024-09-14T11:54:24.461746+0000","last_peered":"2024-09-14T11:54:24.461746+0000","last_clean":"2024-09-14T11:54:24.461746+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:54:24.461746+0000","last_undegraded":"2024-09-14T11:54:24.461746+0000","last_fullsized":"2024-09-14T11:54:24.461746+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.554941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'322","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874917+0000","last_change":"2024-09-14T11:14:04.126728+0000","last_active":"2024-09-14T11:56:14.874917+0000","last_peered":"2024-09-14T11:56:14.874917+0000","last_clean":"2024-09-14T11:56:14.874917+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:14.874917+0000","last_undegraded":"2024-09-14T11:56:14.874917+0000","last_fullsized":"2024-09-14T11:56:14.874917+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:41.626044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":621,"num_read_kb":6703,"num_write":1161,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'561","reported_seq":2237,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622076+0000","last_change":"2024-09-14T11:14:06.123174+0000","last_active":"2024-09-14T11:55:41.622076+0000","last_peered":"2024-09-14T11:55:41.622076+0000","last_clean":"2024-09-14T11:55:41.622076+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:55:41.622076+0000","last_undegraded":"2024-09-14T11:55:41.622076+0000","last_fullsized":"2024-09-14T11:55:41.622076+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:37.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'322","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.836719+0000","last_change":"2024-09-14T11:14:04.122664+0000","last_active":"2024-09-14T11:56:14.836719+0000","last_peered":"2024-09-14T11:56:14.836719+0000","last_clean":"2024-09-14T11:56:14.836719+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:14.836719+0000","last_undegraded":"2024-09-14T11:56:14.836719+0000","last_fullsized":"2024-09-14T11:56:14.836719+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":604,"num_read_kb":11794,"num_write":1115,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'475","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.537995+0000","last_change":"2024-09-14T11:14:06.124737+0000","last_active":"2024-09-14T11:54:26.537995+0000","last_peered":"2024-09-14T11:54:26.537995+0000","last_clean":"2024-09-14T11:54:26.537995+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:54:26.537995+0000","last_undegraded":"2024-09-14T11:54:26.537995+0000","last_fullsized":"2024-09-14T11:54:26.537995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:38.559640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'256","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.042785+0000","last_change":"2024-09-14T11:14:04.128237+0000","last_active":"2024-09-14T11:54:06.042785+0000","last_peered":"2024-09-14T11:54:06.042785+0000","last_clean":"2024-09-14T11:54:06.042785+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:54:06.042785+0000","last_undegraded":"2024-09-14T11:54:06.042785+0000","last_fullsized":"2024-09-14T11:54:06.042785+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:22.273382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10601423,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":430,"num_read_kb":13079,"num_write":914,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1060","reported_seq":2767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540504+0000","last_change":"2024-09-14T11:14:06.134846+0000","last_active":"2024-09-14T11:54:04.540504+0000","last_peered":"2024-09-14T11:54:04.540504+0000","last_clean":"2024-09-14T11:54:04.540504+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:54:04.540504+0000","last_undegraded":"2024-09-14T11:54:04.540504+0000","last_fullsized":"2024-09-14T11:54:04.540504+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:16.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'326","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.792537+0000","last_change":"2024-09-14T11:14:04.121928+0000","last_active":"2024-09-14T11:56:14.792537+0000","last_peered":"2024-09-14T11:56:14.792537+0000","last_clean":"2024-09-14T11:56:14.792537+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:14.792537+0000","last_undegraded":"2024-09-14T11:56:14.792537+0000","last_fullsized":"2024-09-14T11:56:14.792537+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:49.409365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2001957,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":601,"num_read_kb":64951,"num_write":1148,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'462","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.795372+0000","last_change":"2024-09-14T11:14:06.131212+0000","last_active":"2024-09-14T11:54:15.795372+0000","last_peered":"2024-09-14T11:54:15.795372+0000","last_clean":"2024-09-14T11:54:15.795372+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:54:15.795372+0000","last_undegraded":"2024-09-14T11:54:15.795372+0000","last_fullsized":"2024-09-14T11:54:15.795372+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:20.091159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'297","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.777423+0000","last_change":"2024-09-14T11:14:04.134464+0000","last_active":"2024-09-14T11:53:43.777423+0000","last_peered":"2024-09-14T11:53:43.777423+0000","last_clean":"2024-09-14T11:53:43.777423+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:53:43.777423+0000","last_undegraded":"2024-09-14T11:53:43.777423+0000","last_fullsized":"2024-09-14T11:53:43.777423+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:30.803104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12181485,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":979,"num_read_kb":31256,"num_write":1068,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'797","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.547089+0000","last_change":"2024-09-14T11:14:06.123280+0000","last_active":"2024-09-14T11:54:08.547089+0000","last_peered":"2024-09-14T11:54:08.547089+0000","last_clean":"2024-09-14T11:54:08.547089+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:54:08.547089+0000","last_undegraded":"2024-09-14T11:54:08.547089+0000","last_fullsized":"2024-09-14T11:54:08.547089+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:47.903630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.798085+0000","last_change":"2024-09-14T11:14:04.123532+0000","last_active":"2024-09-14T11:56:14.798085+0000","last_peered":"2024-09-14T11:56:14.798085+0000","last_clean":"2024-09-14T11:56:14.798085+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:14.798085+0000","last_undegraded":"2024-09-14T11:56:14.798085+0000","last_fullsized":"2024-09-14T11:56:14.798085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:19.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632597,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":400,"num_read_kb":10088,"num_write":805,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'969","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114339+0000","last_change":"2024-09-14T11:14:38.192581+0000","last_active":"2024-09-14T11:54:27.114339+0000","last_peered":"2024-09-14T11:54:27.114339+0000","last_clean":"2024-09-14T11:54:27.114339+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:54:27.114339+0000","last_undegraded":"2024-09-14T11:54:27.114339+0000","last_fullsized":"2024-09-14T11:54:27.114339+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":900,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:55.081995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'281","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887971+0000","last_change":"2024-09-14T11:14:04.133635+0000","last_active":"2024-09-14T11:56:14.887971+0000","last_peered":"2024-09-14T11:56:14.887971+0000","last_clean":"2024-09-14T11:56:14.887971+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:14.887971+0000","last_undegraded":"2024-09-14T11:56:14.887971+0000","last_fullsized":"2024-09-14T11:56:14.887971+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:20.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656670,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":689,"num_read_kb":31980,"num_write":981,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'456","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113514+0000","last_change":"2024-09-14T11:14:06.120786+0000","last_active":"2024-09-14T11:54:27.113514+0000","last_peered":"2024-09-14T11:54:27.113514+0000","last_clean":"2024-09-14T11:54:27.113514+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:54:27.113514+0000","last_undegraded":"2024-09-14T11:54:27.113514+0000","last_fullsized":"2024-09-14T11:54:27.113514+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:54.953125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'842","reported_seq":2512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114073+0000","last_change":"2024-09-14T11:14:06.124595+0000","last_active":"2024-09-14T11:54:27.114073+0000","last_peered":"2024-09-14T11:54:27.114073+0000","last_clean":"2024-09-14T11:54:27.114073+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:54:27.114073+0000","last_undegraded":"2024-09-14T11:54:27.114073+0000","last_fullsized":"2024-09-14T11:54:27.114073+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:05.222764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'359","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.809065+0000","last_change":"2024-09-14T11:14:38.194800+0000","last_active":"2024-09-14T11:56:14.809065+0000","last_peered":"2024-09-14T11:56:14.809065+0000","last_clean":"2024-09-14T11:56:14.809065+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:14.809065+0000","last_undegraded":"2024-09-14T11:56:14.809065+0000","last_fullsized":"2024-09-14T11:56:14.809065+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.771928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":664,"num_read_kb":5626,"num_write":1133,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1033","reported_seq":2958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113832+0000","last_change":"2024-09-14T11:14:06.123475+0000","last_active":"2024-09-14T11:54:27.113832+0000","last_peered":"2024-09-14T11:54:27.113832+0000","last_clean":"2024-09-14T11:54:27.113832+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:54:27.113832+0000","last_undegraded":"2024-09-14T11:54:27.113832+0000","last_fullsized":"2024-09-14T11:54:27.113832+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1000,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:19.165857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.556657+0000","last_change":"2024-09-14T11:14:04.127657+0000","last_active":"2024-09-14T11:56:15.556657+0000","last_peered":"2024-09-14T11:56:15.556657+0000","last_clean":"2024-09-14T11:56:15.556657+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:15.556657+0000","last_undegraded":"2024-09-14T11:56:15.556657+0000","last_fullsized":"2024-09-14T11:56:15.556657+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:06.672463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114354+0000","last_change":"2024-09-14T11:14:06.126958+0000","last_active":"2024-09-14T11:54:27.114354+0000","last_peered":"2024-09-14T11:54:27.114354+0000","last_clean":"2024-09-14T11:54:27.114354+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:54:27.114354+0000","last_undegraded":"2024-09-14T11:54:27.114354+0000","last_fullsized":"2024-09-14T11:54:27.114354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:26.370068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.544255+0000","last_change":"2024-09-14T11:14:04.124069+0000","last_active":"2024-09-14T11:56:15.544255+0000","last_peered":"2024-09-14T11:56:15.544255+0000","last_clean":"2024-09-14T11:56:15.544255+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:15.544255+0000","last_undegraded":"2024-09-14T11:56:15.544255+0000","last_fullsized":"2024-09-14T11:56:15.544255+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:34.849444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'797","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.716592+0000","last_change":"2024-09-14T11:14:06.121906+0000","last_active":"2024-09-14T11:53:56.716592+0000","last_peered":"2024-09-14T11:53:56.716592+0000","last_clean":"2024-09-14T11:53:56.716592+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:53:56.716592+0000","last_undegraded":"2024-09-14T11:53:56.716592+0000","last_fullsized":"2024-09-14T11:53:56.716592+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:09.756613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.581006+0000","last_change":"2024-09-14T11:14:04.134028+0000","last_active":"2024-09-14T11:56:15.581006+0000","last_peered":"2024-09-14T11:56:15.581006+0000","last_clean":"2024-09-14T11:56:15.581006+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:15.581006+0000","last_undegraded":"2024-09-14T11:56:15.581006+0000","last_fullsized":"2024-09-14T11:56:15.581006+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:15.221483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'452","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546378+0000","last_change":"2024-09-14T11:14:06.126750+0000","last_active":"2024-09-14T11:54:26.546378+0000","last_peered":"2024-09-14T11:54:26.546378+0000","last_clean":"2024-09-14T11:54:26.546378+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:54:26.546378+0000","last_undegraded":"2024-09-14T11:54:26.546378+0000","last_fullsized":"2024-09-14T11:54:26.546378+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:36.058072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'402","reported_seq":1130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.899014+0000","last_change":"2024-09-14T11:14:04.124388+0000","last_active":"2024-09-14T11:56:14.899014+0000","last_peered":"2024-09-14T11:56:14.899014+0000","last_clean":"2024-09-14T11:56:14.899014+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:14.899014+0000","last_undegraded":"2024-09-14T11:56:14.899014+0000","last_fullsized":"2024-09-14T11:56:14.899014+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:48.709233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245244,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1018,"num_read_kb":31602,"num_write":1270,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'449","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262318+0000","last_change":"2024-09-14T11:14:06.120737+0000","last_active":"2024-09-14T11:54:09.262318+0000","last_peered":"2024-09-14T11:54:09.262318+0000","last_clean":"2024-09-14T11:54:09.262318+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:54:09.262318+0000","last_undegraded":"2024-09-14T11:54:09.262318+0000","last_fullsized":"2024-09-14T11:54:09.262318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:08.169000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'305","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.873253+0000","last_change":"2024-09-14T11:14:04.131958+0000","last_active":"2024-09-14T11:56:14.873253+0000","last_peered":"2024-09-14T11:56:14.873253+0000","last_clean":"2024-09-14T11:56:14.873253+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:14.873253+0000","last_undegraded":"2024-09-14T11:56:14.873253+0000","last_fullsized":"2024-09-14T11:56:14.873253+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:07.141707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12587448,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":530,"num_read_kb":49466,"num_write":1002,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'149","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.173403+0000","last_change":"2024-09-14T11:14:14.157140+0000","last_active":"2024-09-14T11:54:27.173403+0000","last_peered":"2024-09-14T11:54:27.173403+0000","last_clean":"2024-09-14T11:54:27.173403+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:54:27.173403+0000","last_undegraded":"2024-09-14T11:54:27.173403+0000","last_fullsized":"2024-09-14T11:54:27.173403+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'472","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462103+0000","last_change":"2024-09-14T11:14:06.114316+0000","last_active":"2024-09-14T11:54:24.462103+0000","last_peered":"2024-09-14T11:54:24.462103+0000","last_clean":"2024-09-14T11:54:24.462103+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:54:24.462103+0000","last_undegraded":"2024-09-14T11:54:24.462103+0000","last_fullsized":"2024-09-14T11:54:24.462103+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:27.459152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'326","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.779294+0000","last_change":"2024-09-14T11:14:04.130305+0000","last_active":"2024-09-14T11:56:14.779294+0000","last_peered":"2024-09-14T11:56:14.779294+0000","last_clean":"2024-09-14T11:56:14.779294+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:14.779294+0000","last_undegraded":"2024-09-14T11:56:14.779294+0000","last_fullsized":"2024-09-14T11:56:14.779294+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:34.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11283977,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":545,"num_read_kb":64656,"num_write":1047,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032244+0000","last_change":"2024-09-14T11:14:08.133120+0000","last_active":"2024-09-14T11:52:51.032244+0000","last_peered":"2024-09-14T11:52:51.032244+0000","last_clean":"2024-09-14T11:52:51.032244+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:52:51.032244+0000","last_undegraded":"2024-09-14T11:52:51.032244+0000","last_fullsized":"2024-09-14T11:52:51.032244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:46.516129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.396646+0000","last_change":"2024-09-14T11:14:10.155409+0000","last_active":"2024-09-14T11:56:14.396646+0000","last_peered":"2024-09-14T11:56:14.396646+0000","last_clean":"2024-09-14T11:56:14.396646+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:14.396646+0000","last_undegraded":"2024-09-14T11:56:14.396646+0000","last_fullsized":"2024-09-14T11:56:14.396646+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:46.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.789188+0000","last_change":"2024-09-14T11:14:12.146041+0000","last_active":"2024-09-14T11:52:54.789188+0000","last_peered":"2024-09-14T11:52:54.789188+0000","last_clean":"2024-09-14T11:52:54.789188+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:52:54.789188+0000","last_undegraded":"2024-09-14T11:52:54.789188+0000","last_fullsized":"2024-09-14T11:52:54.789188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:07.310103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2525","reported_seq":4350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.558442+0000","last_change":"2024-09-14T11:14:14.162522+0000","last_active":"2024-09-14T11:54:26.558442+0000","last_peered":"2024-09-14T11:54:26.558442+0000","last_clean":"2024-09-14T11:54:26.558442+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:54:26.558442+0000","last_undegraded":"2024-09-14T11:54:26.558442+0000","last_fullsized":"2024-09-14T11:54:26.558442+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.242957+0000","last_change":"2024-09-14T11:14:06.123796+0000","last_active":"2024-09-14T11:53:58.242957+0000","last_peered":"2024-09-14T11:53:58.242957+0000","last_clean":"2024-09-14T11:53:58.242957+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:53:58.242957+0000","last_undegraded":"2024-09-14T11:53:58.242957+0000","last_fullsized":"2024-09-14T11:53:58.242957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.088566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'355","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897988+0000","last_change":"2024-09-14T11:14:04.119220+0000","last_active":"2024-09-14T11:56:14.897988+0000","last_peered":"2024-09-14T11:56:14.897988+0000","last_clean":"2024-09-14T11:56:14.897988+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:14.897988+0000","last_undegraded":"2024-09-14T11:56:14.897988+0000","last_fullsized":"2024-09-14T11:56:14.897988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:38.371093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1196,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":645,"num_read_kb":35601,"num_write":1184,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"37'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.737726+0000","last_change":"2024-09-14T11:14:08.135860+0000","last_active":"2024-09-14T11:56:13.737726+0000","last_peered":"2024-09-14T11:56:13.737726+0000","last_clean":"2024-09-14T11:56:13.737726+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:13.737726+0000","last_undegraded":"2024-09-14T11:56:13.737726+0000","last_fullsized":"2024-09-14T11:56:13.737726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:46.310304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'85","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.820592+0000","last_change":"2024-09-14T11:14:10.148306+0000","last_active":"2024-09-14T11:54:18.820592+0000","last_peered":"2024-09-14T11:54:18.820592+0000","last_clean":"2024-09-14T11:54:18.820592+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:54:18.820592+0000","last_undegraded":"2024-09-14T11:54:18.820592+0000","last_fullsized":"2024-09-14T11:54:18.820592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:24.120046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783507+0000","last_change":"2024-09-14T11:14:12.155662+0000","last_active":"2024-09-14T11:52:55.783507+0000","last_peered":"2024-09-14T11:52:55.783507+0000","last_clean":"2024-09-14T11:52:55.783507+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:52:55.783507+0000","last_undegraded":"2024-09-14T11:52:55.783507+0000","last_fullsized":"2024-09-14T11:52:55.783507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.540261+0000","last_change":"2024-09-14T11:14:14.154923+0000","last_active":"2024-09-14T11:53:52.540261+0000","last_peered":"2024-09-14T11:53:52.540261+0000","last_clean":"2024-09-14T11:53:52.540261+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:53:52.540261+0000","last_undegraded":"2024-09-14T11:53:52.540261+0000","last_fullsized":"2024-09-14T11:53:52.540261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:08.154888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'429","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.932863+0000","last_change":"2024-09-14T11:14:06.134060+0000","last_active":"2024-09-14T11:54:02.932863+0000","last_peered":"2024-09-14T11:54:02.932863+0000","last_clean":"2024-09-14T11:54:02.932863+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:54:02.932863+0000","last_undegraded":"2024-09-14T11:54:02.932863+0000","last_fullsized":"2024-09-14T11:54:02.932863+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:50.929113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'380","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.731352+0000","last_change":"2024-09-14T11:14:04.131269+0000","last_active":"2024-09-14T11:56:14.731352+0000","last_peered":"2024-09-14T11:56:14.731352+0000","last_clean":"2024-09-14T11:56:14.731352+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:14.731352+0000","last_undegraded":"2024-09-14T11:56:14.731352+0000","last_fullsized":"2024-09-14T11:56:14.731352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.204839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982763,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":788,"num_read_kb":18319,"num_write":1387,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.894797+0000","last_change":"2024-09-14T11:14:08.134301+0000","last_active":"2024-09-14T11:52:49.894797+0000","last_peered":"2024-09-14T11:52:49.894797+0000","last_clean":"2024-09-14T11:52:49.894797+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:52:49.894797+0000","last_undegraded":"2024-09-14T11:52:49.894797+0000","last_fullsized":"2024-09-14T11:52:49.894797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.190597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'98","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.837361+0000","last_change":"2024-09-14T11:14:10.152502+0000","last_active":"2024-09-14T11:54:18.837361+0000","last_peered":"2024-09-14T11:54:18.837361+0000","last_clean":"2024-09-14T11:54:18.837361+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:54:18.837361+0000","last_undegraded":"2024-09-14T11:54:18.837361+0000","last_fullsized":"2024-09-14T11:54:18.837361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:42.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.742621+0000","last_change":"2024-09-14T11:14:12.146612+0000","last_active":"2024-09-14T11:56:13.742621+0000","last_peered":"2024-09-14T11:56:13.742621+0000","last_clean":"2024-09-14T11:56:13.742621+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:13.742621+0000","last_undegraded":"2024-09-14T11:56:13.742621+0000","last_fullsized":"2024-09-14T11:56:13.742621+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:59.916147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.603559+0000","last_change":"2024-09-14T11:14:14.157146+0000","last_active":"2024-09-14T11:54:26.603559+0000","last_peered":"2024-09-14T11:54:26.603559+0000","last_clean":"2024-09-14T11:54:26.603559+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:54:26.603559+0000","last_undegraded":"2024-09-14T11:54:26.603559+0000","last_fullsized":"2024-09-14T11:54:26.603559+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'525","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.725224+0000","last_change":"2024-09-14T11:14:38.194359+0000","last_active":"2024-09-14T11:54:03.725224+0000","last_peered":"2024-09-14T11:54:03.725224+0000","last_clean":"2024-09-14T11:54:03.725224+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:54:03.725224+0000","last_undegraded":"2024-09-14T11:54:03.725224+0000","last_fullsized":"2024-09-14T11:54:03.725224+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:56.602770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.572772+0000","last_change":"2024-09-14T11:14:04.128674+0000","last_active":"2024-09-14T11:56:15.572772+0000","last_peered":"2024-09-14T11:56:15.572772+0000","last_clean":"2024-09-14T11:56:15.572772+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:15.572772+0000","last_undegraded":"2024-09-14T11:56:15.572772+0000","last_fullsized":"2024-09-14T11:56:15.572772+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.487246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032273+0000","last_change":"2024-09-14T11:14:08.132713+0000","last_active":"2024-09-14T11:52:51.032273+0000","last_peered":"2024-09-14T11:52:51.032273+0000","last_clean":"2024-09-14T11:52:51.032273+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:52:51.032273+0000","last_undegraded":"2024-09-14T11:52:51.032273+0000","last_fullsized":"2024-09-14T11:52:51.032273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.166831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'250","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.104576+0000","last_change":"2024-09-14T11:14:10.151136+0000","last_active":"2024-09-14T11:56:14.104576+0000","last_peered":"2024-09-14T11:56:14.104576+0000","last_clean":"2024-09-14T11:56:14.104576+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:14.104576+0000","last_undegraded":"2024-09-14T11:56:14.104576+0000","last_fullsized":"2024-09-14T11:56:14.104576+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.560101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.746769+0000","last_change":"2024-09-14T11:14:12.152920+0000","last_active":"2024-09-14T11:56:13.746769+0000","last_peered":"2024-09-14T11:56:13.746769+0000","last_clean":"2024-09-14T11:56:13.746769+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:13.746769+0000","last_undegraded":"2024-09-14T11:56:13.746769+0000","last_fullsized":"2024-09-14T11:56:13.746769+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:33.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1226","reported_seq":2881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358325+0000","last_change":"2024-09-14T11:14:06.125762+0000","last_active":"2024-09-14T11:54:05.358325+0000","last_peered":"2024-09-14T11:54:05.358325+0000","last_clean":"2024-09-14T11:54:05.358325+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:54:05.358325+0000","last_undegraded":"2024-09-14T11:54:05.358325+0000","last_fullsized":"2024-09-14T11:54:05.358325+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:18.791358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'329","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.766628+0000","last_change":"2024-09-14T11:14:04.130569+0000","last_active":"2024-09-14T11:56:14.766628+0000","last_peered":"2024-09-14T11:56:14.766628+0000","last_clean":"2024-09-14T11:56:14.766628+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:14.766628+0000","last_undegraded":"2024-09-14T11:56:14.766628+0000","last_fullsized":"2024-09-14T11:56:14.766628+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:07.122939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":614,"num_read_kb":41733,"num_write":1076,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.791334+0000","last_change":"2024-09-14T11:14:08.133899+0000","last_active":"2024-09-14T11:53:09.791334+0000","last_peered":"2024-09-14T11:53:09.791334+0000","last_clean":"2024-09-14T11:53:09.791334+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:53:09.791334+0000","last_undegraded":"2024-09-14T11:53:09.791334+0000","last_fullsized":"2024-09-14T11:53:09.791334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:53.760916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'350","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:21.054040+0000","last_change":"2024-09-14T11:14:10.148253+0000","last_active":"2024-09-14T11:55:21.054040+0000","last_peered":"2024-09-14T11:55:21.054040+0000","last_clean":"2024-09-14T11:55:21.054040+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:55:21.054040+0000","last_undegraded":"2024-09-14T11:55:21.054040+0000","last_fullsized":"2024-09-14T11:55:21.054040+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:31.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":579,"num_read_kb":1108,"num_write":464,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892192+0000","last_change":"2024-09-14T11:14:12.146180+0000","last_active":"2024-09-14T11:52:29.892192+0000","last_peered":"2024-09-14T11:52:29.892192+0000","last_clean":"2024-09-14T11:52:29.892192+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:52:29.892192+0000","last_undegraded":"2024-09-14T11:52:29.892192+0000","last_fullsized":"2024-09-14T11:52:29.892192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:08.096291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'551","reported_seq":1353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.743153+0000","last_change":"2024-09-14T11:14:14.163358+0000","last_active":"2024-09-14T11:55:42.743153+0000","last_peered":"2024-09-14T11:55:42.743153+0000","last_clean":"2024-09-14T11:55:42.743153+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:55:42.743153+0000","last_undegraded":"2024-09-14T11:55:42.743153+0000","last_fullsized":"2024-09-14T11:55:42.743153+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.528715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'805","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783202+0000","last_change":"2024-09-14T11:14:06.122574+0000","last_active":"2024-09-14T11:54:07.783202+0000","last_peered":"2024-09-14T11:54:07.783202+0000","last_clean":"2024-09-14T11:54:07.783202+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:54:07.783202+0000","last_undegraded":"2024-09-14T11:54:07.783202+0000","last_fullsized":"2024-09-14T11:54:07.783202+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:48.369389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'287","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.748314+0000","last_change":"2024-09-14T11:14:38.341826+0000","last_active":"2024-09-14T11:56:14.748314+0000","last_peered":"2024-09-14T11:56:14.748314+0000","last_clean":"2024-09-14T11:56:14.748314+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:14.748314+0000","last_undegraded":"2024-09-14T11:56:14.748314+0000","last_fullsized":"2024-09-14T11:56:14.748314+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:15.557976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656139,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":522,"num_read_kb":67475,"num_write":1005,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777294+0000","last_change":"2024-09-14T11:14:08.128050+0000","last_active":"2024-09-14T11:53:09.777294+0000","last_peered":"2024-09-14T11:53:09.777294+0000","last_clean":"2024-09-14T11:53:09.777294+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:53:09.777294+0000","last_undegraded":"2024-09-14T11:53:09.777294+0000","last_fullsized":"2024-09-14T11:53:09.777294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:20.497715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'289","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.704528+0000","last_change":"2024-09-14T11:14:10.154690+0000","last_active":"2024-09-14T11:55:42.704528+0000","last_peered":"2024-09-14T11:55:42.704528+0000","last_clean":"2024-09-14T11:55:42.704528+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:55:42.704528+0000","last_undegraded":"2024-09-14T11:55:42.704528+0000","last_fullsized":"2024-09-14T11:55:42.704528+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:11.627375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":989,"num_write":396,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899412+0000","last_change":"2024-09-14T11:14:12.151137+0000","last_active":"2024-09-14T11:53:19.899412+0000","last_peered":"2024-09-14T11:53:19.899412+0000","last_clean":"2024-09-14T11:53:19.899412+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:53:19.899412+0000","last_undegraded":"2024-09-14T11:53:19.899412+0000","last_fullsized":"2024-09-14T11:53:19.899412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:29.769264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'118","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.889408+0000","last_change":"2024-09-14T11:14:14.157438+0000","last_active":"2024-09-14T11:55:32.889408+0000","last_peered":"2024-09-14T11:55:32.889408+0000","last_clean":"2024-09-14T11:55:32.889408+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:55:32.889408+0000","last_undegraded":"2024-09-14T11:55:32.889408+0000","last_fullsized":"2024-09-14T11:55:32.889408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:00.893536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1038","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935378+0000","last_change":"2024-09-14T11:14:06.128782+0000","last_active":"2024-09-14T11:54:09.935378+0000","last_peered":"2024-09-14T11:54:09.935378+0000","last_clean":"2024-09-14T11:54:09.935378+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:54:09.935378+0000","last_undegraded":"2024-09-14T11:54:09.935378+0000","last_fullsized":"2024-09-14T11:54:09.935378+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:45.064796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'265","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.810356+0000","last_change":"2024-09-14T11:14:04.126361+0000","last_active":"2024-09-14T11:56:14.810356+0000","last_peered":"2024-09-14T11:56:14.810356+0000","last_clean":"2024-09-14T11:56:14.810356+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:14.810356+0000","last_undegraded":"2024-09-14T11:56:14.810356+0000","last_fullsized":"2024-09-14T11:56:14.810356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:57.417770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245220,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":404,"num_read_kb":31073,"num_write":880,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771841+0000","last_change":"2024-09-14T11:14:08.126954+0000","last_active":"2024-09-14T11:52:24.771841+0000","last_peered":"2024-09-14T11:52:24.771841+0000","last_clean":"2024-09-14T11:52:24.771841+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:52:24.771841+0000","last_undegraded":"2024-09-14T11:52:24.771841+0000","last_fullsized":"2024-09-14T11:52:24.771841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:45.136292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'300","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.732982+0000","last_change":"2024-09-14T11:14:10.152183+0000","last_active":"2024-09-14T11:56:14.732982+0000","last_peered":"2024-09-14T11:56:14.732982+0000","last_clean":"2024-09-14T11:56:14.732982+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:14.732982+0000","last_undegraded":"2024-09-14T11:56:14.732982+0000","last_fullsized":"2024-09-14T11:56:14.732982+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.467798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'787","reported_seq":4040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.747751+0000","last_change":"2024-09-14T11:14:12.147169+0000","last_active":"2024-09-14T11:56:13.747751+0000","last_peered":"2024-09-14T11:56:13.747751+0000","last_clean":"2024-09-14T11:56:13.747751+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:13.747751+0000","last_undegraded":"2024-09-14T11:56:13.747751+0000","last_fullsized":"2024-09-14T11:56:13.747751+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:25.604563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573078+0000","last_change":"2024-09-14T11:14:14.159513+0000","last_active":"2024-09-14T11:55:41.573078+0000","last_peered":"2024-09-14T11:55:41.573078+0000","last_clean":"2024-09-14T11:55:41.573078+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:55:41.573078+0000","last_undegraded":"2024-09-14T11:55:41.573078+0000","last_fullsized":"2024-09-14T11:55:41.573078+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.781431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'412","reported_seq":1898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630266+0000","last_change":"2024-09-14T11:14:06.131730+0000","last_active":"2024-09-14T11:55:41.630266+0000","last_peered":"2024-09-14T11:55:41.630266+0000","last_clean":"2024-09-14T11:55:41.630266+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:55:41.630266+0000","last_undegraded":"2024-09-14T11:55:41.630266+0000","last_fullsized":"2024-09-14T11:55:41.630266+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:31.948943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'322","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.657114+0000","last_change":"2024-09-14T11:14:04.129793+0000","last_active":"2024-09-14T11:53:53.657114+0000","last_peered":"2024-09-14T11:53:53.657114+0000","last_clean":"2024-09-14T11:53:53.657114+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:53:53.657114+0000","last_undegraded":"2024-09-14T11:53:53.657114+0000","last_fullsized":"2024-09-14T11:53:53.657114+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.783947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7193835,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":735,"num_read_kb":46336,"num_write":1063,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.778424+0000","last_change":"2024-09-14T11:14:08.138126+0000","last_active":"2024-09-14T11:53:19.778424+0000","last_peered":"2024-09-14T11:53:19.778424+0000","last_clean":"2024-09-14T11:53:19.778424+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:53:19.778424+0000","last_undegraded":"2024-09-14T11:53:19.778424+0000","last_fullsized":"2024-09-14T11:53:19.778424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.320143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'491","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.847886+0000","last_change":"2024-09-14T11:14:10.155037+0000","last_active":"2024-09-14T11:56:14.847886+0000","last_peered":"2024-09-14T11:56:14.847886+0000","last_clean":"2024-09-14T11:56:14.847886+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:14.847886+0000","last_undegraded":"2024-09-14T11:56:14.847886+0000","last_fullsized":"2024-09-14T11:56:14.847886+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:11.589031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":872,"num_read_kb":2063,"num_write":732,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777908+0000","last_change":"2024-09-14T11:14:12.150404+0000","last_active":"2024-09-14T11:53:14.777908+0000","last_peered":"2024-09-14T11:53:14.777908+0000","last_clean":"2024-09-14T11:53:14.777908+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:53:14.777908+0000","last_undegraded":"2024-09-14T11:53:14.777908+0000","last_fullsized":"2024-09-14T11:53:14.777908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:35.156152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.719675+0000","last_change":"2024-09-14T11:14:14.158980+0000","last_active":"2024-09-14T11:53:53.719675+0000","last_peered":"2024-09-14T11:53:53.719675+0000","last_clean":"2024-09-14T11:53:53.719675+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:53:53.719675+0000","last_undegraded":"2024-09-14T11:53:53.719675+0000","last_fullsized":"2024-09-14T11:53:53.719675+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'845","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540265+0000","last_change":"2024-09-14T11:14:06.121080+0000","last_active":"2024-09-14T11:54:04.540265+0000","last_peered":"2024-09-14T11:54:04.540265+0000","last_clean":"2024-09-14T11:54:04.540265+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:54:04.540265+0000","last_undegraded":"2024-09-14T11:54:04.540265+0000","last_fullsized":"2024-09-14T11:54:04.540265+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.620906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'357","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.837330+0000","last_change":"2024-09-14T11:14:04.123630+0000","last_active":"2024-09-14T11:56:14.837330+0000","last_peered":"2024-09-14T11:56:14.837330+0000","last_clean":"2024-09-14T11:56:14.837330+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:14.837330+0000","last_undegraded":"2024-09-14T11:56:14.837330+0000","last_fullsized":"2024-09-14T11:56:14.837330+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.120592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5259761,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":686,"num_read_kb":16903,"num_write":1198,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771872+0000","last_change":"2024-09-14T11:14:08.130949+0000","last_active":"2024-09-14T11:52:24.771872+0000","last_peered":"2024-09-14T11:52:24.771872+0000","last_clean":"2024-09-14T11:52:24.771872+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:52:24.771872+0000","last_undegraded":"2024-09-14T11:52:24.771872+0000","last_fullsized":"2024-09-14T11:52:24.771872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:57.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.591066+0000","last_change":"2024-09-14T11:14:10.152305+0000","last_active":"2024-09-14T11:56:15.591066+0000","last_peered":"2024-09-14T11:56:15.591066+0000","last_clean":"2024-09-14T11:56:15.591066+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:15.591066+0000","last_undegraded":"2024-09-14T11:56:15.591066+0000","last_fullsized":"2024-09-14T11:56:15.591066+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:30.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894361+0000","last_change":"2024-09-14T11:14:12.155158+0000","last_active":"2024-09-14T11:52:34.894361+0000","last_peered":"2024-09-14T11:52:34.894361+0000","last_clean":"2024-09-14T11:52:34.894361+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:52:34.894361+0000","last_undegraded":"2024-09-14T11:52:34.894361+0000","last_fullsized":"2024-09-14T11:52:34.894361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:57.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'118","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906638+0000","last_change":"2024-09-14T11:14:14.161551+0000","last_active":"2024-09-14T11:54:19.906638+0000","last_peered":"2024-09-14T11:54:19.906638+0000","last_clean":"2024-09-14T11:54:19.906638+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:54:19.906638+0000","last_undegraded":"2024-09-14T11:54:19.906638+0000","last_fullsized":"2024-09-14T11:54:19.906638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:31.034926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1643","reported_seq":3307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.620971+0000","last_change":"2024-09-14T11:14:06.121979+0000","last_active":"2024-09-14T11:55:41.620971+0000","last_peered":"2024-09-14T11:55:41.620971+0000","last_clean":"2024-09-14T11:55:41.620971+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:55:41.620971+0000","last_undegraded":"2024-09-14T11:55:41.620971+0000","last_fullsized":"2024-09-14T11:55:41.620971+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.503786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596591+0000","last_change":"2024-09-14T11:14:04.126591+0000","last_active":"2024-09-14T11:56:15.596591+0000","last_peered":"2024-09-14T11:56:15.596591+0000","last_clean":"2024-09-14T11:56:15.596591+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:15.596591+0000","last_undegraded":"2024-09-14T11:56:15.596591+0000","last_fullsized":"2024-09-14T11:56:15.596591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:36.129660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891630+0000","last_change":"2024-09-14T11:14:08.137550+0000","last_active":"2024-09-14T11:52:24.891630+0000","last_peered":"2024-09-14T11:52:24.891630+0000","last_clean":"2024-09-14T11:52:24.891630+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:52:24.891630+0000","last_undegraded":"2024-09-14T11:52:24.891630+0000","last_fullsized":"2024-09-14T11:52:24.891630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:25.401132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'290","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.736856+0000","last_change":"2024-09-14T11:14:10.147623+0000","last_active":"2024-09-14T11:55:42.736856+0000","last_peered":"2024-09-14T11:55:42.736856+0000","last_clean":"2024-09-14T11:55:42.736856+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:55:42.736856+0000","last_undegraded":"2024-09-14T11:55:42.736856+0000","last_fullsized":"2024-09-14T11:55:42.736856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:59.040566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79243,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1023,"num_write":396,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'759","reported_seq":2576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.743750+0000","last_change":"2024-09-14T11:14:12.150811+0000","last_active":"2024-09-14T11:56:13.743750+0000","last_peered":"2024-09-14T11:56:13.743750+0000","last_clean":"2024-09-14T11:56:13.743750+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:13.743750+0000","last_undegraded":"2024-09-14T11:56:13.743750+0000","last_fullsized":"2024-09-14T11:56:13.743750+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:59.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'145","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.116982+0000","last_change":"2024-09-14T11:14:14.152510+0000","last_active":"2024-09-14T11:54:26.116982+0000","last_peered":"2024-09-14T11:54:26.116982+0000","last_clean":"2024-09-14T11:54:26.116982+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:54:26.116982+0000","last_undegraded":"2024-09-14T11:54:26.116982+0000","last_fullsized":"2024-09-14T11:54:26.116982+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358932+0000","last_change":"2024-09-14T11:14:06.129574+0000","last_active":"2024-09-14T11:54:05.358932+0000","last_peered":"2024-09-14T11:54:05.358932+0000","last_clean":"2024-09-14T11:54:05.358932+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:54:05.358932+0000","last_undegraded":"2024-09-14T11:54:05.358932+0000","last_fullsized":"2024-09-14T11:54:05.358932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.251050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627434+0000","last_change":"2024-09-14T11:14:04.121041+0000","last_active":"2024-09-14T11:56:15.627434+0000","last_peered":"2024-09-14T11:56:15.627434+0000","last_clean":"2024-09-14T11:56:15.627434+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:15.627434+0000","last_undegraded":"2024-09-14T11:56:15.627434+0000","last_fullsized":"2024-09-14T11:56:15.627434+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:42.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.473253+0000","last_change":"2024-09-14T11:14:08.137840+0000","last_active":"2024-09-14T11:55:42.473253+0000","last_peered":"2024-09-14T11:55:42.473253+0000","last_clean":"2024-09-14T11:55:42.473253+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:55:42.473253+0000","last_undegraded":"2024-09-14T11:55:42.473253+0000","last_fullsized":"2024-09-14T11:55:42.473253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.414460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'79","reported_seq":592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.808261+0000","last_change":"2024-09-14T11:14:10.153344+0000","last_active":"2024-09-14T11:54:18.808261+0000","last_peered":"2024-09-14T11:54:18.808261+0000","last_clean":"2024-09-14T11:54:18.808261+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:54:18.808261+0000","last_undegraded":"2024-09-14T11:54:18.808261+0000","last_fullsized":"2024-09-14T11:54:18.808261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:08.968908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745724+0000","last_change":"2024-09-14T11:14:12.154356+0000","last_active":"2024-09-14T11:56:13.745724+0000","last_peered":"2024-09-14T11:56:13.745724+0000","last_clean":"2024-09-14T11:56:13.745724+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:13.745724+0000","last_undegraded":"2024-09-14T11:56:13.745724+0000","last_fullsized":"2024-09-14T11:56:13.745724+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:48.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.169895+0000","last_change":"2024-09-14T11:14:14.157483+0000","last_active":"2024-09-14T11:54:27.169895+0000","last_peered":"2024-09-14T11:54:27.169895+0000","last_clean":"2024-09-14T11:54:27.169895+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:54:27.169895+0000","last_undegraded":"2024-09-14T11:54:27.169895+0000","last_fullsized":"2024-09-14T11:54:27.169895+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:28.829014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'510","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546442+0000","last_change":"2024-09-14T11:14:06.118633+0000","last_active":"2024-09-14T11:54:26.546442+0000","last_peered":"2024-09-14T11:54:26.546442+0000","last_clean":"2024-09-14T11:54:26.546442+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:54:26.546442+0000","last_undegraded":"2024-09-14T11:54:26.546442+0000","last_fullsized":"2024-09-14T11:54:26.546442+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:05.940637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'309","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.853490+0000","last_change":"2024-09-14T11:14:04.114747+0000","last_active":"2024-09-14T11:56:14.853490+0000","last_peered":"2024-09-14T11:56:14.853490+0000","last_clean":"2024-09-14T11:56:14.853490+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:14.853490+0000","last_undegraded":"2024-09-14T11:56:14.853490+0000","last_fullsized":"2024-09-14T11:56:14.853490+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:09.164037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":617,"num_read_kb":522,"num_write":1116,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:25.780132+0000","last_change":"2024-09-14T11:14:08.136517+0000","last_active":"2024-09-14T11:52:25.780132+0000","last_peered":"2024-09-14T11:52:25.780132+0000","last_clean":"2024-09-14T11:52:25.780132+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:52:25.780132+0000","last_undegraded":"2024-09-14T11:52:25.780132+0000","last_fullsized":"2024-09-14T11:52:25.780132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:22.745520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'353","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.530634+0000","last_change":"2024-09-14T11:14:10.153476+0000","last_active":"2024-09-14T11:54:47.530634+0000","last_peered":"2024-09-14T11:54:47.530634+0000","last_clean":"2024-09-14T11:54:47.530634+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:54:47.530634+0000","last_undegraded":"2024-09-14T11:54:47.530634+0000","last_fullsized":"2024-09-14T11:54:47.530634+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:16.395304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62917,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1190,"num_read_kb":1708,"num_write":1718,"num_write_kb":1592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:30.780175+0000","last_change":"2024-09-14T11:14:12.154775+0000","last_active":"2024-09-14T11:52:30.780175+0000","last_peered":"2024-09-14T11:52:30.780175+0000","last_clean":"2024-09-14T11:52:30.780175+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:52:30.780175+0000","last_undegraded":"2024-09-14T11:52:30.780175+0000","last_fullsized":"2024-09-14T11:52:30.780175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:42.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'182","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.542886+0000","last_change":"2024-09-14T11:14:14.155863+0000","last_active":"2024-09-14T11:54:08.542886+0000","last_peered":"2024-09-14T11:54:08.542886+0000","last_clean":"2024-09-14T11:54:08.542886+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:54:08.542886+0000","last_undegraded":"2024-09-14T11:54:08.542886+0000","last_fullsized":"2024-09-14T11:54:08.542886+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'464","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114499+0000","last_change":"2024-09-14T11:14:06.128526+0000","last_active":"2024-09-14T11:54:27.114499+0000","last_peered":"2024-09-14T11:54:27.114499+0000","last_clean":"2024-09-14T11:54:27.114499+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:54:27.114499+0000","last_undegraded":"2024-09-14T11:54:27.114499+0000","last_fullsized":"2024-09-14T11:54:27.114499+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:37.682655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798596+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:53:59.798596+0000","last_peered":"2024-09-14T11:53:59.798596+0000","last_clean":"2024-09-14T11:53:59.798596+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:53:59.798596+0000","last_undegraded":"2024-09-14T11:53:59.798596+0000","last_fullsized":"2024-09-14T11:53:59.798596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037656+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:53:31.037656+0000","last_peered":"2024-09-14T11:53:31.037656+0000","last_clean":"2024-09-14T11:53:31.037656+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:53:31.037656+0000","last_undegraded":"2024-09-14T11:53:31.037656+0000","last_fullsized":"2024-09-14T11:53:31.037656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'300","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.739239+0000","last_change":"2024-09-14T11:14:38.194463+0000","last_active":"2024-09-14T11:56:14.739239+0000","last_peered":"2024-09-14T11:56:14.739239+0000","last_clean":"2024-09-14T11:56:14.739239+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:14.739239+0000","last_undegraded":"2024-09-14T11:56:14.739239+0000","last_fullsized":"2024-09-14T11:56:14.739239+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:55.622697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28690,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":707,"num_read_kb":7470,"num_write":982,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.796289+0000","last_change":"2024-09-14T11:14:08.127046+0000","last_active":"2024-09-14T11:53:44.796289+0000","last_peered":"2024-09-14T11:53:44.796289+0000","last_clean":"2024-09-14T11:53:44.796289+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:53:44.796289+0000","last_undegraded":"2024-09-14T11:53:44.796289+0000","last_fullsized":"2024-09-14T11:53:44.796289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:28.320083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'732","reported_seq":1411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.724994+0000","last_change":"2024-09-14T11:14:10.150205+0000","last_active":"2024-09-14T11:55:42.724994+0000","last_peered":"2024-09-14T11:55:42.724994+0000","last_clean":"2024-09-14T11:55:42.724994+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:55:42.724994+0000","last_undegraded":"2024-09-14T11:55:42.724994+0000","last_fullsized":"2024-09-14T11:55:42.724994+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:59.627142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278360,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1442,"num_read_kb":3218,"num_write":1388,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899257+0000","last_change":"2024-09-14T11:14:12.153336+0000","last_active":"2024-09-14T11:53:14.899257+0000","last_peered":"2024-09-14T11:53:14.899257+0000","last_clean":"2024-09-14T11:53:14.899257+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:53:14.899257+0000","last_undegraded":"2024-09-14T11:53:14.899257+0000","last_fullsized":"2024-09-14T11:53:14.899257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:44.740572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.171650+0000","last_change":"2024-09-14T11:14:14.160899+0000","last_active":"2024-09-14T11:54:27.171650+0000","last_peered":"2024-09-14T11:54:27.171650+0000","last_clean":"2024-09-14T11:54:27.171650+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:54:27.171650+0000","last_undegraded":"2024-09-14T11:54:27.171650+0000","last_fullsized":"2024-09-14T11:54:27.171650+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:04.990449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1362","reported_seq":3132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461598+0000","last_change":"2024-09-14T11:14:06.132529+0000","last_active":"2024-09-14T11:54:24.461598+0000","last_peered":"2024-09-14T11:54:24.461598+0000","last_clean":"2024-09-14T11:54:24.461598+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:54:24.461598+0000","last_undegraded":"2024-09-14T11:54:24.461598+0000","last_fullsized":"2024-09-14T11:54:24.461598+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:28.977740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.799455+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:54:04.799455+0000","last_peered":"2024-09-14T11:54:04.799455+0000","last_clean":"2024-09-14T11:54:04.799455+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:54:04.799455+0000","last_undegraded":"2024-09-14T11:54:04.799455+0000","last_fullsized":"2024-09-14T11:54:04.799455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'342","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887104+0000","last_change":"2024-09-14T11:14:04.129263+0000","last_active":"2024-09-14T11:56:14.887104+0000","last_peered":"2024-09-14T11:56:14.887104+0000","last_clean":"2024-09-14T11:56:14.887104+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:14.887104+0000","last_undegraded":"2024-09-14T11:56:14.887104+0000","last_fullsized":"2024-09-14T11:56:14.887104+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:09.002526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6274379,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":595,"num_read_kb":6150,"num_write":1129,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.034937+0000","last_change":"2024-09-14T11:14:08.132493+0000","last_active":"2024-09-14T11:53:11.034937+0000","last_peered":"2024-09-14T11:53:11.034937+0000","last_clean":"2024-09-14T11:53:11.034937+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:53:11.034937+0000","last_undegraded":"2024-09-14T11:53:11.034937+0000","last_fullsized":"2024-09-14T11:53:11.034937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:47.392912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1252","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.501292+0000","last_change":"2024-09-14T11:14:10.149170+0000","last_active":"2024-09-14T11:56:14.501292+0000","last_peered":"2024-09-14T11:56:14.501292+0000","last_clean":"2024-09-14T11:56:14.501292+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:14.501292+0000","last_undegraded":"2024-09-14T11:56:14.501292+0000","last_fullsized":"2024-09-14T11:56:14.501292+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:28.655782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119324,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1945,"num_read_kb":3507,"num_write":1048,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798697+0000","last_change":"2024-09-14T11:14:12.148579+0000","last_active":"2024-09-14T11:53:59.798697+0000","last_peered":"2024-09-14T11:53:59.798697+0000","last_clean":"2024-09-14T11:53:59.798697+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:53:59.798697+0000","last_undegraded":"2024-09-14T11:53:59.798697+0000","last_fullsized":"2024-09-14T11:53:59.798697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:34.551801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'132","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.544059+0000","last_change":"2024-09-14T11:14:14.146054+0000","last_active":"2024-09-14T11:54:26.544059+0000","last_peered":"2024-09-14T11:54:26.544059+0000","last_clean":"2024-09-14T11:54:26.544059+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:54:26.544059+0000","last_undegraded":"2024-09-14T11:54:26.544059+0000","last_fullsized":"2024-09-14T11:54:26.544059+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'782","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114491+0000","last_change":"2024-09-14T11:14:06.121305+0000","last_active":"2024-09-14T11:54:27.114491+0000","last_peered":"2024-09-14T11:54:27.114491+0000","last_clean":"2024-09-14T11:54:27.114491+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:54:27.114491+0000","last_undegraded":"2024-09-14T11:54:27.114491+0000","last_fullsized":"2024-09-14T11:54:27.114491+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:09.239590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.779410+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:53:29.779410+0000","last_peered":"2024-09-14T11:53:29.779410+0000","last_clean":"2024-09-14T11:53:29.779410+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:53:29.779410+0000","last_undegraded":"2024-09-14T11:53:29.779410+0000","last_fullsized":"2024-09-14T11:53:29.779410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.901283+0000","last_change":"2024-09-14T11:14:04.124056+0000","last_active":"2024-09-14T11:56:14.901283+0000","last_peered":"2024-09-14T11:56:14.901283+0000","last_clean":"2024-09-14T11:56:14.901283+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:14.901283+0000","last_undegraded":"2024-09-14T11:56:14.901283+0000","last_fullsized":"2024-09-14T11:56:14.901283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:04.512560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704641,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":659,"num_read_kb":72006,"num_write":1117,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777365+0000","last_change":"2024-09-14T11:14:08.136300+0000","last_active":"2024-09-14T11:53:09.777365+0000","last_peered":"2024-09-14T11:53:09.777365+0000","last_clean":"2024-09-14T11:53:09.777365+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:53:09.777365+0000","last_undegraded":"2024-09-14T11:53:09.777365+0000","last_fullsized":"2024-09-14T11:53:09.777365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.813468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'251","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.881867+0000","last_change":"2024-09-14T11:14:10.150542+0000","last_active":"2024-09-14T11:55:42.881867+0000","last_peered":"2024-09-14T11:55:42.881867+0000","last_clean":"2024-09-14T11:55:42.881867+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:55:42.881867+0000","last_undegraded":"2024-09-14T11:55:42.881867+0000","last_fullsized":"2024-09-14T11:55:42.881867+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:40.011295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903323+0000","last_change":"2024-09-14T11:14:12.151445+0000","last_active":"2024-09-14T11:53:49.903323+0000","last_peered":"2024-09-14T11:53:49.903323+0000","last_clean":"2024-09-14T11:53:49.903323+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:53:49.903323+0000","last_undegraded":"2024-09-14T11:53:49.903323+0000","last_fullsized":"2024-09-14T11:53:49.903323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:44.622819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'267","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.261950+0000","last_change":"2024-09-14T11:14:14.160808+0000","last_active":"2024-09-14T11:54:27.261950+0000","last_peered":"2024-09-14T11:54:27.261950+0000","last_clean":"2024-09-14T11:54:27.261950+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:54:27.261950+0000","last_undegraded":"2024-09-14T11:54:27.261950+0000","last_fullsized":"2024-09-14T11:54:27.261950+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:19.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'430","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261834+0000","last_change":"2024-09-14T11:14:06.126970+0000","last_active":"2024-09-14T11:54:09.261834+0000","last_peered":"2024-09-14T11:54:09.261834+0000","last_clean":"2024-09-14T11:54:09.261834+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:54:09.261834+0000","last_undegraded":"2024-09-14T11:54:09.261834+0000","last_fullsized":"2024-09-14T11:54:09.261834+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.633196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037624+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:53:31.037624+0000","last_peered":"2024-09-14T11:53:31.037624+0000","last_clean":"2024-09-14T11:53:31.037624+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:53:31.037624+0000","last_undegraded":"2024-09-14T11:53:31.037624+0000","last_fullsized":"2024-09-14T11:53:31.037624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'299","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.690633+0000","last_change":"2024-09-14T11:14:38.192227+0000","last_active":"2024-09-14T11:56:14.690633+0000","last_peered":"2024-09-14T11:56:14.690633+0000","last_clean":"2024-09-14T11:56:14.690633+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:14.690633+0000","last_undegraded":"2024-09-14T11:56:14.690633+0000","last_fullsized":"2024-09-14T11:56:14.690633+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:28.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2382,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1214,"num_read_kb":7389,"num_write":1076,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903347+0000","last_change":"2024-09-14T11:14:08.128824+0000","last_active":"2024-09-14T11:53:49.903347+0000","last_peered":"2024-09-14T11:53:49.903347+0000","last_clean":"2024-09-14T11:53:49.903347+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:53:49.903347+0000","last_undegraded":"2024-09-14T11:53:49.903347+0000","last_fullsized":"2024-09-14T11:53:49.903347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:21.240092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914906+0000","last_change":"2024-09-14T11:14:10.153993+0000","last_active":"2024-09-14T11:55:19.914906+0000","last_peered":"2024-09-14T11:55:19.914906+0000","last_clean":"2024-09-14T11:55:19.914906+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:55:19.914906+0000","last_undegraded":"2024-09-14T11:55:19.914906+0000","last_fullsized":"2024-09-14T11:55:19.914906+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:30.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786573+0000","last_change":"2024-09-14T11:14:12.155597+0000","last_active":"2024-09-14T11:53:15.786573+0000","last_peered":"2024-09-14T11:53:15.786573+0000","last_clean":"2024-09-14T11:53:15.786573+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:53:15.786573+0000","last_undegraded":"2024-09-14T11:53:15.786573+0000","last_fullsized":"2024-09-14T11:53:15.786573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:57.628565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.459335+0000","last_change":"2024-09-14T11:14:14.159918+0000","last_active":"2024-09-14T11:54:24.459335+0000","last_peered":"2024-09-14T11:54:24.459335+0000","last_clean":"2024-09-14T11:54:24.459335+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:54:24.459335+0000","last_undegraded":"2024-09-14T11:54:24.459335+0000","last_fullsized":"2024-09-14T11:54:24.459335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'456","reported_seq":2014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540230+0000","last_change":"2024-09-14T11:14:06.123387+0000","last_active":"2024-09-14T11:54:04.540230+0000","last_peered":"2024-09-14T11:54:04.540230+0000","last_clean":"2024-09-14T11:54:04.540230+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:54:04.540230+0000","last_undegraded":"2024-09-14T11:54:04.540230+0000","last_fullsized":"2024-09-14T11:54:04.540230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.573555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'331","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.212163+0000","last_change":"2024-09-14T11:14:04.122373+0000","last_active":"2024-09-14T11:53:44.212163+0000","last_peered":"2024-09-14T11:53:44.212163+0000","last_clean":"2024-09-14T11:53:44.212163+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:53:44.212163+0000","last_undegraded":"2024-09-14T11:53:44.212163+0000","last_fullsized":"2024-09-14T11:53:44.212163+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.435958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11556973,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":687,"num_read_kb":43585,"num_write":1188,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.900264+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:53:29.900264+0000","last_peered":"2024-09-14T11:53:29.900264+0000","last_clean":"2024-09-14T11:53:29.900264+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:53:29.900264+0000","last_undegraded":"2024-09-14T11:53:29.900264+0000","last_fullsized":"2024-09-14T11:53:29.900264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902721+0000","last_change":"2024-09-14T11:14:08.133183+0000","last_active":"2024-09-14T11:53:44.902721+0000","last_peered":"2024-09-14T11:53:44.902721+0000","last_clean":"2024-09-14T11:53:44.902721+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:53:44.902721+0000","last_undegraded":"2024-09-14T11:53:44.902721+0000","last_fullsized":"2024-09-14T11:53:44.902721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:59.309932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'535","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.161109+0000","last_change":"2024-09-14T11:14:10.149213+0000","last_active":"2024-09-14T11:56:14.161109+0000","last_peered":"2024-09-14T11:56:14.161109+0000","last_clean":"2024-09-14T11:56:14.161109+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:14.161109+0000","last_undegraded":"2024-09-14T11:56:14.161109+0000","last_fullsized":"2024-09-14T11:56:14.161109+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:41.451954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":930,"num_read_kb":2012,"num_write":766,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791397+0000","last_change":"2024-09-14T11:14:12.151179+0000","last_active":"2024-09-14T11:53:50.791397+0000","last_peered":"2024-09-14T11:53:50.791397+0000","last_clean":"2024-09-14T11:53:50.791397+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:53:50.791397+0000","last_undegraded":"2024-09-14T11:53:50.791397+0000","last_fullsized":"2024-09-14T11:53:50.791397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:00.606325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'163","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.780862+0000","last_change":"2024-09-14T11:14:14.155856+0000","last_active":"2024-09-14T11:54:07.780862+0000","last_peered":"2024-09-14T11:54:07.780862+0000","last_clean":"2024-09-14T11:54:07.780862+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:54:07.780862+0000","last_undegraded":"2024-09-14T11:54:07.780862+0000","last_fullsized":"2024-09-14T11:54:07.780862+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:06.203953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'751","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462007+0000","last_change":"2024-09-14T11:14:06.133092+0000","last_active":"2024-09-14T11:54:24.462007+0000","last_peered":"2024-09-14T11:54:24.462007+0000","last_clean":"2024-09-14T11:54:24.462007+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:54:24.462007+0000","last_undegraded":"2024-09-14T11:54:24.462007+0000","last_fullsized":"2024-09-14T11:54:24.462007+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.029629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'328","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879940+0000","last_change":"2024-09-14T11:14:04.126657+0000","last_active":"2024-09-14T11:56:14.879940+0000","last_peered":"2024-09-14T11:56:14.879940+0000","last_clean":"2024-09-14T11:56:14.879940+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:14.879940+0000","last_undegraded":"2024-09-14T11:56:14.879940+0000","last_fullsized":"2024-09-14T11:56:14.879940+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.821826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583989,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":613,"num_read_kb":25654,"num_write":983,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795376+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:53:39.795376+0000","last_peered":"2024-09-14T11:53:39.795376+0000","last_clean":"2024-09-14T11:53:39.795376+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:53:39.795376+0000","last_undegraded":"2024-09-14T11:53:39.795376+0000","last_fullsized":"2024-09-14T11:53:39.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790686+0000","last_change":"2024-09-14T11:14:08.130246+0000","last_active":"2024-09-14T11:53:45.790686+0000","last_peered":"2024-09-14T11:53:45.790686+0000","last_clean":"2024-09-14T11:53:45.790686+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:53:45.790686+0000","last_undegraded":"2024-09-14T11:53:45.790686+0000","last_fullsized":"2024-09-14T11:53:45.790686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:01.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.533448+0000","last_change":"2024-09-14T11:14:10.139669+0000","last_active":"2024-09-14T11:54:47.533448+0000","last_peered":"2024-09-14T11:54:47.533448+0000","last_clean":"2024-09-14T11:54:47.533448+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:54:47.533448+0000","last_undegraded":"2024-09-14T11:54:47.533448+0000","last_fullsized":"2024-09-14T11:54:47.533448+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:53.709411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'806","reported_seq":2672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.749522+0000","last_change":"2024-09-14T11:14:12.147417+0000","last_active":"2024-09-14T11:55:42.749522+0000","last_peered":"2024-09-14T11:55:42.749522+0000","last_clean":"2024-09-14T11:55:42.749522+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:55:42.749522+0000","last_undegraded":"2024-09-14T11:55:42.749522+0000","last_fullsized":"2024-09-14T11:55:42.749522+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.126531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'93","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.910691+0000","last_change":"2024-09-14T11:14:14.157125+0000","last_active":"2024-09-14T11:54:49.910691+0000","last_peered":"2024-09-14T11:54:49.910691+0000","last_clean":"2024-09-14T11:54:49.910691+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:54:49.910691+0000","last_undegraded":"2024-09-14T11:54:49.910691+0000","last_fullsized":"2024-09-14T11:54:49.910691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:21.815471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'359","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906023+0000","last_change":"2024-09-14T11:14:06.125720+0000","last_active":"2024-09-14T11:54:14.906023+0000","last_peered":"2024-09-14T11:54:14.906023+0000","last_clean":"2024-09-14T11:54:14.906023+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:54:14.906023+0000","last_undegraded":"2024-09-14T11:54:14.906023+0000","last_fullsized":"2024-09-14T11:54:14.906023+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:46.137614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'307","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.725729+0000","last_change":"2024-09-14T11:14:38.192877+0000","last_active":"2024-09-14T11:56:14.725729+0000","last_peered":"2024-09-14T11:56:14.725729+0000","last_clean":"2024-09-14T11:56:14.725729+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:14.725729+0000","last_undegraded":"2024-09-14T11:56:14.725729+0000","last_fullsized":"2024-09-14T11:56:14.725729+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:30.960755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65182,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":517,"num_read_kb":1407,"num_write":960,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895813+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:52:54.895813+0000","last_peered":"2024-09-14T11:52:54.895813+0000","last_clean":"2024-09-14T11:52:54.895813+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:52:54.895813+0000","last_undegraded":"2024-09-14T11:52:54.895813+0000","last_fullsized":"2024-09-14T11:52:54.895813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790665+0000","last_change":"2024-09-14T11:14:08.135691+0000","last_active":"2024-09-14T11:53:45.790665+0000","last_peered":"2024-09-14T11:53:45.790665+0000","last_clean":"2024-09-14T11:53:45.790665+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:53:45.790665+0000","last_undegraded":"2024-09-14T11:53:45.790665+0000","last_fullsized":"2024-09-14T11:53:45.790665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:47.242553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'99","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.842534+0000","last_change":"2024-09-14T11:14:10.151595+0000","last_active":"2024-09-14T11:54:18.842534+0000","last_peered":"2024-09-14T11:54:18.842534+0000","last_clean":"2024-09-14T11:54:18.842534+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:54:18.842534+0000","last_undegraded":"2024-09-14T11:54:18.842534+0000","last_fullsized":"2024-09-14T11:54:18.842534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:13.188765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'788","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745773+0000","last_change":"2024-09-14T11:14:12.153305+0000","last_active":"2024-09-14T11:56:13.745773+0000","last_peered":"2024-09-14T11:56:13.745773+0000","last_clean":"2024-09-14T11:56:13.745773+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:13.745773+0000","last_undegraded":"2024-09-14T11:56:13.745773+0000","last_fullsized":"2024-09-14T11:56:13.745773+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:43.896569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'327","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573474+0000","last_change":"2024-09-14T11:14:14.156952+0000","last_active":"2024-09-14T11:55:41.573474+0000","last_peered":"2024-09-14T11:55:41.573474+0000","last_clean":"2024-09-14T11:55:41.573474+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:55:41.573474+0000","last_undegraded":"2024-09-14T11:55:41.573474+0000","last_fullsized":"2024-09-14T11:55:41.573474+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:32.686915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1137","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546620+0000","last_change":"2024-09-14T11:14:06.126733+0000","last_active":"2024-09-14T11:54:26.546620+0000","last_peered":"2024-09-14T11:54:26.546620+0000","last_clean":"2024-09-14T11:54:26.546620+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:54:26.546620+0000","last_undegraded":"2024-09-14T11:54:26.546620+0000","last_fullsized":"2024-09-14T11:54:26.546620+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:23.487750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.911863+0000","last_change":"2024-09-14T11:14:04.122866+0000","last_active":"2024-09-14T11:56:14.911863+0000","last_peered":"2024-09-14T11:56:14.911863+0000","last_clean":"2024-09-14T11:56:14.911863+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:14.911863+0000","last_undegraded":"2024-09-14T11:56:14.911863+0000","last_fullsized":"2024-09-14T11:56:14.911863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:50.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657270,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":597,"num_read_kb":7233,"num_write":1267,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783429+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:52:55.783429+0000","last_peered":"2024-09-14T11:52:55.783429+0000","last_clean":"2024-09-14T11:52:55.783429+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:52:55.783429+0000","last_undegraded":"2024-09-14T11:52:55.783429+0000","last_fullsized":"2024-09-14T11:52:55.783429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.905998+0000","last_change":"2024-09-14T11:14:08.133929+0000","last_active":"2024-09-14T11:54:14.905998+0000","last_peered":"2024-09-14T11:54:14.905998+0000","last_clean":"2024-09-14T11:54:14.905998+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:54:14.905998+0000","last_undegraded":"2024-09-14T11:54:14.905998+0000","last_fullsized":"2024-09-14T11:54:14.905998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.740629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'757","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.338152+0000","last_change":"2024-09-14T11:14:10.152020+0000","last_active":"2024-09-14T11:56:14.338152+0000","last_peered":"2024-09-14T11:56:14.338152+0000","last_clean":"2024-09-14T11:56:14.338152+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:14.338152+0000","last_undegraded":"2024-09-14T11:56:14.338152+0000","last_fullsized":"2024-09-14T11:56:14.338152+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:50.734251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147171,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1349,"num_read_kb":3105,"num_write":1118,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903071+0000","last_change":"2024-09-14T11:14:12.151322+0000","last_active":"2024-09-14T11:53:49.903071+0000","last_peered":"2024-09-14T11:53:49.903071+0000","last_clean":"2024-09-14T11:53:49.903071+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:53:49.903071+0000","last_undegraded":"2024-09-14T11:53:49.903071+0000","last_fullsized":"2024-09-14T11:53:49.903071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:55.159584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.544659+0000","last_change":"2024-09-14T11:14:14.164267+0000","last_active":"2024-09-14T11:54:08.544659+0000","last_peered":"2024-09-14T11:54:08.544659+0000","last_clean":"2024-09-14T11:54:08.544659+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:54:08.544659+0000","last_undegraded":"2024-09-14T11:54:08.544659+0000","last_fullsized":"2024-09-14T11:54:08.544659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:05.688641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'143","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.219226+0000","last_change":"2024-09-14T11:14:14.160222+0000","last_active":"2024-09-14T11:54:27.219226+0000","last_peered":"2024-09-14T11:54:27.219226+0000","last_clean":"2024-09-14T11:54:27.219226+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:54:27.219226+0000","last_undegraded":"2024-09-14T11:54:27.219226+0000","last_fullsized":"2024-09-14T11:54:27.219226+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:30.394037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'430","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783769+0000","last_change":"2024-09-14T11:14:06.128783+0000","last_active":"2024-09-14T11:54:07.783769+0000","last_peered":"2024-09-14T11:54:07.783769+0000","last_clean":"2024-09-14T11:54:07.783769+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:54:07.783769+0000","last_undegraded":"2024-09-14T11:54:07.783769+0000","last_fullsized":"2024-09-14T11:54:07.783769+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:11.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633344+0000","last_change":"2024-09-14T11:14:04.130995+0000","last_active":"2024-09-14T11:56:15.633344+0000","last_peered":"2024-09-14T11:56:15.633344+0000","last_clean":"2024-09-14T11:56:15.633344+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:15.633344+0000","last_undegraded":"2024-09-14T11:56:15.633344+0000","last_fullsized":"2024-09-14T11:56:15.633344+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:00.303178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.713330+0000","last_change":"2024-09-14T11:14:08.137606+0000","last_active":"2024-09-14T11:56:13.713330+0000","last_peered":"2024-09-14T11:56:13.713330+0000","last_clean":"2024-09-14T11:56:13.713330+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:13.713330+0000","last_undegraded":"2024-09-14T11:56:13.713330+0000","last_fullsized":"2024-09-14T11:56:13.713330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.107289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'263","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.676370+0000","last_change":"2024-09-14T11:14:10.149828+0000","last_active":"2024-09-14T11:56:14.676370+0000","last_peered":"2024-09-14T11:56:14.676370+0000","last_clean":"2024-09-14T11:56:14.676370+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:14.676370+0000","last_undegraded":"2024-09-14T11:56:14.676370+0000","last_fullsized":"2024-09-14T11:56:14.676370+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.820903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903614+0000","last_change":"2024-09-14T11:14:12.152653+0000","last_active":"2024-09-14T11:53:54.903614+0000","last_peered":"2024-09-14T11:53:54.903614+0000","last_clean":"2024-09-14T11:53:54.903614+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:53:54.903614+0000","last_undegraded":"2024-09-14T11:53:54.903614+0000","last_fullsized":"2024-09-14T11:53:54.903614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:35.385522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.992844+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:26.992844+0000","last_peered":"2024-09-14T11:54:26.992844+0000","last_clean":"2024-09-14T11:54:26.992844+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:26.992844+0000","last_undegraded":"2024-09-14T11:54:26.992844+0000","last_fullsized":"2024-09-14T11:54:26.992844+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'780","reported_seq":2399,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262003+0000","last_change":"2024-09-14T11:14:06.131159+0000","last_active":"2024-09-14T11:54:09.262003+0000","last_peered":"2024-09-14T11:54:09.262003+0000","last_clean":"2024-09-14T11:54:09.262003+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:54:09.262003+0000","last_undegraded":"2024-09-14T11:54:09.262003+0000","last_fullsized":"2024-09-14T11:54:09.262003+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:12.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'345","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.800943+0000","last_change":"2024-09-14T11:14:04.136243+0000","last_active":"2024-09-14T11:56:14.800943+0000","last_peered":"2024-09-14T11:56:14.800943+0000","last_clean":"2024-09-14T11:56:14.800943+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:14.800943+0000","last_undegraded":"2024-09-14T11:56:14.800943+0000","last_fullsized":"2024-09-14T11:56:14.800943+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:43.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22419747,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":606,"num_read_kb":24187,"num_write":1136,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903109+0000","last_change":"2024-09-14T11:14:08.132760+0000","last_active":"2024-09-14T11:53:49.903109+0000","last_peered":"2024-09-14T11:53:49.903109+0000","last_clean":"2024-09-14T11:53:49.903109+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:53:49.903109+0000","last_undegraded":"2024-09-14T11:53:49.903109+0000","last_fullsized":"2024-09-14T11:53:49.903109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.260856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'48","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.684887+0000","last_change":"2024-09-14T11:14:10.148065+0000","last_active":"2024-09-14T11:54:18.684887+0000","last_peered":"2024-09-14T11:54:18.684887+0000","last_clean":"2024-09-14T11:54:18.684887+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:54:18.684887+0000","last_undegraded":"2024-09-14T11:54:18.684887+0000","last_fullsized":"2024-09-14T11:54:18.684887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:38.290868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797903+0000","last_change":"2024-09-14T11:14:12.150881+0000","last_active":"2024-09-14T11:53:54.797903+0000","last_peered":"2024-09-14T11:53:54.797903+0000","last_clean":"2024-09-14T11:53:54.797903+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:53:54.797903+0000","last_undegraded":"2024-09-14T11:53:54.797903+0000","last_fullsized":"2024-09-14T11:53:54.797903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:58.272068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'218","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.536299+0000","last_change":"2024-09-14T11:14:14.153783+0000","last_active":"2024-09-14T11:54:26.536299+0000","last_peered":"2024-09-14T11:54:26.536299+0000","last_clean":"2024-09-14T11:54:26.536299+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:54:26.536299+0000","last_undegraded":"2024-09-14T11:54:26.536299+0000","last_fullsized":"2024-09-14T11:54:26.536299+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:47.004373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'913","reported_seq":2649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.628932+0000","last_change":"2024-09-14T11:14:06.125324+0000","last_active":"2024-09-14T11:55:41.628932+0000","last_peered":"2024-09-14T11:55:41.628932+0000","last_clean":"2024-09-14T11:55:41.628932+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:55:41.628932+0000","last_undegraded":"2024-09-14T11:55:41.628932+0000","last_fullsized":"2024-09-14T11:55:41.628932+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:01.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'308","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.501119+0000","last_change":"2024-09-14T11:14:04.125695+0000","last_active":"2024-09-14T11:53:55.501119+0000","last_peered":"2024-09-14T11:53:55.501119+0000","last_clean":"2024-09-14T11:53:55.501119+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:53:55.501119+0000","last_undegraded":"2024-09-14T11:53:55.501119+0000","last_fullsized":"2024-09-14T11:53:55.501119+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:38.353380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352819,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":730,"num_read_kb":3352,"num_write":1101,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.796955+0000","last_change":"2024-09-14T11:14:08.136483+0000","last_active":"2024-09-14T11:53:49.796955+0000","last_peered":"2024-09-14T11:53:49.796955+0000","last_clean":"2024-09-14T11:53:49.796955+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:53:49.796955+0000","last_undegraded":"2024-09-14T11:53:49.796955+0000","last_fullsized":"2024-09-14T11:53:49.796955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:28.874481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.055458+0000","last_change":"2024-09-14T11:14:10.151225+0000","last_active":"2024-09-14T11:56:14.055458+0000","last_peered":"2024-09-14T11:56:14.055458+0000","last_clean":"2024-09-14T11:56:14.055458+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:14.055458+0000","last_undegraded":"2024-09-14T11:56:14.055458+0000","last_fullsized":"2024-09-14T11:56:14.055458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:07.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792203+0000","last_change":"2024-09-14T11:14:12.152706+0000","last_active":"2024-09-14T11:53:55.792203+0000","last_peered":"2024-09-14T11:53:55.792203+0000","last_clean":"2024-09-14T11:53:55.792203+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:53:55.792203+0000","last_undegraded":"2024-09-14T11:53:55.792203+0000","last_fullsized":"2024-09-14T11:53:55.792203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:02.677520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'129","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.902922+0000","last_change":"2024-09-14T11:14:14.163359+0000","last_active":"2024-09-14T11:54:26.902922+0000","last_peered":"2024-09-14T11:54:26.902922+0000","last_clean":"2024-09-14T11:54:26.902922+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:54:26.902922+0000","last_undegraded":"2024-09-14T11:54:26.902922+0000","last_fullsized":"2024-09-14T11:54:26.902922+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'564","reported_seq":2291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629178+0000","last_change":"2024-09-14T11:14:06.114979+0000","last_active":"2024-09-14T11:55:41.629178+0000","last_peered":"2024-09-14T11:55:41.629178+0000","last_clean":"2024-09-14T11:55:41.629178+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:55:41.629178+0000","last_undegraded":"2024-09-14T11:55:41.629178+0000","last_fullsized":"2024-09-14T11:55:41.629178+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:34.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'381","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886235+0000","last_change":"2024-09-14T11:14:04.123707+0000","last_active":"2024-09-14T11:56:14.886235+0000","last_peered":"2024-09-14T11:56:14.886235+0000","last_clean":"2024-09-14T11:56:14.886235+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:14.886235+0000","last_undegraded":"2024-09-14T11:56:14.886235+0000","last_fullsized":"2024-09-14T11:56:14.886235+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:47.655600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17714616,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":685,"num_read_kb":20814,"num_write":1338,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791400+0000","last_change":"2024-09-14T11:14:08.138146+0000","last_active":"2024-09-14T11:53:50.791400+0000","last_peered":"2024-09-14T11:53:50.791400+0000","last_clean":"2024-09-14T11:53:50.791400+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:53:50.791400+0000","last_undegraded":"2024-09-14T11:53:50.791400+0000","last_fullsized":"2024-09-14T11:53:50.791400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.928629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'266","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.855796+0000","last_change":"2024-09-14T11:14:10.151325+0000","last_active":"2024-09-14T11:56:13.855796+0000","last_peered":"2024-09-14T11:56:13.855796+0000","last_clean":"2024-09-14T11:56:13.855796+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:13.855796+0000","last_undegraded":"2024-09-14T11:56:13.855796+0000","last_fullsized":"2024-09-14T11:56:13.855796+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:32.211592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903894+0000","last_change":"2024-09-14T11:14:12.154497+0000","last_active":"2024-09-14T11:53:54.903894+0000","last_peered":"2024-09-14T11:53:54.903894+0000","last_clean":"2024-09-14T11:53:54.903894+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:53:54.903894+0000","last_undegraded":"2024-09-14T11:53:54.903894+0000","last_fullsized":"2024-09-14T11:53:54.903894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:27.388051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114150+0000","last_change":"2024-09-14T11:14:06.128364+0000","last_active":"2024-09-14T11:54:27.114150+0000","last_peered":"2024-09-14T11:54:27.114150+0000","last_clean":"2024-09-14T11:54:27.114150+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:54:27.114150+0000","last_undegraded":"2024-09-14T11:54:27.114150+0000","last_fullsized":"2024-09-14T11:54:27.114150+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.420636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.920042+0000","last_change":"2024-09-14T11:14:04.124479+0000","last_active":"2024-09-14T11:56:14.920042+0000","last_peered":"2024-09-14T11:56:14.920042+0000","last_clean":"2024-09-14T11:56:14.920042+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:14.920042+0000","last_undegraded":"2024-09-14T11:56:14.920042+0000","last_fullsized":"2024-09-14T11:56:14.920042+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:07.746886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22971,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":546,"num_read_kb":1976,"num_write":1057,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906070+0000","last_change":"2024-09-14T11:14:08.125925+0000","last_active":"2024-09-14T11:54:14.906070+0000","last_peered":"2024-09-14T11:54:14.906070+0000","last_clean":"2024-09-14T11:54:14.906070+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:54:14.906070+0000","last_undegraded":"2024-09-14T11:54:14.906070+0000","last_fullsized":"2024-09-14T11:54:14.906070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:37.664162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'485","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.759911+0000","last_change":"2024-09-14T11:14:10.149612+0000","last_active":"2024-09-14T11:56:13.759911+0000","last_peered":"2024-09-14T11:56:13.759911+0000","last_clean":"2024-09-14T11:56:13.759911+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:13.759911+0000","last_undegraded":"2024-09-14T11:56:13.759911+0000","last_fullsized":"2024-09-14T11:56:13.759911+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:51.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116470,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1869,"num_write":750,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022383+0000","last_change":"2024-09-14T11:14:12.152526+0000","last_active":"2024-09-14T11:51:46.022383+0000","last_peered":"2024-09-14T11:51:46.022383+0000","last_clean":"2024-09-14T11:51:46.022383+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:51:46.022383+0000","last_undegraded":"2024-09-14T11:51:46.022383+0000","last_fullsized":"2024-09-14T11:51:46.022383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.316198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.457622+0000","last_change":"2024-09-14T11:14:14.153440+0000","last_active":"2024-09-14T11:54:24.457622+0000","last_peered":"2024-09-14T11:54:24.457622+0000","last_clean":"2024-09-14T11:54:24.457622+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:54:24.457622+0000","last_undegraded":"2024-09-14T11:54:24.457622+0000","last_fullsized":"2024-09-14T11:54:24.457622+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.457388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'412","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629660+0000","last_change":"2024-09-14T11:14:06.133265+0000","last_active":"2024-09-14T11:55:41.629660+0000","last_peered":"2024-09-14T11:55:41.629660+0000","last_clean":"2024-09-14T11:55:41.629660+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:55:41.629660+0000","last_undegraded":"2024-09-14T11:55:41.629660+0000","last_fullsized":"2024-09-14T11:55:41.629660+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:39.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'331","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886913+0000","last_change":"2024-09-14T11:14:04.120305+0000","last_active":"2024-09-14T11:56:14.886913+0000","last_peered":"2024-09-14T11:56:14.886913+0000","last_clean":"2024-09-14T11:56:14.886913+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:14.886913+0000","last_undegraded":"2024-09-14T11:56:14.886913+0000","last_fullsized":"2024-09-14T11:56:14.886913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:30.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245368,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":667,"num_read_kb":10770,"num_write":1182,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790754+0000","last_change":"2024-09-14T11:14:08.136472+0000","last_active":"2024-09-14T11:53:45.790754+0000","last_peered":"2024-09-14T11:53:45.790754+0000","last_clean":"2024-09-14T11:53:45.790754+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:53:45.790754+0000","last_undegraded":"2024-09-14T11:53:45.790754+0000","last_fullsized":"2024-09-14T11:53:45.790754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:13.023971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.930797+0000","last_change":"2024-09-14T11:14:10.152603+0000","last_active":"2024-09-14T11:56:13.930797+0000","last_peered":"2024-09-14T11:56:13.930797+0000","last_clean":"2024-09-14T11:56:13.930797+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:13.930797+0000","last_undegraded":"2024-09-14T11:56:13.930797+0000","last_fullsized":"2024-09-14T11:56:13.930797+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:04.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.887234+0000","last_change":"2024-09-14T11:14:12.153956+0000","last_active":"2024-09-14T11:51:44.887234+0000","last_peered":"2024-09-14T11:51:44.887234+0000","last_clean":"2024-09-14T11:51:44.887234+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:51:44.887234+0000","last_undegraded":"2024-09-14T11:51:44.887234+0000","last_fullsized":"2024-09-14T11:51:44.887234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:06.820196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'231","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.069083+0000","last_change":"2024-09-14T11:14:14.159808+0000","last_active":"2024-09-14T11:54:25.069083+0000","last_peered":"2024-09-14T11:54:25.069083+0000","last_clean":"2024-09-14T11:54:25.069083+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:54:25.069083+0000","last_undegraded":"2024-09-14T11:54:25.069083+0000","last_fullsized":"2024-09-14T11:54:25.069083+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:54.636606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'495","reported_seq":2082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622438+0000","last_change":"2024-09-14T11:14:06.115825+0000","last_active":"2024-09-14T11:55:41.622438+0000","last_peered":"2024-09-14T11:55:41.622438+0000","last_clean":"2024-09-14T11:55:41.622438+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:55:41.622438+0000","last_undegraded":"2024-09-14T11:55:41.622438+0000","last_fullsized":"2024-09-14T11:55:41.622438+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:59.337368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.619156+0000","last_change":"2024-09-14T11:14:04.123750+0000","last_active":"2024-09-14T11:56:15.619156+0000","last_peered":"2024-09-14T11:56:15.619156+0000","last_clean":"2024-09-14T11:56:15.619156+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:15.619156+0000","last_undegraded":"2024-09-14T11:56:15.619156+0000","last_fullsized":"2024-09-14T11:56:15.619156+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:35.861181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.774310+0000","last_change":"2024-09-14T11:14:08.137009+0000","last_active":"2024-09-14T11:51:40.774310+0000","last_peered":"2024-09-14T11:51:40.774310+0000","last_clean":"2024-09-14T11:51:40.774310+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:51:40.774310+0000","last_undegraded":"2024-09-14T11:51:40.774310+0000","last_fullsized":"2024-09-14T11:51:40.774310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.777442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'292","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.905574+0000","last_change":"2024-09-14T11:14:10.154505+0000","last_active":"2024-09-14T11:56:14.905574+0000","last_peered":"2024-09-14T11:56:14.905574+0000","last_clean":"2024-09-14T11:56:14.905574+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:14.905574+0000","last_undegraded":"2024-09-14T11:56:14.905574+0000","last_fullsized":"2024-09-14T11:56:14.905574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.388017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.891069+0000","last_change":"2024-09-14T11:14:12.149836+0000","last_active":"2024-09-14T11:52:19.891069+0000","last_peered":"2024-09-14T11:52:19.891069+0000","last_clean":"2024-09-14T11:52:19.891069+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:52:19.891069+0000","last_undegraded":"2024-09-14T11:52:19.891069+0000","last_fullsized":"2024-09-14T11:52:19.891069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:32.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'144","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.738055+0000","last_change":"2024-09-14T11:14:14.162000+0000","last_active":"2024-09-14T11:55:42.738055+0000","last_peered":"2024-09-14T11:55:42.738055+0000","last_clean":"2024-09-14T11:55:42.738055+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:55:42.738055+0000","last_undegraded":"2024-09-14T11:55:42.738055+0000","last_fullsized":"2024-09-14T11:55:42.738055+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'419","reported_seq":2018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.546724+0000","last_change":"2024-09-14T11:14:06.123837+0000","last_active":"2024-09-14T11:54:08.546724+0000","last_peered":"2024-09-14T11:54:08.546724+0000","last_clean":"2024-09-14T11:54:08.546724+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:54:08.546724+0000","last_undegraded":"2024-09-14T11:54:08.546724+0000","last_fullsized":"2024-09-14T11:54:08.546724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:37.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'336","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874282+0000","last_change":"2024-09-14T11:14:04.131548+0000","last_active":"2024-09-14T11:56:14.874282+0000","last_peered":"2024-09-14T11:56:14.874282+0000","last_clean":"2024-09-14T11:56:14.874282+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:14.874282+0000","last_undegraded":"2024-09-14T11:56:14.874282+0000","last_fullsized":"2024-09-14T11:56:14.874282+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.843269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020451,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":527,"num_read_kb":46731,"num_write":1083,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.886602+0000","last_change":"2024-09-14T11:14:08.137590+0000","last_active":"2024-09-14T11:51:39.886602+0000","last_peered":"2024-09-14T11:51:39.886602+0000","last_clean":"2024-09-14T11:51:39.886602+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:51:39.886602+0000","last_undegraded":"2024-09-14T11:51:39.886602+0000","last_fullsized":"2024-09-14T11:51:39.886602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:47.658963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'81","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.853482+0000","last_change":"2024-09-14T11:14:10.148590+0000","last_active":"2024-09-14T11:54:18.853482+0000","last_peered":"2024-09-14T11:54:18.853482+0000","last_clean":"2024-09-14T11:54:18.853482+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:54:18.853482+0000","last_undegraded":"2024-09-14T11:54:18.853482+0000","last_fullsized":"2024-09-14T11:54:18.853482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:10.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.741161+0000","last_change":"2024-09-14T11:14:12.152664+0000","last_active":"2024-09-14T11:56:13.741161+0000","last_peered":"2024-09-14T11:56:13.741161+0000","last_clean":"2024-09-14T11:56:13.741161+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:13.741161+0000","last_undegraded":"2024-09-14T11:56:13.741161+0000","last_fullsized":"2024-09-14T11:56:13.741161+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:48.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":602,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.739702+0000","last_change":"2024-09-14T11:14:14.162036+0000","last_active":"2024-09-14T11:55:42.739702+0000","last_peered":"2024-09-14T11:55:42.739702+0000","last_clean":"2024-09-14T11:55:42.739702+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:55:42.739702+0000","last_undegraded":"2024-09-14T11:55:42.739702+0000","last_fullsized":"2024-09-14T11:55:42.739702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.951880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'913","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622796+0000","last_change":"2024-09-14T11:14:06.120190+0000","last_active":"2024-09-14T11:55:41.622796+0000","last_peered":"2024-09-14T11:55:41.622796+0000","last_clean":"2024-09-14T11:55:41.622796+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:55:41.622796+0000","last_undegraded":"2024-09-14T11:55:41.622796+0000","last_fullsized":"2024-09-14T11:55:41.622796+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:35.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.196694+0000","last_change":"2024-09-14T11:14:04.123412+0000","last_active":"2024-09-14T11:52:56.196694+0000","last_peered":"2024-09-14T11:52:56.196694+0000","last_clean":"2024-09-14T11:52:56.196694+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:52:56.196694+0000","last_undegraded":"2024-09-14T11:52:56.196694+0000","last_fullsized":"2024-09-14T11:52:56.196694+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.337185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":355102,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":456,"num_read_kb":14579,"num_write":991,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.774628+0000","last_change":"2024-09-14T11:14:08.138426+0000","last_active":"2024-09-14T11:51:39.774628+0000","last_peered":"2024-09-14T11:51:39.774628+0000","last_clean":"2024-09-14T11:51:39.774628+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:51:39.774628+0000","last_undegraded":"2024-09-14T11:51:39.774628+0000","last_fullsized":"2024-09-14T11:51:39.774628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:56.436534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'293","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:16.053262+0000","last_change":"2024-09-14T11:14:10.149256+0000","last_active":"2024-09-14T11:55:16.053262+0000","last_peered":"2024-09-14T11:55:16.053262+0000","last_clean":"2024-09-14T11:55:16.053262+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:55:16.053262+0000","last_undegraded":"2024-09-14T11:55:16.053262+0000","last_fullsized":"2024-09-14T11:55:16.053262+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:47.592442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56966,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":484,"num_read_kb":971,"num_write":398,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896607+0000","last_change":"2024-09-14T11:14:12.150595+0000","last_active":"2024-09-14T11:52:54.896607+0000","last_peered":"2024-09-14T11:52:54.896607+0000","last_clean":"2024-09-14T11:52:54.896607+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:52:54.896607+0000","last_undegraded":"2024-09-14T11:52:54.896607+0000","last_fullsized":"2024-09-14T11:52:54.896607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:47.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.835967+0000","last_change":"2024-09-14T11:14:14.159475+0000","last_active":"2024-09-14T11:53:58.835967+0000","last_peered":"2024-09-14T11:53:58.835967+0000","last_clean":"2024-09-14T11:53:58.835967+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:53:58.835967+0000","last_undegraded":"2024-09-14T11:53:58.835967+0000","last_fullsized":"2024-09-14T11:53:58.835967+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:45.105897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.456474+0000","last_change":"2024-09-14T11:14:06.120205+0000","last_active":"2024-09-14T11:54:24.456474+0000","last_peered":"2024-09-14T11:54:24.456474+0000","last_clean":"2024-09-14T11:54:24.456474+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:54:24.456474+0000","last_undegraded":"2024-09-14T11:54:24.456474+0000","last_fullsized":"2024-09-14T11:54:24.456474+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:27.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'305","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.671899+0000","last_change":"2024-09-14T11:14:04.127561+0000","last_active":"2024-09-14T11:54:09.671899+0000","last_peered":"2024-09-14T11:54:09.671899+0000","last_clean":"2024-09-14T11:54:09.671899+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:54:09.671899+0000","last_undegraded":"2024-09-14T11:54:09.671899+0000","last_fullsized":"2024-09-14T11:54:09.671899+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:28.538642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10816046,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":634,"num_read_kb":130241,"num_write":1125,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.021483+0000","last_change":"2024-09-14T11:14:08.133404+0000","last_active":"2024-09-14T11:51:41.021483+0000","last_peered":"2024-09-14T11:51:41.021483+0000","last_clean":"2024-09-14T11:51:41.021483+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:51:41.021483+0000","last_undegraded":"2024-09-14T11:51:41.021483+0000","last_fullsized":"2024-09-14T11:51:41.021483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.597866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'259","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.703138+0000","last_change":"2024-09-14T11:14:10.152035+0000","last_active":"2024-09-14T11:55:42.703138+0000","last_peered":"2024-09-14T11:55:42.703138+0000","last_clean":"2024-09-14T11:55:42.703138+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:55:42.703138+0000","last_undegraded":"2024-09-14T11:55:42.703138+0000","last_fullsized":"2024-09-14T11:55:42.703138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.459789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52410,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":861,"num_write":338,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.785014+0000","last_change":"2024-09-14T11:14:12.151730+0000","last_active":"2024-09-14T11:53:05.785014+0000","last_peered":"2024-09-14T11:53:05.785014+0000","last_clean":"2024-09-14T11:53:05.785014+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:53:05.785014+0000","last_undegraded":"2024-09-14T11:53:05.785014+0000","last_fullsized":"2024-09-14T11:53:05.785014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:44.746381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'326","reported_seq":1757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.782919+0000","last_change":"2024-09-14T11:14:06.118920+0000","last_active":"2024-09-14T11:54:07.782919+0000","last_peered":"2024-09-14T11:54:07.782919+0000","last_clean":"2024-09-14T11:54:07.782919+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:54:07.782919+0000","last_undegraded":"2024-09-14T11:54:07.782919+0000","last_fullsized":"2024-09-14T11:54:07.782919+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:18.730208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'332","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.859521+0000","last_change":"2024-09-14T11:14:04.123599+0000","last_active":"2024-09-14T11:56:14.859521+0000","last_peered":"2024-09-14T11:56:14.859521+0000","last_clean":"2024-09-14T11:56:14.859521+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:14.859521+0000","last_undegraded":"2024-09-14T11:56:14.859521+0000","last_fullsized":"2024-09-14T11:56:14.859521+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.290130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27602,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":552,"num_read_kb":1005,"num_write":1003,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.782950+0000","last_change":"2024-09-14T11:14:08.137705+0000","last_active":"2024-09-14T11:52:50.782950+0000","last_peered":"2024-09-14T11:52:50.782950+0000","last_clean":"2024-09-14T11:52:50.782950+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:52:50.782950+0000","last_undegraded":"2024-09-14T11:52:50.782950+0000","last_fullsized":"2024-09-14T11:52:50.782950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:21.751164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'227","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.785868+0000","last_change":"2024-09-14T11:14:10.155049+0000","last_active":"2024-09-14T11:56:14.785868+0000","last_peered":"2024-09-14T11:56:14.785868+0000","last_clean":"2024-09-14T11:56:14.785868+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:14.785868+0000","last_undegraded":"2024-09-14T11:56:14.785868+0000","last_fullsized":"2024-09-14T11:56:14.785868+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.366018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.775077+0000","last_change":"2024-09-14T11:14:12.150674+0000","last_active":"2024-09-14T11:51:45.775077+0000","last_peered":"2024-09-14T11:51:45.775077+0000","last_clean":"2024-09-14T11:51:45.775077+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:51:45.775077+0000","last_undegraded":"2024-09-14T11:51:45.775077+0000","last_fullsized":"2024-09-14T11:51:45.775077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:49.433914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'147","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.024834+0000","last_change":"2024-09-14T11:14:14.161497+0000","last_active":"2024-09-14T11:54:25.024834+0000","last_peered":"2024-09-14T11:54:25.024834+0000","last_clean":"2024-09-14T11:54:25.024834+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:54:25.024834+0000","last_undegraded":"2024-09-14T11:54:25.024834+0000","last_fullsized":"2024-09-14T11:54:25.024834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:34.625158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2254,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.547132+0000","last_change":"2024-09-14T11:14:06.130562+0000","last_active":"2024-09-14T11:54:26.547132+0000","last_peered":"2024-09-14T11:54:26.547132+0000","last_clean":"2024-09-14T11:54:26.547132+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:54:26.547132+0000","last_undegraded":"2024-09-14T11:54:26.547132+0000","last_fullsized":"2024-09-14T11:54:26.547132+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:50.157895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'315","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.863491+0000","last_change":"2024-09-14T11:14:04.128727+0000","last_active":"2024-09-14T11:56:14.863491+0000","last_peered":"2024-09-14T11:56:14.863491+0000","last_clean":"2024-09-14T11:56:14.863491+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:14.863491+0000","last_undegraded":"2024-09-14T11:56:14.863491+0000","last_fullsized":"2024-09-14T11:56:14.863491+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.665738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975596,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":653,"num_read_kb":5062,"num_write":1054,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895731+0000","last_change":"2024-09-14T11:14:08.134254+0000","last_active":"2024-09-14T11:52:54.895731+0000","last_peered":"2024-09-14T11:52:54.895731+0000","last_clean":"2024-09-14T11:52:54.895731+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:52:54.895731+0000","last_undegraded":"2024-09-14T11:52:54.895731+0000","last_fullsized":"2024-09-14T11:52:54.895731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:52.559637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'315","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.965179+0000","last_change":"2024-09-14T11:14:10.151521+0000","last_active":"2024-09-14T11:56:14.965179+0000","last_peered":"2024-09-14T11:56:14.965179+0000","last_clean":"2024-09-14T11:56:14.965179+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:14.965179+0000","last_undegraded":"2024-09-14T11:56:14.965179+0000","last_fullsized":"2024-09-14T11:56:14.965179+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:57.363193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.888499+0000","last_change":"2024-09-14T11:14:12.152149+0000","last_active":"2024-09-14T11:51:44.888499+0000","last_peered":"2024-09-14T11:51:44.888499+0000","last_clean":"2024-09-14T11:51:44.888499+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:51:44.888499+0000","last_undegraded":"2024-09-14T11:51:44.888499+0000","last_fullsized":"2024-09-14T11:51:44.888499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.701102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'114","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.619651+0000","last_change":"2024-09-14T11:14:14.160202+0000","last_active":"2024-09-14T11:55:41.619651+0000","last_peered":"2024-09-14T11:55:41.619651+0000","last_clean":"2024-09-14T11:55:41.619651+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:55:41.619651+0000","last_undegraded":"2024-09-14T11:55:41.619651+0000","last_fullsized":"2024-09-14T11:55:41.619651+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:39.404108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'433","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935365+0000","last_change":"2024-09-14T11:14:06.130413+0000","last_active":"2024-09-14T11:54:09.935365+0000","last_peered":"2024-09-14T11:54:09.935365+0000","last_clean":"2024-09-14T11:54:09.935365+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:54:09.935365+0000","last_undegraded":"2024-09-14T11:54:09.935365+0000","last_fullsized":"2024-09-14T11:54:09.935365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:11.813244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633603+0000","last_change":"2024-09-14T11:14:04.137347+0000","last_active":"2024-09-14T11:56:15.633603+0000","last_peered":"2024-09-14T11:56:15.633603+0000","last_clean":"2024-09-14T11:56:15.633603+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:15.633603+0000","last_undegraded":"2024-09-14T11:56:15.633603+0000","last_fullsized":"2024-09-14T11:56:15.633603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:12.340493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'537","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540930+0000","last_change":"2024-09-14T11:14:06.127358+0000","last_active":"2024-09-14T11:54:04.540930+0000","last_peered":"2024-09-14T11:54:04.540930+0000","last_clean":"2024-09-14T11:54:04.540930+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:54:04.540930+0000","last_undegraded":"2024-09-14T11:54:04.540930+0000","last_fullsized":"2024-09-14T11:54:04.540930+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.425756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'341","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.712479+0000","last_change":"2024-09-14T11:14:04.118653+0000","last_active":"2024-09-14T11:56:14.712479+0000","last_peered":"2024-09-14T11:56:14.712479+0000","last_clean":"2024-09-14T11:56:14.712479+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:14.712479+0000","last_undegraded":"2024-09-14T11:56:14.712479+0000","last_fullsized":"2024-09-14T11:56:14.712479+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:13.808933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3533357,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":540,"num_read_kb":5548,"num_write":1089,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1188","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462084+0000","last_change":"2024-09-14T11:14:06.123772+0000","last_active":"2024-09-14T11:54:24.462084+0000","last_peered":"2024-09-14T11:54:24.462084+0000","last_clean":"2024-09-14T11:54:24.462084+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:54:24.462084+0000","last_undegraded":"2024-09-14T11:54:24.462084+0000","last_fullsized":"2024-09-14T11:54:24.462084+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:26.689879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.038968+0000","last_change":"2024-09-14T11:14:04.124321+0000","last_active":"2024-09-14T11:53:41.038968+0000","last_peered":"2024-09-14T11:53:41.038968+0000","last_clean":"2024-09-14T11:53:41.038968+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:53:41.038968+0000","last_undegraded":"2024-09-14T11:53:41.038968+0000","last_fullsized":"2024-09-14T11:53:41.038968+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:47.955033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22827244,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":722,"num_read_kb":86471,"num_write":1283,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'459","reported_seq":2193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262421+0000","last_change":"2024-09-14T11:14:06.124181+0000","last_active":"2024-09-14T11:54:09.262421+0000","last_peered":"2024-09-14T11:54:09.262421+0000","last_clean":"2024-09-14T11:54:09.262421+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:54:09.262421+0000","last_undegraded":"2024-09-14T11:54:09.262421+0000","last_fullsized":"2024-09-14T11:54:09.262421+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:13.371439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.900742+0000","last_change":"2024-09-14T11:14:04.123362+0000","last_active":"2024-09-14T11:56:14.900742+0000","last_peered":"2024-09-14T11:56:14.900742+0000","last_clean":"2024-09-14T11:56:14.900742+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:14.900742+0000","last_undegraded":"2024-09-14T11:56:14.900742+0000","last_fullsized":"2024-09-14T11:56:14.900742+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.168395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3656166,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":583,"num_read_kb":9527,"num_write":1057,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'417","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261739+0000","last_change":"2024-09-14T11:14:06.128550+0000","last_active":"2024-09-14T11:54:09.261739+0000","last_peered":"2024-09-14T11:54:09.261739+0000","last_clean":"2024-09-14T11:54:09.261739+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:54:09.261739+0000","last_undegraded":"2024-09-14T11:54:09.261739+0000","last_fullsized":"2024-09-14T11:54:09.261739+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:02.461046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'313","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.875272+0000","last_change":"2024-09-14T11:14:04.122779+0000","last_active":"2024-09-14T11:56:14.875272+0000","last_peered":"2024-09-14T11:56:14.875272+0000","last_clean":"2024-09-14T11:56:14.875272+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:14.875272+0000","last_undegraded":"2024-09-14T11:56:14.875272+0000","last_fullsized":"2024-09-14T11:56:14.875272+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:12.163971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656073,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":626,"num_read_kb":10971,"num_write":1133,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'779","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540032+0000","last_change":"2024-09-14T11:14:06.130234+0000","last_active":"2024-09-14T11:54:04.540032+0000","last_peered":"2024-09-14T11:54:04.540032+0000","last_clean":"2024-09-14T11:54:04.540032+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:54:04.540032+0000","last_undegraded":"2024-09-14T11:54:04.540032+0000","last_fullsized":"2024-09-14T11:54:04.540032+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:46.526972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'379","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879373+0000","last_change":"2024-09-14T11:14:04.112512+0000","last_active":"2024-09-14T11:56:14.879373+0000","last_peered":"2024-09-14T11:56:14.879373+0000","last_clean":"2024-09-14T11:56:14.879373+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:14.879373+0000","last_undegraded":"2024-09-14T11:56:14.879373+0000","last_fullsized":"2024-09-14T11:56:14.879373+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:27.221991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984864,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":934,"num_read_kb":11029,"num_write":1159,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'408","reported_seq":1927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546902+0000","last_change":"2024-09-14T11:14:06.116873+0000","last_active":"2024-09-14T11:54:26.546902+0000","last_peered":"2024-09-14T11:54:26.546902+0000","last_clean":"2024-09-14T11:54:26.546902+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:54:26.546902+0000","last_undegraded":"2024-09-14T11:54:26.546902+0000","last_fullsized":"2024-09-14T11:54:26.546902+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.999726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'373","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751186+0000","last_change":"2024-09-14T11:14:38.342285+0000","last_active":"2024-09-14T11:56:14.751186+0000","last_peered":"2024-09-14T11:56:14.751186+0000","last_clean":"2024-09-14T11:56:14.751186+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:14.751186+0000","last_undegraded":"2024-09-14T11:56:14.751186+0000","last_fullsized":"2024-09-14T11:56:14.751186+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:29.747736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":944,"num_read_kb":685,"num_write":1212,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'542","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.934942+0000","last_change":"2024-09-14T11:14:06.129076+0000","last_active":"2024-09-14T11:54:09.934942+0000","last_peered":"2024-09-14T11:54:09.934942+0000","last_clean":"2024-09-14T11:54:09.934942+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:54:09.934942+0000","last_undegraded":"2024-09-14T11:54:09.934942+0000","last_fullsized":"2024-09-14T11:54:09.934942+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:59.804760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'282","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.865575+0000","last_change":"2024-09-14T11:14:04.136228+0000","last_active":"2024-09-14T11:56:14.865575+0000","last_peered":"2024-09-14T11:56:14.865575+0000","last_clean":"2024-09-14T11:56:14.865575+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:14.865575+0000","last_undegraded":"2024-09-14T11:56:14.865575+0000","last_fullsized":"2024-09-14T11:56:14.865575+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:56.091790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":899,"num_read_kb":80980,"num_write":993,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'485","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630227+0000","last_change":"2024-09-14T11:14:06.134085+0000","last_active":"2024-09-14T11:55:41.630227+0000","last_peered":"2024-09-14T11:55:41.630227+0000","last_clean":"2024-09-14T11:55:41.630227+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:55:41.630227+0000","last_undegraded":"2024-09-14T11:55:41.630227+0000","last_fullsized":"2024-09-14T11:55:41.630227+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:23.324462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'275","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.175748+0000","last_change":"2024-09-14T11:14:04.120745+0000","last_active":"2024-09-14T11:54:01.175748+0000","last_peered":"2024-09-14T11:54:01.175748+0000","last_clean":"2024-09-14T11:54:01.175748+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:54:01.175748+0000","last_undegraded":"2024-09-14T11:54:01.175748+0000","last_fullsized":"2024-09-14T11:54:01.175748+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.093196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266315,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":591,"num_read_kb":85641,"num_write":923,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'419","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935731+0000","last_change":"2024-09-14T11:14:06.121086+0000","last_active":"2024-09-14T11:54:09.935731+0000","last_peered":"2024-09-14T11:54:09.935731+0000","last_clean":"2024-09-14T11:54:09.935731+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:54:09.935731+0000","last_undegraded":"2024-09-14T11:54:09.935731+0000","last_fullsized":"2024-09-14T11:54:09.935731+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:36.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'346","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.883516+0000","last_change":"2024-09-14T11:14:04.118390+0000","last_active":"2024-09-14T11:56:14.883516+0000","last_peered":"2024-09-14T11:56:14.883516+0000","last_clean":"2024-09-14T11:56:14.883516+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:14.883516+0000","last_undegraded":"2024-09-14T11:56:14.883516+0000","last_fullsized":"2024-09-14T11:56:14.883516+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:49.436222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31120,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":552,"num_read_kb":30121,"num_write":1016,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'413","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725240+0000","last_change":"2024-09-14T11:14:06.132235+0000","last_active":"2024-09-14T11:54:06.725240+0000","last_peered":"2024-09-14T11:54:06.725240+0000","last_clean":"2024-09-14T11:54:06.725240+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:54:06.725240+0000","last_undegraded":"2024-09-14T11:54:06.725240+0000","last_fullsized":"2024-09-14T11:54:06.725240+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:50.899051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'267","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.954998+0000","last_change":"2024-09-14T11:14:04.131711+0000","last_active":"2024-09-14T11:52:56.954998+0000","last_peered":"2024-09-14T11:52:56.954998+0000","last_clean":"2024-09-14T11:52:56.954998+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:52:56.954998+0000","last_undegraded":"2024-09-14T11:52:56.954998+0000","last_fullsized":"2024-09-14T11:52:56.954998+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:26.386858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10537395,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":542,"num_read_kb":61948,"num_write":971,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'815","reported_seq":2398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114472+0000","last_change":"2024-09-14T11:14:06.130289+0000","last_active":"2024-09-14T11:54:27.114472+0000","last_peered":"2024-09-14T11:54:27.114472+0000","last_clean":"2024-09-14T11:54:27.114472+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:54:27.114472+0000","last_undegraded":"2024-09-14T11:54:27.114472+0000","last_fullsized":"2024-09-14T11:54:27.114472+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:55.217977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'274","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897119+0000","last_change":"2024-09-14T11:14:04.137105+0000","last_active":"2024-09-14T11:56:14.897119+0000","last_peered":"2024-09-14T11:56:14.897119+0000","last_clean":"2024-09-14T11:56:14.897119+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:14.897119+0000","last_undegraded":"2024-09-14T11:56:14.897119+0000","last_fullsized":"2024-09-14T11:56:14.897119+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:13.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6928313,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":385,"num_read_kb":33889,"num_write":863,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'381","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.621727+0000","last_change":"2024-09-14T11:14:06.130068+0000","last_active":"2024-09-14T11:55:41.621727+0000","last_peered":"2024-09-14T11:55:41.621727+0000","last_clean":"2024-09-14T11:55:41.621727+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:55:41.621727+0000","last_undegraded":"2024-09-14T11:55:41.621727+0000","last_fullsized":"2024-09-14T11:55:41.621727+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:39.243281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.620139+0000","last_change":"2024-09-14T11:14:38.195137+0000","last_active":"2024-09-14T11:56:15.620139+0000","last_peered":"2024-09-14T11:56:15.620139+0000","last_clean":"2024-09-14T11:56:15.620139+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:15.620139+0000","last_undegraded":"2024-09-14T11:56:15.620139+0000","last_fullsized":"2024-09-14T11:56:15.620139+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:31.310723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546426+0000","last_change":"2024-09-14T11:14:06.125029+0000","last_active":"2024-09-14T11:54:26.546426+0000","last_peered":"2024-09-14T11:54:26.546426+0000","last_clean":"2024-09-14T11:54:26.546426+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:54:26.546426+0000","last_undegraded":"2024-09-14T11:54:26.546426+0000","last_fullsized":"2024-09-14T11:54:26.546426+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:21.648012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'460","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.755808+0000","last_change":"2024-09-14T11:14:04.136230+0000","last_active":"2024-09-14T11:56:14.755808+0000","last_peered":"2024-09-14T11:56:14.755808+0000","last_clean":"2024-09-14T11:56:14.755808+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:14.755808+0000","last_undegraded":"2024-09-14T11:56:14.755808+0000","last_fullsized":"2024-09-14T11:56:14.755808+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246530,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1141,"num_read_kb":1914,"num_write":1383,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'474","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783207+0000","last_change":"2024-09-14T11:14:06.128570+0000","last_active":"2024-09-14T11:54:07.783207+0000","last_peered":"2024-09-14T11:54:07.783207+0000","last_clean":"2024-09-14T11:54:07.783207+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:54:07.783207+0000","last_undegraded":"2024-09-14T11:54:07.783207+0000","last_fullsized":"2024-09-14T11:54:07.783207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751883+0000","last_change":"2024-09-14T11:14:04.117766+0000","last_active":"2024-09-14T11:56:14.751883+0000","last_peered":"2024-09-14T11:56:14.751883+0000","last_clean":"2024-09-14T11:56:14.751883+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:14.751883+0000","last_undegraded":"2024-09-14T11:56:14.751883+0000","last_fullsized":"2024-09-14T11:56:14.751883+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:32.550269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8013749,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":531,"num_read_kb":47806,"num_write":1050,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'444","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725116+0000","last_change":"2024-09-14T11:14:06.124232+0000","last_active":"2024-09-14T11:54:06.725116+0000","last_peered":"2024-09-14T11:54:06.725116+0000","last_clean":"2024-09-14T11:54:06.725116+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:54:06.725116+0000","last_undegraded":"2024-09-14T11:54:06.725116+0000","last_fullsized":"2024-09-14T11:54:06.725116+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:46.127557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'280","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.512020+0000","last_change":"2024-09-14T11:14:04.128834+0000","last_active":"2024-09-14T11:53:56.512020+0000","last_peered":"2024-09-14T11:53:56.512020+0000","last_clean":"2024-09-14T11:53:56.512020+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:53:56.512020+0000","last_undegraded":"2024-09-14T11:53:56.512020+0000","last_fullsized":"2024-09-14T11:53:56.512020+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:37.995845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28806777,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":627,"num_read_kb":86520,"num_write":1108,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'279","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039733+0000","last_change":"2024-09-14T11:14:38.193534+0000","last_active":"2024-09-14T11:53:46.039733+0000","last_peered":"2024-09-14T11:53:46.039733+0000","last_clean":"2024-09-14T11:53:46.039733+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:53:46.039733+0000","last_undegraded":"2024-09-14T11:53:46.039733+0000","last_fullsized":"2024-09-14T11:53:46.039733+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.503196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9606194,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":490,"num_read_kb":20028,"num_write":994,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'499","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461479+0000","last_change":"2024-09-14T11:14:06.134114+0000","last_active":"2024-09-14T11:54:24.461479+0000","last_peered":"2024-09-14T11:54:24.461479+0000","last_clean":"2024-09-14T11:54:24.461479+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:54:24.461479+0000","last_undegraded":"2024-09-14T11:54:24.461479+0000","last_fullsized":"2024-09-14T11:54:24.461479+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:15.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'332","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.818324+0000","last_change":"2024-09-14T11:14:04.121552+0000","last_active":"2024-09-14T11:56:14.818324+0000","last_peered":"2024-09-14T11:56:14.818324+0000","last_clean":"2024-09-14T11:56:14.818324+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:14.818324+0000","last_undegraded":"2024-09-14T11:56:14.818324+0000","last_fullsized":"2024-09-14T11:56:14.818324+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704768,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":667,"num_read_kb":183365,"num_write":1166,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546904+0000","last_change":"2024-09-14T11:14:06.130886+0000","last_active":"2024-09-14T11:54:26.546904+0000","last_peered":"2024-09-14T11:54:26.546904+0000","last_clean":"2024-09-14T11:54:26.546904+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:54:26.546904+0000","last_undegraded":"2024-09-14T11:54:26.546904+0000","last_fullsized":"2024-09-14T11:54:26.546904+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:55.595674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":623,"ondisk_log_size":623,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1751706,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17281,"num_read_kb":35094,"num_write":14573,"num_write_kb":11683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1736704,"data_stored":1339267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2007,"ondisk_log_size":2007,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2408,"num_read_kb":2871,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3689,"ondisk_log_size":3689,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":312077430,"num_objects":2146,"num_object_clones":0,"num_object_copies":6438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2146,"num_whiteouts":0,"num_read":42168,"num_read_kb":2244652,"num_write":70766,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":383938560,"data_stored":383938560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3690,"ondisk_log_size":3690,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":32505856,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":174309,"num_write":148,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68157440,"data_stored":68157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":32597625,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":121,"num_read_kb":174255,"num_write":143,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59904000,"data_stored":59900746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509955,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318188,"kb_used_data":62004,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94053652,"statfs":{"total":96636764160,"available":96310939648,"internally_reserved":0,"allocated":63492096,"data_stored":61539547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509955,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300512,"kb_used_data":138896,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94071328,"statfs":{"total":96636764160,"available":96329039872,"internally_reserved":0,"allocated":142229504,"data_stored":140164901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509954,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542658,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388084,"kb_used_data":103936,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93983756,"statfs":{"total":96636764160,"available":96239366144,"internally_reserved":0,"allocated":106430464,"data_stored":104414681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542661,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":119312,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":122175488,"data_stored":120173426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542659,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202848,"kb_used_data":109148,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94168992,"statfs":{"total":96636764160,"available":96429047808,"internally_reserved":0,"allocated":111767552,"data_stored":109843385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542658,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316596,"kb_used_data":150816,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94055244,"statfs":{"total":96636764160,"available":96312569856,"internally_reserved":0,"allocated":154435584,"data_stored":152440708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542657,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347636,"kb_used_data":95580,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94024204,"statfs":{"total":96636764160,"available":96280784896,"internally_reserved":0,"allocated":97873920,"data_stored":95880257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60837888,"data_stored":60837888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39305216,"data_stored":39305216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28925952,"data_stored":28925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":56725504,"data_stored":56725504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":123715584,"data_stored":123715584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60817408,"data_stored":60817408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":129533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":248005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":173177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":663552,"data_stored":556965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":187067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":8437031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5246976,"data_stored":5246081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:56:17.684 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:56:18.004 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:18.017 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:56:18.020 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1533,"stamp":"2024-09-14T11:56:17.915099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":253903219,"num_objects":1842,"num_object_clones":0,"num_object_copies":5052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":309079,"num_read_kb":2857147,"num_write":162521,"num_write_kb":2485827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12671,"ondisk_log_size":12671,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2238488,"kb_used_data":665272,"kb_used_omap":12,"kb_used_meta":1572211,"kb_avail":752736232,"statfs":{"total":773094113280,"available":770801901568,"internally_reserved":0,"allocated":681238528,"data_stored":665432954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1609944624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-478967205,"num_objects":-2991,"num_object_clones":0,"num_object_copies":-8951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2991,"num_whiteouts":0,"num_read":3349,"num_read_kb":2962,"num_write":3177,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005313"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039779+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:53:46.039779+0000","last_peered":"2024-09-14T11:53:46.039779+0000","last_clean":"2024-09-14T11:53:46.039779+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:53:46.039779+0000","last_undegraded":"2024-09-14T11:53:46.039779+0000","last_fullsized":"2024-09-14T11:53:46.039779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:51.058211+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:55:51.058211+0000","last_peered":"2024-09-14T11:55:51.058211+0000","last_clean":"2024-09-14T11:55:51.058211+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:55:51.058211+0000","last_undegraded":"2024-09-14T11:55:51.058211+0000","last_fullsized":"2024-09-14T11:55:51.058211+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.763337+0000","last_change":"2024-09-14T11:41:15.877777+0000","last_active":"2024-09-14T11:51:19.763337+0000","last_peered":"2024-09-14T11:51:19.763337+0000","last_clean":"2024-09-14T11:51:19.763337+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:51:19.763337+0000","last_undegraded":"2024-09-14T11:51:19.763337+0000","last_fullsized":"2024-09-14T11:51:19.763337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.018964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.917468+0000","last_change":"2024-09-14T11:30:44.720933+0000","last_active":"2024-09-14T11:55:44.917468+0000","last_peered":"2024-09-14T11:55:44.917468+0000","last_clean":"2024-09-14T11:55:44.917468+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:55:44.917468+0000","last_undegraded":"2024-09-14T11:55:44.917468+0000","last_fullsized":"2024-09-14T11:55:44.917468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:46.706797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777983+0000","last_change":"2024-09-14T11:29:10.325552+0000","last_active":"2024-09-14T11:53:14.777983+0000","last_peered":"2024-09-14T11:53:14.777983+0000","last_clean":"2024-09-14T11:53:14.777983+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:53:14.777983+0000","last_undegraded":"2024-09-14T11:53:14.777983+0000","last_fullsized":"2024-09-14T11:53:14.777983+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:26.043474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.787081+0000","last_change":"2024-09-14T11:41:15.870239+0000","last_active":"2024-09-14T11:53:20.787081+0000","last_peered":"2024-09-14T11:53:20.787081+0000","last_clean":"2024-09-14T11:53:20.787081+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:53:20.787081+0000","last_undegraded":"2024-09-14T11:53:20.787081+0000","last_fullsized":"2024-09-14T11:53:20.787081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:07.125369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902783+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:53:44.902783+0000","last_peered":"2024-09-14T11:53:44.902783+0000","last_clean":"2024-09-14T11:53:44.902783+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:53:44.902783+0000","last_undegraded":"2024-09-14T11:53:44.902783+0000","last_fullsized":"2024-09-14T11:53:44.902783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.774451+0000","last_change":"2024-09-14T11:30:44.718407+0000","last_active":"2024-09-14T11:52:49.774451+0000","last_peered":"2024-09-14T11:52:49.774451+0000","last_clean":"2024-09-14T11:52:49.774451+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:52:49.774451+0000","last_undegraded":"2024-09-14T11:52:49.774451+0000","last_fullsized":"2024-09-14T11:52:49.774451+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:51.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.075756+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:53:31.075756+0000","last_peered":"2024-09-14T11:53:31.075756+0000","last_clean":"2024-09-14T11:53:31.075756+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:53:31.075756+0000","last_undegraded":"2024-09-14T11:53:31.075756+0000","last_fullsized":"2024-09-14T11:53:31.075756+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:51.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896093+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:52:54.896093+0000","last_peered":"2024-09-14T11:52:54.896093+0000","last_clean":"2024-09-14T11:52:54.896093+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:52:54.896093+0000","last_undegraded":"2024-09-14T11:52:54.896093+0000","last_fullsized":"2024-09-14T11:52:54.896093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:47.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.884913+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:51:39.884913+0000","last_peered":"2024-09-14T11:51:39.884913+0000","last_clean":"2024-09-14T11:51:39.884913+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:51:39.884913+0000","last_undegraded":"2024-09-14T11:51:39.884913+0000","last_fullsized":"2024-09-14T11:51:39.884913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:06.934022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.328043+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:52:32.328043+0000","last_peered":"2024-09-14T11:52:32.328043+0000","last_clean":"2024-09-14T11:52:32.328043+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:52:32.328043+0000","last_undegraded":"2024-09-14T11:52:32.328043+0000","last_fullsized":"2024-09-14T11:52:32.328043+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.704261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.780910+0000","last_change":"2024-09-14T11:30:47.742222+0000","last_active":"2024-09-14T11:52:35.780910+0000","last_peered":"2024-09-14T11:52:35.780910+0000","last_clean":"2024-09-14T11:52:35.780910+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:52:35.780910+0000","last_undegraded":"2024-09-14T11:52:35.780910+0000","last_fullsized":"2024-09-14T11:52:35.780910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:53.632539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.773815+0000","last_change":"2024-09-14T11:29:10.322697+0000","last_active":"2024-09-14T11:51:40.773815+0000","last_peered":"2024-09-14T11:51:40.773815+0000","last_clean":"2024-09-14T11:51:40.773815+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:51:40.773815+0000","last_undegraded":"2024-09-14T11:51:40.773815+0000","last_fullsized":"2024-09-14T11:51:40.773815+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.258272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771084+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:51:19.771084+0000","last_peered":"2024-09-14T11:51:19.771084+0000","last_clean":"2024-09-14T11:51:19.771084+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:51:19.771084+0000","last_undegraded":"2024-09-14T11:51:19.771084+0000","last_fullsized":"2024-09-14T11:51:19.771084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.063452+0000","last_change":"2024-09-14T11:30:47.735777+0000","last_active":"2024-09-14T11:56:14.063452+0000","last_peered":"2024-09-14T11:56:14.063452+0000","last_clean":"2024-09-14T11:56:14.063452+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:14.063452+0000","last_undegraded":"2024-09-14T11:56:14.063452+0000","last_fullsized":"2024-09-14T11:56:14.063452+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:09.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771151+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:51:19.771151+0000","last_peered":"2024-09-14T11:51:19.771151+0000","last_clean":"2024-09-14T11:51:19.771151+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:51:19.771151+0000","last_undegraded":"2024-09-14T11:51:19.771151+0000","last_fullsized":"2024-09-14T11:51:19.771151+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918751+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:55:49.918751+0000","last_peered":"2024-09-14T11:55:49.918751+0000","last_clean":"2024-09-14T11:55:49.918751+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:55:49.918751+0000","last_undegraded":"2024-09-14T11:55:49.918751+0000","last_fullsized":"2024-09-14T11:55:49.918751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17456,"num_write":12,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899090+0000","last_change":"2024-09-14T11:29:10.322726+0000","last_active":"2024-09-14T11:53:19.899090+0000","last_peered":"2024-09-14T11:53:19.899090+0000","last_clean":"2024-09-14T11:53:19.899090+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:53:19.899090+0000","last_undegraded":"2024-09-14T11:53:19.899090+0000","last_fullsized":"2024-09-14T11:53:19.899090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:47.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892752+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:52:34.892752+0000","last_peered":"2024-09-14T11:52:34.892752+0000","last_clean":"2024-09-14T11:52:34.892752+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:52:34.892752+0000","last_undegraded":"2024-09-14T11:52:34.892752+0000","last_fullsized":"2024-09-14T11:52:34.892752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022348+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:51:46.022348+0000","last_peered":"2024-09-14T11:51:46.022348+0000","last_clean":"2024-09-14T11:51:46.022348+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:51:46.022348+0000","last_undegraded":"2024-09-14T11:51:46.022348+0000","last_fullsized":"2024-09-14T11:51:46.022348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:09.499277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.775890+0000","last_change":"2024-09-14T11:41:15.871132+0000","last_active":"2024-09-14T11:52:59.775890+0000","last_peered":"2024-09-14T11:52:59.775890+0000","last_clean":"2024-09-14T11:52:59.775890+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:52:59.775890+0000","last_undegraded":"2024-09-14T11:52:59.775890+0000","last_fullsized":"2024-09-14T11:52:59.775890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:52.619076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.887227+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:51:54.887227+0000","last_peered":"2024-09-14T11:51:54.887227+0000","last_clean":"2024-09-14T11:51:54.887227+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:51:54.887227+0000","last_undegraded":"2024-09-14T11:51:54.887227+0000","last_fullsized":"2024-09-14T11:51:54.887227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.766752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.772338+0000","last_change":"2024-09-14T11:30:44.715477+0000","last_active":"2024-09-14T11:52:29.772338+0000","last_peered":"2024-09-14T11:52:29.772338+0000","last_clean":"2024-09-14T11:52:29.772338+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:52:29.772338+0000","last_undegraded":"2024-09-14T11:52:29.772338+0000","last_fullsized":"2024-09-14T11:52:29.772338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:47.193927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.905463+0000","last_change":"2024-09-14T11:29:10.321195+0000","last_active":"2024-09-14T11:53:26.905463+0000","last_peered":"2024-09-14T11:53:26.905463+0000","last_clean":"2024-09-14T11:53:26.905463+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:53:26.905463+0000","last_undegraded":"2024-09-14T11:53:26.905463+0000","last_fullsized":"2024-09-14T11:53:26.905463+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:38.747021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893830+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:52:29.893830+0000","last_peered":"2024-09-14T11:52:29.893830+0000","last_clean":"2024-09-14T11:52:29.893830+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:52:29.893830+0000","last_undegraded":"2024-09-14T11:52:29.893830+0000","last_fullsized":"2024-09-14T11:52:29.893830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887752+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:51:49.887752+0000","last_peered":"2024-09-14T11:51:49.887752+0000","last_clean":"2024-09-14T11:51:49.887752+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:51:49.887752+0000","last_undegraded":"2024-09-14T11:51:49.887752+0000","last_fullsized":"2024-09-14T11:51:49.887752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:48.649434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.795879+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.795879+0000","last_peered":"2024-09-14T11:56:13.795879+0000","last_clean":"2024-09-14T11:56:13.795879+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.795879+0000","last_undegraded":"2024-09-14T11:56:13.795879+0000","last_fullsized":"2024-09-14T11:56:13.795879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:13.281310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887721+0000","last_change":"2024-09-14T11:30:47.735047+0000","last_active":"2024-09-14T11:51:49.887721+0000","last_peered":"2024-09-14T11:51:49.887721+0000","last_clean":"2024-09-14T11:51:49.887721+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:51:49.887721+0000","last_undegraded":"2024-09-14T11:51:49.887721+0000","last_fullsized":"2024-09-14T11:51:49.887721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:04.517023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.904880+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:54:04.904880+0000","last_peered":"2024-09-14T11:54:04.904880+0000","last_clean":"2024-09-14T11:54:04.904880+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:54:04.904880+0000","last_undegraded":"2024-09-14T11:54:04.904880+0000","last_fullsized":"2024-09-14T11:54:04.904880+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:06.177114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.886468+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:51:49.886468+0000","last_peered":"2024-09-14T11:51:49.886468+0000","last_clean":"2024-09-14T11:51:49.886468+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:51:49.886468+0000","last_undegraded":"2024-09-14T11:51:49.886468+0000","last_fullsized":"2024-09-14T11:51:49.886468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:39.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.774516+0000","last_change":"2024-09-14T11:30:44.718710+0000","last_active":"2024-09-14T11:51:45.774516+0000","last_peered":"2024-09-14T11:51:45.774516+0000","last_clean":"2024-09-14T11:51:45.774516+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:51:45.774516+0000","last_undegraded":"2024-09-14T11:51:45.774516+0000","last_fullsized":"2024-09-14T11:51:45.774516+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:50.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.288212+0000","last_change":"2024-09-14T11:29:10.311886+0000","last_active":"2024-09-14T11:53:31.288212+0000","last_peered":"2024-09-14T11:53:31.288212+0000","last_clean":"2024-09-14T11:53:31.288212+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:53:31.288212+0000","last_undegraded":"2024-09-14T11:53:31.288212+0000","last_fullsized":"2024-09-14T11:53:31.288212+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:59.142362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794592+0000","last_change":"2024-09-14T11:30:47.739387+0000","last_active":"2024-09-14T11:54:10.794592+0000","last_peered":"2024-09-14T11:54:10.794592+0000","last_clean":"2024-09-14T11:54:10.794592+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:54:10.794592+0000","last_undegraded":"2024-09-14T11:54:10.794592+0000","last_fullsized":"2024-09-14T11:54:10.794592+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022300+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:51:46.022300+0000","last_peered":"2024-09-14T11:51:46.022300+0000","last_clean":"2024-09-14T11:51:46.022300+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:51:46.022300+0000","last_undegraded":"2024-09-14T11:51:46.022300+0000","last_fullsized":"2024-09-14T11:51:46.022300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:44.955288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.770544+0000","last_change":"2024-09-14T11:41:15.868312+0000","last_active":"2024-09-14T11:52:14.770544+0000","last_peered":"2024-09-14T11:52:14.770544+0000","last_clean":"2024-09-14T11:52:14.770544+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:52:14.770544+0000","last_undegraded":"2024-09-14T11:52:14.770544+0000","last_fullsized":"2024-09-14T11:52:14.770544+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:13.069995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777960+0000","last_change":"2024-09-14T11:30:44.719858+0000","last_active":"2024-09-14T11:53:14.777960+0000","last_peered":"2024-09-14T11:53:14.777960+0000","last_clean":"2024-09-14T11:53:14.777960+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:53:14.777960+0000","last_undegraded":"2024-09-14T11:53:14.777960+0000","last_fullsized":"2024-09-14T11:53:14.777960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.415891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.041236+0000","last_change":"2024-09-14T11:29:10.324751+0000","last_active":"2024-09-14T11:53:56.041236+0000","last_peered":"2024-09-14T11:53:56.041236+0000","last_clean":"2024-09-14T11:53:56.041236+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:53:56.041236+0000","last_undegraded":"2024-09-14T11:53:56.041236+0000","last_fullsized":"2024-09-14T11:53:56.041236+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:56.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.777049+0000","last_change":"2024-09-14T11:41:15.865744+0000","last_active":"2024-09-14T11:52:05.777049+0000","last_peered":"2024-09-14T11:52:05.777049+0000","last_clean":"2024-09-14T11:52:05.777049+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:52:05.777049+0000","last_undegraded":"2024-09-14T11:52:05.777049+0000","last_fullsized":"2024-09-14T11:52:05.777049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:25.011776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792258+0000","last_change":"2024-09-14T11:29:10.325256+0000","last_active":"2024-09-14T11:53:55.792258+0000","last_peered":"2024-09-14T11:53:55.792258+0000","last_clean":"2024-09-14T11:53:55.792258+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:53:55.792258+0000","last_undegraded":"2024-09-14T11:53:55.792258+0000","last_fullsized":"2024-09-14T11:53:55.792258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.015196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.778952+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:52:09.778952+0000","last_peered":"2024-09-14T11:52:09.778952+0000","last_clean":"2024-09-14T11:52:09.778952+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:52:09.778952+0000","last_undegraded":"2024-09-14T11:52:09.778952+0000","last_fullsized":"2024-09-14T11:52:09.778952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:30.781685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898417+0000","last_change":"2024-09-14T11:30:44.717178+0000","last_active":"2024-09-14T11:53:14.898417+0000","last_peered":"2024-09-14T11:53:14.898417+0000","last_clean":"2024-09-14T11:53:14.898417+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:53:14.898417+0000","last_undegraded":"2024-09-14T11:53:14.898417+0000","last_fullsized":"2024-09-14T11:53:14.898417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.604554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.782090+0000","last_change":"2024-09-14T11:29:10.320629+0000","last_active":"2024-09-14T11:53:54.782090+0000","last_peered":"2024-09-14T11:53:54.782090+0000","last_clean":"2024-09-14T11:53:54.782090+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:53:54.782090+0000","last_undegraded":"2024-09-14T11:53:54.782090+0000","last_fullsized":"2024-09-14T11:53:54.782090+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:20.168734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892148+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:52:29.892148+0000","last_peered":"2024-09-14T11:52:29.892148+0000","last_clean":"2024-09-14T11:52:29.892148+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:52:29.892148+0000","last_undegraded":"2024-09-14T11:52:29.892148+0000","last_fullsized":"2024-09-14T11:52:29.892148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:38.823344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912541+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:14.912541+0000","last_peered":"2024-09-14T11:56:14.912541+0000","last_clean":"2024-09-14T11:56:14.912541+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:14.912541+0000","last_undegraded":"2024-09-14T11:56:14.912541+0000","last_fullsized":"2024-09-14T11:56:14.912541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.014650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893118+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:52:24.893118+0000","last_peered":"2024-09-14T11:52:24.893118+0000","last_clean":"2024-09-14T11:52:24.893118+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:52:24.893118+0000","last_undegraded":"2024-09-14T11:52:24.893118+0000","last_fullsized":"2024-09-14T11:52:24.893118+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:57.259600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785620+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:52:29.785620+0000","last_peered":"2024-09-14T11:52:29.785620+0000","last_clean":"2024-09-14T11:52:29.785620+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:52:29.785620+0000","last_undegraded":"2024-09-14T11:52:29.785620+0000","last_fullsized":"2024-09-14T11:52:29.785620+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:58.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891569+0000","last_change":"2024-09-14T11:30:44.713694+0000","last_active":"2024-09-14T11:52:24.891569+0000","last_peered":"2024-09-14T11:52:24.891569+0000","last_clean":"2024-09-14T11:52:24.891569+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:52:24.891569+0000","last_undegraded":"2024-09-14T11:52:24.891569+0000","last_fullsized":"2024-09-14T11:52:24.891569+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:40.066993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.790581+0000","last_change":"2024-09-14T11:29:10.321325+0000","last_active":"2024-09-14T11:53:04.790581+0000","last_peered":"2024-09-14T11:53:04.790581+0000","last_clean":"2024-09-14T11:53:04.790581+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:53:04.790581+0000","last_undegraded":"2024-09-14T11:53:04.790581+0000","last_fullsized":"2024-09-14T11:53:04.790581+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:02.452550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.915942+0000","last_change":"2024-09-14T11:30:47.737000+0000","last_active":"2024-09-14T11:55:34.915942+0000","last_peered":"2024-09-14T11:55:34.915942+0000","last_clean":"2024-09-14T11:55:34.915942+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:55:34.915942+0000","last_undegraded":"2024-09-14T11:55:34.915942+0000","last_fullsized":"2024-09-14T11:55:34.915942+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:03.413738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893146+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:52:24.893146+0000","last_peered":"2024-09-14T11:52:24.893146+0000","last_clean":"2024-09-14T11:52:24.893146+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:52:24.893146+0000","last_undegraded":"2024-09-14T11:52:24.893146+0000","last_fullsized":"2024-09-14T11:52:24.893146+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:33.383073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786619+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:52:34.786619+0000","last_peered":"2024-09-14T11:52:34.786619+0000","last_clean":"2024-09-14T11:52:34.786619+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:52:34.786619+0000","last_undegraded":"2024-09-14T11:52:34.786619+0000","last_fullsized":"2024-09-14T11:52:34.786619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:02.318969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784088+0000","last_change":"2024-09-14T11:29:10.322148+0000","last_active":"2024-09-14T11:53:00.784088+0000","last_peered":"2024-09-14T11:53:00.784088+0000","last_clean":"2024-09-14T11:53:00.784088+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:53:00.784088+0000","last_undegraded":"2024-09-14T11:53:00.784088+0000","last_fullsized":"2024-09-14T11:53:00.784088+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.995810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795341+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:53:39.795341+0000","last_peered":"2024-09-14T11:53:39.795341+0000","last_clean":"2024-09-14T11:53:39.795341+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:53:39.795341+0000","last_undegraded":"2024-09-14T11:53:39.795341+0000","last_fullsized":"2024-09-14T11:53:39.795341+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.795943+0000","last_change":"2024-09-14T11:30:44.720970+0000","last_active":"2024-09-14T11:55:49.795943+0000","last_peered":"2024-09-14T11:55:49.795943+0000","last_clean":"2024-09-14T11:55:49.795943+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:55:49.795943+0000","last_undegraded":"2024-09-14T11:55:49.795943+0000","last_fullsized":"2024-09-14T11:55:49.795943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:44.416082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784182+0000","last_change":"2024-09-14T11:29:10.322645+0000","last_active":"2024-09-14T11:53:00.784182+0000","last_peered":"2024-09-14T11:53:00.784182+0000","last_clean":"2024-09-14T11:53:00.784182+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:53:00.784182+0000","last_undegraded":"2024-09-14T11:53:00.784182+0000","last_fullsized":"2024-09-14T11:53:00.784182+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:51.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785838+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:52:29.785838+0000","last_peered":"2024-09-14T11:52:29.785838+0000","last_clean":"2024-09-14T11:52:29.785838+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:52:29.785838+0000","last_undegraded":"2024-09-14T11:52:29.785838+0000","last_fullsized":"2024-09-14T11:52:29.785838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:07.281823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.047286+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:54:36.047286+0000","last_peered":"2024-09-14T11:54:36.047286+0000","last_clean":"2024-09-14T11:54:36.047286+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:54:36.047286+0000","last_undegraded":"2024-09-14T11:54:36.047286+0000","last_fullsized":"2024-09-14T11:54:36.047286+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:34.901574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.402107+0000","last_change":"2024-09-14T11:29:10.323320+0000","last_active":"2024-09-14T11:52:33.402107+0000","last_peered":"2024-09-14T11:52:33.402107+0000","last_clean":"2024-09-14T11:52:33.402107+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:52:33.402107+0000","last_undegraded":"2024-09-14T11:52:33.402107+0000","last_fullsized":"2024-09-14T11:52:33.402107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:18.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.799375+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:54:40.799375+0000","last_peered":"2024-09-14T11:54:40.799375+0000","last_clean":"2024-09-14T11:54:40.799375+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:54:40.799375+0000","last_undegraded":"2024-09-14T11:54:40.799375+0000","last_fullsized":"2024-09-14T11:54:40.799375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.613026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.784752+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:52:24.784752+0000","last_peered":"2024-09-14T11:52:24.784752+0000","last_clean":"2024-09-14T11:52:24.784752+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:52:24.784752+0000","last_undegraded":"2024-09-14T11:52:24.784752+0000","last_fullsized":"2024-09-14T11:52:24.784752+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:46.872224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905103+0000","last_change":"2024-09-14T11:29:10.321492+0000","last_active":"2024-09-14T11:54:09.905103+0000","last_peered":"2024-09-14T11:54:09.905103+0000","last_clean":"2024-09-14T11:54:09.905103+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:54:09.905103+0000","last_undegraded":"2024-09-14T11:54:09.905103+0000","last_fullsized":"2024-09-14T11:54:09.905103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:01.698920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.770106+0000","last_change":"2024-09-14T11:41:15.869275+0000","last_active":"2024-09-14T11:52:09.770106+0000","last_peered":"2024-09-14T11:52:09.770106+0000","last_clean":"2024-09-14T11:52:09.770106+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:52:09.770106+0000","last_undegraded":"2024-09-14T11:52:09.770106+0000","last_fullsized":"2024-09-14T11:52:09.770106+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:58.504841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902212+0000","last_change":"2024-09-14T11:30:47.734644+0000","last_active":"2024-09-14T11:53:44.902212+0000","last_peered":"2024-09-14T11:53:44.902212+0000","last_clean":"2024-09-14T11:53:44.902212+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:53:44.902212+0000","last_undegraded":"2024-09-14T11:53:44.902212+0000","last_fullsized":"2024-09-14T11:53:44.902212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:00.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.788562+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:52:49.788562+0000","last_peered":"2024-09-14T11:52:49.788562+0000","last_clean":"2024-09-14T11:52:49.788562+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:52:49.788562+0000","last_undegraded":"2024-09-14T11:52:49.788562+0000","last_fullsized":"2024-09-14T11:52:49.788562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:27.988666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043510+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:54:11.043510+0000","last_peered":"2024-09-14T11:54:11.043510+0000","last_clean":"2024-09-14T11:54:11.043510+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:54:11.043510+0000","last_undegraded":"2024-09-14T11:54:11.043510+0000","last_fullsized":"2024-09-14T11:54:11.043510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.891635+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:52:09.891635+0000","last_peered":"2024-09-14T11:52:09.891635+0000","last_clean":"2024-09-14T11:52:09.891635+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:52:09.891635+0000","last_undegraded":"2024-09-14T11:52:09.891635+0000","last_fullsized":"2024-09-14T11:52:09.891635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:47.380694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.049498+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:54:51.049498+0000","last_peered":"2024-09-14T11:54:51.049498+0000","last_clean":"2024-09-14T11:54:51.049498+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:54:51.049498+0000","last_undegraded":"2024-09-14T11:54:51.049498+0000","last_fullsized":"2024-09-14T11:54:51.049498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.117139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794642+0000","last_change":"2024-09-14T11:29:10.319801+0000","last_active":"2024-09-14T11:54:10.794642+0000","last_peered":"2024-09-14T11:54:10.794642+0000","last_clean":"2024-09-14T11:54:10.794642+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:54:10.794642+0000","last_undegraded":"2024-09-14T11:54:10.794642+0000","last_fullsized":"2024-09-14T11:54:10.794642+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:43.613741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790704+0000","last_change":"2024-09-14T11:30:47.742418+0000","last_active":"2024-09-14T11:53:45.790704+0000","last_peered":"2024-09-14T11:53:45.790704+0000","last_clean":"2024-09-14T11:53:45.790704+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:53:45.790704+0000","last_undegraded":"2024-09-14T11:53:45.790704+0000","last_fullsized":"2024-09-14T11:53:45.790704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:46.735010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.901661+0000","last_change":"2024-09-14T11:30:44.713119+0000","last_active":"2024-09-14T11:53:39.901661+0000","last_peered":"2024-09-14T11:53:39.901661+0000","last_clean":"2024-09-14T11:53:39.901661+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:53:39.901661+0000","last_undegraded":"2024-09-14T11:53:39.901661+0000","last_fullsized":"2024-09-14T11:53:39.901661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:45.277861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794558+0000","last_change":"2024-09-14T11:29:10.321339+0000","last_active":"2024-09-14T11:54:10.794558+0000","last_peered":"2024-09-14T11:54:10.794558+0000","last_clean":"2024-09-14T11:54:10.794558+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:54:10.794558+0000","last_undegraded":"2024-09-14T11:54:10.794558+0000","last_fullsized":"2024-09-14T11:54:10.794558+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:57.698726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790015+0000","last_change":"2024-09-14T11:30:44.721204+0000","last_active":"2024-09-14T11:53:40.790015+0000","last_peered":"2024-09-14T11:53:40.790015+0000","last_clean":"2024-09-14T11:53:40.790015+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:53:40.790015+0000","last_undegraded":"2024-09-14T11:53:40.790015+0000","last_fullsized":"2024-09-14T11:53:40.790015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.676688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792100+0000","last_change":"2024-09-14T11:29:10.324357+0000","last_active":"2024-09-14T11:53:14.792100+0000","last_peered":"2024-09-14T11:53:14.792100+0000","last_clean":"2024-09-14T11:53:14.792100+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:53:14.792100+0000","last_undegraded":"2024-09-14T11:53:14.792100+0000","last_fullsized":"2024-09-14T11:53:14.792100+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:35.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'303","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.793622+0000","last_change":"2024-09-14T11:14:04.132821+0000","last_active":"2024-09-14T11:56:14.793622+0000","last_peered":"2024-09-14T11:56:14.793622+0000","last_clean":"2024-09-14T11:56:14.793622+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:14.793622+0000","last_undegraded":"2024-09-14T11:56:14.793622+0000","last_fullsized":"2024-09-14T11:56:14.793622+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:20.604907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901394,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":578,"num_read_kb":2359,"num_write":1120,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1592","reported_seq":3377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461746+0000","last_change":"2024-09-14T11:14:06.121950+0000","last_active":"2024-09-14T11:54:24.461746+0000","last_peered":"2024-09-14T11:54:24.461746+0000","last_clean":"2024-09-14T11:54:24.461746+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:54:24.461746+0000","last_undegraded":"2024-09-14T11:54:24.461746+0000","last_fullsized":"2024-09-14T11:54:24.461746+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.554941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'322","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874917+0000","last_change":"2024-09-14T11:14:04.126728+0000","last_active":"2024-09-14T11:56:14.874917+0000","last_peered":"2024-09-14T11:56:14.874917+0000","last_clean":"2024-09-14T11:56:14.874917+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:14.874917+0000","last_undegraded":"2024-09-14T11:56:14.874917+0000","last_fullsized":"2024-09-14T11:56:14.874917+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:41.626044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":621,"num_read_kb":6703,"num_write":1161,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'561","reported_seq":2237,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622076+0000","last_change":"2024-09-14T11:14:06.123174+0000","last_active":"2024-09-14T11:55:41.622076+0000","last_peered":"2024-09-14T11:55:41.622076+0000","last_clean":"2024-09-14T11:55:41.622076+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:55:41.622076+0000","last_undegraded":"2024-09-14T11:55:41.622076+0000","last_fullsized":"2024-09-14T11:55:41.622076+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:37.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'322","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.836719+0000","last_change":"2024-09-14T11:14:04.122664+0000","last_active":"2024-09-14T11:56:14.836719+0000","last_peered":"2024-09-14T11:56:14.836719+0000","last_clean":"2024-09-14T11:56:14.836719+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:14.836719+0000","last_undegraded":"2024-09-14T11:56:14.836719+0000","last_fullsized":"2024-09-14T11:56:14.836719+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":604,"num_read_kb":11794,"num_write":1115,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'475","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.537995+0000","last_change":"2024-09-14T11:14:06.124737+0000","last_active":"2024-09-14T11:54:26.537995+0000","last_peered":"2024-09-14T11:54:26.537995+0000","last_clean":"2024-09-14T11:54:26.537995+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:54:26.537995+0000","last_undegraded":"2024-09-14T11:54:26.537995+0000","last_fullsized":"2024-09-14T11:54:26.537995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:38.559640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.618263+0000","last_change":"2024-09-14T11:14:04.128237+0000","last_active":"2024-09-14T11:56:15.618263+0000","last_peered":"2024-09-14T11:56:15.618263+0000","last_clean":"2024-09-14T11:56:15.618263+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:15.618263+0000","last_undegraded":"2024-09-14T11:56:15.618263+0000","last_fullsized":"2024-09-14T11:56:15.618263+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:22.273382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1060","reported_seq":2767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540504+0000","last_change":"2024-09-14T11:14:06.134846+0000","last_active":"2024-09-14T11:54:04.540504+0000","last_peered":"2024-09-14T11:54:04.540504+0000","last_clean":"2024-09-14T11:54:04.540504+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:54:04.540504+0000","last_undegraded":"2024-09-14T11:54:04.540504+0000","last_fullsized":"2024-09-14T11:54:04.540504+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:16.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'326","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.792537+0000","last_change":"2024-09-14T11:14:04.121928+0000","last_active":"2024-09-14T11:56:14.792537+0000","last_peered":"2024-09-14T11:56:14.792537+0000","last_clean":"2024-09-14T11:56:14.792537+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:14.792537+0000","last_undegraded":"2024-09-14T11:56:14.792537+0000","last_fullsized":"2024-09-14T11:56:14.792537+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:49.409365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2001957,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":601,"num_read_kb":64951,"num_write":1148,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'462","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.795372+0000","last_change":"2024-09-14T11:14:06.131212+0000","last_active":"2024-09-14T11:54:15.795372+0000","last_peered":"2024-09-14T11:54:15.795372+0000","last_clean":"2024-09-14T11:54:15.795372+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:54:15.795372+0000","last_undegraded":"2024-09-14T11:54:15.795372+0000","last_fullsized":"2024-09-14T11:54:15.795372+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:20.091159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.586411+0000","last_change":"2024-09-14T11:14:04.134464+0000","last_active":"2024-09-14T11:56:15.586411+0000","last_peered":"2024-09-14T11:56:15.586411+0000","last_clean":"2024-09-14T11:56:15.586411+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:15.586411+0000","last_undegraded":"2024-09-14T11:56:15.586411+0000","last_fullsized":"2024-09-14T11:56:15.586411+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:30.803104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'797","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.547089+0000","last_change":"2024-09-14T11:14:06.123280+0000","last_active":"2024-09-14T11:54:08.547089+0000","last_peered":"2024-09-14T11:54:08.547089+0000","last_clean":"2024-09-14T11:54:08.547089+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:54:08.547089+0000","last_undegraded":"2024-09-14T11:54:08.547089+0000","last_fullsized":"2024-09-14T11:54:08.547089+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:47.903630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.798085+0000","last_change":"2024-09-14T11:14:04.123532+0000","last_active":"2024-09-14T11:56:14.798085+0000","last_peered":"2024-09-14T11:56:14.798085+0000","last_clean":"2024-09-14T11:56:14.798085+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:14.798085+0000","last_undegraded":"2024-09-14T11:56:14.798085+0000","last_fullsized":"2024-09-14T11:56:14.798085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:19.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632597,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":400,"num_read_kb":10088,"num_write":805,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'969","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114339+0000","last_change":"2024-09-14T11:14:38.192581+0000","last_active":"2024-09-14T11:54:27.114339+0000","last_peered":"2024-09-14T11:54:27.114339+0000","last_clean":"2024-09-14T11:54:27.114339+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:54:27.114339+0000","last_undegraded":"2024-09-14T11:54:27.114339+0000","last_fullsized":"2024-09-14T11:54:27.114339+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":900,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:55.081995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'281","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887971+0000","last_change":"2024-09-14T11:14:04.133635+0000","last_active":"2024-09-14T11:56:14.887971+0000","last_peered":"2024-09-14T11:56:14.887971+0000","last_clean":"2024-09-14T11:56:14.887971+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:14.887971+0000","last_undegraded":"2024-09-14T11:56:14.887971+0000","last_fullsized":"2024-09-14T11:56:14.887971+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:20.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656670,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":689,"num_read_kb":31980,"num_write":981,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'456","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113514+0000","last_change":"2024-09-14T11:14:06.120786+0000","last_active":"2024-09-14T11:54:27.113514+0000","last_peered":"2024-09-14T11:54:27.113514+0000","last_clean":"2024-09-14T11:54:27.113514+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:54:27.113514+0000","last_undegraded":"2024-09-14T11:54:27.113514+0000","last_fullsized":"2024-09-14T11:54:27.113514+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:54.953125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'842","reported_seq":2512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114073+0000","last_change":"2024-09-14T11:14:06.124595+0000","last_active":"2024-09-14T11:54:27.114073+0000","last_peered":"2024-09-14T11:54:27.114073+0000","last_clean":"2024-09-14T11:54:27.114073+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:54:27.114073+0000","last_undegraded":"2024-09-14T11:54:27.114073+0000","last_fullsized":"2024-09-14T11:54:27.114073+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:05.222764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'359","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.809065+0000","last_change":"2024-09-14T11:14:38.194800+0000","last_active":"2024-09-14T11:56:14.809065+0000","last_peered":"2024-09-14T11:56:14.809065+0000","last_clean":"2024-09-14T11:56:14.809065+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:14.809065+0000","last_undegraded":"2024-09-14T11:56:14.809065+0000","last_fullsized":"2024-09-14T11:56:14.809065+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.771928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":664,"num_read_kb":5626,"num_write":1133,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1033","reported_seq":2958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113832+0000","last_change":"2024-09-14T11:14:06.123475+0000","last_active":"2024-09-14T11:54:27.113832+0000","last_peered":"2024-09-14T11:54:27.113832+0000","last_clean":"2024-09-14T11:54:27.113832+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:54:27.113832+0000","last_undegraded":"2024-09-14T11:54:27.113832+0000","last_fullsized":"2024-09-14T11:54:27.113832+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1000,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:19.165857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.556657+0000","last_change":"2024-09-14T11:14:04.127657+0000","last_active":"2024-09-14T11:56:15.556657+0000","last_peered":"2024-09-14T11:56:15.556657+0000","last_clean":"2024-09-14T11:56:15.556657+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:15.556657+0000","last_undegraded":"2024-09-14T11:56:15.556657+0000","last_fullsized":"2024-09-14T11:56:15.556657+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:06.672463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114354+0000","last_change":"2024-09-14T11:14:06.126958+0000","last_active":"2024-09-14T11:54:27.114354+0000","last_peered":"2024-09-14T11:54:27.114354+0000","last_clean":"2024-09-14T11:54:27.114354+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:54:27.114354+0000","last_undegraded":"2024-09-14T11:54:27.114354+0000","last_fullsized":"2024-09-14T11:54:27.114354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:26.370068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.544255+0000","last_change":"2024-09-14T11:14:04.124069+0000","last_active":"2024-09-14T11:56:15.544255+0000","last_peered":"2024-09-14T11:56:15.544255+0000","last_clean":"2024-09-14T11:56:15.544255+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:15.544255+0000","last_undegraded":"2024-09-14T11:56:15.544255+0000","last_fullsized":"2024-09-14T11:56:15.544255+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:34.849444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'797","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.716592+0000","last_change":"2024-09-14T11:14:06.121906+0000","last_active":"2024-09-14T11:53:56.716592+0000","last_peered":"2024-09-14T11:53:56.716592+0000","last_clean":"2024-09-14T11:53:56.716592+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:53:56.716592+0000","last_undegraded":"2024-09-14T11:53:56.716592+0000","last_fullsized":"2024-09-14T11:53:56.716592+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:09.756613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.581006+0000","last_change":"2024-09-14T11:14:04.134028+0000","last_active":"2024-09-14T11:56:15.581006+0000","last_peered":"2024-09-14T11:56:15.581006+0000","last_clean":"2024-09-14T11:56:15.581006+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:15.581006+0000","last_undegraded":"2024-09-14T11:56:15.581006+0000","last_fullsized":"2024-09-14T11:56:15.581006+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:15.221483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'452","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546378+0000","last_change":"2024-09-14T11:14:06.126750+0000","last_active":"2024-09-14T11:54:26.546378+0000","last_peered":"2024-09-14T11:54:26.546378+0000","last_clean":"2024-09-14T11:54:26.546378+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:54:26.546378+0000","last_undegraded":"2024-09-14T11:54:26.546378+0000","last_fullsized":"2024-09-14T11:54:26.546378+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:36.058072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'402","reported_seq":1130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.899014+0000","last_change":"2024-09-14T11:14:04.124388+0000","last_active":"2024-09-14T11:56:14.899014+0000","last_peered":"2024-09-14T11:56:14.899014+0000","last_clean":"2024-09-14T11:56:14.899014+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:14.899014+0000","last_undegraded":"2024-09-14T11:56:14.899014+0000","last_fullsized":"2024-09-14T11:56:14.899014+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:48.709233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245244,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1018,"num_read_kb":31602,"num_write":1270,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'449","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262318+0000","last_change":"2024-09-14T11:14:06.120737+0000","last_active":"2024-09-14T11:54:09.262318+0000","last_peered":"2024-09-14T11:54:09.262318+0000","last_clean":"2024-09-14T11:54:09.262318+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:54:09.262318+0000","last_undegraded":"2024-09-14T11:54:09.262318+0000","last_fullsized":"2024-09-14T11:54:09.262318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:08.169000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'305","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.873253+0000","last_change":"2024-09-14T11:14:04.131958+0000","last_active":"2024-09-14T11:56:14.873253+0000","last_peered":"2024-09-14T11:56:14.873253+0000","last_clean":"2024-09-14T11:56:14.873253+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:14.873253+0000","last_undegraded":"2024-09-14T11:56:14.873253+0000","last_fullsized":"2024-09-14T11:56:14.873253+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:07.141707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12587448,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":530,"num_read_kb":49466,"num_write":1002,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'149","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.173403+0000","last_change":"2024-09-14T11:14:14.157140+0000","last_active":"2024-09-14T11:54:27.173403+0000","last_peered":"2024-09-14T11:54:27.173403+0000","last_clean":"2024-09-14T11:54:27.173403+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:54:27.173403+0000","last_undegraded":"2024-09-14T11:54:27.173403+0000","last_fullsized":"2024-09-14T11:54:27.173403+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'472","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462103+0000","last_change":"2024-09-14T11:14:06.114316+0000","last_active":"2024-09-14T11:54:24.462103+0000","last_peered":"2024-09-14T11:54:24.462103+0000","last_clean":"2024-09-14T11:54:24.462103+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:54:24.462103+0000","last_undegraded":"2024-09-14T11:54:24.462103+0000","last_fullsized":"2024-09-14T11:54:24.462103+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:27.459152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'326","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.779294+0000","last_change":"2024-09-14T11:14:04.130305+0000","last_active":"2024-09-14T11:56:14.779294+0000","last_peered":"2024-09-14T11:56:14.779294+0000","last_clean":"2024-09-14T11:56:14.779294+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:14.779294+0000","last_undegraded":"2024-09-14T11:56:14.779294+0000","last_fullsized":"2024-09-14T11:56:14.779294+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:34.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11283977,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":545,"num_read_kb":64656,"num_write":1047,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032244+0000","last_change":"2024-09-14T11:14:08.133120+0000","last_active":"2024-09-14T11:52:51.032244+0000","last_peered":"2024-09-14T11:52:51.032244+0000","last_clean":"2024-09-14T11:52:51.032244+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:52:51.032244+0000","last_undegraded":"2024-09-14T11:52:51.032244+0000","last_fullsized":"2024-09-14T11:52:51.032244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:46.516129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.396646+0000","last_change":"2024-09-14T11:14:10.155409+0000","last_active":"2024-09-14T11:56:14.396646+0000","last_peered":"2024-09-14T11:56:14.396646+0000","last_clean":"2024-09-14T11:56:14.396646+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:14.396646+0000","last_undegraded":"2024-09-14T11:56:14.396646+0000","last_fullsized":"2024-09-14T11:56:14.396646+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:46.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.789188+0000","last_change":"2024-09-14T11:14:12.146041+0000","last_active":"2024-09-14T11:52:54.789188+0000","last_peered":"2024-09-14T11:52:54.789188+0000","last_clean":"2024-09-14T11:52:54.789188+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:52:54.789188+0000","last_undegraded":"2024-09-14T11:52:54.789188+0000","last_fullsized":"2024-09-14T11:52:54.789188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:07.310103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2525","reported_seq":4350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.558442+0000","last_change":"2024-09-14T11:14:14.162522+0000","last_active":"2024-09-14T11:54:26.558442+0000","last_peered":"2024-09-14T11:54:26.558442+0000","last_clean":"2024-09-14T11:54:26.558442+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:54:26.558442+0000","last_undegraded":"2024-09-14T11:54:26.558442+0000","last_fullsized":"2024-09-14T11:54:26.558442+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.242957+0000","last_change":"2024-09-14T11:14:06.123796+0000","last_active":"2024-09-14T11:53:58.242957+0000","last_peered":"2024-09-14T11:53:58.242957+0000","last_clean":"2024-09-14T11:53:58.242957+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:53:58.242957+0000","last_undegraded":"2024-09-14T11:53:58.242957+0000","last_fullsized":"2024-09-14T11:53:58.242957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.088566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'355","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897988+0000","last_change":"2024-09-14T11:14:04.119220+0000","last_active":"2024-09-14T11:56:14.897988+0000","last_peered":"2024-09-14T11:56:14.897988+0000","last_clean":"2024-09-14T11:56:14.897988+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:14.897988+0000","last_undegraded":"2024-09-14T11:56:14.897988+0000","last_fullsized":"2024-09-14T11:56:14.897988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:38.371093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1196,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":645,"num_read_kb":35601,"num_write":1184,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"37'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.737726+0000","last_change":"2024-09-14T11:14:08.135860+0000","last_active":"2024-09-14T11:56:13.737726+0000","last_peered":"2024-09-14T11:56:13.737726+0000","last_clean":"2024-09-14T11:56:13.737726+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:13.737726+0000","last_undegraded":"2024-09-14T11:56:13.737726+0000","last_fullsized":"2024-09-14T11:56:13.737726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:46.310304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'85","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.820592+0000","last_change":"2024-09-14T11:14:10.148306+0000","last_active":"2024-09-14T11:54:18.820592+0000","last_peered":"2024-09-14T11:54:18.820592+0000","last_clean":"2024-09-14T11:54:18.820592+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:54:18.820592+0000","last_undegraded":"2024-09-14T11:54:18.820592+0000","last_fullsized":"2024-09-14T11:54:18.820592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:24.120046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783507+0000","last_change":"2024-09-14T11:14:12.155662+0000","last_active":"2024-09-14T11:52:55.783507+0000","last_peered":"2024-09-14T11:52:55.783507+0000","last_clean":"2024-09-14T11:52:55.783507+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:52:55.783507+0000","last_undegraded":"2024-09-14T11:52:55.783507+0000","last_fullsized":"2024-09-14T11:52:55.783507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.540261+0000","last_change":"2024-09-14T11:14:14.154923+0000","last_active":"2024-09-14T11:53:52.540261+0000","last_peered":"2024-09-14T11:53:52.540261+0000","last_clean":"2024-09-14T11:53:52.540261+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:53:52.540261+0000","last_undegraded":"2024-09-14T11:53:52.540261+0000","last_fullsized":"2024-09-14T11:53:52.540261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:08.154888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'429","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.932863+0000","last_change":"2024-09-14T11:14:06.134060+0000","last_active":"2024-09-14T11:54:02.932863+0000","last_peered":"2024-09-14T11:54:02.932863+0000","last_clean":"2024-09-14T11:54:02.932863+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:54:02.932863+0000","last_undegraded":"2024-09-14T11:54:02.932863+0000","last_fullsized":"2024-09-14T11:54:02.932863+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:50.929113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'380","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.731352+0000","last_change":"2024-09-14T11:14:04.131269+0000","last_active":"2024-09-14T11:56:14.731352+0000","last_peered":"2024-09-14T11:56:14.731352+0000","last_clean":"2024-09-14T11:56:14.731352+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:14.731352+0000","last_undegraded":"2024-09-14T11:56:14.731352+0000","last_fullsized":"2024-09-14T11:56:14.731352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.204839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982763,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":788,"num_read_kb":18319,"num_write":1387,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.894797+0000","last_change":"2024-09-14T11:14:08.134301+0000","last_active":"2024-09-14T11:52:49.894797+0000","last_peered":"2024-09-14T11:52:49.894797+0000","last_clean":"2024-09-14T11:52:49.894797+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:52:49.894797+0000","last_undegraded":"2024-09-14T11:52:49.894797+0000","last_fullsized":"2024-09-14T11:52:49.894797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.190597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'98","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.837361+0000","last_change":"2024-09-14T11:14:10.152502+0000","last_active":"2024-09-14T11:54:18.837361+0000","last_peered":"2024-09-14T11:54:18.837361+0000","last_clean":"2024-09-14T11:54:18.837361+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:54:18.837361+0000","last_undegraded":"2024-09-14T11:54:18.837361+0000","last_fullsized":"2024-09-14T11:54:18.837361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:42.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.742621+0000","last_change":"2024-09-14T11:14:12.146612+0000","last_active":"2024-09-14T11:56:13.742621+0000","last_peered":"2024-09-14T11:56:13.742621+0000","last_clean":"2024-09-14T11:56:13.742621+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:13.742621+0000","last_undegraded":"2024-09-14T11:56:13.742621+0000","last_fullsized":"2024-09-14T11:56:13.742621+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:59.916147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.603559+0000","last_change":"2024-09-14T11:14:14.157146+0000","last_active":"2024-09-14T11:54:26.603559+0000","last_peered":"2024-09-14T11:54:26.603559+0000","last_clean":"2024-09-14T11:54:26.603559+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:54:26.603559+0000","last_undegraded":"2024-09-14T11:54:26.603559+0000","last_fullsized":"2024-09-14T11:54:26.603559+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'525","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.725224+0000","last_change":"2024-09-14T11:14:38.194359+0000","last_active":"2024-09-14T11:54:03.725224+0000","last_peered":"2024-09-14T11:54:03.725224+0000","last_clean":"2024-09-14T11:54:03.725224+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:54:03.725224+0000","last_undegraded":"2024-09-14T11:54:03.725224+0000","last_fullsized":"2024-09-14T11:54:03.725224+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:56.602770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.572772+0000","last_change":"2024-09-14T11:14:04.128674+0000","last_active":"2024-09-14T11:56:15.572772+0000","last_peered":"2024-09-14T11:56:15.572772+0000","last_clean":"2024-09-14T11:56:15.572772+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:15.572772+0000","last_undegraded":"2024-09-14T11:56:15.572772+0000","last_fullsized":"2024-09-14T11:56:15.572772+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.487246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032273+0000","last_change":"2024-09-14T11:14:08.132713+0000","last_active":"2024-09-14T11:52:51.032273+0000","last_peered":"2024-09-14T11:52:51.032273+0000","last_clean":"2024-09-14T11:52:51.032273+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:52:51.032273+0000","last_undegraded":"2024-09-14T11:52:51.032273+0000","last_fullsized":"2024-09-14T11:52:51.032273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.166831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'250","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.104576+0000","last_change":"2024-09-14T11:14:10.151136+0000","last_active":"2024-09-14T11:56:14.104576+0000","last_peered":"2024-09-14T11:56:14.104576+0000","last_clean":"2024-09-14T11:56:14.104576+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:14.104576+0000","last_undegraded":"2024-09-14T11:56:14.104576+0000","last_fullsized":"2024-09-14T11:56:14.104576+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.560101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.746769+0000","last_change":"2024-09-14T11:14:12.152920+0000","last_active":"2024-09-14T11:56:13.746769+0000","last_peered":"2024-09-14T11:56:13.746769+0000","last_clean":"2024-09-14T11:56:13.746769+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:13.746769+0000","last_undegraded":"2024-09-14T11:56:13.746769+0000","last_fullsized":"2024-09-14T11:56:13.746769+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:33.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1226","reported_seq":2881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358325+0000","last_change":"2024-09-14T11:14:06.125762+0000","last_active":"2024-09-14T11:54:05.358325+0000","last_peered":"2024-09-14T11:54:05.358325+0000","last_clean":"2024-09-14T11:54:05.358325+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:54:05.358325+0000","last_undegraded":"2024-09-14T11:54:05.358325+0000","last_fullsized":"2024-09-14T11:54:05.358325+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:18.791358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'329","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.766628+0000","last_change":"2024-09-14T11:14:04.130569+0000","last_active":"2024-09-14T11:56:14.766628+0000","last_peered":"2024-09-14T11:56:14.766628+0000","last_clean":"2024-09-14T11:56:14.766628+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:14.766628+0000","last_undegraded":"2024-09-14T11:56:14.766628+0000","last_fullsized":"2024-09-14T11:56:14.766628+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:07.122939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":614,"num_read_kb":41733,"num_write":1076,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.791334+0000","last_change":"2024-09-14T11:14:08.133899+0000","last_active":"2024-09-14T11:53:09.791334+0000","last_peered":"2024-09-14T11:53:09.791334+0000","last_clean":"2024-09-14T11:53:09.791334+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:53:09.791334+0000","last_undegraded":"2024-09-14T11:53:09.791334+0000","last_fullsized":"2024-09-14T11:53:09.791334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:53.760916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'355","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.626523+0000","last_change":"2024-09-14T11:14:10.148253+0000","last_active":"2024-09-14T11:56:14.626523+0000","last_peered":"2024-09-14T11:56:14.626523+0000","last_clean":"2024-09-14T11:56:14.626523+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:14.626523+0000","last_undegraded":"2024-09-14T11:56:14.626523+0000","last_fullsized":"2024-09-14T11:56:14.626523+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:31.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892192+0000","last_change":"2024-09-14T11:14:12.146180+0000","last_active":"2024-09-14T11:52:29.892192+0000","last_peered":"2024-09-14T11:52:29.892192+0000","last_clean":"2024-09-14T11:52:29.892192+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:52:29.892192+0000","last_undegraded":"2024-09-14T11:52:29.892192+0000","last_fullsized":"2024-09-14T11:52:29.892192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:08.096291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'551","reported_seq":1353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.743153+0000","last_change":"2024-09-14T11:14:14.163358+0000","last_active":"2024-09-14T11:55:42.743153+0000","last_peered":"2024-09-14T11:55:42.743153+0000","last_clean":"2024-09-14T11:55:42.743153+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:55:42.743153+0000","last_undegraded":"2024-09-14T11:55:42.743153+0000","last_fullsized":"2024-09-14T11:55:42.743153+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.528715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'805","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783202+0000","last_change":"2024-09-14T11:14:06.122574+0000","last_active":"2024-09-14T11:54:07.783202+0000","last_peered":"2024-09-14T11:54:07.783202+0000","last_clean":"2024-09-14T11:54:07.783202+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:54:07.783202+0000","last_undegraded":"2024-09-14T11:54:07.783202+0000","last_fullsized":"2024-09-14T11:54:07.783202+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:48.369389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'287","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.748314+0000","last_change":"2024-09-14T11:14:38.341826+0000","last_active":"2024-09-14T11:56:14.748314+0000","last_peered":"2024-09-14T11:56:14.748314+0000","last_clean":"2024-09-14T11:56:14.748314+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:14.748314+0000","last_undegraded":"2024-09-14T11:56:14.748314+0000","last_fullsized":"2024-09-14T11:56:14.748314+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:15.557976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656139,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":522,"num_read_kb":67475,"num_write":1005,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777294+0000","last_change":"2024-09-14T11:14:08.128050+0000","last_active":"2024-09-14T11:53:09.777294+0000","last_peered":"2024-09-14T11:53:09.777294+0000","last_clean":"2024-09-14T11:53:09.777294+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:53:09.777294+0000","last_undegraded":"2024-09-14T11:53:09.777294+0000","last_fullsized":"2024-09-14T11:53:09.777294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:20.497715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'289","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.704528+0000","last_change":"2024-09-14T11:14:10.154690+0000","last_active":"2024-09-14T11:55:42.704528+0000","last_peered":"2024-09-14T11:55:42.704528+0000","last_clean":"2024-09-14T11:55:42.704528+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:55:42.704528+0000","last_undegraded":"2024-09-14T11:55:42.704528+0000","last_fullsized":"2024-09-14T11:55:42.704528+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:11.627375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":989,"num_write":396,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899412+0000","last_change":"2024-09-14T11:14:12.151137+0000","last_active":"2024-09-14T11:53:19.899412+0000","last_peered":"2024-09-14T11:53:19.899412+0000","last_clean":"2024-09-14T11:53:19.899412+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:53:19.899412+0000","last_undegraded":"2024-09-14T11:53:19.899412+0000","last_fullsized":"2024-09-14T11:53:19.899412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:29.769264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'118","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.889408+0000","last_change":"2024-09-14T11:14:14.157438+0000","last_active":"2024-09-14T11:55:32.889408+0000","last_peered":"2024-09-14T11:55:32.889408+0000","last_clean":"2024-09-14T11:55:32.889408+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:55:32.889408+0000","last_undegraded":"2024-09-14T11:55:32.889408+0000","last_fullsized":"2024-09-14T11:55:32.889408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:00.893536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1038","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935378+0000","last_change":"2024-09-14T11:14:06.128782+0000","last_active":"2024-09-14T11:54:09.935378+0000","last_peered":"2024-09-14T11:54:09.935378+0000","last_clean":"2024-09-14T11:54:09.935378+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:54:09.935378+0000","last_undegraded":"2024-09-14T11:54:09.935378+0000","last_fullsized":"2024-09-14T11:54:09.935378+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:45.064796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'265","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.810356+0000","last_change":"2024-09-14T11:14:04.126361+0000","last_active":"2024-09-14T11:56:14.810356+0000","last_peered":"2024-09-14T11:56:14.810356+0000","last_clean":"2024-09-14T11:56:14.810356+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:14.810356+0000","last_undegraded":"2024-09-14T11:56:14.810356+0000","last_fullsized":"2024-09-14T11:56:14.810356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:57.417770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245220,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":404,"num_read_kb":31073,"num_write":880,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771841+0000","last_change":"2024-09-14T11:14:08.126954+0000","last_active":"2024-09-14T11:52:24.771841+0000","last_peered":"2024-09-14T11:52:24.771841+0000","last_clean":"2024-09-14T11:52:24.771841+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:52:24.771841+0000","last_undegraded":"2024-09-14T11:52:24.771841+0000","last_fullsized":"2024-09-14T11:52:24.771841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:45.136292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'300","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.732982+0000","last_change":"2024-09-14T11:14:10.152183+0000","last_active":"2024-09-14T11:56:14.732982+0000","last_peered":"2024-09-14T11:56:14.732982+0000","last_clean":"2024-09-14T11:56:14.732982+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:14.732982+0000","last_undegraded":"2024-09-14T11:56:14.732982+0000","last_fullsized":"2024-09-14T11:56:14.732982+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.467798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'787","reported_seq":4040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.747751+0000","last_change":"2024-09-14T11:14:12.147169+0000","last_active":"2024-09-14T11:56:13.747751+0000","last_peered":"2024-09-14T11:56:13.747751+0000","last_clean":"2024-09-14T11:56:13.747751+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:13.747751+0000","last_undegraded":"2024-09-14T11:56:13.747751+0000","last_fullsized":"2024-09-14T11:56:13.747751+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:25.604563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573078+0000","last_change":"2024-09-14T11:14:14.159513+0000","last_active":"2024-09-14T11:55:41.573078+0000","last_peered":"2024-09-14T11:55:41.573078+0000","last_clean":"2024-09-14T11:55:41.573078+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:55:41.573078+0000","last_undegraded":"2024-09-14T11:55:41.573078+0000","last_fullsized":"2024-09-14T11:55:41.573078+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.781431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'412","reported_seq":1898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630266+0000","last_change":"2024-09-14T11:14:06.131730+0000","last_active":"2024-09-14T11:55:41.630266+0000","last_peered":"2024-09-14T11:55:41.630266+0000","last_clean":"2024-09-14T11:55:41.630266+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:55:41.630266+0000","last_undegraded":"2024-09-14T11:55:41.630266+0000","last_fullsized":"2024-09-14T11:55:41.630266+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:31.948943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627548+0000","last_change":"2024-09-14T11:14:04.129793+0000","last_active":"2024-09-14T11:56:15.627548+0000","last_peered":"2024-09-14T11:56:15.627548+0000","last_clean":"2024-09-14T11:56:15.627548+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:15.627548+0000","last_undegraded":"2024-09-14T11:56:15.627548+0000","last_fullsized":"2024-09-14T11:56:15.627548+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.783947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.778424+0000","last_change":"2024-09-14T11:14:08.138126+0000","last_active":"2024-09-14T11:53:19.778424+0000","last_peered":"2024-09-14T11:53:19.778424+0000","last_clean":"2024-09-14T11:53:19.778424+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:53:19.778424+0000","last_undegraded":"2024-09-14T11:53:19.778424+0000","last_fullsized":"2024-09-14T11:53:19.778424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.320143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'491","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.847886+0000","last_change":"2024-09-14T11:14:10.155037+0000","last_active":"2024-09-14T11:56:14.847886+0000","last_peered":"2024-09-14T11:56:14.847886+0000","last_clean":"2024-09-14T11:56:14.847886+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:14.847886+0000","last_undegraded":"2024-09-14T11:56:14.847886+0000","last_fullsized":"2024-09-14T11:56:14.847886+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:11.589031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":872,"num_read_kb":2063,"num_write":732,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777908+0000","last_change":"2024-09-14T11:14:12.150404+0000","last_active":"2024-09-14T11:53:14.777908+0000","last_peered":"2024-09-14T11:53:14.777908+0000","last_clean":"2024-09-14T11:53:14.777908+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:53:14.777908+0000","last_undegraded":"2024-09-14T11:53:14.777908+0000","last_fullsized":"2024-09-14T11:53:14.777908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:35.156152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.719675+0000","last_change":"2024-09-14T11:14:14.158980+0000","last_active":"2024-09-14T11:53:53.719675+0000","last_peered":"2024-09-14T11:53:53.719675+0000","last_clean":"2024-09-14T11:53:53.719675+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:53:53.719675+0000","last_undegraded":"2024-09-14T11:53:53.719675+0000","last_fullsized":"2024-09-14T11:53:53.719675+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'845","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540265+0000","last_change":"2024-09-14T11:14:06.121080+0000","last_active":"2024-09-14T11:54:04.540265+0000","last_peered":"2024-09-14T11:54:04.540265+0000","last_clean":"2024-09-14T11:54:04.540265+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:54:04.540265+0000","last_undegraded":"2024-09-14T11:54:04.540265+0000","last_fullsized":"2024-09-14T11:54:04.540265+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.620906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'357","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.837330+0000","last_change":"2024-09-14T11:14:04.123630+0000","last_active":"2024-09-14T11:56:14.837330+0000","last_peered":"2024-09-14T11:56:14.837330+0000","last_clean":"2024-09-14T11:56:14.837330+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:14.837330+0000","last_undegraded":"2024-09-14T11:56:14.837330+0000","last_fullsized":"2024-09-14T11:56:14.837330+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.120592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5259761,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":686,"num_read_kb":16903,"num_write":1198,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771872+0000","last_change":"2024-09-14T11:14:08.130949+0000","last_active":"2024-09-14T11:52:24.771872+0000","last_peered":"2024-09-14T11:52:24.771872+0000","last_clean":"2024-09-14T11:52:24.771872+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:52:24.771872+0000","last_undegraded":"2024-09-14T11:52:24.771872+0000","last_fullsized":"2024-09-14T11:52:24.771872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:57.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.591066+0000","last_change":"2024-09-14T11:14:10.152305+0000","last_active":"2024-09-14T11:56:15.591066+0000","last_peered":"2024-09-14T11:56:15.591066+0000","last_clean":"2024-09-14T11:56:15.591066+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:15.591066+0000","last_undegraded":"2024-09-14T11:56:15.591066+0000","last_fullsized":"2024-09-14T11:56:15.591066+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:30.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894361+0000","last_change":"2024-09-14T11:14:12.155158+0000","last_active":"2024-09-14T11:52:34.894361+0000","last_peered":"2024-09-14T11:52:34.894361+0000","last_clean":"2024-09-14T11:52:34.894361+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:52:34.894361+0000","last_undegraded":"2024-09-14T11:52:34.894361+0000","last_fullsized":"2024-09-14T11:52:34.894361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:57.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'118","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906638+0000","last_change":"2024-09-14T11:14:14.161551+0000","last_active":"2024-09-14T11:54:19.906638+0000","last_peered":"2024-09-14T11:54:19.906638+0000","last_clean":"2024-09-14T11:54:19.906638+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:54:19.906638+0000","last_undegraded":"2024-09-14T11:54:19.906638+0000","last_fullsized":"2024-09-14T11:54:19.906638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:31.034926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1643","reported_seq":3307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.620971+0000","last_change":"2024-09-14T11:14:06.121979+0000","last_active":"2024-09-14T11:55:41.620971+0000","last_peered":"2024-09-14T11:55:41.620971+0000","last_clean":"2024-09-14T11:55:41.620971+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:55:41.620971+0000","last_undegraded":"2024-09-14T11:55:41.620971+0000","last_fullsized":"2024-09-14T11:55:41.620971+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.503786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596591+0000","last_change":"2024-09-14T11:14:04.126591+0000","last_active":"2024-09-14T11:56:15.596591+0000","last_peered":"2024-09-14T11:56:15.596591+0000","last_clean":"2024-09-14T11:56:15.596591+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:15.596591+0000","last_undegraded":"2024-09-14T11:56:15.596591+0000","last_fullsized":"2024-09-14T11:56:15.596591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:36.129660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891630+0000","last_change":"2024-09-14T11:14:08.137550+0000","last_active":"2024-09-14T11:52:24.891630+0000","last_peered":"2024-09-14T11:52:24.891630+0000","last_clean":"2024-09-14T11:52:24.891630+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:52:24.891630+0000","last_undegraded":"2024-09-14T11:52:24.891630+0000","last_fullsized":"2024-09-14T11:52:24.891630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:25.401132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'290","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.736856+0000","last_change":"2024-09-14T11:14:10.147623+0000","last_active":"2024-09-14T11:55:42.736856+0000","last_peered":"2024-09-14T11:55:42.736856+0000","last_clean":"2024-09-14T11:55:42.736856+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:55:42.736856+0000","last_undegraded":"2024-09-14T11:55:42.736856+0000","last_fullsized":"2024-09-14T11:55:42.736856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:59.040566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79243,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1023,"num_write":396,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'759","reported_seq":2576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.743750+0000","last_change":"2024-09-14T11:14:12.150811+0000","last_active":"2024-09-14T11:56:13.743750+0000","last_peered":"2024-09-14T11:56:13.743750+0000","last_clean":"2024-09-14T11:56:13.743750+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:13.743750+0000","last_undegraded":"2024-09-14T11:56:13.743750+0000","last_fullsized":"2024-09-14T11:56:13.743750+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:59.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'145","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.116982+0000","last_change":"2024-09-14T11:14:14.152510+0000","last_active":"2024-09-14T11:54:26.116982+0000","last_peered":"2024-09-14T11:54:26.116982+0000","last_clean":"2024-09-14T11:54:26.116982+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:54:26.116982+0000","last_undegraded":"2024-09-14T11:54:26.116982+0000","last_fullsized":"2024-09-14T11:54:26.116982+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358932+0000","last_change":"2024-09-14T11:14:06.129574+0000","last_active":"2024-09-14T11:54:05.358932+0000","last_peered":"2024-09-14T11:54:05.358932+0000","last_clean":"2024-09-14T11:54:05.358932+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:54:05.358932+0000","last_undegraded":"2024-09-14T11:54:05.358932+0000","last_fullsized":"2024-09-14T11:54:05.358932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.251050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627434+0000","last_change":"2024-09-14T11:14:04.121041+0000","last_active":"2024-09-14T11:56:15.627434+0000","last_peered":"2024-09-14T11:56:15.627434+0000","last_clean":"2024-09-14T11:56:15.627434+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:15.627434+0000","last_undegraded":"2024-09-14T11:56:15.627434+0000","last_fullsized":"2024-09-14T11:56:15.627434+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:42.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.724714+0000","last_change":"2024-09-14T11:14:08.137840+0000","last_active":"2024-09-14T11:56:13.724714+0000","last_peered":"2024-09-14T11:56:13.724714+0000","last_clean":"2024-09-14T11:56:13.724714+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:13.724714+0000","last_undegraded":"2024-09-14T11:56:13.724714+0000","last_fullsized":"2024-09-14T11:56:13.724714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.414460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'79","reported_seq":592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.808261+0000","last_change":"2024-09-14T11:14:10.153344+0000","last_active":"2024-09-14T11:54:18.808261+0000","last_peered":"2024-09-14T11:54:18.808261+0000","last_clean":"2024-09-14T11:54:18.808261+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:54:18.808261+0000","last_undegraded":"2024-09-14T11:54:18.808261+0000","last_fullsized":"2024-09-14T11:54:18.808261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:08.968908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745724+0000","last_change":"2024-09-14T11:14:12.154356+0000","last_active":"2024-09-14T11:56:13.745724+0000","last_peered":"2024-09-14T11:56:13.745724+0000","last_clean":"2024-09-14T11:56:13.745724+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:13.745724+0000","last_undegraded":"2024-09-14T11:56:13.745724+0000","last_fullsized":"2024-09-14T11:56:13.745724+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:48.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.169895+0000","last_change":"2024-09-14T11:14:14.157483+0000","last_active":"2024-09-14T11:54:27.169895+0000","last_peered":"2024-09-14T11:54:27.169895+0000","last_clean":"2024-09-14T11:54:27.169895+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:54:27.169895+0000","last_undegraded":"2024-09-14T11:54:27.169895+0000","last_fullsized":"2024-09-14T11:54:27.169895+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:28.829014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'510","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546442+0000","last_change":"2024-09-14T11:14:06.118633+0000","last_active":"2024-09-14T11:54:26.546442+0000","last_peered":"2024-09-14T11:54:26.546442+0000","last_clean":"2024-09-14T11:54:26.546442+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:54:26.546442+0000","last_undegraded":"2024-09-14T11:54:26.546442+0000","last_fullsized":"2024-09-14T11:54:26.546442+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:05.940637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'309","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.853490+0000","last_change":"2024-09-14T11:14:04.114747+0000","last_active":"2024-09-14T11:56:14.853490+0000","last_peered":"2024-09-14T11:56:14.853490+0000","last_clean":"2024-09-14T11:56:14.853490+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:14.853490+0000","last_undegraded":"2024-09-14T11:56:14.853490+0000","last_fullsized":"2024-09-14T11:56:14.853490+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:09.164037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":617,"num_read_kb":522,"num_write":1116,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:25.780132+0000","last_change":"2024-09-14T11:14:08.136517+0000","last_active":"2024-09-14T11:52:25.780132+0000","last_peered":"2024-09-14T11:52:25.780132+0000","last_clean":"2024-09-14T11:52:25.780132+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:52:25.780132+0000","last_undegraded":"2024-09-14T11:52:25.780132+0000","last_fullsized":"2024-09-14T11:52:25.780132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:22.745520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'358","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.456163+0000","last_change":"2024-09-14T11:14:10.153476+0000","last_active":"2024-09-14T11:56:14.456163+0000","last_peered":"2024-09-14T11:56:14.456163+0000","last_clean":"2024-09-14T11:56:14.456163+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:14.456163+0000","last_undegraded":"2024-09-14T11:56:14.456163+0000","last_fullsized":"2024-09-14T11:56:14.456163+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:16.395304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:30.780175+0000","last_change":"2024-09-14T11:14:12.154775+0000","last_active":"2024-09-14T11:52:30.780175+0000","last_peered":"2024-09-14T11:52:30.780175+0000","last_clean":"2024-09-14T11:52:30.780175+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:52:30.780175+0000","last_undegraded":"2024-09-14T11:52:30.780175+0000","last_fullsized":"2024-09-14T11:52:30.780175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:42.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'182","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.542886+0000","last_change":"2024-09-14T11:14:14.155863+0000","last_active":"2024-09-14T11:54:08.542886+0000","last_peered":"2024-09-14T11:54:08.542886+0000","last_clean":"2024-09-14T11:54:08.542886+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:54:08.542886+0000","last_undegraded":"2024-09-14T11:54:08.542886+0000","last_fullsized":"2024-09-14T11:54:08.542886+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'464","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114499+0000","last_change":"2024-09-14T11:14:06.128526+0000","last_active":"2024-09-14T11:54:27.114499+0000","last_peered":"2024-09-14T11:54:27.114499+0000","last_clean":"2024-09-14T11:54:27.114499+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:54:27.114499+0000","last_undegraded":"2024-09-14T11:54:27.114499+0000","last_fullsized":"2024-09-14T11:54:27.114499+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:37.682655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798596+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:53:59.798596+0000","last_peered":"2024-09-14T11:53:59.798596+0000","last_clean":"2024-09-14T11:53:59.798596+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:53:59.798596+0000","last_undegraded":"2024-09-14T11:53:59.798596+0000","last_fullsized":"2024-09-14T11:53:59.798596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037656+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:53:31.037656+0000","last_peered":"2024-09-14T11:53:31.037656+0000","last_clean":"2024-09-14T11:53:31.037656+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:53:31.037656+0000","last_undegraded":"2024-09-14T11:53:31.037656+0000","last_fullsized":"2024-09-14T11:53:31.037656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'300","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.739239+0000","last_change":"2024-09-14T11:14:38.194463+0000","last_active":"2024-09-14T11:56:14.739239+0000","last_peered":"2024-09-14T11:56:14.739239+0000","last_clean":"2024-09-14T11:56:14.739239+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:14.739239+0000","last_undegraded":"2024-09-14T11:56:14.739239+0000","last_fullsized":"2024-09-14T11:56:14.739239+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:55.622697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28690,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":707,"num_read_kb":7470,"num_write":982,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.796289+0000","last_change":"2024-09-14T11:14:08.127046+0000","last_active":"2024-09-14T11:53:44.796289+0000","last_peered":"2024-09-14T11:53:44.796289+0000","last_clean":"2024-09-14T11:53:44.796289+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:53:44.796289+0000","last_undegraded":"2024-09-14T11:53:44.796289+0000","last_fullsized":"2024-09-14T11:53:44.796289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:28.320083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.067086+0000","last_change":"2024-09-14T11:14:10.150205+0000","last_active":"2024-09-14T11:56:15.067086+0000","last_peered":"2024-09-14T11:56:15.067086+0000","last_clean":"2024-09-14T11:56:15.067086+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:15.067086+0000","last_undegraded":"2024-09-14T11:56:15.067086+0000","last_fullsized":"2024-09-14T11:56:15.067086+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:59.627142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899257+0000","last_change":"2024-09-14T11:14:12.153336+0000","last_active":"2024-09-14T11:53:14.899257+0000","last_peered":"2024-09-14T11:53:14.899257+0000","last_clean":"2024-09-14T11:53:14.899257+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:53:14.899257+0000","last_undegraded":"2024-09-14T11:53:14.899257+0000","last_fullsized":"2024-09-14T11:53:14.899257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:44.740572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.171650+0000","last_change":"2024-09-14T11:14:14.160899+0000","last_active":"2024-09-14T11:54:27.171650+0000","last_peered":"2024-09-14T11:54:27.171650+0000","last_clean":"2024-09-14T11:54:27.171650+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:54:27.171650+0000","last_undegraded":"2024-09-14T11:54:27.171650+0000","last_fullsized":"2024-09-14T11:54:27.171650+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:04.990449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1362","reported_seq":3132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461598+0000","last_change":"2024-09-14T11:14:06.132529+0000","last_active":"2024-09-14T11:54:24.461598+0000","last_peered":"2024-09-14T11:54:24.461598+0000","last_clean":"2024-09-14T11:54:24.461598+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:54:24.461598+0000","last_undegraded":"2024-09-14T11:54:24.461598+0000","last_fullsized":"2024-09-14T11:54:24.461598+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:28.977740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.799455+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:54:04.799455+0000","last_peered":"2024-09-14T11:54:04.799455+0000","last_clean":"2024-09-14T11:54:04.799455+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:54:04.799455+0000","last_undegraded":"2024-09-14T11:54:04.799455+0000","last_fullsized":"2024-09-14T11:54:04.799455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'342","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887104+0000","last_change":"2024-09-14T11:14:04.129263+0000","last_active":"2024-09-14T11:56:14.887104+0000","last_peered":"2024-09-14T11:56:14.887104+0000","last_clean":"2024-09-14T11:56:14.887104+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:14.887104+0000","last_undegraded":"2024-09-14T11:56:14.887104+0000","last_fullsized":"2024-09-14T11:56:14.887104+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:09.002526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6274379,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":595,"num_read_kb":6150,"num_write":1129,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.034937+0000","last_change":"2024-09-14T11:14:08.132493+0000","last_active":"2024-09-14T11:53:11.034937+0000","last_peered":"2024-09-14T11:53:11.034937+0000","last_clean":"2024-09-14T11:53:11.034937+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:53:11.034937+0000","last_undegraded":"2024-09-14T11:53:11.034937+0000","last_fullsized":"2024-09-14T11:53:11.034937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:47.392912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1252","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.501292+0000","last_change":"2024-09-14T11:14:10.149170+0000","last_active":"2024-09-14T11:56:14.501292+0000","last_peered":"2024-09-14T11:56:14.501292+0000","last_clean":"2024-09-14T11:56:14.501292+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:14.501292+0000","last_undegraded":"2024-09-14T11:56:14.501292+0000","last_fullsized":"2024-09-14T11:56:14.501292+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:28.655782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119324,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1945,"num_read_kb":3507,"num_write":1048,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798697+0000","last_change":"2024-09-14T11:14:12.148579+0000","last_active":"2024-09-14T11:53:59.798697+0000","last_peered":"2024-09-14T11:53:59.798697+0000","last_clean":"2024-09-14T11:53:59.798697+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:53:59.798697+0000","last_undegraded":"2024-09-14T11:53:59.798697+0000","last_fullsized":"2024-09-14T11:53:59.798697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:34.551801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'132","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.544059+0000","last_change":"2024-09-14T11:14:14.146054+0000","last_active":"2024-09-14T11:54:26.544059+0000","last_peered":"2024-09-14T11:54:26.544059+0000","last_clean":"2024-09-14T11:54:26.544059+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:54:26.544059+0000","last_undegraded":"2024-09-14T11:54:26.544059+0000","last_fullsized":"2024-09-14T11:54:26.544059+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'782","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114491+0000","last_change":"2024-09-14T11:14:06.121305+0000","last_active":"2024-09-14T11:54:27.114491+0000","last_peered":"2024-09-14T11:54:27.114491+0000","last_clean":"2024-09-14T11:54:27.114491+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:54:27.114491+0000","last_undegraded":"2024-09-14T11:54:27.114491+0000","last_fullsized":"2024-09-14T11:54:27.114491+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:09.239590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.779410+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:53:29.779410+0000","last_peered":"2024-09-14T11:53:29.779410+0000","last_clean":"2024-09-14T11:53:29.779410+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:53:29.779410+0000","last_undegraded":"2024-09-14T11:53:29.779410+0000","last_fullsized":"2024-09-14T11:53:29.779410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.901283+0000","last_change":"2024-09-14T11:14:04.124056+0000","last_active":"2024-09-14T11:56:14.901283+0000","last_peered":"2024-09-14T11:56:14.901283+0000","last_clean":"2024-09-14T11:56:14.901283+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:14.901283+0000","last_undegraded":"2024-09-14T11:56:14.901283+0000","last_fullsized":"2024-09-14T11:56:14.901283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:04.512560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704641,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":659,"num_read_kb":72006,"num_write":1117,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777365+0000","last_change":"2024-09-14T11:14:08.136300+0000","last_active":"2024-09-14T11:53:09.777365+0000","last_peered":"2024-09-14T11:53:09.777365+0000","last_clean":"2024-09-14T11:53:09.777365+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:53:09.777365+0000","last_undegraded":"2024-09-14T11:53:09.777365+0000","last_fullsized":"2024-09-14T11:53:09.777365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.813468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'251","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.881867+0000","last_change":"2024-09-14T11:14:10.150542+0000","last_active":"2024-09-14T11:55:42.881867+0000","last_peered":"2024-09-14T11:55:42.881867+0000","last_clean":"2024-09-14T11:55:42.881867+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:55:42.881867+0000","last_undegraded":"2024-09-14T11:55:42.881867+0000","last_fullsized":"2024-09-14T11:55:42.881867+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:40.011295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903323+0000","last_change":"2024-09-14T11:14:12.151445+0000","last_active":"2024-09-14T11:53:49.903323+0000","last_peered":"2024-09-14T11:53:49.903323+0000","last_clean":"2024-09-14T11:53:49.903323+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:53:49.903323+0000","last_undegraded":"2024-09-14T11:53:49.903323+0000","last_fullsized":"2024-09-14T11:53:49.903323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:44.622819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'267","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.261950+0000","last_change":"2024-09-14T11:14:14.160808+0000","last_active":"2024-09-14T11:54:27.261950+0000","last_peered":"2024-09-14T11:54:27.261950+0000","last_clean":"2024-09-14T11:54:27.261950+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:54:27.261950+0000","last_undegraded":"2024-09-14T11:54:27.261950+0000","last_fullsized":"2024-09-14T11:54:27.261950+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:19.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'430","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261834+0000","last_change":"2024-09-14T11:14:06.126970+0000","last_active":"2024-09-14T11:54:09.261834+0000","last_peered":"2024-09-14T11:54:09.261834+0000","last_clean":"2024-09-14T11:54:09.261834+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:54:09.261834+0000","last_undegraded":"2024-09-14T11:54:09.261834+0000","last_fullsized":"2024-09-14T11:54:09.261834+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.633196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037624+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:53:31.037624+0000","last_peered":"2024-09-14T11:53:31.037624+0000","last_clean":"2024-09-14T11:53:31.037624+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:53:31.037624+0000","last_undegraded":"2024-09-14T11:53:31.037624+0000","last_fullsized":"2024-09-14T11:53:31.037624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'299","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.690633+0000","last_change":"2024-09-14T11:14:38.192227+0000","last_active":"2024-09-14T11:56:14.690633+0000","last_peered":"2024-09-14T11:56:14.690633+0000","last_clean":"2024-09-14T11:56:14.690633+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:14.690633+0000","last_undegraded":"2024-09-14T11:56:14.690633+0000","last_fullsized":"2024-09-14T11:56:14.690633+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:28.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2382,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1214,"num_read_kb":7389,"num_write":1076,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903347+0000","last_change":"2024-09-14T11:14:08.128824+0000","last_active":"2024-09-14T11:53:49.903347+0000","last_peered":"2024-09-14T11:53:49.903347+0000","last_clean":"2024-09-14T11:53:49.903347+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:53:49.903347+0000","last_undegraded":"2024-09-14T11:53:49.903347+0000","last_fullsized":"2024-09-14T11:53:49.903347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:21.240092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914906+0000","last_change":"2024-09-14T11:14:10.153993+0000","last_active":"2024-09-14T11:55:19.914906+0000","last_peered":"2024-09-14T11:55:19.914906+0000","last_clean":"2024-09-14T11:55:19.914906+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:55:19.914906+0000","last_undegraded":"2024-09-14T11:55:19.914906+0000","last_fullsized":"2024-09-14T11:55:19.914906+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:30.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786573+0000","last_change":"2024-09-14T11:14:12.155597+0000","last_active":"2024-09-14T11:53:15.786573+0000","last_peered":"2024-09-14T11:53:15.786573+0000","last_clean":"2024-09-14T11:53:15.786573+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:53:15.786573+0000","last_undegraded":"2024-09-14T11:53:15.786573+0000","last_fullsized":"2024-09-14T11:53:15.786573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:57.628565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.459335+0000","last_change":"2024-09-14T11:14:14.159918+0000","last_active":"2024-09-14T11:54:24.459335+0000","last_peered":"2024-09-14T11:54:24.459335+0000","last_clean":"2024-09-14T11:54:24.459335+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:54:24.459335+0000","last_undegraded":"2024-09-14T11:54:24.459335+0000","last_fullsized":"2024-09-14T11:54:24.459335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'456","reported_seq":2014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540230+0000","last_change":"2024-09-14T11:14:06.123387+0000","last_active":"2024-09-14T11:54:04.540230+0000","last_peered":"2024-09-14T11:54:04.540230+0000","last_clean":"2024-09-14T11:54:04.540230+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:54:04.540230+0000","last_undegraded":"2024-09-14T11:54:04.540230+0000","last_fullsized":"2024-09-14T11:54:04.540230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.573555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596601+0000","last_change":"2024-09-14T11:14:04.122373+0000","last_active":"2024-09-14T11:56:15.596601+0000","last_peered":"2024-09-14T11:56:15.596601+0000","last_clean":"2024-09-14T11:56:15.596601+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:15.596601+0000","last_undegraded":"2024-09-14T11:56:15.596601+0000","last_fullsized":"2024-09-14T11:56:15.596601+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.435958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.900264+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:53:29.900264+0000","last_peered":"2024-09-14T11:53:29.900264+0000","last_clean":"2024-09-14T11:53:29.900264+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:53:29.900264+0000","last_undegraded":"2024-09-14T11:53:29.900264+0000","last_fullsized":"2024-09-14T11:53:29.900264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902721+0000","last_change":"2024-09-14T11:14:08.133183+0000","last_active":"2024-09-14T11:53:44.902721+0000","last_peered":"2024-09-14T11:53:44.902721+0000","last_clean":"2024-09-14T11:53:44.902721+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:53:44.902721+0000","last_undegraded":"2024-09-14T11:53:44.902721+0000","last_fullsized":"2024-09-14T11:53:44.902721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:59.309932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'535","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.161109+0000","last_change":"2024-09-14T11:14:10.149213+0000","last_active":"2024-09-14T11:56:14.161109+0000","last_peered":"2024-09-14T11:56:14.161109+0000","last_clean":"2024-09-14T11:56:14.161109+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:14.161109+0000","last_undegraded":"2024-09-14T11:56:14.161109+0000","last_fullsized":"2024-09-14T11:56:14.161109+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:41.451954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":930,"num_read_kb":2012,"num_write":766,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791397+0000","last_change":"2024-09-14T11:14:12.151179+0000","last_active":"2024-09-14T11:53:50.791397+0000","last_peered":"2024-09-14T11:53:50.791397+0000","last_clean":"2024-09-14T11:53:50.791397+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:53:50.791397+0000","last_undegraded":"2024-09-14T11:53:50.791397+0000","last_fullsized":"2024-09-14T11:53:50.791397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:00.606325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'163","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.780862+0000","last_change":"2024-09-14T11:14:14.155856+0000","last_active":"2024-09-14T11:54:07.780862+0000","last_peered":"2024-09-14T11:54:07.780862+0000","last_clean":"2024-09-14T11:54:07.780862+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:54:07.780862+0000","last_undegraded":"2024-09-14T11:54:07.780862+0000","last_fullsized":"2024-09-14T11:54:07.780862+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:06.203953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'751","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462007+0000","last_change":"2024-09-14T11:14:06.133092+0000","last_active":"2024-09-14T11:54:24.462007+0000","last_peered":"2024-09-14T11:54:24.462007+0000","last_clean":"2024-09-14T11:54:24.462007+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:54:24.462007+0000","last_undegraded":"2024-09-14T11:54:24.462007+0000","last_fullsized":"2024-09-14T11:54:24.462007+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.029629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'328","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879940+0000","last_change":"2024-09-14T11:14:04.126657+0000","last_active":"2024-09-14T11:56:14.879940+0000","last_peered":"2024-09-14T11:56:14.879940+0000","last_clean":"2024-09-14T11:56:14.879940+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:14.879940+0000","last_undegraded":"2024-09-14T11:56:14.879940+0000","last_fullsized":"2024-09-14T11:56:14.879940+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.821826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583989,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":613,"num_read_kb":25654,"num_write":983,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795376+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:53:39.795376+0000","last_peered":"2024-09-14T11:53:39.795376+0000","last_clean":"2024-09-14T11:53:39.795376+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:53:39.795376+0000","last_undegraded":"2024-09-14T11:53:39.795376+0000","last_fullsized":"2024-09-14T11:53:39.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790686+0000","last_change":"2024-09-14T11:14:08.130246+0000","last_active":"2024-09-14T11:53:45.790686+0000","last_peered":"2024-09-14T11:53:45.790686+0000","last_clean":"2024-09-14T11:53:45.790686+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:53:45.790686+0000","last_undegraded":"2024-09-14T11:53:45.790686+0000","last_fullsized":"2024-09-14T11:53:45.790686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:01.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.533448+0000","last_change":"2024-09-14T11:14:10.139669+0000","last_active":"2024-09-14T11:54:47.533448+0000","last_peered":"2024-09-14T11:54:47.533448+0000","last_clean":"2024-09-14T11:54:47.533448+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:54:47.533448+0000","last_undegraded":"2024-09-14T11:54:47.533448+0000","last_fullsized":"2024-09-14T11:54:47.533448+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:53.709411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'810","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.658795+0000","last_change":"2024-09-14T11:14:12.147417+0000","last_active":"2024-09-14T11:56:15.658795+0000","last_peered":"2024-09-14T11:56:15.658795+0000","last_clean":"2024-09-14T11:56:15.658795+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:15.658795+0000","last_undegraded":"2024-09-14T11:56:15.658795+0000","last_fullsized":"2024-09-14T11:56:15.658795+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.126531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'93","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.910691+0000","last_change":"2024-09-14T11:14:14.157125+0000","last_active":"2024-09-14T11:54:49.910691+0000","last_peered":"2024-09-14T11:54:49.910691+0000","last_clean":"2024-09-14T11:54:49.910691+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:54:49.910691+0000","last_undegraded":"2024-09-14T11:54:49.910691+0000","last_fullsized":"2024-09-14T11:54:49.910691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:21.815471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'359","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906023+0000","last_change":"2024-09-14T11:14:06.125720+0000","last_active":"2024-09-14T11:54:14.906023+0000","last_peered":"2024-09-14T11:54:14.906023+0000","last_clean":"2024-09-14T11:54:14.906023+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:54:14.906023+0000","last_undegraded":"2024-09-14T11:54:14.906023+0000","last_fullsized":"2024-09-14T11:54:14.906023+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:46.137614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'307","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.725729+0000","last_change":"2024-09-14T11:14:38.192877+0000","last_active":"2024-09-14T11:56:14.725729+0000","last_peered":"2024-09-14T11:56:14.725729+0000","last_clean":"2024-09-14T11:56:14.725729+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:14.725729+0000","last_undegraded":"2024-09-14T11:56:14.725729+0000","last_fullsized":"2024-09-14T11:56:14.725729+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:30.960755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65182,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":517,"num_read_kb":1407,"num_write":960,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895813+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:52:54.895813+0000","last_peered":"2024-09-14T11:52:54.895813+0000","last_clean":"2024-09-14T11:52:54.895813+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:52:54.895813+0000","last_undegraded":"2024-09-14T11:52:54.895813+0000","last_fullsized":"2024-09-14T11:52:54.895813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790665+0000","last_change":"2024-09-14T11:14:08.135691+0000","last_active":"2024-09-14T11:53:45.790665+0000","last_peered":"2024-09-14T11:53:45.790665+0000","last_clean":"2024-09-14T11:53:45.790665+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:53:45.790665+0000","last_undegraded":"2024-09-14T11:53:45.790665+0000","last_fullsized":"2024-09-14T11:53:45.790665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:47.242553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'99","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.842534+0000","last_change":"2024-09-14T11:14:10.151595+0000","last_active":"2024-09-14T11:54:18.842534+0000","last_peered":"2024-09-14T11:54:18.842534+0000","last_clean":"2024-09-14T11:54:18.842534+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:54:18.842534+0000","last_undegraded":"2024-09-14T11:54:18.842534+0000","last_fullsized":"2024-09-14T11:54:18.842534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:13.188765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'788","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745773+0000","last_change":"2024-09-14T11:14:12.153305+0000","last_active":"2024-09-14T11:56:13.745773+0000","last_peered":"2024-09-14T11:56:13.745773+0000","last_clean":"2024-09-14T11:56:13.745773+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:13.745773+0000","last_undegraded":"2024-09-14T11:56:13.745773+0000","last_fullsized":"2024-09-14T11:56:13.745773+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:43.896569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'327","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573474+0000","last_change":"2024-09-14T11:14:14.156952+0000","last_active":"2024-09-14T11:55:41.573474+0000","last_peered":"2024-09-14T11:55:41.573474+0000","last_clean":"2024-09-14T11:55:41.573474+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:55:41.573474+0000","last_undegraded":"2024-09-14T11:55:41.573474+0000","last_fullsized":"2024-09-14T11:55:41.573474+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:32.686915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1137","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546620+0000","last_change":"2024-09-14T11:14:06.126733+0000","last_active":"2024-09-14T11:54:26.546620+0000","last_peered":"2024-09-14T11:54:26.546620+0000","last_clean":"2024-09-14T11:54:26.546620+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:54:26.546620+0000","last_undegraded":"2024-09-14T11:54:26.546620+0000","last_fullsized":"2024-09-14T11:54:26.546620+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:23.487750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.911863+0000","last_change":"2024-09-14T11:14:04.122866+0000","last_active":"2024-09-14T11:56:14.911863+0000","last_peered":"2024-09-14T11:56:14.911863+0000","last_clean":"2024-09-14T11:56:14.911863+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:14.911863+0000","last_undegraded":"2024-09-14T11:56:14.911863+0000","last_fullsized":"2024-09-14T11:56:14.911863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:50.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657270,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":597,"num_read_kb":7233,"num_write":1267,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783429+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:52:55.783429+0000","last_peered":"2024-09-14T11:52:55.783429+0000","last_clean":"2024-09-14T11:52:55.783429+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:52:55.783429+0000","last_undegraded":"2024-09-14T11:52:55.783429+0000","last_fullsized":"2024-09-14T11:52:55.783429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.905998+0000","last_change":"2024-09-14T11:14:08.133929+0000","last_active":"2024-09-14T11:54:14.905998+0000","last_peered":"2024-09-14T11:54:14.905998+0000","last_clean":"2024-09-14T11:54:14.905998+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:54:14.905998+0000","last_undegraded":"2024-09-14T11:54:14.905998+0000","last_fullsized":"2024-09-14T11:54:14.905998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.740629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'757","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.338152+0000","last_change":"2024-09-14T11:14:10.152020+0000","last_active":"2024-09-14T11:56:14.338152+0000","last_peered":"2024-09-14T11:56:14.338152+0000","last_clean":"2024-09-14T11:56:14.338152+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:14.338152+0000","last_undegraded":"2024-09-14T11:56:14.338152+0000","last_fullsized":"2024-09-14T11:56:14.338152+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:50.734251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147171,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1349,"num_read_kb":3105,"num_write":1118,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903071+0000","last_change":"2024-09-14T11:14:12.151322+0000","last_active":"2024-09-14T11:53:49.903071+0000","last_peered":"2024-09-14T11:53:49.903071+0000","last_clean":"2024-09-14T11:53:49.903071+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:53:49.903071+0000","last_undegraded":"2024-09-14T11:53:49.903071+0000","last_fullsized":"2024-09-14T11:53:49.903071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:55.159584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.544659+0000","last_change":"2024-09-14T11:14:14.164267+0000","last_active":"2024-09-14T11:54:08.544659+0000","last_peered":"2024-09-14T11:54:08.544659+0000","last_clean":"2024-09-14T11:54:08.544659+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:54:08.544659+0000","last_undegraded":"2024-09-14T11:54:08.544659+0000","last_fullsized":"2024-09-14T11:54:08.544659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:05.688641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'143","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.219226+0000","last_change":"2024-09-14T11:14:14.160222+0000","last_active":"2024-09-14T11:54:27.219226+0000","last_peered":"2024-09-14T11:54:27.219226+0000","last_clean":"2024-09-14T11:54:27.219226+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:54:27.219226+0000","last_undegraded":"2024-09-14T11:54:27.219226+0000","last_fullsized":"2024-09-14T11:54:27.219226+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:30.394037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'430","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783769+0000","last_change":"2024-09-14T11:14:06.128783+0000","last_active":"2024-09-14T11:54:07.783769+0000","last_peered":"2024-09-14T11:54:07.783769+0000","last_clean":"2024-09-14T11:54:07.783769+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:54:07.783769+0000","last_undegraded":"2024-09-14T11:54:07.783769+0000","last_fullsized":"2024-09-14T11:54:07.783769+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:11.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633344+0000","last_change":"2024-09-14T11:14:04.130995+0000","last_active":"2024-09-14T11:56:15.633344+0000","last_peered":"2024-09-14T11:56:15.633344+0000","last_clean":"2024-09-14T11:56:15.633344+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:15.633344+0000","last_undegraded":"2024-09-14T11:56:15.633344+0000","last_fullsized":"2024-09-14T11:56:15.633344+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:00.303178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.713330+0000","last_change":"2024-09-14T11:14:08.137606+0000","last_active":"2024-09-14T11:56:13.713330+0000","last_peered":"2024-09-14T11:56:13.713330+0000","last_clean":"2024-09-14T11:56:13.713330+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:13.713330+0000","last_undegraded":"2024-09-14T11:56:13.713330+0000","last_fullsized":"2024-09-14T11:56:13.713330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.107289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'263","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.676370+0000","last_change":"2024-09-14T11:14:10.149828+0000","last_active":"2024-09-14T11:56:14.676370+0000","last_peered":"2024-09-14T11:56:14.676370+0000","last_clean":"2024-09-14T11:56:14.676370+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:14.676370+0000","last_undegraded":"2024-09-14T11:56:14.676370+0000","last_fullsized":"2024-09-14T11:56:14.676370+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.820903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903614+0000","last_change":"2024-09-14T11:14:12.152653+0000","last_active":"2024-09-14T11:53:54.903614+0000","last_peered":"2024-09-14T11:53:54.903614+0000","last_clean":"2024-09-14T11:53:54.903614+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:53:54.903614+0000","last_undegraded":"2024-09-14T11:53:54.903614+0000","last_fullsized":"2024-09-14T11:53:54.903614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:35.385522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.992844+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:26.992844+0000","last_peered":"2024-09-14T11:54:26.992844+0000","last_clean":"2024-09-14T11:54:26.992844+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:26.992844+0000","last_undegraded":"2024-09-14T11:54:26.992844+0000","last_fullsized":"2024-09-14T11:54:26.992844+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'780","reported_seq":2399,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262003+0000","last_change":"2024-09-14T11:14:06.131159+0000","last_active":"2024-09-14T11:54:09.262003+0000","last_peered":"2024-09-14T11:54:09.262003+0000","last_clean":"2024-09-14T11:54:09.262003+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:54:09.262003+0000","last_undegraded":"2024-09-14T11:54:09.262003+0000","last_fullsized":"2024-09-14T11:54:09.262003+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:12.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'345","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.800943+0000","last_change":"2024-09-14T11:14:04.136243+0000","last_active":"2024-09-14T11:56:14.800943+0000","last_peered":"2024-09-14T11:56:14.800943+0000","last_clean":"2024-09-14T11:56:14.800943+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:14.800943+0000","last_undegraded":"2024-09-14T11:56:14.800943+0000","last_fullsized":"2024-09-14T11:56:14.800943+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:43.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22419747,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":606,"num_read_kb":24187,"num_write":1136,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903109+0000","last_change":"2024-09-14T11:14:08.132760+0000","last_active":"2024-09-14T11:53:49.903109+0000","last_peered":"2024-09-14T11:53:49.903109+0000","last_clean":"2024-09-14T11:53:49.903109+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:53:49.903109+0000","last_undegraded":"2024-09-14T11:53:49.903109+0000","last_fullsized":"2024-09-14T11:53:49.903109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.260856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'48","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.684887+0000","last_change":"2024-09-14T11:14:10.148065+0000","last_active":"2024-09-14T11:54:18.684887+0000","last_peered":"2024-09-14T11:54:18.684887+0000","last_clean":"2024-09-14T11:54:18.684887+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:54:18.684887+0000","last_undegraded":"2024-09-14T11:54:18.684887+0000","last_fullsized":"2024-09-14T11:54:18.684887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:38.290868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797903+0000","last_change":"2024-09-14T11:14:12.150881+0000","last_active":"2024-09-14T11:53:54.797903+0000","last_peered":"2024-09-14T11:53:54.797903+0000","last_clean":"2024-09-14T11:53:54.797903+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:53:54.797903+0000","last_undegraded":"2024-09-14T11:53:54.797903+0000","last_fullsized":"2024-09-14T11:53:54.797903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:58.272068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'218","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.536299+0000","last_change":"2024-09-14T11:14:14.153783+0000","last_active":"2024-09-14T11:54:26.536299+0000","last_peered":"2024-09-14T11:54:26.536299+0000","last_clean":"2024-09-14T11:54:26.536299+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:54:26.536299+0000","last_undegraded":"2024-09-14T11:54:26.536299+0000","last_fullsized":"2024-09-14T11:54:26.536299+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:47.004373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'913","reported_seq":2649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.628932+0000","last_change":"2024-09-14T11:14:06.125324+0000","last_active":"2024-09-14T11:55:41.628932+0000","last_peered":"2024-09-14T11:55:41.628932+0000","last_clean":"2024-09-14T11:55:41.628932+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:55:41.628932+0000","last_undegraded":"2024-09-14T11:55:41.628932+0000","last_fullsized":"2024-09-14T11:55:41.628932+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:01.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.616179+0000","last_change":"2024-09-14T11:14:04.125695+0000","last_active":"2024-09-14T11:56:15.616179+0000","last_peered":"2024-09-14T11:56:15.616179+0000","last_clean":"2024-09-14T11:56:15.616179+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:15.616179+0000","last_undegraded":"2024-09-14T11:56:15.616179+0000","last_fullsized":"2024-09-14T11:56:15.616179+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:38.353380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.796955+0000","last_change":"2024-09-14T11:14:08.136483+0000","last_active":"2024-09-14T11:53:49.796955+0000","last_peered":"2024-09-14T11:53:49.796955+0000","last_clean":"2024-09-14T11:53:49.796955+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:53:49.796955+0000","last_undegraded":"2024-09-14T11:53:49.796955+0000","last_fullsized":"2024-09-14T11:53:49.796955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:28.874481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.055458+0000","last_change":"2024-09-14T11:14:10.151225+0000","last_active":"2024-09-14T11:56:14.055458+0000","last_peered":"2024-09-14T11:56:14.055458+0000","last_clean":"2024-09-14T11:56:14.055458+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:14.055458+0000","last_undegraded":"2024-09-14T11:56:14.055458+0000","last_fullsized":"2024-09-14T11:56:14.055458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:07.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792203+0000","last_change":"2024-09-14T11:14:12.152706+0000","last_active":"2024-09-14T11:53:55.792203+0000","last_peered":"2024-09-14T11:53:55.792203+0000","last_clean":"2024-09-14T11:53:55.792203+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:53:55.792203+0000","last_undegraded":"2024-09-14T11:53:55.792203+0000","last_fullsized":"2024-09-14T11:53:55.792203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:02.677520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'129","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.902922+0000","last_change":"2024-09-14T11:14:14.163359+0000","last_active":"2024-09-14T11:54:26.902922+0000","last_peered":"2024-09-14T11:54:26.902922+0000","last_clean":"2024-09-14T11:54:26.902922+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:54:26.902922+0000","last_undegraded":"2024-09-14T11:54:26.902922+0000","last_fullsized":"2024-09-14T11:54:26.902922+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'564","reported_seq":2291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629178+0000","last_change":"2024-09-14T11:14:06.114979+0000","last_active":"2024-09-14T11:55:41.629178+0000","last_peered":"2024-09-14T11:55:41.629178+0000","last_clean":"2024-09-14T11:55:41.629178+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:55:41.629178+0000","last_undegraded":"2024-09-14T11:55:41.629178+0000","last_fullsized":"2024-09-14T11:55:41.629178+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:34.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'381","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886235+0000","last_change":"2024-09-14T11:14:04.123707+0000","last_active":"2024-09-14T11:56:14.886235+0000","last_peered":"2024-09-14T11:56:14.886235+0000","last_clean":"2024-09-14T11:56:14.886235+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:14.886235+0000","last_undegraded":"2024-09-14T11:56:14.886235+0000","last_fullsized":"2024-09-14T11:56:14.886235+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:47.655600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17714616,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":685,"num_read_kb":20814,"num_write":1338,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791400+0000","last_change":"2024-09-14T11:14:08.138146+0000","last_active":"2024-09-14T11:53:50.791400+0000","last_peered":"2024-09-14T11:53:50.791400+0000","last_clean":"2024-09-14T11:53:50.791400+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:53:50.791400+0000","last_undegraded":"2024-09-14T11:53:50.791400+0000","last_fullsized":"2024-09-14T11:53:50.791400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.928629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'266","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.855796+0000","last_change":"2024-09-14T11:14:10.151325+0000","last_active":"2024-09-14T11:56:13.855796+0000","last_peered":"2024-09-14T11:56:13.855796+0000","last_clean":"2024-09-14T11:56:13.855796+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:13.855796+0000","last_undegraded":"2024-09-14T11:56:13.855796+0000","last_fullsized":"2024-09-14T11:56:13.855796+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:32.211592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903894+0000","last_change":"2024-09-14T11:14:12.154497+0000","last_active":"2024-09-14T11:53:54.903894+0000","last_peered":"2024-09-14T11:53:54.903894+0000","last_clean":"2024-09-14T11:53:54.903894+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:53:54.903894+0000","last_undegraded":"2024-09-14T11:53:54.903894+0000","last_fullsized":"2024-09-14T11:53:54.903894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:27.388051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114150+0000","last_change":"2024-09-14T11:14:06.128364+0000","last_active":"2024-09-14T11:54:27.114150+0000","last_peered":"2024-09-14T11:54:27.114150+0000","last_clean":"2024-09-14T11:54:27.114150+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:54:27.114150+0000","last_undegraded":"2024-09-14T11:54:27.114150+0000","last_fullsized":"2024-09-14T11:54:27.114150+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.420636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.920042+0000","last_change":"2024-09-14T11:14:04.124479+0000","last_active":"2024-09-14T11:56:14.920042+0000","last_peered":"2024-09-14T11:56:14.920042+0000","last_clean":"2024-09-14T11:56:14.920042+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:14.920042+0000","last_undegraded":"2024-09-14T11:56:14.920042+0000","last_fullsized":"2024-09-14T11:56:14.920042+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:07.746886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22971,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":546,"num_read_kb":1976,"num_write":1057,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906070+0000","last_change":"2024-09-14T11:14:08.125925+0000","last_active":"2024-09-14T11:54:14.906070+0000","last_peered":"2024-09-14T11:54:14.906070+0000","last_clean":"2024-09-14T11:54:14.906070+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:54:14.906070+0000","last_undegraded":"2024-09-14T11:54:14.906070+0000","last_fullsized":"2024-09-14T11:54:14.906070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:37.664162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'485","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.759911+0000","last_change":"2024-09-14T11:14:10.149612+0000","last_active":"2024-09-14T11:56:13.759911+0000","last_peered":"2024-09-14T11:56:13.759911+0000","last_clean":"2024-09-14T11:56:13.759911+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:13.759911+0000","last_undegraded":"2024-09-14T11:56:13.759911+0000","last_fullsized":"2024-09-14T11:56:13.759911+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:51.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116470,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1869,"num_write":750,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022383+0000","last_change":"2024-09-14T11:14:12.152526+0000","last_active":"2024-09-14T11:51:46.022383+0000","last_peered":"2024-09-14T11:51:46.022383+0000","last_clean":"2024-09-14T11:51:46.022383+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:51:46.022383+0000","last_undegraded":"2024-09-14T11:51:46.022383+0000","last_fullsized":"2024-09-14T11:51:46.022383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.316198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.457622+0000","last_change":"2024-09-14T11:14:14.153440+0000","last_active":"2024-09-14T11:54:24.457622+0000","last_peered":"2024-09-14T11:54:24.457622+0000","last_clean":"2024-09-14T11:54:24.457622+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:54:24.457622+0000","last_undegraded":"2024-09-14T11:54:24.457622+0000","last_fullsized":"2024-09-14T11:54:24.457622+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.457388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'412","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629660+0000","last_change":"2024-09-14T11:14:06.133265+0000","last_active":"2024-09-14T11:55:41.629660+0000","last_peered":"2024-09-14T11:55:41.629660+0000","last_clean":"2024-09-14T11:55:41.629660+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:55:41.629660+0000","last_undegraded":"2024-09-14T11:55:41.629660+0000","last_fullsized":"2024-09-14T11:55:41.629660+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:39.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'331","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886913+0000","last_change":"2024-09-14T11:14:04.120305+0000","last_active":"2024-09-14T11:56:14.886913+0000","last_peered":"2024-09-14T11:56:14.886913+0000","last_clean":"2024-09-14T11:56:14.886913+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:14.886913+0000","last_undegraded":"2024-09-14T11:56:14.886913+0000","last_fullsized":"2024-09-14T11:56:14.886913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:30.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245368,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":667,"num_read_kb":10770,"num_write":1182,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790754+0000","last_change":"2024-09-14T11:14:08.136472+0000","last_active":"2024-09-14T11:53:45.790754+0000","last_peered":"2024-09-14T11:53:45.790754+0000","last_clean":"2024-09-14T11:53:45.790754+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:53:45.790754+0000","last_undegraded":"2024-09-14T11:53:45.790754+0000","last_fullsized":"2024-09-14T11:53:45.790754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:13.023971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.930797+0000","last_change":"2024-09-14T11:14:10.152603+0000","last_active":"2024-09-14T11:56:13.930797+0000","last_peered":"2024-09-14T11:56:13.930797+0000","last_clean":"2024-09-14T11:56:13.930797+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:13.930797+0000","last_undegraded":"2024-09-14T11:56:13.930797+0000","last_fullsized":"2024-09-14T11:56:13.930797+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:04.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.887234+0000","last_change":"2024-09-14T11:14:12.153956+0000","last_active":"2024-09-14T11:51:44.887234+0000","last_peered":"2024-09-14T11:51:44.887234+0000","last_clean":"2024-09-14T11:51:44.887234+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:51:44.887234+0000","last_undegraded":"2024-09-14T11:51:44.887234+0000","last_fullsized":"2024-09-14T11:51:44.887234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:06.820196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'231","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.069083+0000","last_change":"2024-09-14T11:14:14.159808+0000","last_active":"2024-09-14T11:54:25.069083+0000","last_peered":"2024-09-14T11:54:25.069083+0000","last_clean":"2024-09-14T11:54:25.069083+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:54:25.069083+0000","last_undegraded":"2024-09-14T11:54:25.069083+0000","last_fullsized":"2024-09-14T11:54:25.069083+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:54.636606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'495","reported_seq":2082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622438+0000","last_change":"2024-09-14T11:14:06.115825+0000","last_active":"2024-09-14T11:55:41.622438+0000","last_peered":"2024-09-14T11:55:41.622438+0000","last_clean":"2024-09-14T11:55:41.622438+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:55:41.622438+0000","last_undegraded":"2024-09-14T11:55:41.622438+0000","last_fullsized":"2024-09-14T11:55:41.622438+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:59.337368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.619156+0000","last_change":"2024-09-14T11:14:04.123750+0000","last_active":"2024-09-14T11:56:15.619156+0000","last_peered":"2024-09-14T11:56:15.619156+0000","last_clean":"2024-09-14T11:56:15.619156+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:15.619156+0000","last_undegraded":"2024-09-14T11:56:15.619156+0000","last_fullsized":"2024-09-14T11:56:15.619156+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:35.861181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.774310+0000","last_change":"2024-09-14T11:14:08.137009+0000","last_active":"2024-09-14T11:51:40.774310+0000","last_peered":"2024-09-14T11:51:40.774310+0000","last_clean":"2024-09-14T11:51:40.774310+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:51:40.774310+0000","last_undegraded":"2024-09-14T11:51:40.774310+0000","last_fullsized":"2024-09-14T11:51:40.774310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.777442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'292","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.905574+0000","last_change":"2024-09-14T11:14:10.154505+0000","last_active":"2024-09-14T11:56:14.905574+0000","last_peered":"2024-09-14T11:56:14.905574+0000","last_clean":"2024-09-14T11:56:14.905574+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:14.905574+0000","last_undegraded":"2024-09-14T11:56:14.905574+0000","last_fullsized":"2024-09-14T11:56:14.905574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.388017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.891069+0000","last_change":"2024-09-14T11:14:12.149836+0000","last_active":"2024-09-14T11:52:19.891069+0000","last_peered":"2024-09-14T11:52:19.891069+0000","last_clean":"2024-09-14T11:52:19.891069+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:52:19.891069+0000","last_undegraded":"2024-09-14T11:52:19.891069+0000","last_fullsized":"2024-09-14T11:52:19.891069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:32.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'144","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.744952+0000","last_change":"2024-09-14T11:14:14.162000+0000","last_active":"2024-09-14T11:55:42.744952+0000","last_peered":"2024-09-14T11:55:42.744952+0000","last_clean":"2024-09-14T11:55:42.744952+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:55:42.744952+0000","last_undegraded":"2024-09-14T11:55:42.744952+0000","last_fullsized":"2024-09-14T11:55:42.744952+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'419","reported_seq":2018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.546724+0000","last_change":"2024-09-14T11:14:06.123837+0000","last_active":"2024-09-14T11:54:08.546724+0000","last_peered":"2024-09-14T11:54:08.546724+0000","last_clean":"2024-09-14T11:54:08.546724+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:54:08.546724+0000","last_undegraded":"2024-09-14T11:54:08.546724+0000","last_fullsized":"2024-09-14T11:54:08.546724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:37.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'336","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874282+0000","last_change":"2024-09-14T11:14:04.131548+0000","last_active":"2024-09-14T11:56:14.874282+0000","last_peered":"2024-09-14T11:56:14.874282+0000","last_clean":"2024-09-14T11:56:14.874282+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:14.874282+0000","last_undegraded":"2024-09-14T11:56:14.874282+0000","last_fullsized":"2024-09-14T11:56:14.874282+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.843269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020451,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":527,"num_read_kb":46731,"num_write":1083,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.886602+0000","last_change":"2024-09-14T11:14:08.137590+0000","last_active":"2024-09-14T11:51:39.886602+0000","last_peered":"2024-09-14T11:51:39.886602+0000","last_clean":"2024-09-14T11:51:39.886602+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:51:39.886602+0000","last_undegraded":"2024-09-14T11:51:39.886602+0000","last_fullsized":"2024-09-14T11:51:39.886602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:47.658963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'81","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.853482+0000","last_change":"2024-09-14T11:14:10.148590+0000","last_active":"2024-09-14T11:54:18.853482+0000","last_peered":"2024-09-14T11:54:18.853482+0000","last_clean":"2024-09-14T11:54:18.853482+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:54:18.853482+0000","last_undegraded":"2024-09-14T11:54:18.853482+0000","last_fullsized":"2024-09-14T11:54:18.853482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:10.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.741161+0000","last_change":"2024-09-14T11:14:12.152664+0000","last_active":"2024-09-14T11:56:13.741161+0000","last_peered":"2024-09-14T11:56:13.741161+0000","last_clean":"2024-09-14T11:56:13.741161+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:13.741161+0000","last_undegraded":"2024-09-14T11:56:13.741161+0000","last_fullsized":"2024-09-14T11:56:13.741161+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:48.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":602,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.739702+0000","last_change":"2024-09-14T11:14:14.162036+0000","last_active":"2024-09-14T11:55:42.739702+0000","last_peered":"2024-09-14T11:55:42.739702+0000","last_clean":"2024-09-14T11:55:42.739702+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:55:42.739702+0000","last_undegraded":"2024-09-14T11:55:42.739702+0000","last_fullsized":"2024-09-14T11:55:42.739702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.951880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'913","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622796+0000","last_change":"2024-09-14T11:14:06.120190+0000","last_active":"2024-09-14T11:55:41.622796+0000","last_peered":"2024-09-14T11:55:41.622796+0000","last_clean":"2024-09-14T11:55:41.622796+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:55:41.622796+0000","last_undegraded":"2024-09-14T11:55:41.622796+0000","last_fullsized":"2024-09-14T11:55:41.622796+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:35.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633326+0000","last_change":"2024-09-14T11:14:04.123412+0000","last_active":"2024-09-14T11:56:15.633326+0000","last_peered":"2024-09-14T11:56:15.633326+0000","last_clean":"2024-09-14T11:56:15.633326+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:15.633326+0000","last_undegraded":"2024-09-14T11:56:15.633326+0000","last_fullsized":"2024-09-14T11:56:15.633326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.337185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.774628+0000","last_change":"2024-09-14T11:14:08.138426+0000","last_active":"2024-09-14T11:51:39.774628+0000","last_peered":"2024-09-14T11:51:39.774628+0000","last_clean":"2024-09-14T11:51:39.774628+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:51:39.774628+0000","last_undegraded":"2024-09-14T11:51:39.774628+0000","last_fullsized":"2024-09-14T11:51:39.774628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:56.436534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'298","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.242404+0000","last_change":"2024-09-14T11:14:10.149256+0000","last_active":"2024-09-14T11:56:15.242404+0000","last_peered":"2024-09-14T11:56:15.242404+0000","last_clean":"2024-09-14T11:56:15.242404+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:15.242404+0000","last_undegraded":"2024-09-14T11:56:15.242404+0000","last_fullsized":"2024-09-14T11:56:15.242404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:47.592442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896607+0000","last_change":"2024-09-14T11:14:12.150595+0000","last_active":"2024-09-14T11:52:54.896607+0000","last_peered":"2024-09-14T11:52:54.896607+0000","last_clean":"2024-09-14T11:52:54.896607+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:52:54.896607+0000","last_undegraded":"2024-09-14T11:52:54.896607+0000","last_fullsized":"2024-09-14T11:52:54.896607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:47.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.835967+0000","last_change":"2024-09-14T11:14:14.159475+0000","last_active":"2024-09-14T11:53:58.835967+0000","last_peered":"2024-09-14T11:53:58.835967+0000","last_clean":"2024-09-14T11:53:58.835967+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:53:58.835967+0000","last_undegraded":"2024-09-14T11:53:58.835967+0000","last_fullsized":"2024-09-14T11:53:58.835967+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:45.105897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.456474+0000","last_change":"2024-09-14T11:14:06.120205+0000","last_active":"2024-09-14T11:54:24.456474+0000","last_peered":"2024-09-14T11:54:24.456474+0000","last_clean":"2024-09-14T11:54:24.456474+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:54:24.456474+0000","last_undegraded":"2024-09-14T11:54:24.456474+0000","last_fullsized":"2024-09-14T11:54:24.456474+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:27.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.606584+0000","last_change":"2024-09-14T11:14:04.127561+0000","last_active":"2024-09-14T11:56:15.606584+0000","last_peered":"2024-09-14T11:56:15.606584+0000","last_clean":"2024-09-14T11:56:15.606584+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:15.606584+0000","last_undegraded":"2024-09-14T11:56:15.606584+0000","last_fullsized":"2024-09-14T11:56:15.606584+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:28.538642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.021483+0000","last_change":"2024-09-14T11:14:08.133404+0000","last_active":"2024-09-14T11:51:41.021483+0000","last_peered":"2024-09-14T11:51:41.021483+0000","last_clean":"2024-09-14T11:51:41.021483+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:51:41.021483+0000","last_undegraded":"2024-09-14T11:51:41.021483+0000","last_fullsized":"2024-09-14T11:51:41.021483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.597866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'259","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.703138+0000","last_change":"2024-09-14T11:14:10.152035+0000","last_active":"2024-09-14T11:55:42.703138+0000","last_peered":"2024-09-14T11:55:42.703138+0000","last_clean":"2024-09-14T11:55:42.703138+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:55:42.703138+0000","last_undegraded":"2024-09-14T11:55:42.703138+0000","last_fullsized":"2024-09-14T11:55:42.703138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.459789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52410,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":861,"num_write":338,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.785014+0000","last_change":"2024-09-14T11:14:12.151730+0000","last_active":"2024-09-14T11:53:05.785014+0000","last_peered":"2024-09-14T11:53:05.785014+0000","last_clean":"2024-09-14T11:53:05.785014+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:53:05.785014+0000","last_undegraded":"2024-09-14T11:53:05.785014+0000","last_fullsized":"2024-09-14T11:53:05.785014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:44.746381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'326","reported_seq":1757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.782919+0000","last_change":"2024-09-14T11:14:06.118920+0000","last_active":"2024-09-14T11:54:07.782919+0000","last_peered":"2024-09-14T11:54:07.782919+0000","last_clean":"2024-09-14T11:54:07.782919+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:54:07.782919+0000","last_undegraded":"2024-09-14T11:54:07.782919+0000","last_fullsized":"2024-09-14T11:54:07.782919+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:18.730208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'332","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.859521+0000","last_change":"2024-09-14T11:14:04.123599+0000","last_active":"2024-09-14T11:56:14.859521+0000","last_peered":"2024-09-14T11:56:14.859521+0000","last_clean":"2024-09-14T11:56:14.859521+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:14.859521+0000","last_undegraded":"2024-09-14T11:56:14.859521+0000","last_fullsized":"2024-09-14T11:56:14.859521+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.290130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27602,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":552,"num_read_kb":1005,"num_write":1003,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.782950+0000","last_change":"2024-09-14T11:14:08.137705+0000","last_active":"2024-09-14T11:52:50.782950+0000","last_peered":"2024-09-14T11:52:50.782950+0000","last_clean":"2024-09-14T11:52:50.782950+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:52:50.782950+0000","last_undegraded":"2024-09-14T11:52:50.782950+0000","last_fullsized":"2024-09-14T11:52:50.782950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:21.751164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'227","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.785868+0000","last_change":"2024-09-14T11:14:10.155049+0000","last_active":"2024-09-14T11:56:14.785868+0000","last_peered":"2024-09-14T11:56:14.785868+0000","last_clean":"2024-09-14T11:56:14.785868+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:14.785868+0000","last_undegraded":"2024-09-14T11:56:14.785868+0000","last_fullsized":"2024-09-14T11:56:14.785868+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.366018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.775077+0000","last_change":"2024-09-14T11:14:12.150674+0000","last_active":"2024-09-14T11:51:45.775077+0000","last_peered":"2024-09-14T11:51:45.775077+0000","last_clean":"2024-09-14T11:51:45.775077+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:51:45.775077+0000","last_undegraded":"2024-09-14T11:51:45.775077+0000","last_fullsized":"2024-09-14T11:51:45.775077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:49.433914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'147","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.024834+0000","last_change":"2024-09-14T11:14:14.161497+0000","last_active":"2024-09-14T11:54:25.024834+0000","last_peered":"2024-09-14T11:54:25.024834+0000","last_clean":"2024-09-14T11:54:25.024834+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:54:25.024834+0000","last_undegraded":"2024-09-14T11:54:25.024834+0000","last_fullsized":"2024-09-14T11:54:25.024834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:34.625158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2254,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.547132+0000","last_change":"2024-09-14T11:14:06.130562+0000","last_active":"2024-09-14T11:54:26.547132+0000","last_peered":"2024-09-14T11:54:26.547132+0000","last_clean":"2024-09-14T11:54:26.547132+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:54:26.547132+0000","last_undegraded":"2024-09-14T11:54:26.547132+0000","last_fullsized":"2024-09-14T11:54:26.547132+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:50.157895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'315","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.863491+0000","last_change":"2024-09-14T11:14:04.128727+0000","last_active":"2024-09-14T11:56:14.863491+0000","last_peered":"2024-09-14T11:56:14.863491+0000","last_clean":"2024-09-14T11:56:14.863491+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:14.863491+0000","last_undegraded":"2024-09-14T11:56:14.863491+0000","last_fullsized":"2024-09-14T11:56:14.863491+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.665738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975596,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":653,"num_read_kb":5062,"num_write":1054,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895731+0000","last_change":"2024-09-14T11:14:08.134254+0000","last_active":"2024-09-14T11:52:54.895731+0000","last_peered":"2024-09-14T11:52:54.895731+0000","last_clean":"2024-09-14T11:52:54.895731+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:52:54.895731+0000","last_undegraded":"2024-09-14T11:52:54.895731+0000","last_fullsized":"2024-09-14T11:52:54.895731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:52.559637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'315","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.965179+0000","last_change":"2024-09-14T11:14:10.151521+0000","last_active":"2024-09-14T11:56:14.965179+0000","last_peered":"2024-09-14T11:56:14.965179+0000","last_clean":"2024-09-14T11:56:14.965179+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:14.965179+0000","last_undegraded":"2024-09-14T11:56:14.965179+0000","last_fullsized":"2024-09-14T11:56:14.965179+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:57.363193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.888499+0000","last_change":"2024-09-14T11:14:12.152149+0000","last_active":"2024-09-14T11:51:44.888499+0000","last_peered":"2024-09-14T11:51:44.888499+0000","last_clean":"2024-09-14T11:51:44.888499+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:51:44.888499+0000","last_undegraded":"2024-09-14T11:51:44.888499+0000","last_fullsized":"2024-09-14T11:51:44.888499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.701102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'114","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.619651+0000","last_change":"2024-09-14T11:14:14.160202+0000","last_active":"2024-09-14T11:55:41.619651+0000","last_peered":"2024-09-14T11:55:41.619651+0000","last_clean":"2024-09-14T11:55:41.619651+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:55:41.619651+0000","last_undegraded":"2024-09-14T11:55:41.619651+0000","last_fullsized":"2024-09-14T11:55:41.619651+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:39.404108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'433","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935365+0000","last_change":"2024-09-14T11:14:06.130413+0000","last_active":"2024-09-14T11:54:09.935365+0000","last_peered":"2024-09-14T11:54:09.935365+0000","last_clean":"2024-09-14T11:54:09.935365+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:54:09.935365+0000","last_undegraded":"2024-09-14T11:54:09.935365+0000","last_fullsized":"2024-09-14T11:54:09.935365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:11.813244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633603+0000","last_change":"2024-09-14T11:14:04.137347+0000","last_active":"2024-09-14T11:56:15.633603+0000","last_peered":"2024-09-14T11:56:15.633603+0000","last_clean":"2024-09-14T11:56:15.633603+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:15.633603+0000","last_undegraded":"2024-09-14T11:56:15.633603+0000","last_fullsized":"2024-09-14T11:56:15.633603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:12.340493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'537","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540930+0000","last_change":"2024-09-14T11:14:06.127358+0000","last_active":"2024-09-14T11:54:04.540930+0000","last_peered":"2024-09-14T11:54:04.540930+0000","last_clean":"2024-09-14T11:54:04.540930+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:54:04.540930+0000","last_undegraded":"2024-09-14T11:54:04.540930+0000","last_fullsized":"2024-09-14T11:54:04.540930+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.425756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'341","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.712479+0000","last_change":"2024-09-14T11:14:04.118653+0000","last_active":"2024-09-14T11:56:14.712479+0000","last_peered":"2024-09-14T11:56:14.712479+0000","last_clean":"2024-09-14T11:56:14.712479+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:14.712479+0000","last_undegraded":"2024-09-14T11:56:14.712479+0000","last_fullsized":"2024-09-14T11:56:14.712479+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:13.808933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3533357,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":540,"num_read_kb":5548,"num_write":1089,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1188","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462084+0000","last_change":"2024-09-14T11:14:06.123772+0000","last_active":"2024-09-14T11:54:24.462084+0000","last_peered":"2024-09-14T11:54:24.462084+0000","last_clean":"2024-09-14T11:54:24.462084+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:54:24.462084+0000","last_undegraded":"2024-09-14T11:54:24.462084+0000","last_fullsized":"2024-09-14T11:54:24.462084+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:26.689879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615626+0000","last_change":"2024-09-14T11:14:04.124321+0000","last_active":"2024-09-14T11:56:15.615626+0000","last_peered":"2024-09-14T11:56:15.615626+0000","last_clean":"2024-09-14T11:56:15.615626+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:15.615626+0000","last_undegraded":"2024-09-14T11:56:15.615626+0000","last_fullsized":"2024-09-14T11:56:15.615626+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:47.955033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'459","reported_seq":2193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262421+0000","last_change":"2024-09-14T11:14:06.124181+0000","last_active":"2024-09-14T11:54:09.262421+0000","last_peered":"2024-09-14T11:54:09.262421+0000","last_clean":"2024-09-14T11:54:09.262421+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:54:09.262421+0000","last_undegraded":"2024-09-14T11:54:09.262421+0000","last_fullsized":"2024-09-14T11:54:09.262421+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:13.371439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.900742+0000","last_change":"2024-09-14T11:14:04.123362+0000","last_active":"2024-09-14T11:56:14.900742+0000","last_peered":"2024-09-14T11:56:14.900742+0000","last_clean":"2024-09-14T11:56:14.900742+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:14.900742+0000","last_undegraded":"2024-09-14T11:56:14.900742+0000","last_fullsized":"2024-09-14T11:56:14.900742+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.168395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3656166,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":583,"num_read_kb":9527,"num_write":1057,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'417","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261739+0000","last_change":"2024-09-14T11:14:06.128550+0000","last_active":"2024-09-14T11:54:09.261739+0000","last_peered":"2024-09-14T11:54:09.261739+0000","last_clean":"2024-09-14T11:54:09.261739+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:54:09.261739+0000","last_undegraded":"2024-09-14T11:54:09.261739+0000","last_fullsized":"2024-09-14T11:54:09.261739+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:02.461046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'313","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.875272+0000","last_change":"2024-09-14T11:14:04.122779+0000","last_active":"2024-09-14T11:56:14.875272+0000","last_peered":"2024-09-14T11:56:14.875272+0000","last_clean":"2024-09-14T11:56:14.875272+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:14.875272+0000","last_undegraded":"2024-09-14T11:56:14.875272+0000","last_fullsized":"2024-09-14T11:56:14.875272+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:12.163971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656073,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":626,"num_read_kb":10971,"num_write":1133,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'779","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540032+0000","last_change":"2024-09-14T11:14:06.130234+0000","last_active":"2024-09-14T11:54:04.540032+0000","last_peered":"2024-09-14T11:54:04.540032+0000","last_clean":"2024-09-14T11:54:04.540032+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:54:04.540032+0000","last_undegraded":"2024-09-14T11:54:04.540032+0000","last_fullsized":"2024-09-14T11:54:04.540032+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:46.526972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'379","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879373+0000","last_change":"2024-09-14T11:14:04.112512+0000","last_active":"2024-09-14T11:56:14.879373+0000","last_peered":"2024-09-14T11:56:14.879373+0000","last_clean":"2024-09-14T11:56:14.879373+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:14.879373+0000","last_undegraded":"2024-09-14T11:56:14.879373+0000","last_fullsized":"2024-09-14T11:56:14.879373+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:27.221991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984864,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":934,"num_read_kb":11029,"num_write":1159,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'408","reported_seq":1927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546902+0000","last_change":"2024-09-14T11:14:06.116873+0000","last_active":"2024-09-14T11:54:26.546902+0000","last_peered":"2024-09-14T11:54:26.546902+0000","last_clean":"2024-09-14T11:54:26.546902+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:54:26.546902+0000","last_undegraded":"2024-09-14T11:54:26.546902+0000","last_fullsized":"2024-09-14T11:54:26.546902+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.999726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'373","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751186+0000","last_change":"2024-09-14T11:14:38.342285+0000","last_active":"2024-09-14T11:56:14.751186+0000","last_peered":"2024-09-14T11:56:14.751186+0000","last_clean":"2024-09-14T11:56:14.751186+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:14.751186+0000","last_undegraded":"2024-09-14T11:56:14.751186+0000","last_fullsized":"2024-09-14T11:56:14.751186+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:29.747736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":944,"num_read_kb":685,"num_write":1212,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'542","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.934942+0000","last_change":"2024-09-14T11:14:06.129076+0000","last_active":"2024-09-14T11:54:09.934942+0000","last_peered":"2024-09-14T11:54:09.934942+0000","last_clean":"2024-09-14T11:54:09.934942+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:54:09.934942+0000","last_undegraded":"2024-09-14T11:54:09.934942+0000","last_fullsized":"2024-09-14T11:54:09.934942+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:59.804760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'282","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.865575+0000","last_change":"2024-09-14T11:14:04.136228+0000","last_active":"2024-09-14T11:56:14.865575+0000","last_peered":"2024-09-14T11:56:14.865575+0000","last_clean":"2024-09-14T11:56:14.865575+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:14.865575+0000","last_undegraded":"2024-09-14T11:56:14.865575+0000","last_fullsized":"2024-09-14T11:56:14.865575+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:56.091790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":899,"num_read_kb":80980,"num_write":993,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'485","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630227+0000","last_change":"2024-09-14T11:14:06.134085+0000","last_active":"2024-09-14T11:55:41.630227+0000","last_peered":"2024-09-14T11:55:41.630227+0000","last_clean":"2024-09-14T11:55:41.630227+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:55:41.630227+0000","last_undegraded":"2024-09-14T11:55:41.630227+0000","last_fullsized":"2024-09-14T11:55:41.630227+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:23.324462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.584249+0000","last_change":"2024-09-14T11:14:04.120745+0000","last_active":"2024-09-14T11:56:15.584249+0000","last_peered":"2024-09-14T11:56:15.584249+0000","last_clean":"2024-09-14T11:56:15.584249+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:15.584249+0000","last_undegraded":"2024-09-14T11:56:15.584249+0000","last_fullsized":"2024-09-14T11:56:15.584249+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.093196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'419","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935731+0000","last_change":"2024-09-14T11:14:06.121086+0000","last_active":"2024-09-14T11:54:09.935731+0000","last_peered":"2024-09-14T11:54:09.935731+0000","last_clean":"2024-09-14T11:54:09.935731+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:54:09.935731+0000","last_undegraded":"2024-09-14T11:54:09.935731+0000","last_fullsized":"2024-09-14T11:54:09.935731+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:36.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'346","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.883516+0000","last_change":"2024-09-14T11:14:04.118390+0000","last_active":"2024-09-14T11:56:14.883516+0000","last_peered":"2024-09-14T11:56:14.883516+0000","last_clean":"2024-09-14T11:56:14.883516+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:14.883516+0000","last_undegraded":"2024-09-14T11:56:14.883516+0000","last_fullsized":"2024-09-14T11:56:14.883516+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:49.436222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31120,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":552,"num_read_kb":30121,"num_write":1016,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'413","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725240+0000","last_change":"2024-09-14T11:14:06.132235+0000","last_active":"2024-09-14T11:54:06.725240+0000","last_peered":"2024-09-14T11:54:06.725240+0000","last_clean":"2024-09-14T11:54:06.725240+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:54:06.725240+0000","last_undegraded":"2024-09-14T11:54:06.725240+0000","last_fullsized":"2024-09-14T11:54:06.725240+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:50.899051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.640403+0000","last_change":"2024-09-14T11:14:04.131711+0000","last_active":"2024-09-14T11:56:15.640403+0000","last_peered":"2024-09-14T11:56:15.640403+0000","last_clean":"2024-09-14T11:56:15.640403+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:15.640403+0000","last_undegraded":"2024-09-14T11:56:15.640403+0000","last_fullsized":"2024-09-14T11:56:15.640403+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:26.386858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'815","reported_seq":2398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114472+0000","last_change":"2024-09-14T11:14:06.130289+0000","last_active":"2024-09-14T11:54:27.114472+0000","last_peered":"2024-09-14T11:54:27.114472+0000","last_clean":"2024-09-14T11:54:27.114472+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:54:27.114472+0000","last_undegraded":"2024-09-14T11:54:27.114472+0000","last_fullsized":"2024-09-14T11:54:27.114472+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:55.217977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'274","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897119+0000","last_change":"2024-09-14T11:14:04.137105+0000","last_active":"2024-09-14T11:56:14.897119+0000","last_peered":"2024-09-14T11:56:14.897119+0000","last_clean":"2024-09-14T11:56:14.897119+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:14.897119+0000","last_undegraded":"2024-09-14T11:56:14.897119+0000","last_fullsized":"2024-09-14T11:56:14.897119+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:13.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6928313,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":385,"num_read_kb":33889,"num_write":863,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'381","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.621727+0000","last_change":"2024-09-14T11:14:06.130068+0000","last_active":"2024-09-14T11:55:41.621727+0000","last_peered":"2024-09-14T11:55:41.621727+0000","last_clean":"2024-09-14T11:55:41.621727+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:55:41.621727+0000","last_undegraded":"2024-09-14T11:55:41.621727+0000","last_fullsized":"2024-09-14T11:55:41.621727+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:39.243281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.620139+0000","last_change":"2024-09-14T11:14:38.195137+0000","last_active":"2024-09-14T11:56:15.620139+0000","last_peered":"2024-09-14T11:56:15.620139+0000","last_clean":"2024-09-14T11:56:15.620139+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:15.620139+0000","last_undegraded":"2024-09-14T11:56:15.620139+0000","last_fullsized":"2024-09-14T11:56:15.620139+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:31.310723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546426+0000","last_change":"2024-09-14T11:14:06.125029+0000","last_active":"2024-09-14T11:54:26.546426+0000","last_peered":"2024-09-14T11:54:26.546426+0000","last_clean":"2024-09-14T11:54:26.546426+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:54:26.546426+0000","last_undegraded":"2024-09-14T11:54:26.546426+0000","last_fullsized":"2024-09-14T11:54:26.546426+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:21.648012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'460","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.755808+0000","last_change":"2024-09-14T11:14:04.136230+0000","last_active":"2024-09-14T11:56:14.755808+0000","last_peered":"2024-09-14T11:56:14.755808+0000","last_clean":"2024-09-14T11:56:14.755808+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:14.755808+0000","last_undegraded":"2024-09-14T11:56:14.755808+0000","last_fullsized":"2024-09-14T11:56:14.755808+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246530,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1141,"num_read_kb":1914,"num_write":1383,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'474","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783207+0000","last_change":"2024-09-14T11:14:06.128570+0000","last_active":"2024-09-14T11:54:07.783207+0000","last_peered":"2024-09-14T11:54:07.783207+0000","last_clean":"2024-09-14T11:54:07.783207+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:54:07.783207+0000","last_undegraded":"2024-09-14T11:54:07.783207+0000","last_fullsized":"2024-09-14T11:54:07.783207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751883+0000","last_change":"2024-09-14T11:14:04.117766+0000","last_active":"2024-09-14T11:56:14.751883+0000","last_peered":"2024-09-14T11:56:14.751883+0000","last_clean":"2024-09-14T11:56:14.751883+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:14.751883+0000","last_undegraded":"2024-09-14T11:56:14.751883+0000","last_fullsized":"2024-09-14T11:56:14.751883+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:32.550269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8013749,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":531,"num_read_kb":47806,"num_write":1050,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'444","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725116+0000","last_change":"2024-09-14T11:14:06.124232+0000","last_active":"2024-09-14T11:54:06.725116+0000","last_peered":"2024-09-14T11:54:06.725116+0000","last_clean":"2024-09-14T11:54:06.725116+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:54:06.725116+0000","last_undegraded":"2024-09-14T11:54:06.725116+0000","last_fullsized":"2024-09-14T11:54:06.725116+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:46.127557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615982+0000","last_change":"2024-09-14T11:14:04.128834+0000","last_active":"2024-09-14T11:56:15.615982+0000","last_peered":"2024-09-14T11:56:15.615982+0000","last_clean":"2024-09-14T11:56:15.615982+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:15.615982+0000","last_undegraded":"2024-09-14T11:56:15.615982+0000","last_fullsized":"2024-09-14T11:56:15.615982+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:37.995845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615334+0000","last_change":"2024-09-14T11:14:38.193534+0000","last_active":"2024-09-14T11:56:15.615334+0000","last_peered":"2024-09-14T11:56:15.615334+0000","last_clean":"2024-09-14T11:56:15.615334+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:15.615334+0000","last_undegraded":"2024-09-14T11:56:15.615334+0000","last_fullsized":"2024-09-14T11:56:15.615334+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.503196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'499","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461479+0000","last_change":"2024-09-14T11:14:06.134114+0000","last_active":"2024-09-14T11:54:24.461479+0000","last_peered":"2024-09-14T11:54:24.461479+0000","last_clean":"2024-09-14T11:54:24.461479+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:54:24.461479+0000","last_undegraded":"2024-09-14T11:54:24.461479+0000","last_fullsized":"2024-09-14T11:54:24.461479+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:15.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'332","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.818324+0000","last_change":"2024-09-14T11:14:04.121552+0000","last_active":"2024-09-14T11:56:14.818324+0000","last_peered":"2024-09-14T11:56:14.818324+0000","last_clean":"2024-09-14T11:56:14.818324+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:14.818324+0000","last_undegraded":"2024-09-14T11:56:14.818324+0000","last_fullsized":"2024-09-14T11:56:14.818324+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704768,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":667,"num_read_kb":183365,"num_write":1166,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546904+0000","last_change":"2024-09-14T11:14:06.130886+0000","last_active":"2024-09-14T11:54:26.546904+0000","last_peered":"2024-09-14T11:54:26.546904+0000","last_clean":"2024-09-14T11:54:26.546904+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:54:26.546904+0000","last_undegraded":"2024-09-14T11:54:26.546904+0000","last_fullsized":"2024-09-14T11:54:26.546904+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:55.595674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":627,"ondisk_log_size":627,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1693090,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17359,"num_read_kb":35854,"num_write":14609,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1130496,"data_stored":783760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2037,"ondisk_log_size":2037,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3689,"ondisk_log_size":3689,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":194891002,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":0,"num_read":42947,"num_read_kb":2244654,"num_write":71545,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":269365248,"data_stored":269365248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3570,"ondisk_log_size":3570,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":130,"num_read_kb":174309,"num_write":150,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":59768832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":32594424,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":122,"num_read_kb":174255,"num_write":144,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":54657024,"data_stored":54654665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509955,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318188,"kb_used_data":62004,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94053652,"statfs":{"total":96636764160,"available":96310939648,"internally_reserved":0,"allocated":63492096,"data_stored":61539547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509956,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166576,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205264,"statfs":{"total":96636764160,"available":96466190336,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509954,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542658,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388084,"kb_used_data":103936,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93983756,"statfs":{"total":96636764160,"available":96239366144,"internally_reserved":0,"allocated":106430464,"data_stored":104414681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542661,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":119312,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":122175488,"data_stored":120173426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542659,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202848,"kb_used_data":109148,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94168992,"statfs":{"total":96636764160,"available":96429047808,"internally_reserved":0,"allocated":111767552,"data_stored":109843385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542658,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316596,"kb_used_data":150816,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94055244,"statfs":{"total":96636764160,"available":96312569856,"internally_reserved":0,"allocated":154435584,"data_stored":152440708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542657,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347636,"kb_used_data":95580,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94024204,"statfs":{"total":96636764160,"available":96280784896,"internally_reserved":0,"allocated":97873920,"data_stored":95880257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60837888,"data_stored":60837888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39305216,"data_stored":39305216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28925952,"data_stored":28925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":56725504,"data_stored":56725504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60817408,"data_stored":60817408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":129533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":248005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":173177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":187067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":8437031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:56:18.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:56:18.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:56:18.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:18.393 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:56:18.395 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1533,"stamp":"2024-09-14T11:56:17.915099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":253903219,"num_objects":1842,"num_object_clones":0,"num_object_copies":5052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":309079,"num_read_kb":2857147,"num_write":162521,"num_write_kb":2485827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12671,"ondisk_log_size":12671,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2238488,"kb_used_data":665272,"kb_used_omap":12,"kb_used_meta":1572211,"kb_avail":752736232,"statfs":{"total":773094113280,"available":770801901568,"internally_reserved":0,"allocated":681238528,"data_stored":665432954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1609944624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-478967205,"num_objects":-2991,"num_object_clones":0,"num_object_copies":-8951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2991,"num_whiteouts":0,"num_read":3349,"num_read_kb":2962,"num_write":3177,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005313"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039779+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:53:46.039779+0000","last_peered":"2024-09-14T11:53:46.039779+0000","last_clean":"2024-09-14T11:53:46.039779+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:53:46.039779+0000","last_undegraded":"2024-09-14T11:53:46.039779+0000","last_fullsized":"2024-09-14T11:53:46.039779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:51.058211+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:55:51.058211+0000","last_peered":"2024-09-14T11:55:51.058211+0000","last_clean":"2024-09-14T11:55:51.058211+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:55:51.058211+0000","last_undegraded":"2024-09-14T11:55:51.058211+0000","last_fullsized":"2024-09-14T11:55:51.058211+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.763337+0000","last_change":"2024-09-14T11:41:15.877777+0000","last_active":"2024-09-14T11:51:19.763337+0000","last_peered":"2024-09-14T11:51:19.763337+0000","last_clean":"2024-09-14T11:51:19.763337+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:51:19.763337+0000","last_undegraded":"2024-09-14T11:51:19.763337+0000","last_fullsized":"2024-09-14T11:51:19.763337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.018964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.917468+0000","last_change":"2024-09-14T11:30:44.720933+0000","last_active":"2024-09-14T11:55:44.917468+0000","last_peered":"2024-09-14T11:55:44.917468+0000","last_clean":"2024-09-14T11:55:44.917468+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:55:44.917468+0000","last_undegraded":"2024-09-14T11:55:44.917468+0000","last_fullsized":"2024-09-14T11:55:44.917468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:46.706797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777983+0000","last_change":"2024-09-14T11:29:10.325552+0000","last_active":"2024-09-14T11:53:14.777983+0000","last_peered":"2024-09-14T11:53:14.777983+0000","last_clean":"2024-09-14T11:53:14.777983+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:53:14.777983+0000","last_undegraded":"2024-09-14T11:53:14.777983+0000","last_fullsized":"2024-09-14T11:53:14.777983+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:26.043474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.787081+0000","last_change":"2024-09-14T11:41:15.870239+0000","last_active":"2024-09-14T11:53:20.787081+0000","last_peered":"2024-09-14T11:53:20.787081+0000","last_clean":"2024-09-14T11:53:20.787081+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:53:20.787081+0000","last_undegraded":"2024-09-14T11:53:20.787081+0000","last_fullsized":"2024-09-14T11:53:20.787081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:07.125369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902783+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:53:44.902783+0000","last_peered":"2024-09-14T11:53:44.902783+0000","last_clean":"2024-09-14T11:53:44.902783+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:53:44.902783+0000","last_undegraded":"2024-09-14T11:53:44.902783+0000","last_fullsized":"2024-09-14T11:53:44.902783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.774451+0000","last_change":"2024-09-14T11:30:44.718407+0000","last_active":"2024-09-14T11:52:49.774451+0000","last_peered":"2024-09-14T11:52:49.774451+0000","last_clean":"2024-09-14T11:52:49.774451+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:52:49.774451+0000","last_undegraded":"2024-09-14T11:52:49.774451+0000","last_fullsized":"2024-09-14T11:52:49.774451+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:51.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.075756+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:53:31.075756+0000","last_peered":"2024-09-14T11:53:31.075756+0000","last_clean":"2024-09-14T11:53:31.075756+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:53:31.075756+0000","last_undegraded":"2024-09-14T11:53:31.075756+0000","last_fullsized":"2024-09-14T11:53:31.075756+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:51.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896093+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:52:54.896093+0000","last_peered":"2024-09-14T11:52:54.896093+0000","last_clean":"2024-09-14T11:52:54.896093+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:52:54.896093+0000","last_undegraded":"2024-09-14T11:52:54.896093+0000","last_fullsized":"2024-09-14T11:52:54.896093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:47.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.884913+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:51:39.884913+0000","last_peered":"2024-09-14T11:51:39.884913+0000","last_clean":"2024-09-14T11:51:39.884913+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:51:39.884913+0000","last_undegraded":"2024-09-14T11:51:39.884913+0000","last_fullsized":"2024-09-14T11:51:39.884913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:06.934022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.328043+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:52:32.328043+0000","last_peered":"2024-09-14T11:52:32.328043+0000","last_clean":"2024-09-14T11:52:32.328043+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:52:32.328043+0000","last_undegraded":"2024-09-14T11:52:32.328043+0000","last_fullsized":"2024-09-14T11:52:32.328043+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.704261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.780910+0000","last_change":"2024-09-14T11:30:47.742222+0000","last_active":"2024-09-14T11:52:35.780910+0000","last_peered":"2024-09-14T11:52:35.780910+0000","last_clean":"2024-09-14T11:52:35.780910+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:52:35.780910+0000","last_undegraded":"2024-09-14T11:52:35.780910+0000","last_fullsized":"2024-09-14T11:52:35.780910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:53.632539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.773815+0000","last_change":"2024-09-14T11:29:10.322697+0000","last_active":"2024-09-14T11:51:40.773815+0000","last_peered":"2024-09-14T11:51:40.773815+0000","last_clean":"2024-09-14T11:51:40.773815+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:51:40.773815+0000","last_undegraded":"2024-09-14T11:51:40.773815+0000","last_fullsized":"2024-09-14T11:51:40.773815+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.258272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771084+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:51:19.771084+0000","last_peered":"2024-09-14T11:51:19.771084+0000","last_clean":"2024-09-14T11:51:19.771084+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:51:19.771084+0000","last_undegraded":"2024-09-14T11:51:19.771084+0000","last_fullsized":"2024-09-14T11:51:19.771084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.063452+0000","last_change":"2024-09-14T11:30:47.735777+0000","last_active":"2024-09-14T11:56:14.063452+0000","last_peered":"2024-09-14T11:56:14.063452+0000","last_clean":"2024-09-14T11:56:14.063452+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:14.063452+0000","last_undegraded":"2024-09-14T11:56:14.063452+0000","last_fullsized":"2024-09-14T11:56:14.063452+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:09.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.771151+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:51:19.771151+0000","last_peered":"2024-09-14T11:51:19.771151+0000","last_clean":"2024-09-14T11:51:19.771151+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:51:19.771151+0000","last_undegraded":"2024-09-14T11:51:19.771151+0000","last_fullsized":"2024-09-14T11:51:19.771151+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918751+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:55:49.918751+0000","last_peered":"2024-09-14T11:55:49.918751+0000","last_clean":"2024-09-14T11:55:49.918751+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:55:49.918751+0000","last_undegraded":"2024-09-14T11:55:49.918751+0000","last_fullsized":"2024-09-14T11:55:49.918751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17456,"num_write":12,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899090+0000","last_change":"2024-09-14T11:29:10.322726+0000","last_active":"2024-09-14T11:53:19.899090+0000","last_peered":"2024-09-14T11:53:19.899090+0000","last_clean":"2024-09-14T11:53:19.899090+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:53:19.899090+0000","last_undegraded":"2024-09-14T11:53:19.899090+0000","last_fullsized":"2024-09-14T11:53:19.899090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:47.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892752+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:52:34.892752+0000","last_peered":"2024-09-14T11:52:34.892752+0000","last_clean":"2024-09-14T11:52:34.892752+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:52:34.892752+0000","last_undegraded":"2024-09-14T11:52:34.892752+0000","last_fullsized":"2024-09-14T11:52:34.892752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022348+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:51:46.022348+0000","last_peered":"2024-09-14T11:51:46.022348+0000","last_clean":"2024-09-14T11:51:46.022348+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:51:46.022348+0000","last_undegraded":"2024-09-14T11:51:46.022348+0000","last_fullsized":"2024-09-14T11:51:46.022348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:09.499277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.775890+0000","last_change":"2024-09-14T11:41:15.871132+0000","last_active":"2024-09-14T11:52:59.775890+0000","last_peered":"2024-09-14T11:52:59.775890+0000","last_clean":"2024-09-14T11:52:59.775890+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:52:59.775890+0000","last_undegraded":"2024-09-14T11:52:59.775890+0000","last_fullsized":"2024-09-14T11:52:59.775890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:52.619076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.887227+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:51:54.887227+0000","last_peered":"2024-09-14T11:51:54.887227+0000","last_clean":"2024-09-14T11:51:54.887227+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:51:54.887227+0000","last_undegraded":"2024-09-14T11:51:54.887227+0000","last_fullsized":"2024-09-14T11:51:54.887227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.766752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.772338+0000","last_change":"2024-09-14T11:30:44.715477+0000","last_active":"2024-09-14T11:52:29.772338+0000","last_peered":"2024-09-14T11:52:29.772338+0000","last_clean":"2024-09-14T11:52:29.772338+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:52:29.772338+0000","last_undegraded":"2024-09-14T11:52:29.772338+0000","last_fullsized":"2024-09-14T11:52:29.772338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:47.193927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.905463+0000","last_change":"2024-09-14T11:29:10.321195+0000","last_active":"2024-09-14T11:53:26.905463+0000","last_peered":"2024-09-14T11:53:26.905463+0000","last_clean":"2024-09-14T11:53:26.905463+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:53:26.905463+0000","last_undegraded":"2024-09-14T11:53:26.905463+0000","last_fullsized":"2024-09-14T11:53:26.905463+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:38.747021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893830+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:52:29.893830+0000","last_peered":"2024-09-14T11:52:29.893830+0000","last_clean":"2024-09-14T11:52:29.893830+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:52:29.893830+0000","last_undegraded":"2024-09-14T11:52:29.893830+0000","last_fullsized":"2024-09-14T11:52:29.893830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887752+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:51:49.887752+0000","last_peered":"2024-09-14T11:51:49.887752+0000","last_clean":"2024-09-14T11:51:49.887752+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:51:49.887752+0000","last_undegraded":"2024-09-14T11:51:49.887752+0000","last_fullsized":"2024-09-14T11:51:49.887752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:48.649434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.795879+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.795879+0000","last_peered":"2024-09-14T11:56:13.795879+0000","last_clean":"2024-09-14T11:56:13.795879+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.795879+0000","last_undegraded":"2024-09-14T11:56:13.795879+0000","last_fullsized":"2024-09-14T11:56:13.795879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:13.281310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887721+0000","last_change":"2024-09-14T11:30:47.735047+0000","last_active":"2024-09-14T11:51:49.887721+0000","last_peered":"2024-09-14T11:51:49.887721+0000","last_clean":"2024-09-14T11:51:49.887721+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:51:49.887721+0000","last_undegraded":"2024-09-14T11:51:49.887721+0000","last_fullsized":"2024-09-14T11:51:49.887721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:04.517023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.904880+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:54:04.904880+0000","last_peered":"2024-09-14T11:54:04.904880+0000","last_clean":"2024-09-14T11:54:04.904880+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:54:04.904880+0000","last_undegraded":"2024-09-14T11:54:04.904880+0000","last_fullsized":"2024-09-14T11:54:04.904880+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:06.177114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.886468+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:51:49.886468+0000","last_peered":"2024-09-14T11:51:49.886468+0000","last_clean":"2024-09-14T11:51:49.886468+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:51:49.886468+0000","last_undegraded":"2024-09-14T11:51:49.886468+0000","last_fullsized":"2024-09-14T11:51:49.886468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:39.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.774516+0000","last_change":"2024-09-14T11:30:44.718710+0000","last_active":"2024-09-14T11:51:45.774516+0000","last_peered":"2024-09-14T11:51:45.774516+0000","last_clean":"2024-09-14T11:51:45.774516+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:51:45.774516+0000","last_undegraded":"2024-09-14T11:51:45.774516+0000","last_fullsized":"2024-09-14T11:51:45.774516+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:50.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.288212+0000","last_change":"2024-09-14T11:29:10.311886+0000","last_active":"2024-09-14T11:53:31.288212+0000","last_peered":"2024-09-14T11:53:31.288212+0000","last_clean":"2024-09-14T11:53:31.288212+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:53:31.288212+0000","last_undegraded":"2024-09-14T11:53:31.288212+0000","last_fullsized":"2024-09-14T11:53:31.288212+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:59.142362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794592+0000","last_change":"2024-09-14T11:30:47.739387+0000","last_active":"2024-09-14T11:54:10.794592+0000","last_peered":"2024-09-14T11:54:10.794592+0000","last_clean":"2024-09-14T11:54:10.794592+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:54:10.794592+0000","last_undegraded":"2024-09-14T11:54:10.794592+0000","last_fullsized":"2024-09-14T11:54:10.794592+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022300+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:51:46.022300+0000","last_peered":"2024-09-14T11:51:46.022300+0000","last_clean":"2024-09-14T11:51:46.022300+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:51:46.022300+0000","last_undegraded":"2024-09-14T11:51:46.022300+0000","last_fullsized":"2024-09-14T11:51:46.022300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:44.955288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.770544+0000","last_change":"2024-09-14T11:41:15.868312+0000","last_active":"2024-09-14T11:52:14.770544+0000","last_peered":"2024-09-14T11:52:14.770544+0000","last_clean":"2024-09-14T11:52:14.770544+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:52:14.770544+0000","last_undegraded":"2024-09-14T11:52:14.770544+0000","last_fullsized":"2024-09-14T11:52:14.770544+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:13.069995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777960+0000","last_change":"2024-09-14T11:30:44.719858+0000","last_active":"2024-09-14T11:53:14.777960+0000","last_peered":"2024-09-14T11:53:14.777960+0000","last_clean":"2024-09-14T11:53:14.777960+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:53:14.777960+0000","last_undegraded":"2024-09-14T11:53:14.777960+0000","last_fullsized":"2024-09-14T11:53:14.777960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.415891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.041236+0000","last_change":"2024-09-14T11:29:10.324751+0000","last_active":"2024-09-14T11:53:56.041236+0000","last_peered":"2024-09-14T11:53:56.041236+0000","last_clean":"2024-09-14T11:53:56.041236+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:53:56.041236+0000","last_undegraded":"2024-09-14T11:53:56.041236+0000","last_fullsized":"2024-09-14T11:53:56.041236+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:56.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.777049+0000","last_change":"2024-09-14T11:41:15.865744+0000","last_active":"2024-09-14T11:52:05.777049+0000","last_peered":"2024-09-14T11:52:05.777049+0000","last_clean":"2024-09-14T11:52:05.777049+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:52:05.777049+0000","last_undegraded":"2024-09-14T11:52:05.777049+0000","last_fullsized":"2024-09-14T11:52:05.777049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:25.011776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792258+0000","last_change":"2024-09-14T11:29:10.325256+0000","last_active":"2024-09-14T11:53:55.792258+0000","last_peered":"2024-09-14T11:53:55.792258+0000","last_clean":"2024-09-14T11:53:55.792258+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:53:55.792258+0000","last_undegraded":"2024-09-14T11:53:55.792258+0000","last_fullsized":"2024-09-14T11:53:55.792258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.015196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.778952+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:52:09.778952+0000","last_peered":"2024-09-14T11:52:09.778952+0000","last_clean":"2024-09-14T11:52:09.778952+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:52:09.778952+0000","last_undegraded":"2024-09-14T11:52:09.778952+0000","last_fullsized":"2024-09-14T11:52:09.778952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:30.781685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898417+0000","last_change":"2024-09-14T11:30:44.717178+0000","last_active":"2024-09-14T11:53:14.898417+0000","last_peered":"2024-09-14T11:53:14.898417+0000","last_clean":"2024-09-14T11:53:14.898417+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:53:14.898417+0000","last_undegraded":"2024-09-14T11:53:14.898417+0000","last_fullsized":"2024-09-14T11:53:14.898417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.604554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.782090+0000","last_change":"2024-09-14T11:29:10.320629+0000","last_active":"2024-09-14T11:53:54.782090+0000","last_peered":"2024-09-14T11:53:54.782090+0000","last_clean":"2024-09-14T11:53:54.782090+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:53:54.782090+0000","last_undegraded":"2024-09-14T11:53:54.782090+0000","last_fullsized":"2024-09-14T11:53:54.782090+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:20.168734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892148+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:52:29.892148+0000","last_peered":"2024-09-14T11:52:29.892148+0000","last_clean":"2024-09-14T11:52:29.892148+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:52:29.892148+0000","last_undegraded":"2024-09-14T11:52:29.892148+0000","last_fullsized":"2024-09-14T11:52:29.892148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:38.823344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912541+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:14.912541+0000","last_peered":"2024-09-14T11:56:14.912541+0000","last_clean":"2024-09-14T11:56:14.912541+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:14.912541+0000","last_undegraded":"2024-09-14T11:56:14.912541+0000","last_fullsized":"2024-09-14T11:56:14.912541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.014650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893118+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:52:24.893118+0000","last_peered":"2024-09-14T11:52:24.893118+0000","last_clean":"2024-09-14T11:52:24.893118+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:52:24.893118+0000","last_undegraded":"2024-09-14T11:52:24.893118+0000","last_fullsized":"2024-09-14T11:52:24.893118+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:57.259600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785620+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:52:29.785620+0000","last_peered":"2024-09-14T11:52:29.785620+0000","last_clean":"2024-09-14T11:52:29.785620+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:52:29.785620+0000","last_undegraded":"2024-09-14T11:52:29.785620+0000","last_fullsized":"2024-09-14T11:52:29.785620+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:58.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891569+0000","last_change":"2024-09-14T11:30:44.713694+0000","last_active":"2024-09-14T11:52:24.891569+0000","last_peered":"2024-09-14T11:52:24.891569+0000","last_clean":"2024-09-14T11:52:24.891569+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:52:24.891569+0000","last_undegraded":"2024-09-14T11:52:24.891569+0000","last_fullsized":"2024-09-14T11:52:24.891569+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:40.066993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.790581+0000","last_change":"2024-09-14T11:29:10.321325+0000","last_active":"2024-09-14T11:53:04.790581+0000","last_peered":"2024-09-14T11:53:04.790581+0000","last_clean":"2024-09-14T11:53:04.790581+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:53:04.790581+0000","last_undegraded":"2024-09-14T11:53:04.790581+0000","last_fullsized":"2024-09-14T11:53:04.790581+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:02.452550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.915942+0000","last_change":"2024-09-14T11:30:47.737000+0000","last_active":"2024-09-14T11:55:34.915942+0000","last_peered":"2024-09-14T11:55:34.915942+0000","last_clean":"2024-09-14T11:55:34.915942+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:55:34.915942+0000","last_undegraded":"2024-09-14T11:55:34.915942+0000","last_fullsized":"2024-09-14T11:55:34.915942+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:03.413738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893146+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:52:24.893146+0000","last_peered":"2024-09-14T11:52:24.893146+0000","last_clean":"2024-09-14T11:52:24.893146+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:52:24.893146+0000","last_undegraded":"2024-09-14T11:52:24.893146+0000","last_fullsized":"2024-09-14T11:52:24.893146+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:33.383073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786619+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:52:34.786619+0000","last_peered":"2024-09-14T11:52:34.786619+0000","last_clean":"2024-09-14T11:52:34.786619+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:52:34.786619+0000","last_undegraded":"2024-09-14T11:52:34.786619+0000","last_fullsized":"2024-09-14T11:52:34.786619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:02.318969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784088+0000","last_change":"2024-09-14T11:29:10.322148+0000","last_active":"2024-09-14T11:53:00.784088+0000","last_peered":"2024-09-14T11:53:00.784088+0000","last_clean":"2024-09-14T11:53:00.784088+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:53:00.784088+0000","last_undegraded":"2024-09-14T11:53:00.784088+0000","last_fullsized":"2024-09-14T11:53:00.784088+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.995810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795341+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:53:39.795341+0000","last_peered":"2024-09-14T11:53:39.795341+0000","last_clean":"2024-09-14T11:53:39.795341+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:53:39.795341+0000","last_undegraded":"2024-09-14T11:53:39.795341+0000","last_fullsized":"2024-09-14T11:53:39.795341+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.795943+0000","last_change":"2024-09-14T11:30:44.720970+0000","last_active":"2024-09-14T11:55:49.795943+0000","last_peered":"2024-09-14T11:55:49.795943+0000","last_clean":"2024-09-14T11:55:49.795943+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:55:49.795943+0000","last_undegraded":"2024-09-14T11:55:49.795943+0000","last_fullsized":"2024-09-14T11:55:49.795943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:44.416082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784182+0000","last_change":"2024-09-14T11:29:10.322645+0000","last_active":"2024-09-14T11:53:00.784182+0000","last_peered":"2024-09-14T11:53:00.784182+0000","last_clean":"2024-09-14T11:53:00.784182+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:53:00.784182+0000","last_undegraded":"2024-09-14T11:53:00.784182+0000","last_fullsized":"2024-09-14T11:53:00.784182+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:51.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785838+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:52:29.785838+0000","last_peered":"2024-09-14T11:52:29.785838+0000","last_clean":"2024-09-14T11:52:29.785838+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:52:29.785838+0000","last_undegraded":"2024-09-14T11:52:29.785838+0000","last_fullsized":"2024-09-14T11:52:29.785838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:07.281823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.047286+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:54:36.047286+0000","last_peered":"2024-09-14T11:54:36.047286+0000","last_clean":"2024-09-14T11:54:36.047286+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:54:36.047286+0000","last_undegraded":"2024-09-14T11:54:36.047286+0000","last_fullsized":"2024-09-14T11:54:36.047286+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:34.901574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.402107+0000","last_change":"2024-09-14T11:29:10.323320+0000","last_active":"2024-09-14T11:52:33.402107+0000","last_peered":"2024-09-14T11:52:33.402107+0000","last_clean":"2024-09-14T11:52:33.402107+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:52:33.402107+0000","last_undegraded":"2024-09-14T11:52:33.402107+0000","last_fullsized":"2024-09-14T11:52:33.402107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:18.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.799375+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:54:40.799375+0000","last_peered":"2024-09-14T11:54:40.799375+0000","last_clean":"2024-09-14T11:54:40.799375+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:54:40.799375+0000","last_undegraded":"2024-09-14T11:54:40.799375+0000","last_fullsized":"2024-09-14T11:54:40.799375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.613026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.784752+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:52:24.784752+0000","last_peered":"2024-09-14T11:52:24.784752+0000","last_clean":"2024-09-14T11:52:24.784752+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:52:24.784752+0000","last_undegraded":"2024-09-14T11:52:24.784752+0000","last_fullsized":"2024-09-14T11:52:24.784752+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:46.872224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905103+0000","last_change":"2024-09-14T11:29:10.321492+0000","last_active":"2024-09-14T11:54:09.905103+0000","last_peered":"2024-09-14T11:54:09.905103+0000","last_clean":"2024-09-14T11:54:09.905103+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:54:09.905103+0000","last_undegraded":"2024-09-14T11:54:09.905103+0000","last_fullsized":"2024-09-14T11:54:09.905103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:01.698920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.770106+0000","last_change":"2024-09-14T11:41:15.869275+0000","last_active":"2024-09-14T11:52:09.770106+0000","last_peered":"2024-09-14T11:52:09.770106+0000","last_clean":"2024-09-14T11:52:09.770106+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:52:09.770106+0000","last_undegraded":"2024-09-14T11:52:09.770106+0000","last_fullsized":"2024-09-14T11:52:09.770106+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:58.504841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902212+0000","last_change":"2024-09-14T11:30:47.734644+0000","last_active":"2024-09-14T11:53:44.902212+0000","last_peered":"2024-09-14T11:53:44.902212+0000","last_clean":"2024-09-14T11:53:44.902212+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:53:44.902212+0000","last_undegraded":"2024-09-14T11:53:44.902212+0000","last_fullsized":"2024-09-14T11:53:44.902212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:00.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.788562+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:52:49.788562+0000","last_peered":"2024-09-14T11:52:49.788562+0000","last_clean":"2024-09-14T11:52:49.788562+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:52:49.788562+0000","last_undegraded":"2024-09-14T11:52:49.788562+0000","last_fullsized":"2024-09-14T11:52:49.788562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:27.988666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043510+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:54:11.043510+0000","last_peered":"2024-09-14T11:54:11.043510+0000","last_clean":"2024-09-14T11:54:11.043510+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:54:11.043510+0000","last_undegraded":"2024-09-14T11:54:11.043510+0000","last_fullsized":"2024-09-14T11:54:11.043510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.891635+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:52:09.891635+0000","last_peered":"2024-09-14T11:52:09.891635+0000","last_clean":"2024-09-14T11:52:09.891635+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:52:09.891635+0000","last_undegraded":"2024-09-14T11:52:09.891635+0000","last_fullsized":"2024-09-14T11:52:09.891635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:47.380694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.049498+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:54:51.049498+0000","last_peered":"2024-09-14T11:54:51.049498+0000","last_clean":"2024-09-14T11:54:51.049498+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:54:51.049498+0000","last_undegraded":"2024-09-14T11:54:51.049498+0000","last_fullsized":"2024-09-14T11:54:51.049498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.117139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794642+0000","last_change":"2024-09-14T11:29:10.319801+0000","last_active":"2024-09-14T11:54:10.794642+0000","last_peered":"2024-09-14T11:54:10.794642+0000","last_clean":"2024-09-14T11:54:10.794642+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:54:10.794642+0000","last_undegraded":"2024-09-14T11:54:10.794642+0000","last_fullsized":"2024-09-14T11:54:10.794642+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:43.613741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790704+0000","last_change":"2024-09-14T11:30:47.742418+0000","last_active":"2024-09-14T11:53:45.790704+0000","last_peered":"2024-09-14T11:53:45.790704+0000","last_clean":"2024-09-14T11:53:45.790704+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:53:45.790704+0000","last_undegraded":"2024-09-14T11:53:45.790704+0000","last_fullsized":"2024-09-14T11:53:45.790704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:46.735010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.901661+0000","last_change":"2024-09-14T11:30:44.713119+0000","last_active":"2024-09-14T11:53:39.901661+0000","last_peered":"2024-09-14T11:53:39.901661+0000","last_clean":"2024-09-14T11:53:39.901661+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:53:39.901661+0000","last_undegraded":"2024-09-14T11:53:39.901661+0000","last_fullsized":"2024-09-14T11:53:39.901661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:45.277861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794558+0000","last_change":"2024-09-14T11:29:10.321339+0000","last_active":"2024-09-14T11:54:10.794558+0000","last_peered":"2024-09-14T11:54:10.794558+0000","last_clean":"2024-09-14T11:54:10.794558+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:54:10.794558+0000","last_undegraded":"2024-09-14T11:54:10.794558+0000","last_fullsized":"2024-09-14T11:54:10.794558+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:57.698726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790015+0000","last_change":"2024-09-14T11:30:44.721204+0000","last_active":"2024-09-14T11:53:40.790015+0000","last_peered":"2024-09-14T11:53:40.790015+0000","last_clean":"2024-09-14T11:53:40.790015+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:53:40.790015+0000","last_undegraded":"2024-09-14T11:53:40.790015+0000","last_fullsized":"2024-09-14T11:53:40.790015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.676688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792100+0000","last_change":"2024-09-14T11:29:10.324357+0000","last_active":"2024-09-14T11:53:14.792100+0000","last_peered":"2024-09-14T11:53:14.792100+0000","last_clean":"2024-09-14T11:53:14.792100+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:53:14.792100+0000","last_undegraded":"2024-09-14T11:53:14.792100+0000","last_fullsized":"2024-09-14T11:53:14.792100+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:35.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'303","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.793622+0000","last_change":"2024-09-14T11:14:04.132821+0000","last_active":"2024-09-14T11:56:14.793622+0000","last_peered":"2024-09-14T11:56:14.793622+0000","last_clean":"2024-09-14T11:56:14.793622+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:14.793622+0000","last_undegraded":"2024-09-14T11:56:14.793622+0000","last_fullsized":"2024-09-14T11:56:14.793622+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:20.604907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6901394,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":578,"num_read_kb":2359,"num_write":1120,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1592","reported_seq":3377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461746+0000","last_change":"2024-09-14T11:14:06.121950+0000","last_active":"2024-09-14T11:54:24.461746+0000","last_peered":"2024-09-14T11:54:24.461746+0000","last_clean":"2024-09-14T11:54:24.461746+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:54:24.461746+0000","last_undegraded":"2024-09-14T11:54:24.461746+0000","last_fullsized":"2024-09-14T11:54:24.461746+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.554941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'322","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874917+0000","last_change":"2024-09-14T11:14:04.126728+0000","last_active":"2024-09-14T11:56:14.874917+0000","last_peered":"2024-09-14T11:56:14.874917+0000","last_clean":"2024-09-14T11:56:14.874917+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:14.874917+0000","last_undegraded":"2024-09-14T11:56:14.874917+0000","last_fullsized":"2024-09-14T11:56:14.874917+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:41.626044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":621,"num_read_kb":6703,"num_write":1161,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'561","reported_seq":2237,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622076+0000","last_change":"2024-09-14T11:14:06.123174+0000","last_active":"2024-09-14T11:55:41.622076+0000","last_peered":"2024-09-14T11:55:41.622076+0000","last_clean":"2024-09-14T11:55:41.622076+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:55:41.622076+0000","last_undegraded":"2024-09-14T11:55:41.622076+0000","last_fullsized":"2024-09-14T11:55:41.622076+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:37.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'322","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.836719+0000","last_change":"2024-09-14T11:14:04.122664+0000","last_active":"2024-09-14T11:56:14.836719+0000","last_peered":"2024-09-14T11:56:14.836719+0000","last_clean":"2024-09-14T11:56:14.836719+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:14.836719+0000","last_undegraded":"2024-09-14T11:56:14.836719+0000","last_fullsized":"2024-09-14T11:56:14.836719+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4503,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":604,"num_read_kb":11794,"num_write":1115,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'475","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.537995+0000","last_change":"2024-09-14T11:14:06.124737+0000","last_active":"2024-09-14T11:54:26.537995+0000","last_peered":"2024-09-14T11:54:26.537995+0000","last_clean":"2024-09-14T11:54:26.537995+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:54:26.537995+0000","last_undegraded":"2024-09-14T11:54:26.537995+0000","last_fullsized":"2024-09-14T11:54:26.537995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:38.559640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.618263+0000","last_change":"2024-09-14T11:14:04.128237+0000","last_active":"2024-09-14T11:56:15.618263+0000","last_peered":"2024-09-14T11:56:15.618263+0000","last_clean":"2024-09-14T11:56:15.618263+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:15.618263+0000","last_undegraded":"2024-09-14T11:56:15.618263+0000","last_fullsized":"2024-09-14T11:56:15.618263+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:22.273382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1060","reported_seq":2767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540504+0000","last_change":"2024-09-14T11:14:06.134846+0000","last_active":"2024-09-14T11:54:04.540504+0000","last_peered":"2024-09-14T11:54:04.540504+0000","last_clean":"2024-09-14T11:54:04.540504+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:54:04.540504+0000","last_undegraded":"2024-09-14T11:54:04.540504+0000","last_fullsized":"2024-09-14T11:54:04.540504+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:16.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'326","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.792537+0000","last_change":"2024-09-14T11:14:04.121928+0000","last_active":"2024-09-14T11:56:14.792537+0000","last_peered":"2024-09-14T11:56:14.792537+0000","last_clean":"2024-09-14T11:56:14.792537+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:14.792537+0000","last_undegraded":"2024-09-14T11:56:14.792537+0000","last_fullsized":"2024-09-14T11:56:14.792537+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:49.409365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2001957,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":601,"num_read_kb":64951,"num_write":1148,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'462","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.795372+0000","last_change":"2024-09-14T11:14:06.131212+0000","last_active":"2024-09-14T11:54:15.795372+0000","last_peered":"2024-09-14T11:54:15.795372+0000","last_clean":"2024-09-14T11:54:15.795372+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:54:15.795372+0000","last_undegraded":"2024-09-14T11:54:15.795372+0000","last_fullsized":"2024-09-14T11:54:15.795372+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:20.091159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.586411+0000","last_change":"2024-09-14T11:14:04.134464+0000","last_active":"2024-09-14T11:56:15.586411+0000","last_peered":"2024-09-14T11:56:15.586411+0000","last_clean":"2024-09-14T11:56:15.586411+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:15.586411+0000","last_undegraded":"2024-09-14T11:56:15.586411+0000","last_fullsized":"2024-09-14T11:56:15.586411+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:30.803104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'797","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.547089+0000","last_change":"2024-09-14T11:14:06.123280+0000","last_active":"2024-09-14T11:54:08.547089+0000","last_peered":"2024-09-14T11:54:08.547089+0000","last_clean":"2024-09-14T11:54:08.547089+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:54:08.547089+0000","last_undegraded":"2024-09-14T11:54:08.547089+0000","last_fullsized":"2024-09-14T11:54:08.547089+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:47.903630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'265","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.798085+0000","last_change":"2024-09-14T11:14:04.123532+0000","last_active":"2024-09-14T11:56:14.798085+0000","last_peered":"2024-09-14T11:56:14.798085+0000","last_clean":"2024-09-14T11:56:14.798085+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:14.798085+0000","last_undegraded":"2024-09-14T11:56:14.798085+0000","last_fullsized":"2024-09-14T11:56:14.798085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:19.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632597,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":400,"num_read_kb":10088,"num_write":805,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'969","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114339+0000","last_change":"2024-09-14T11:14:38.192581+0000","last_active":"2024-09-14T11:54:27.114339+0000","last_peered":"2024-09-14T11:54:27.114339+0000","last_clean":"2024-09-14T11:54:27.114339+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:54:27.114339+0000","last_undegraded":"2024-09-14T11:54:27.114339+0000","last_fullsized":"2024-09-14T11:54:27.114339+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":900,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:55.081995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'281","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887971+0000","last_change":"2024-09-14T11:14:04.133635+0000","last_active":"2024-09-14T11:56:14.887971+0000","last_peered":"2024-09-14T11:56:14.887971+0000","last_clean":"2024-09-14T11:56:14.887971+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:14.887971+0000","last_undegraded":"2024-09-14T11:56:14.887971+0000","last_fullsized":"2024-09-14T11:56:14.887971+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:20.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656670,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":689,"num_read_kb":31980,"num_write":981,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'456","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113514+0000","last_change":"2024-09-14T11:14:06.120786+0000","last_active":"2024-09-14T11:54:27.113514+0000","last_peered":"2024-09-14T11:54:27.113514+0000","last_clean":"2024-09-14T11:54:27.113514+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:54:27.113514+0000","last_undegraded":"2024-09-14T11:54:27.113514+0000","last_fullsized":"2024-09-14T11:54:27.113514+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:54.953125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'842","reported_seq":2512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114073+0000","last_change":"2024-09-14T11:14:06.124595+0000","last_active":"2024-09-14T11:54:27.114073+0000","last_peered":"2024-09-14T11:54:27.114073+0000","last_clean":"2024-09-14T11:54:27.114073+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:54:27.114073+0000","last_undegraded":"2024-09-14T11:54:27.114073+0000","last_fullsized":"2024-09-14T11:54:27.114073+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:05.222764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'359","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.809065+0000","last_change":"2024-09-14T11:14:38.194800+0000","last_active":"2024-09-14T11:56:14.809065+0000","last_peered":"2024-09-14T11:56:14.809065+0000","last_clean":"2024-09-14T11:56:14.809065+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:14.809065+0000","last_undegraded":"2024-09-14T11:56:14.809065+0000","last_fullsized":"2024-09-14T11:56:14.809065+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.771928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":452,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":664,"num_read_kb":5626,"num_write":1133,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1033","reported_seq":2958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113832+0000","last_change":"2024-09-14T11:14:06.123475+0000","last_active":"2024-09-14T11:54:27.113832+0000","last_peered":"2024-09-14T11:54:27.113832+0000","last_clean":"2024-09-14T11:54:27.113832+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:54:27.113832+0000","last_undegraded":"2024-09-14T11:54:27.113832+0000","last_fullsized":"2024-09-14T11:54:27.113832+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1000,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:19.165857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.556657+0000","last_change":"2024-09-14T11:14:04.127657+0000","last_active":"2024-09-14T11:56:15.556657+0000","last_peered":"2024-09-14T11:56:15.556657+0000","last_clean":"2024-09-14T11:56:15.556657+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:15.556657+0000","last_undegraded":"2024-09-14T11:56:15.556657+0000","last_fullsized":"2024-09-14T11:56:15.556657+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:06.672463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114354+0000","last_change":"2024-09-14T11:14:06.126958+0000","last_active":"2024-09-14T11:54:27.114354+0000","last_peered":"2024-09-14T11:54:27.114354+0000","last_clean":"2024-09-14T11:54:27.114354+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:54:27.114354+0000","last_undegraded":"2024-09-14T11:54:27.114354+0000","last_fullsized":"2024-09-14T11:54:27.114354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:26.370068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.544255+0000","last_change":"2024-09-14T11:14:04.124069+0000","last_active":"2024-09-14T11:56:15.544255+0000","last_peered":"2024-09-14T11:56:15.544255+0000","last_clean":"2024-09-14T11:56:15.544255+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:15.544255+0000","last_undegraded":"2024-09-14T11:56:15.544255+0000","last_fullsized":"2024-09-14T11:56:15.544255+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:34.849444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'797","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.716592+0000","last_change":"2024-09-14T11:14:06.121906+0000","last_active":"2024-09-14T11:53:56.716592+0000","last_peered":"2024-09-14T11:53:56.716592+0000","last_clean":"2024-09-14T11:53:56.716592+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:53:56.716592+0000","last_undegraded":"2024-09-14T11:53:56.716592+0000","last_fullsized":"2024-09-14T11:53:56.716592+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:09.756613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.581006+0000","last_change":"2024-09-14T11:14:04.134028+0000","last_active":"2024-09-14T11:56:15.581006+0000","last_peered":"2024-09-14T11:56:15.581006+0000","last_clean":"2024-09-14T11:56:15.581006+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:15.581006+0000","last_undegraded":"2024-09-14T11:56:15.581006+0000","last_fullsized":"2024-09-14T11:56:15.581006+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:15.221483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'452","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546378+0000","last_change":"2024-09-14T11:14:06.126750+0000","last_active":"2024-09-14T11:54:26.546378+0000","last_peered":"2024-09-14T11:54:26.546378+0000","last_clean":"2024-09-14T11:54:26.546378+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:54:26.546378+0000","last_undegraded":"2024-09-14T11:54:26.546378+0000","last_fullsized":"2024-09-14T11:54:26.546378+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:36.058072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'402","reported_seq":1130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.899014+0000","last_change":"2024-09-14T11:14:04.124388+0000","last_active":"2024-09-14T11:56:14.899014+0000","last_peered":"2024-09-14T11:56:14.899014+0000","last_clean":"2024-09-14T11:56:14.899014+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:14.899014+0000","last_undegraded":"2024-09-14T11:56:14.899014+0000","last_fullsized":"2024-09-14T11:56:14.899014+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:48.709233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245244,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1018,"num_read_kb":31602,"num_write":1270,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'449","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262318+0000","last_change":"2024-09-14T11:14:06.120737+0000","last_active":"2024-09-14T11:54:09.262318+0000","last_peered":"2024-09-14T11:54:09.262318+0000","last_clean":"2024-09-14T11:54:09.262318+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:54:09.262318+0000","last_undegraded":"2024-09-14T11:54:09.262318+0000","last_fullsized":"2024-09-14T11:54:09.262318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:08.169000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'305","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.873253+0000","last_change":"2024-09-14T11:14:04.131958+0000","last_active":"2024-09-14T11:56:14.873253+0000","last_peered":"2024-09-14T11:56:14.873253+0000","last_clean":"2024-09-14T11:56:14.873253+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:14.873253+0000","last_undegraded":"2024-09-14T11:56:14.873253+0000","last_fullsized":"2024-09-14T11:56:14.873253+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:07.141707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12587448,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":530,"num_read_kb":49466,"num_write":1002,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'149","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.173403+0000","last_change":"2024-09-14T11:14:14.157140+0000","last_active":"2024-09-14T11:54:27.173403+0000","last_peered":"2024-09-14T11:54:27.173403+0000","last_clean":"2024-09-14T11:54:27.173403+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:54:27.173403+0000","last_undegraded":"2024-09-14T11:54:27.173403+0000","last_fullsized":"2024-09-14T11:54:27.173403+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'472","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462103+0000","last_change":"2024-09-14T11:14:06.114316+0000","last_active":"2024-09-14T11:54:24.462103+0000","last_peered":"2024-09-14T11:54:24.462103+0000","last_clean":"2024-09-14T11:54:24.462103+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:54:24.462103+0000","last_undegraded":"2024-09-14T11:54:24.462103+0000","last_fullsized":"2024-09-14T11:54:24.462103+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:27.459152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'326","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.779294+0000","last_change":"2024-09-14T11:14:04.130305+0000","last_active":"2024-09-14T11:56:14.779294+0000","last_peered":"2024-09-14T11:56:14.779294+0000","last_clean":"2024-09-14T11:56:14.779294+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:14.779294+0000","last_undegraded":"2024-09-14T11:56:14.779294+0000","last_fullsized":"2024-09-14T11:56:14.779294+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:34.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11283977,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":545,"num_read_kb":64656,"num_write":1047,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032244+0000","last_change":"2024-09-14T11:14:08.133120+0000","last_active":"2024-09-14T11:52:51.032244+0000","last_peered":"2024-09-14T11:52:51.032244+0000","last_clean":"2024-09-14T11:52:51.032244+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:52:51.032244+0000","last_undegraded":"2024-09-14T11:52:51.032244+0000","last_fullsized":"2024-09-14T11:52:51.032244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:46.516129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.396646+0000","last_change":"2024-09-14T11:14:10.155409+0000","last_active":"2024-09-14T11:56:14.396646+0000","last_peered":"2024-09-14T11:56:14.396646+0000","last_clean":"2024-09-14T11:56:14.396646+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:14.396646+0000","last_undegraded":"2024-09-14T11:56:14.396646+0000","last_fullsized":"2024-09-14T11:56:14.396646+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:46.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.789188+0000","last_change":"2024-09-14T11:14:12.146041+0000","last_active":"2024-09-14T11:52:54.789188+0000","last_peered":"2024-09-14T11:52:54.789188+0000","last_clean":"2024-09-14T11:52:54.789188+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:52:54.789188+0000","last_undegraded":"2024-09-14T11:52:54.789188+0000","last_fullsized":"2024-09-14T11:52:54.789188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:07.310103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2525","reported_seq":4350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.558442+0000","last_change":"2024-09-14T11:14:14.162522+0000","last_active":"2024-09-14T11:54:26.558442+0000","last_peered":"2024-09-14T11:54:26.558442+0000","last_clean":"2024-09-14T11:54:26.558442+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:54:26.558442+0000","last_undegraded":"2024-09-14T11:54:26.558442+0000","last_fullsized":"2024-09-14T11:54:26.558442+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.242957+0000","last_change":"2024-09-14T11:14:06.123796+0000","last_active":"2024-09-14T11:53:58.242957+0000","last_peered":"2024-09-14T11:53:58.242957+0000","last_clean":"2024-09-14T11:53:58.242957+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:53:58.242957+0000","last_undegraded":"2024-09-14T11:53:58.242957+0000","last_fullsized":"2024-09-14T11:53:58.242957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.088566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'355","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897988+0000","last_change":"2024-09-14T11:14:04.119220+0000","last_active":"2024-09-14T11:56:14.897988+0000","last_peered":"2024-09-14T11:56:14.897988+0000","last_clean":"2024-09-14T11:56:14.897988+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:14.897988+0000","last_undegraded":"2024-09-14T11:56:14.897988+0000","last_fullsized":"2024-09-14T11:56:14.897988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:38.371093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1196,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":645,"num_read_kb":35601,"num_write":1184,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"37'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.737726+0000","last_change":"2024-09-14T11:14:08.135860+0000","last_active":"2024-09-14T11:56:13.737726+0000","last_peered":"2024-09-14T11:56:13.737726+0000","last_clean":"2024-09-14T11:56:13.737726+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:13.737726+0000","last_undegraded":"2024-09-14T11:56:13.737726+0000","last_fullsized":"2024-09-14T11:56:13.737726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:46.310304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'85","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.820592+0000","last_change":"2024-09-14T11:14:10.148306+0000","last_active":"2024-09-14T11:54:18.820592+0000","last_peered":"2024-09-14T11:54:18.820592+0000","last_clean":"2024-09-14T11:54:18.820592+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:54:18.820592+0000","last_undegraded":"2024-09-14T11:54:18.820592+0000","last_fullsized":"2024-09-14T11:54:18.820592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:24.120046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783507+0000","last_change":"2024-09-14T11:14:12.155662+0000","last_active":"2024-09-14T11:52:55.783507+0000","last_peered":"2024-09-14T11:52:55.783507+0000","last_clean":"2024-09-14T11:52:55.783507+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:52:55.783507+0000","last_undegraded":"2024-09-14T11:52:55.783507+0000","last_fullsized":"2024-09-14T11:52:55.783507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.540261+0000","last_change":"2024-09-14T11:14:14.154923+0000","last_active":"2024-09-14T11:53:52.540261+0000","last_peered":"2024-09-14T11:53:52.540261+0000","last_clean":"2024-09-14T11:53:52.540261+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:53:52.540261+0000","last_undegraded":"2024-09-14T11:53:52.540261+0000","last_fullsized":"2024-09-14T11:53:52.540261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:08.154888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'429","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.932863+0000","last_change":"2024-09-14T11:14:06.134060+0000","last_active":"2024-09-14T11:54:02.932863+0000","last_peered":"2024-09-14T11:54:02.932863+0000","last_clean":"2024-09-14T11:54:02.932863+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:54:02.932863+0000","last_undegraded":"2024-09-14T11:54:02.932863+0000","last_fullsized":"2024-09-14T11:54:02.932863+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:50.929113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'380","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.731352+0000","last_change":"2024-09-14T11:14:04.131269+0000","last_active":"2024-09-14T11:56:14.731352+0000","last_peered":"2024-09-14T11:56:14.731352+0000","last_clean":"2024-09-14T11:56:14.731352+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:14.731352+0000","last_undegraded":"2024-09-14T11:56:14.731352+0000","last_fullsized":"2024-09-14T11:56:14.731352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.204839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982763,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":788,"num_read_kb":18319,"num_write":1387,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.894797+0000","last_change":"2024-09-14T11:14:08.134301+0000","last_active":"2024-09-14T11:52:49.894797+0000","last_peered":"2024-09-14T11:52:49.894797+0000","last_clean":"2024-09-14T11:52:49.894797+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:52:49.894797+0000","last_undegraded":"2024-09-14T11:52:49.894797+0000","last_fullsized":"2024-09-14T11:52:49.894797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.190597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'98","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.837361+0000","last_change":"2024-09-14T11:14:10.152502+0000","last_active":"2024-09-14T11:54:18.837361+0000","last_peered":"2024-09-14T11:54:18.837361+0000","last_clean":"2024-09-14T11:54:18.837361+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:54:18.837361+0000","last_undegraded":"2024-09-14T11:54:18.837361+0000","last_fullsized":"2024-09-14T11:54:18.837361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:42.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'769","reported_seq":4560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.742621+0000","last_change":"2024-09-14T11:14:12.146612+0000","last_active":"2024-09-14T11:56:13.742621+0000","last_peered":"2024-09-14T11:56:13.742621+0000","last_clean":"2024-09-14T11:56:13.742621+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:13.742621+0000","last_undegraded":"2024-09-14T11:56:13.742621+0000","last_fullsized":"2024-09-14T11:56:13.742621+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:59.916147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.603559+0000","last_change":"2024-09-14T11:14:14.157146+0000","last_active":"2024-09-14T11:54:26.603559+0000","last_peered":"2024-09-14T11:54:26.603559+0000","last_clean":"2024-09-14T11:54:26.603559+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:54:26.603559+0000","last_undegraded":"2024-09-14T11:54:26.603559+0000","last_fullsized":"2024-09-14T11:54:26.603559+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'525","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.725224+0000","last_change":"2024-09-14T11:14:38.194359+0000","last_active":"2024-09-14T11:54:03.725224+0000","last_peered":"2024-09-14T11:54:03.725224+0000","last_clean":"2024-09-14T11:54:03.725224+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:54:03.725224+0000","last_undegraded":"2024-09-14T11:54:03.725224+0000","last_fullsized":"2024-09-14T11:54:03.725224+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:56.602770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.572772+0000","last_change":"2024-09-14T11:14:04.128674+0000","last_active":"2024-09-14T11:56:15.572772+0000","last_peered":"2024-09-14T11:56:15.572772+0000","last_clean":"2024-09-14T11:56:15.572772+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:15.572772+0000","last_undegraded":"2024-09-14T11:56:15.572772+0000","last_fullsized":"2024-09-14T11:56:15.572772+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.487246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032273+0000","last_change":"2024-09-14T11:14:08.132713+0000","last_active":"2024-09-14T11:52:51.032273+0000","last_peered":"2024-09-14T11:52:51.032273+0000","last_clean":"2024-09-14T11:52:51.032273+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:52:51.032273+0000","last_undegraded":"2024-09-14T11:52:51.032273+0000","last_fullsized":"2024-09-14T11:52:51.032273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.166831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'250","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.104576+0000","last_change":"2024-09-14T11:14:10.151136+0000","last_active":"2024-09-14T11:56:14.104576+0000","last_peered":"2024-09-14T11:56:14.104576+0000","last_clean":"2024-09-14T11:56:14.104576+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:14.104576+0000","last_undegraded":"2024-09-14T11:56:14.104576+0000","last_fullsized":"2024-09-14T11:56:14.104576+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.560101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.746769+0000","last_change":"2024-09-14T11:14:12.152920+0000","last_active":"2024-09-14T11:56:13.746769+0000","last_peered":"2024-09-14T11:56:13.746769+0000","last_clean":"2024-09-14T11:56:13.746769+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:13.746769+0000","last_undegraded":"2024-09-14T11:56:13.746769+0000","last_fullsized":"2024-09-14T11:56:13.746769+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:33.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1226","reported_seq":2881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358325+0000","last_change":"2024-09-14T11:14:06.125762+0000","last_active":"2024-09-14T11:54:05.358325+0000","last_peered":"2024-09-14T11:54:05.358325+0000","last_clean":"2024-09-14T11:54:05.358325+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:54:05.358325+0000","last_undegraded":"2024-09-14T11:54:05.358325+0000","last_fullsized":"2024-09-14T11:54:05.358325+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:18.791358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'329","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.766628+0000","last_change":"2024-09-14T11:14:04.130569+0000","last_active":"2024-09-14T11:56:14.766628+0000","last_peered":"2024-09-14T11:56:14.766628+0000","last_clean":"2024-09-14T11:56:14.766628+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:14.766628+0000","last_undegraded":"2024-09-14T11:56:14.766628+0000","last_fullsized":"2024-09-14T11:56:14.766628+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:07.122939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":614,"num_read_kb":41733,"num_write":1076,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.791334+0000","last_change":"2024-09-14T11:14:08.133899+0000","last_active":"2024-09-14T11:53:09.791334+0000","last_peered":"2024-09-14T11:53:09.791334+0000","last_clean":"2024-09-14T11:53:09.791334+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:53:09.791334+0000","last_undegraded":"2024-09-14T11:53:09.791334+0000","last_fullsized":"2024-09-14T11:53:09.791334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:53.760916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'355","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.626523+0000","last_change":"2024-09-14T11:14:10.148253+0000","last_active":"2024-09-14T11:56:14.626523+0000","last_peered":"2024-09-14T11:56:14.626523+0000","last_clean":"2024-09-14T11:56:14.626523+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:14.626523+0000","last_undegraded":"2024-09-14T11:56:14.626523+0000","last_fullsized":"2024-09-14T11:56:14.626523+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:31.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892192+0000","last_change":"2024-09-14T11:14:12.146180+0000","last_active":"2024-09-14T11:52:29.892192+0000","last_peered":"2024-09-14T11:52:29.892192+0000","last_clean":"2024-09-14T11:52:29.892192+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:52:29.892192+0000","last_undegraded":"2024-09-14T11:52:29.892192+0000","last_fullsized":"2024-09-14T11:52:29.892192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:08.096291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'551","reported_seq":1353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.743153+0000","last_change":"2024-09-14T11:14:14.163358+0000","last_active":"2024-09-14T11:55:42.743153+0000","last_peered":"2024-09-14T11:55:42.743153+0000","last_clean":"2024-09-14T11:55:42.743153+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:55:42.743153+0000","last_undegraded":"2024-09-14T11:55:42.743153+0000","last_fullsized":"2024-09-14T11:55:42.743153+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.528715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'805","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783202+0000","last_change":"2024-09-14T11:14:06.122574+0000","last_active":"2024-09-14T11:54:07.783202+0000","last_peered":"2024-09-14T11:54:07.783202+0000","last_clean":"2024-09-14T11:54:07.783202+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:54:07.783202+0000","last_undegraded":"2024-09-14T11:54:07.783202+0000","last_fullsized":"2024-09-14T11:54:07.783202+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:48.369389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'287","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.748314+0000","last_change":"2024-09-14T11:14:38.341826+0000","last_active":"2024-09-14T11:56:14.748314+0000","last_peered":"2024-09-14T11:56:14.748314+0000","last_clean":"2024-09-14T11:56:14.748314+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:14.748314+0000","last_undegraded":"2024-09-14T11:56:14.748314+0000","last_fullsized":"2024-09-14T11:56:14.748314+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:15.557976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656139,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":522,"num_read_kb":67475,"num_write":1005,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777294+0000","last_change":"2024-09-14T11:14:08.128050+0000","last_active":"2024-09-14T11:53:09.777294+0000","last_peered":"2024-09-14T11:53:09.777294+0000","last_clean":"2024-09-14T11:53:09.777294+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:53:09.777294+0000","last_undegraded":"2024-09-14T11:53:09.777294+0000","last_fullsized":"2024-09-14T11:53:09.777294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:20.497715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'289","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.704528+0000","last_change":"2024-09-14T11:14:10.154690+0000","last_active":"2024-09-14T11:55:42.704528+0000","last_peered":"2024-09-14T11:55:42.704528+0000","last_clean":"2024-09-14T11:55:42.704528+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:55:42.704528+0000","last_undegraded":"2024-09-14T11:55:42.704528+0000","last_fullsized":"2024-09-14T11:55:42.704528+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:11.627375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62129,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":989,"num_write":396,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899412+0000","last_change":"2024-09-14T11:14:12.151137+0000","last_active":"2024-09-14T11:53:19.899412+0000","last_peered":"2024-09-14T11:53:19.899412+0000","last_clean":"2024-09-14T11:53:19.899412+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:53:19.899412+0000","last_undegraded":"2024-09-14T11:53:19.899412+0000","last_fullsized":"2024-09-14T11:53:19.899412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:29.769264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'118","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.889408+0000","last_change":"2024-09-14T11:14:14.157438+0000","last_active":"2024-09-14T11:55:32.889408+0000","last_peered":"2024-09-14T11:55:32.889408+0000","last_clean":"2024-09-14T11:55:32.889408+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:55:32.889408+0000","last_undegraded":"2024-09-14T11:55:32.889408+0000","last_fullsized":"2024-09-14T11:55:32.889408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:00.893536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1038","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935378+0000","last_change":"2024-09-14T11:14:06.128782+0000","last_active":"2024-09-14T11:54:09.935378+0000","last_peered":"2024-09-14T11:54:09.935378+0000","last_clean":"2024-09-14T11:54:09.935378+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:54:09.935378+0000","last_undegraded":"2024-09-14T11:54:09.935378+0000","last_fullsized":"2024-09-14T11:54:09.935378+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:45.064796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'265","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.810356+0000","last_change":"2024-09-14T11:14:04.126361+0000","last_active":"2024-09-14T11:56:14.810356+0000","last_peered":"2024-09-14T11:56:14.810356+0000","last_clean":"2024-09-14T11:56:14.810356+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:14.810356+0000","last_undegraded":"2024-09-14T11:56:14.810356+0000","last_fullsized":"2024-09-14T11:56:14.810356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:57.417770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245220,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":404,"num_read_kb":31073,"num_write":880,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771841+0000","last_change":"2024-09-14T11:14:08.126954+0000","last_active":"2024-09-14T11:52:24.771841+0000","last_peered":"2024-09-14T11:52:24.771841+0000","last_clean":"2024-09-14T11:52:24.771841+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:52:24.771841+0000","last_undegraded":"2024-09-14T11:52:24.771841+0000","last_fullsized":"2024-09-14T11:52:24.771841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:45.136292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'300","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.732982+0000","last_change":"2024-09-14T11:14:10.152183+0000","last_active":"2024-09-14T11:56:14.732982+0000","last_peered":"2024-09-14T11:56:14.732982+0000","last_clean":"2024-09-14T11:56:14.732982+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:14.732982+0000","last_undegraded":"2024-09-14T11:56:14.732982+0000","last_fullsized":"2024-09-14T11:56:14.732982+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.467798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'787","reported_seq":4040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.747751+0000","last_change":"2024-09-14T11:14:12.147169+0000","last_active":"2024-09-14T11:56:13.747751+0000","last_peered":"2024-09-14T11:56:13.747751+0000","last_clean":"2024-09-14T11:56:13.747751+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:13.747751+0000","last_undegraded":"2024-09-14T11:56:13.747751+0000","last_fullsized":"2024-09-14T11:56:13.747751+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:25.604563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573078+0000","last_change":"2024-09-14T11:14:14.159513+0000","last_active":"2024-09-14T11:55:41.573078+0000","last_peered":"2024-09-14T11:55:41.573078+0000","last_clean":"2024-09-14T11:55:41.573078+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:55:41.573078+0000","last_undegraded":"2024-09-14T11:55:41.573078+0000","last_fullsized":"2024-09-14T11:55:41.573078+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.781431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'412","reported_seq":1898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630266+0000","last_change":"2024-09-14T11:14:06.131730+0000","last_active":"2024-09-14T11:55:41.630266+0000","last_peered":"2024-09-14T11:55:41.630266+0000","last_clean":"2024-09-14T11:55:41.630266+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:55:41.630266+0000","last_undegraded":"2024-09-14T11:55:41.630266+0000","last_fullsized":"2024-09-14T11:55:41.630266+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:31.948943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627548+0000","last_change":"2024-09-14T11:14:04.129793+0000","last_active":"2024-09-14T11:56:15.627548+0000","last_peered":"2024-09-14T11:56:15.627548+0000","last_clean":"2024-09-14T11:56:15.627548+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:15.627548+0000","last_undegraded":"2024-09-14T11:56:15.627548+0000","last_fullsized":"2024-09-14T11:56:15.627548+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.783947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.778424+0000","last_change":"2024-09-14T11:14:08.138126+0000","last_active":"2024-09-14T11:53:19.778424+0000","last_peered":"2024-09-14T11:53:19.778424+0000","last_clean":"2024-09-14T11:53:19.778424+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:53:19.778424+0000","last_undegraded":"2024-09-14T11:53:19.778424+0000","last_fullsized":"2024-09-14T11:53:19.778424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.320143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'491","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.847886+0000","last_change":"2024-09-14T11:14:10.155037+0000","last_active":"2024-09-14T11:56:14.847886+0000","last_peered":"2024-09-14T11:56:14.847886+0000","last_clean":"2024-09-14T11:56:14.847886+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:14.847886+0000","last_undegraded":"2024-09-14T11:56:14.847886+0000","last_fullsized":"2024-09-14T11:56:14.847886+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:11.589031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":872,"num_read_kb":2063,"num_write":732,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777908+0000","last_change":"2024-09-14T11:14:12.150404+0000","last_active":"2024-09-14T11:53:14.777908+0000","last_peered":"2024-09-14T11:53:14.777908+0000","last_clean":"2024-09-14T11:53:14.777908+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:53:14.777908+0000","last_undegraded":"2024-09-14T11:53:14.777908+0000","last_fullsized":"2024-09-14T11:53:14.777908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:35.156152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.719675+0000","last_change":"2024-09-14T11:14:14.158980+0000","last_active":"2024-09-14T11:53:53.719675+0000","last_peered":"2024-09-14T11:53:53.719675+0000","last_clean":"2024-09-14T11:53:53.719675+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:53:53.719675+0000","last_undegraded":"2024-09-14T11:53:53.719675+0000","last_fullsized":"2024-09-14T11:53:53.719675+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'845","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540265+0000","last_change":"2024-09-14T11:14:06.121080+0000","last_active":"2024-09-14T11:54:04.540265+0000","last_peered":"2024-09-14T11:54:04.540265+0000","last_clean":"2024-09-14T11:54:04.540265+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:54:04.540265+0000","last_undegraded":"2024-09-14T11:54:04.540265+0000","last_fullsized":"2024-09-14T11:54:04.540265+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.620906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'357","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.837330+0000","last_change":"2024-09-14T11:14:04.123630+0000","last_active":"2024-09-14T11:56:14.837330+0000","last_peered":"2024-09-14T11:56:14.837330+0000","last_clean":"2024-09-14T11:56:14.837330+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:14.837330+0000","last_undegraded":"2024-09-14T11:56:14.837330+0000","last_fullsized":"2024-09-14T11:56:14.837330+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.120592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5259761,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":686,"num_read_kb":16903,"num_write":1198,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771872+0000","last_change":"2024-09-14T11:14:08.130949+0000","last_active":"2024-09-14T11:52:24.771872+0000","last_peered":"2024-09-14T11:52:24.771872+0000","last_clean":"2024-09-14T11:52:24.771872+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:52:24.771872+0000","last_undegraded":"2024-09-14T11:52:24.771872+0000","last_fullsized":"2024-09-14T11:52:24.771872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:57.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.591066+0000","last_change":"2024-09-14T11:14:10.152305+0000","last_active":"2024-09-14T11:56:15.591066+0000","last_peered":"2024-09-14T11:56:15.591066+0000","last_clean":"2024-09-14T11:56:15.591066+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:15.591066+0000","last_undegraded":"2024-09-14T11:56:15.591066+0000","last_fullsized":"2024-09-14T11:56:15.591066+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:30.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894361+0000","last_change":"2024-09-14T11:14:12.155158+0000","last_active":"2024-09-14T11:52:34.894361+0000","last_peered":"2024-09-14T11:52:34.894361+0000","last_clean":"2024-09-14T11:52:34.894361+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:52:34.894361+0000","last_undegraded":"2024-09-14T11:52:34.894361+0000","last_fullsized":"2024-09-14T11:52:34.894361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:57.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'118","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906638+0000","last_change":"2024-09-14T11:14:14.161551+0000","last_active":"2024-09-14T11:54:19.906638+0000","last_peered":"2024-09-14T11:54:19.906638+0000","last_clean":"2024-09-14T11:54:19.906638+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:54:19.906638+0000","last_undegraded":"2024-09-14T11:54:19.906638+0000","last_fullsized":"2024-09-14T11:54:19.906638+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:31.034926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1643","reported_seq":3307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.620971+0000","last_change":"2024-09-14T11:14:06.121979+0000","last_active":"2024-09-14T11:55:41.620971+0000","last_peered":"2024-09-14T11:55:41.620971+0000","last_clean":"2024-09-14T11:55:41.620971+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:55:41.620971+0000","last_undegraded":"2024-09-14T11:55:41.620971+0000","last_fullsized":"2024-09-14T11:55:41.620971+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.503786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596591+0000","last_change":"2024-09-14T11:14:04.126591+0000","last_active":"2024-09-14T11:56:15.596591+0000","last_peered":"2024-09-14T11:56:15.596591+0000","last_clean":"2024-09-14T11:56:15.596591+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:15.596591+0000","last_undegraded":"2024-09-14T11:56:15.596591+0000","last_fullsized":"2024-09-14T11:56:15.596591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:36.129660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891630+0000","last_change":"2024-09-14T11:14:08.137550+0000","last_active":"2024-09-14T11:52:24.891630+0000","last_peered":"2024-09-14T11:52:24.891630+0000","last_clean":"2024-09-14T11:52:24.891630+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:52:24.891630+0000","last_undegraded":"2024-09-14T11:52:24.891630+0000","last_fullsized":"2024-09-14T11:52:24.891630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:25.401132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'290","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.736856+0000","last_change":"2024-09-14T11:14:10.147623+0000","last_active":"2024-09-14T11:55:42.736856+0000","last_peered":"2024-09-14T11:55:42.736856+0000","last_clean":"2024-09-14T11:55:42.736856+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:55:42.736856+0000","last_undegraded":"2024-09-14T11:55:42.736856+0000","last_fullsized":"2024-09-14T11:55:42.736856+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:59.040566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79243,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":1023,"num_write":396,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'759","reported_seq":2576,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.743750+0000","last_change":"2024-09-14T11:14:12.150811+0000","last_active":"2024-09-14T11:56:13.743750+0000","last_peered":"2024-09-14T11:56:13.743750+0000","last_clean":"2024-09-14T11:56:13.743750+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:13.743750+0000","last_undegraded":"2024-09-14T11:56:13.743750+0000","last_fullsized":"2024-09-14T11:56:13.743750+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:59.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'145","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.116982+0000","last_change":"2024-09-14T11:14:14.152510+0000","last_active":"2024-09-14T11:54:26.116982+0000","last_peered":"2024-09-14T11:54:26.116982+0000","last_clean":"2024-09-14T11:54:26.116982+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:54:26.116982+0000","last_undegraded":"2024-09-14T11:54:26.116982+0000","last_fullsized":"2024-09-14T11:54:26.116982+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358932+0000","last_change":"2024-09-14T11:14:06.129574+0000","last_active":"2024-09-14T11:54:05.358932+0000","last_peered":"2024-09-14T11:54:05.358932+0000","last_clean":"2024-09-14T11:54:05.358932+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:54:05.358932+0000","last_undegraded":"2024-09-14T11:54:05.358932+0000","last_fullsized":"2024-09-14T11:54:05.358932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.251050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627434+0000","last_change":"2024-09-14T11:14:04.121041+0000","last_active":"2024-09-14T11:56:15.627434+0000","last_peered":"2024-09-14T11:56:15.627434+0000","last_clean":"2024-09-14T11:56:15.627434+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:15.627434+0000","last_undegraded":"2024-09-14T11:56:15.627434+0000","last_fullsized":"2024-09-14T11:56:15.627434+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:42.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.724714+0000","last_change":"2024-09-14T11:14:08.137840+0000","last_active":"2024-09-14T11:56:13.724714+0000","last_peered":"2024-09-14T11:56:13.724714+0000","last_clean":"2024-09-14T11:56:13.724714+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:13.724714+0000","last_undegraded":"2024-09-14T11:56:13.724714+0000","last_fullsized":"2024-09-14T11:56:13.724714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.414460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'79","reported_seq":592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.808261+0000","last_change":"2024-09-14T11:14:10.153344+0000","last_active":"2024-09-14T11:54:18.808261+0000","last_peered":"2024-09-14T11:54:18.808261+0000","last_clean":"2024-09-14T11:54:18.808261+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:54:18.808261+0000","last_undegraded":"2024-09-14T11:54:18.808261+0000","last_fullsized":"2024-09-14T11:54:18.808261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:08.968908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745724+0000","last_change":"2024-09-14T11:14:12.154356+0000","last_active":"2024-09-14T11:56:13.745724+0000","last_peered":"2024-09-14T11:56:13.745724+0000","last_clean":"2024-09-14T11:56:13.745724+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:13.745724+0000","last_undegraded":"2024-09-14T11:56:13.745724+0000","last_fullsized":"2024-09-14T11:56:13.745724+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:48.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.169895+0000","last_change":"2024-09-14T11:14:14.157483+0000","last_active":"2024-09-14T11:54:27.169895+0000","last_peered":"2024-09-14T11:54:27.169895+0000","last_clean":"2024-09-14T11:54:27.169895+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:54:27.169895+0000","last_undegraded":"2024-09-14T11:54:27.169895+0000","last_fullsized":"2024-09-14T11:54:27.169895+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:28.829014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'510","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546442+0000","last_change":"2024-09-14T11:14:06.118633+0000","last_active":"2024-09-14T11:54:26.546442+0000","last_peered":"2024-09-14T11:54:26.546442+0000","last_clean":"2024-09-14T11:54:26.546442+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:54:26.546442+0000","last_undegraded":"2024-09-14T11:54:26.546442+0000","last_fullsized":"2024-09-14T11:54:26.546442+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:05.940637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'309","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.853490+0000","last_change":"2024-09-14T11:14:04.114747+0000","last_active":"2024-09-14T11:56:14.853490+0000","last_peered":"2024-09-14T11:56:14.853490+0000","last_clean":"2024-09-14T11:56:14.853490+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:14.853490+0000","last_undegraded":"2024-09-14T11:56:14.853490+0000","last_fullsized":"2024-09-14T11:56:14.853490+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:09.164037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20817,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":617,"num_read_kb":522,"num_write":1116,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:25.780132+0000","last_change":"2024-09-14T11:14:08.136517+0000","last_active":"2024-09-14T11:52:25.780132+0000","last_peered":"2024-09-14T11:52:25.780132+0000","last_clean":"2024-09-14T11:52:25.780132+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:52:25.780132+0000","last_undegraded":"2024-09-14T11:52:25.780132+0000","last_fullsized":"2024-09-14T11:52:25.780132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:22.745520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'358","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.456163+0000","last_change":"2024-09-14T11:14:10.153476+0000","last_active":"2024-09-14T11:56:14.456163+0000","last_peered":"2024-09-14T11:56:14.456163+0000","last_clean":"2024-09-14T11:56:14.456163+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:14.456163+0000","last_undegraded":"2024-09-14T11:56:14.456163+0000","last_fullsized":"2024-09-14T11:56:14.456163+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:16.395304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:30.780175+0000","last_change":"2024-09-14T11:14:12.154775+0000","last_active":"2024-09-14T11:52:30.780175+0000","last_peered":"2024-09-14T11:52:30.780175+0000","last_clean":"2024-09-14T11:52:30.780175+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:52:30.780175+0000","last_undegraded":"2024-09-14T11:52:30.780175+0000","last_fullsized":"2024-09-14T11:52:30.780175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:42.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'182","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.542886+0000","last_change":"2024-09-14T11:14:14.155863+0000","last_active":"2024-09-14T11:54:08.542886+0000","last_peered":"2024-09-14T11:54:08.542886+0000","last_clean":"2024-09-14T11:54:08.542886+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:54:08.542886+0000","last_undegraded":"2024-09-14T11:54:08.542886+0000","last_fullsized":"2024-09-14T11:54:08.542886+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'464","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114499+0000","last_change":"2024-09-14T11:14:06.128526+0000","last_active":"2024-09-14T11:54:27.114499+0000","last_peered":"2024-09-14T11:54:27.114499+0000","last_clean":"2024-09-14T11:54:27.114499+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:54:27.114499+0000","last_undegraded":"2024-09-14T11:54:27.114499+0000","last_fullsized":"2024-09-14T11:54:27.114499+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:37.682655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798596+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:53:59.798596+0000","last_peered":"2024-09-14T11:53:59.798596+0000","last_clean":"2024-09-14T11:53:59.798596+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:53:59.798596+0000","last_undegraded":"2024-09-14T11:53:59.798596+0000","last_fullsized":"2024-09-14T11:53:59.798596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037656+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:53:31.037656+0000","last_peered":"2024-09-14T11:53:31.037656+0000","last_clean":"2024-09-14T11:53:31.037656+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:53:31.037656+0000","last_undegraded":"2024-09-14T11:53:31.037656+0000","last_fullsized":"2024-09-14T11:53:31.037656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'300","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.739239+0000","last_change":"2024-09-14T11:14:38.194463+0000","last_active":"2024-09-14T11:56:14.739239+0000","last_peered":"2024-09-14T11:56:14.739239+0000","last_clean":"2024-09-14T11:56:14.739239+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:14.739239+0000","last_undegraded":"2024-09-14T11:56:14.739239+0000","last_fullsized":"2024-09-14T11:56:14.739239+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:55.622697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28690,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":707,"num_read_kb":7470,"num_write":982,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.796289+0000","last_change":"2024-09-14T11:14:08.127046+0000","last_active":"2024-09-14T11:53:44.796289+0000","last_peered":"2024-09-14T11:53:44.796289+0000","last_clean":"2024-09-14T11:53:44.796289+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:53:44.796289+0000","last_undegraded":"2024-09-14T11:53:44.796289+0000","last_fullsized":"2024-09-14T11:53:44.796289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:28.320083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.067086+0000","last_change":"2024-09-14T11:14:10.150205+0000","last_active":"2024-09-14T11:56:15.067086+0000","last_peered":"2024-09-14T11:56:15.067086+0000","last_clean":"2024-09-14T11:56:15.067086+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:15.067086+0000","last_undegraded":"2024-09-14T11:56:15.067086+0000","last_fullsized":"2024-09-14T11:56:15.067086+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:59.627142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899257+0000","last_change":"2024-09-14T11:14:12.153336+0000","last_active":"2024-09-14T11:53:14.899257+0000","last_peered":"2024-09-14T11:53:14.899257+0000","last_clean":"2024-09-14T11:53:14.899257+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:53:14.899257+0000","last_undegraded":"2024-09-14T11:53:14.899257+0000","last_fullsized":"2024-09-14T11:53:14.899257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:44.740572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.171650+0000","last_change":"2024-09-14T11:14:14.160899+0000","last_active":"2024-09-14T11:54:27.171650+0000","last_peered":"2024-09-14T11:54:27.171650+0000","last_clean":"2024-09-14T11:54:27.171650+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:54:27.171650+0000","last_undegraded":"2024-09-14T11:54:27.171650+0000","last_fullsized":"2024-09-14T11:54:27.171650+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:04.990449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1362","reported_seq":3132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461598+0000","last_change":"2024-09-14T11:14:06.132529+0000","last_active":"2024-09-14T11:54:24.461598+0000","last_peered":"2024-09-14T11:54:24.461598+0000","last_clean":"2024-09-14T11:54:24.461598+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:54:24.461598+0000","last_undegraded":"2024-09-14T11:54:24.461598+0000","last_fullsized":"2024-09-14T11:54:24.461598+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:28.977740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.799455+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:54:04.799455+0000","last_peered":"2024-09-14T11:54:04.799455+0000","last_clean":"2024-09-14T11:54:04.799455+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:54:04.799455+0000","last_undegraded":"2024-09-14T11:54:04.799455+0000","last_fullsized":"2024-09-14T11:54:04.799455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'342","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.887104+0000","last_change":"2024-09-14T11:14:04.129263+0000","last_active":"2024-09-14T11:56:14.887104+0000","last_peered":"2024-09-14T11:56:14.887104+0000","last_clean":"2024-09-14T11:56:14.887104+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:14.887104+0000","last_undegraded":"2024-09-14T11:56:14.887104+0000","last_fullsized":"2024-09-14T11:56:14.887104+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:09.002526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6274379,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":595,"num_read_kb":6150,"num_write":1129,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.034937+0000","last_change":"2024-09-14T11:14:08.132493+0000","last_active":"2024-09-14T11:53:11.034937+0000","last_peered":"2024-09-14T11:53:11.034937+0000","last_clean":"2024-09-14T11:53:11.034937+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:53:11.034937+0000","last_undegraded":"2024-09-14T11:53:11.034937+0000","last_fullsized":"2024-09-14T11:53:11.034937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:47.392912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1252","reported_seq":2687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.501292+0000","last_change":"2024-09-14T11:14:10.149170+0000","last_active":"2024-09-14T11:56:14.501292+0000","last_peered":"2024-09-14T11:56:14.501292+0000","last_clean":"2024-09-14T11:56:14.501292+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:14.501292+0000","last_undegraded":"2024-09-14T11:56:14.501292+0000","last_fullsized":"2024-09-14T11:56:14.501292+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:28.655782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119324,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1945,"num_read_kb":3507,"num_write":1048,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798697+0000","last_change":"2024-09-14T11:14:12.148579+0000","last_active":"2024-09-14T11:53:59.798697+0000","last_peered":"2024-09-14T11:53:59.798697+0000","last_clean":"2024-09-14T11:53:59.798697+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:53:59.798697+0000","last_undegraded":"2024-09-14T11:53:59.798697+0000","last_fullsized":"2024-09-14T11:53:59.798697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:34.551801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'132","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.544059+0000","last_change":"2024-09-14T11:14:14.146054+0000","last_active":"2024-09-14T11:54:26.544059+0000","last_peered":"2024-09-14T11:54:26.544059+0000","last_clean":"2024-09-14T11:54:26.544059+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:54:26.544059+0000","last_undegraded":"2024-09-14T11:54:26.544059+0000","last_fullsized":"2024-09-14T11:54:26.544059+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'782","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114491+0000","last_change":"2024-09-14T11:14:06.121305+0000","last_active":"2024-09-14T11:54:27.114491+0000","last_peered":"2024-09-14T11:54:27.114491+0000","last_clean":"2024-09-14T11:54:27.114491+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:54:27.114491+0000","last_undegraded":"2024-09-14T11:54:27.114491+0000","last_fullsized":"2024-09-14T11:54:27.114491+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:09.239590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.779410+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:53:29.779410+0000","last_peered":"2024-09-14T11:53:29.779410+0000","last_clean":"2024-09-14T11:53:29.779410+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:53:29.779410+0000","last_undegraded":"2024-09-14T11:53:29.779410+0000","last_fullsized":"2024-09-14T11:53:29.779410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.901283+0000","last_change":"2024-09-14T11:14:04.124056+0000","last_active":"2024-09-14T11:56:14.901283+0000","last_peered":"2024-09-14T11:56:14.901283+0000","last_clean":"2024-09-14T11:56:14.901283+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:14.901283+0000","last_undegraded":"2024-09-14T11:56:14.901283+0000","last_fullsized":"2024-09-14T11:56:14.901283+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:04.512560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704641,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":659,"num_read_kb":72006,"num_write":1117,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777365+0000","last_change":"2024-09-14T11:14:08.136300+0000","last_active":"2024-09-14T11:53:09.777365+0000","last_peered":"2024-09-14T11:53:09.777365+0000","last_clean":"2024-09-14T11:53:09.777365+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:53:09.777365+0000","last_undegraded":"2024-09-14T11:53:09.777365+0000","last_fullsized":"2024-09-14T11:53:09.777365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.813468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'251","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.881867+0000","last_change":"2024-09-14T11:14:10.150542+0000","last_active":"2024-09-14T11:55:42.881867+0000","last_peered":"2024-09-14T11:55:42.881867+0000","last_clean":"2024-09-14T11:55:42.881867+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:55:42.881867+0000","last_undegraded":"2024-09-14T11:55:42.881867+0000","last_fullsized":"2024-09-14T11:55:42.881867+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:40.011295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903323+0000","last_change":"2024-09-14T11:14:12.151445+0000","last_active":"2024-09-14T11:53:49.903323+0000","last_peered":"2024-09-14T11:53:49.903323+0000","last_clean":"2024-09-14T11:53:49.903323+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:53:49.903323+0000","last_undegraded":"2024-09-14T11:53:49.903323+0000","last_fullsized":"2024-09-14T11:53:49.903323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:44.622819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'267","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.261950+0000","last_change":"2024-09-14T11:14:14.160808+0000","last_active":"2024-09-14T11:54:27.261950+0000","last_peered":"2024-09-14T11:54:27.261950+0000","last_clean":"2024-09-14T11:54:27.261950+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:54:27.261950+0000","last_undegraded":"2024-09-14T11:54:27.261950+0000","last_fullsized":"2024-09-14T11:54:27.261950+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:19.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'430","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261834+0000","last_change":"2024-09-14T11:14:06.126970+0000","last_active":"2024-09-14T11:54:09.261834+0000","last_peered":"2024-09-14T11:54:09.261834+0000","last_clean":"2024-09-14T11:54:09.261834+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:54:09.261834+0000","last_undegraded":"2024-09-14T11:54:09.261834+0000","last_fullsized":"2024-09-14T11:54:09.261834+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.633196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037624+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:53:31.037624+0000","last_peered":"2024-09-14T11:53:31.037624+0000","last_clean":"2024-09-14T11:53:31.037624+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:53:31.037624+0000","last_undegraded":"2024-09-14T11:53:31.037624+0000","last_fullsized":"2024-09-14T11:53:31.037624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'299","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.690633+0000","last_change":"2024-09-14T11:14:38.192227+0000","last_active":"2024-09-14T11:56:14.690633+0000","last_peered":"2024-09-14T11:56:14.690633+0000","last_clean":"2024-09-14T11:56:14.690633+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:14.690633+0000","last_undegraded":"2024-09-14T11:56:14.690633+0000","last_fullsized":"2024-09-14T11:56:14.690633+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:28.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2382,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1214,"num_read_kb":7389,"num_write":1076,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903347+0000","last_change":"2024-09-14T11:14:08.128824+0000","last_active":"2024-09-14T11:53:49.903347+0000","last_peered":"2024-09-14T11:53:49.903347+0000","last_clean":"2024-09-14T11:53:49.903347+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:53:49.903347+0000","last_undegraded":"2024-09-14T11:53:49.903347+0000","last_fullsized":"2024-09-14T11:53:49.903347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:21.240092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914906+0000","last_change":"2024-09-14T11:14:10.153993+0000","last_active":"2024-09-14T11:55:19.914906+0000","last_peered":"2024-09-14T11:55:19.914906+0000","last_clean":"2024-09-14T11:55:19.914906+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:55:19.914906+0000","last_undegraded":"2024-09-14T11:55:19.914906+0000","last_fullsized":"2024-09-14T11:55:19.914906+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:30.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786573+0000","last_change":"2024-09-14T11:14:12.155597+0000","last_active":"2024-09-14T11:53:15.786573+0000","last_peered":"2024-09-14T11:53:15.786573+0000","last_clean":"2024-09-14T11:53:15.786573+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:53:15.786573+0000","last_undegraded":"2024-09-14T11:53:15.786573+0000","last_fullsized":"2024-09-14T11:53:15.786573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:57.628565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.459335+0000","last_change":"2024-09-14T11:14:14.159918+0000","last_active":"2024-09-14T11:54:24.459335+0000","last_peered":"2024-09-14T11:54:24.459335+0000","last_clean":"2024-09-14T11:54:24.459335+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:54:24.459335+0000","last_undegraded":"2024-09-14T11:54:24.459335+0000","last_fullsized":"2024-09-14T11:54:24.459335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'456","reported_seq":2014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540230+0000","last_change":"2024-09-14T11:14:06.123387+0000","last_active":"2024-09-14T11:54:04.540230+0000","last_peered":"2024-09-14T11:54:04.540230+0000","last_clean":"2024-09-14T11:54:04.540230+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:54:04.540230+0000","last_undegraded":"2024-09-14T11:54:04.540230+0000","last_fullsized":"2024-09-14T11:54:04.540230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.573555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596601+0000","last_change":"2024-09-14T11:14:04.122373+0000","last_active":"2024-09-14T11:56:15.596601+0000","last_peered":"2024-09-14T11:56:15.596601+0000","last_clean":"2024-09-14T11:56:15.596601+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:15.596601+0000","last_undegraded":"2024-09-14T11:56:15.596601+0000","last_fullsized":"2024-09-14T11:56:15.596601+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.435958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.900264+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:53:29.900264+0000","last_peered":"2024-09-14T11:53:29.900264+0000","last_clean":"2024-09-14T11:53:29.900264+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:53:29.900264+0000","last_undegraded":"2024-09-14T11:53:29.900264+0000","last_fullsized":"2024-09-14T11:53:29.900264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902721+0000","last_change":"2024-09-14T11:14:08.133183+0000","last_active":"2024-09-14T11:53:44.902721+0000","last_peered":"2024-09-14T11:53:44.902721+0000","last_clean":"2024-09-14T11:53:44.902721+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:53:44.902721+0000","last_undegraded":"2024-09-14T11:53:44.902721+0000","last_fullsized":"2024-09-14T11:53:44.902721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:59.309932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'535","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.161109+0000","last_change":"2024-09-14T11:14:10.149213+0000","last_active":"2024-09-14T11:56:14.161109+0000","last_peered":"2024-09-14T11:56:14.161109+0000","last_clean":"2024-09-14T11:56:14.161109+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:14.161109+0000","last_undegraded":"2024-09-14T11:56:14.161109+0000","last_fullsized":"2024-09-14T11:56:14.161109+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:41.451954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104194,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":930,"num_read_kb":2012,"num_write":766,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791397+0000","last_change":"2024-09-14T11:14:12.151179+0000","last_active":"2024-09-14T11:53:50.791397+0000","last_peered":"2024-09-14T11:53:50.791397+0000","last_clean":"2024-09-14T11:53:50.791397+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:53:50.791397+0000","last_undegraded":"2024-09-14T11:53:50.791397+0000","last_fullsized":"2024-09-14T11:53:50.791397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:00.606325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'163","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.780862+0000","last_change":"2024-09-14T11:14:14.155856+0000","last_active":"2024-09-14T11:54:07.780862+0000","last_peered":"2024-09-14T11:54:07.780862+0000","last_clean":"2024-09-14T11:54:07.780862+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:54:07.780862+0000","last_undegraded":"2024-09-14T11:54:07.780862+0000","last_fullsized":"2024-09-14T11:54:07.780862+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:06.203953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'751","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462007+0000","last_change":"2024-09-14T11:14:06.133092+0000","last_active":"2024-09-14T11:54:24.462007+0000","last_peered":"2024-09-14T11:54:24.462007+0000","last_clean":"2024-09-14T11:54:24.462007+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:54:24.462007+0000","last_undegraded":"2024-09-14T11:54:24.462007+0000","last_fullsized":"2024-09-14T11:54:24.462007+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.029629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'328","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879940+0000","last_change":"2024-09-14T11:14:04.126657+0000","last_active":"2024-09-14T11:56:14.879940+0000","last_peered":"2024-09-14T11:56:14.879940+0000","last_clean":"2024-09-14T11:56:14.879940+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:14.879940+0000","last_undegraded":"2024-09-14T11:56:14.879940+0000","last_fullsized":"2024-09-14T11:56:14.879940+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.821826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583989,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":613,"num_read_kb":25654,"num_write":983,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795376+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:53:39.795376+0000","last_peered":"2024-09-14T11:53:39.795376+0000","last_clean":"2024-09-14T11:53:39.795376+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:53:39.795376+0000","last_undegraded":"2024-09-14T11:53:39.795376+0000","last_fullsized":"2024-09-14T11:53:39.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790686+0000","last_change":"2024-09-14T11:14:08.130246+0000","last_active":"2024-09-14T11:53:45.790686+0000","last_peered":"2024-09-14T11:53:45.790686+0000","last_clean":"2024-09-14T11:53:45.790686+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:53:45.790686+0000","last_undegraded":"2024-09-14T11:53:45.790686+0000","last_fullsized":"2024-09-14T11:53:45.790686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:01.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.533448+0000","last_change":"2024-09-14T11:14:10.139669+0000","last_active":"2024-09-14T11:54:47.533448+0000","last_peered":"2024-09-14T11:54:47.533448+0000","last_clean":"2024-09-14T11:54:47.533448+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:54:47.533448+0000","last_undegraded":"2024-09-14T11:54:47.533448+0000","last_fullsized":"2024-09-14T11:54:47.533448+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:53.709411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'810","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.658795+0000","last_change":"2024-09-14T11:14:12.147417+0000","last_active":"2024-09-14T11:56:15.658795+0000","last_peered":"2024-09-14T11:56:15.658795+0000","last_clean":"2024-09-14T11:56:15.658795+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:15.658795+0000","last_undegraded":"2024-09-14T11:56:15.658795+0000","last_fullsized":"2024-09-14T11:56:15.658795+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.126531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'93","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.910691+0000","last_change":"2024-09-14T11:14:14.157125+0000","last_active":"2024-09-14T11:54:49.910691+0000","last_peered":"2024-09-14T11:54:49.910691+0000","last_clean":"2024-09-14T11:54:49.910691+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:54:49.910691+0000","last_undegraded":"2024-09-14T11:54:49.910691+0000","last_fullsized":"2024-09-14T11:54:49.910691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:21.815471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'359","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906023+0000","last_change":"2024-09-14T11:14:06.125720+0000","last_active":"2024-09-14T11:54:14.906023+0000","last_peered":"2024-09-14T11:54:14.906023+0000","last_clean":"2024-09-14T11:54:14.906023+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:54:14.906023+0000","last_undegraded":"2024-09-14T11:54:14.906023+0000","last_fullsized":"2024-09-14T11:54:14.906023+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:46.137614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'307","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.725729+0000","last_change":"2024-09-14T11:14:38.192877+0000","last_active":"2024-09-14T11:56:14.725729+0000","last_peered":"2024-09-14T11:56:14.725729+0000","last_clean":"2024-09-14T11:56:14.725729+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:14.725729+0000","last_undegraded":"2024-09-14T11:56:14.725729+0000","last_fullsized":"2024-09-14T11:56:14.725729+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:30.960755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65182,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":517,"num_read_kb":1407,"num_write":960,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895813+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:52:54.895813+0000","last_peered":"2024-09-14T11:52:54.895813+0000","last_clean":"2024-09-14T11:52:54.895813+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:52:54.895813+0000","last_undegraded":"2024-09-14T11:52:54.895813+0000","last_fullsized":"2024-09-14T11:52:54.895813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790665+0000","last_change":"2024-09-14T11:14:08.135691+0000","last_active":"2024-09-14T11:53:45.790665+0000","last_peered":"2024-09-14T11:53:45.790665+0000","last_clean":"2024-09-14T11:53:45.790665+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:53:45.790665+0000","last_undegraded":"2024-09-14T11:53:45.790665+0000","last_fullsized":"2024-09-14T11:53:45.790665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:47.242553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'99","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.842534+0000","last_change":"2024-09-14T11:14:10.151595+0000","last_active":"2024-09-14T11:54:18.842534+0000","last_peered":"2024-09-14T11:54:18.842534+0000","last_clean":"2024-09-14T11:54:18.842534+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:54:18.842534+0000","last_undegraded":"2024-09-14T11:54:18.842534+0000","last_fullsized":"2024-09-14T11:54:18.842534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:13.188765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'788","reported_seq":2299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745773+0000","last_change":"2024-09-14T11:14:12.153305+0000","last_active":"2024-09-14T11:56:13.745773+0000","last_peered":"2024-09-14T11:56:13.745773+0000","last_clean":"2024-09-14T11:56:13.745773+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:13.745773+0000","last_undegraded":"2024-09-14T11:56:13.745773+0000","last_fullsized":"2024-09-14T11:56:13.745773+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:43.896569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'327","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573474+0000","last_change":"2024-09-14T11:14:14.156952+0000","last_active":"2024-09-14T11:55:41.573474+0000","last_peered":"2024-09-14T11:55:41.573474+0000","last_clean":"2024-09-14T11:55:41.573474+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:55:41.573474+0000","last_undegraded":"2024-09-14T11:55:41.573474+0000","last_fullsized":"2024-09-14T11:55:41.573474+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:32.686915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1137","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546620+0000","last_change":"2024-09-14T11:14:06.126733+0000","last_active":"2024-09-14T11:54:26.546620+0000","last_peered":"2024-09-14T11:54:26.546620+0000","last_clean":"2024-09-14T11:54:26.546620+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:54:26.546620+0000","last_undegraded":"2024-09-14T11:54:26.546620+0000","last_fullsized":"2024-09-14T11:54:26.546620+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:23.487750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'350","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.911863+0000","last_change":"2024-09-14T11:14:04.122866+0000","last_active":"2024-09-14T11:56:14.911863+0000","last_peered":"2024-09-14T11:56:14.911863+0000","last_clean":"2024-09-14T11:56:14.911863+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:14.911863+0000","last_undegraded":"2024-09-14T11:56:14.911863+0000","last_fullsized":"2024-09-14T11:56:14.911863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:50.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1657270,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":597,"num_read_kb":7233,"num_write":1267,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783429+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:52:55.783429+0000","last_peered":"2024-09-14T11:52:55.783429+0000","last_clean":"2024-09-14T11:52:55.783429+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:52:55.783429+0000","last_undegraded":"2024-09-14T11:52:55.783429+0000","last_fullsized":"2024-09-14T11:52:55.783429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.905998+0000","last_change":"2024-09-14T11:14:08.133929+0000","last_active":"2024-09-14T11:54:14.905998+0000","last_peered":"2024-09-14T11:54:14.905998+0000","last_clean":"2024-09-14T11:54:14.905998+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:54:14.905998+0000","last_undegraded":"2024-09-14T11:54:14.905998+0000","last_fullsized":"2024-09-14T11:54:14.905998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.740629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'757","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.338152+0000","last_change":"2024-09-14T11:14:10.152020+0000","last_active":"2024-09-14T11:56:14.338152+0000","last_peered":"2024-09-14T11:56:14.338152+0000","last_clean":"2024-09-14T11:56:14.338152+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:14.338152+0000","last_undegraded":"2024-09-14T11:56:14.338152+0000","last_fullsized":"2024-09-14T11:56:14.338152+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:50.734251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147171,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1349,"num_read_kb":3105,"num_write":1118,"num_write_kb":933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903071+0000","last_change":"2024-09-14T11:14:12.151322+0000","last_active":"2024-09-14T11:53:49.903071+0000","last_peered":"2024-09-14T11:53:49.903071+0000","last_clean":"2024-09-14T11:53:49.903071+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:53:49.903071+0000","last_undegraded":"2024-09-14T11:53:49.903071+0000","last_fullsized":"2024-09-14T11:53:49.903071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:55.159584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.544659+0000","last_change":"2024-09-14T11:14:14.164267+0000","last_active":"2024-09-14T11:54:08.544659+0000","last_peered":"2024-09-14T11:54:08.544659+0000","last_clean":"2024-09-14T11:54:08.544659+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:54:08.544659+0000","last_undegraded":"2024-09-14T11:54:08.544659+0000","last_fullsized":"2024-09-14T11:54:08.544659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:05.688641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'143","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.219226+0000","last_change":"2024-09-14T11:14:14.160222+0000","last_active":"2024-09-14T11:54:27.219226+0000","last_peered":"2024-09-14T11:54:27.219226+0000","last_clean":"2024-09-14T11:54:27.219226+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:54:27.219226+0000","last_undegraded":"2024-09-14T11:54:27.219226+0000","last_fullsized":"2024-09-14T11:54:27.219226+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:30.394037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'430","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783769+0000","last_change":"2024-09-14T11:14:06.128783+0000","last_active":"2024-09-14T11:54:07.783769+0000","last_peered":"2024-09-14T11:54:07.783769+0000","last_clean":"2024-09-14T11:54:07.783769+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:54:07.783769+0000","last_undegraded":"2024-09-14T11:54:07.783769+0000","last_fullsized":"2024-09-14T11:54:07.783769+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:11.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633344+0000","last_change":"2024-09-14T11:14:04.130995+0000","last_active":"2024-09-14T11:56:15.633344+0000","last_peered":"2024-09-14T11:56:15.633344+0000","last_clean":"2024-09-14T11:56:15.633344+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:15.633344+0000","last_undegraded":"2024-09-14T11:56:15.633344+0000","last_fullsized":"2024-09-14T11:56:15.633344+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:00.303178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.713330+0000","last_change":"2024-09-14T11:14:08.137606+0000","last_active":"2024-09-14T11:56:13.713330+0000","last_peered":"2024-09-14T11:56:13.713330+0000","last_clean":"2024-09-14T11:56:13.713330+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:13.713330+0000","last_undegraded":"2024-09-14T11:56:13.713330+0000","last_fullsized":"2024-09-14T11:56:13.713330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.107289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'263","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.676370+0000","last_change":"2024-09-14T11:14:10.149828+0000","last_active":"2024-09-14T11:56:14.676370+0000","last_peered":"2024-09-14T11:56:14.676370+0000","last_clean":"2024-09-14T11:56:14.676370+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:14.676370+0000","last_undegraded":"2024-09-14T11:56:14.676370+0000","last_fullsized":"2024-09-14T11:56:14.676370+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.820903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903614+0000","last_change":"2024-09-14T11:14:12.152653+0000","last_active":"2024-09-14T11:53:54.903614+0000","last_peered":"2024-09-14T11:53:54.903614+0000","last_clean":"2024-09-14T11:53:54.903614+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:53:54.903614+0000","last_undegraded":"2024-09-14T11:53:54.903614+0000","last_fullsized":"2024-09-14T11:53:54.903614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:35.385522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.992844+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:26.992844+0000","last_peered":"2024-09-14T11:54:26.992844+0000","last_clean":"2024-09-14T11:54:26.992844+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:26.992844+0000","last_undegraded":"2024-09-14T11:54:26.992844+0000","last_fullsized":"2024-09-14T11:54:26.992844+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'780","reported_seq":2399,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262003+0000","last_change":"2024-09-14T11:14:06.131159+0000","last_active":"2024-09-14T11:54:09.262003+0000","last_peered":"2024-09-14T11:54:09.262003+0000","last_clean":"2024-09-14T11:54:09.262003+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:54:09.262003+0000","last_undegraded":"2024-09-14T11:54:09.262003+0000","last_fullsized":"2024-09-14T11:54:09.262003+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:12.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'345","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.800943+0000","last_change":"2024-09-14T11:14:04.136243+0000","last_active":"2024-09-14T11:56:14.800943+0000","last_peered":"2024-09-14T11:56:14.800943+0000","last_clean":"2024-09-14T11:56:14.800943+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:14.800943+0000","last_undegraded":"2024-09-14T11:56:14.800943+0000","last_fullsized":"2024-09-14T11:56:14.800943+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:43.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22419747,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":606,"num_read_kb":24187,"num_write":1136,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903109+0000","last_change":"2024-09-14T11:14:08.132760+0000","last_active":"2024-09-14T11:53:49.903109+0000","last_peered":"2024-09-14T11:53:49.903109+0000","last_clean":"2024-09-14T11:53:49.903109+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:53:49.903109+0000","last_undegraded":"2024-09-14T11:53:49.903109+0000","last_fullsized":"2024-09-14T11:53:49.903109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.260856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'48","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.684887+0000","last_change":"2024-09-14T11:14:10.148065+0000","last_active":"2024-09-14T11:54:18.684887+0000","last_peered":"2024-09-14T11:54:18.684887+0000","last_clean":"2024-09-14T11:54:18.684887+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:54:18.684887+0000","last_undegraded":"2024-09-14T11:54:18.684887+0000","last_fullsized":"2024-09-14T11:54:18.684887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:38.290868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797903+0000","last_change":"2024-09-14T11:14:12.150881+0000","last_active":"2024-09-14T11:53:54.797903+0000","last_peered":"2024-09-14T11:53:54.797903+0000","last_clean":"2024-09-14T11:53:54.797903+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:53:54.797903+0000","last_undegraded":"2024-09-14T11:53:54.797903+0000","last_fullsized":"2024-09-14T11:53:54.797903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:58.272068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'218","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.536299+0000","last_change":"2024-09-14T11:14:14.153783+0000","last_active":"2024-09-14T11:54:26.536299+0000","last_peered":"2024-09-14T11:54:26.536299+0000","last_clean":"2024-09-14T11:54:26.536299+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:54:26.536299+0000","last_undegraded":"2024-09-14T11:54:26.536299+0000","last_fullsized":"2024-09-14T11:54:26.536299+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:47.004373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'913","reported_seq":2649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.628932+0000","last_change":"2024-09-14T11:14:06.125324+0000","last_active":"2024-09-14T11:55:41.628932+0000","last_peered":"2024-09-14T11:55:41.628932+0000","last_clean":"2024-09-14T11:55:41.628932+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:55:41.628932+0000","last_undegraded":"2024-09-14T11:55:41.628932+0000","last_fullsized":"2024-09-14T11:55:41.628932+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:01.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.616179+0000","last_change":"2024-09-14T11:14:04.125695+0000","last_active":"2024-09-14T11:56:15.616179+0000","last_peered":"2024-09-14T11:56:15.616179+0000","last_clean":"2024-09-14T11:56:15.616179+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:15.616179+0000","last_undegraded":"2024-09-14T11:56:15.616179+0000","last_fullsized":"2024-09-14T11:56:15.616179+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:38.353380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.796955+0000","last_change":"2024-09-14T11:14:08.136483+0000","last_active":"2024-09-14T11:53:49.796955+0000","last_peered":"2024-09-14T11:53:49.796955+0000","last_clean":"2024-09-14T11:53:49.796955+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:53:49.796955+0000","last_undegraded":"2024-09-14T11:53:49.796955+0000","last_fullsized":"2024-09-14T11:53:49.796955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:28.874481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.055458+0000","last_change":"2024-09-14T11:14:10.151225+0000","last_active":"2024-09-14T11:56:14.055458+0000","last_peered":"2024-09-14T11:56:14.055458+0000","last_clean":"2024-09-14T11:56:14.055458+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:14.055458+0000","last_undegraded":"2024-09-14T11:56:14.055458+0000","last_fullsized":"2024-09-14T11:56:14.055458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:07.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792203+0000","last_change":"2024-09-14T11:14:12.152706+0000","last_active":"2024-09-14T11:53:55.792203+0000","last_peered":"2024-09-14T11:53:55.792203+0000","last_clean":"2024-09-14T11:53:55.792203+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:53:55.792203+0000","last_undegraded":"2024-09-14T11:53:55.792203+0000","last_fullsized":"2024-09-14T11:53:55.792203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:02.677520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'129","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.902922+0000","last_change":"2024-09-14T11:14:14.163359+0000","last_active":"2024-09-14T11:54:26.902922+0000","last_peered":"2024-09-14T11:54:26.902922+0000","last_clean":"2024-09-14T11:54:26.902922+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:54:26.902922+0000","last_undegraded":"2024-09-14T11:54:26.902922+0000","last_fullsized":"2024-09-14T11:54:26.902922+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'564","reported_seq":2291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629178+0000","last_change":"2024-09-14T11:14:06.114979+0000","last_active":"2024-09-14T11:55:41.629178+0000","last_peered":"2024-09-14T11:55:41.629178+0000","last_clean":"2024-09-14T11:55:41.629178+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:55:41.629178+0000","last_undegraded":"2024-09-14T11:55:41.629178+0000","last_fullsized":"2024-09-14T11:55:41.629178+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:34.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'381","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886235+0000","last_change":"2024-09-14T11:14:04.123707+0000","last_active":"2024-09-14T11:56:14.886235+0000","last_peered":"2024-09-14T11:56:14.886235+0000","last_clean":"2024-09-14T11:56:14.886235+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:14.886235+0000","last_undegraded":"2024-09-14T11:56:14.886235+0000","last_fullsized":"2024-09-14T11:56:14.886235+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:47.655600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17714616,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":685,"num_read_kb":20814,"num_write":1338,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791400+0000","last_change":"2024-09-14T11:14:08.138146+0000","last_active":"2024-09-14T11:53:50.791400+0000","last_peered":"2024-09-14T11:53:50.791400+0000","last_clean":"2024-09-14T11:53:50.791400+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:53:50.791400+0000","last_undegraded":"2024-09-14T11:53:50.791400+0000","last_fullsized":"2024-09-14T11:53:50.791400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.928629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'266","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.855796+0000","last_change":"2024-09-14T11:14:10.151325+0000","last_active":"2024-09-14T11:56:13.855796+0000","last_peered":"2024-09-14T11:56:13.855796+0000","last_clean":"2024-09-14T11:56:13.855796+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:13.855796+0000","last_undegraded":"2024-09-14T11:56:13.855796+0000","last_fullsized":"2024-09-14T11:56:13.855796+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:32.211592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903894+0000","last_change":"2024-09-14T11:14:12.154497+0000","last_active":"2024-09-14T11:53:54.903894+0000","last_peered":"2024-09-14T11:53:54.903894+0000","last_clean":"2024-09-14T11:53:54.903894+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:53:54.903894+0000","last_undegraded":"2024-09-14T11:53:54.903894+0000","last_fullsized":"2024-09-14T11:53:54.903894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:27.388051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114150+0000","last_change":"2024-09-14T11:14:06.128364+0000","last_active":"2024-09-14T11:54:27.114150+0000","last_peered":"2024-09-14T11:54:27.114150+0000","last_clean":"2024-09-14T11:54:27.114150+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:54:27.114150+0000","last_undegraded":"2024-09-14T11:54:27.114150+0000","last_fullsized":"2024-09-14T11:54:27.114150+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.420636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.920042+0000","last_change":"2024-09-14T11:14:04.124479+0000","last_active":"2024-09-14T11:56:14.920042+0000","last_peered":"2024-09-14T11:56:14.920042+0000","last_clean":"2024-09-14T11:56:14.920042+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:14.920042+0000","last_undegraded":"2024-09-14T11:56:14.920042+0000","last_fullsized":"2024-09-14T11:56:14.920042+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:07.746886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22971,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":546,"num_read_kb":1976,"num_write":1057,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906070+0000","last_change":"2024-09-14T11:14:08.125925+0000","last_active":"2024-09-14T11:54:14.906070+0000","last_peered":"2024-09-14T11:54:14.906070+0000","last_clean":"2024-09-14T11:54:14.906070+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:54:14.906070+0000","last_undegraded":"2024-09-14T11:54:14.906070+0000","last_fullsized":"2024-09-14T11:54:14.906070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:37.664162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'485","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.759911+0000","last_change":"2024-09-14T11:14:10.149612+0000","last_active":"2024-09-14T11:56:13.759911+0000","last_peered":"2024-09-14T11:56:13.759911+0000","last_clean":"2024-09-14T11:56:13.759911+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:13.759911+0000","last_undegraded":"2024-09-14T11:56:13.759911+0000","last_fullsized":"2024-09-14T11:56:13.759911+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:51.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116470,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":859,"num_read_kb":1869,"num_write":750,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022383+0000","last_change":"2024-09-14T11:14:12.152526+0000","last_active":"2024-09-14T11:51:46.022383+0000","last_peered":"2024-09-14T11:51:46.022383+0000","last_clean":"2024-09-14T11:51:46.022383+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:51:46.022383+0000","last_undegraded":"2024-09-14T11:51:46.022383+0000","last_fullsized":"2024-09-14T11:51:46.022383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.316198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.457622+0000","last_change":"2024-09-14T11:14:14.153440+0000","last_active":"2024-09-14T11:54:24.457622+0000","last_peered":"2024-09-14T11:54:24.457622+0000","last_clean":"2024-09-14T11:54:24.457622+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:54:24.457622+0000","last_undegraded":"2024-09-14T11:54:24.457622+0000","last_fullsized":"2024-09-14T11:54:24.457622+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.457388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'412","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629660+0000","last_change":"2024-09-14T11:14:06.133265+0000","last_active":"2024-09-14T11:55:41.629660+0000","last_peered":"2024-09-14T11:55:41.629660+0000","last_clean":"2024-09-14T11:55:41.629660+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:55:41.629660+0000","last_undegraded":"2024-09-14T11:55:41.629660+0000","last_fullsized":"2024-09-14T11:55:41.629660+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:39.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'331","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.886913+0000","last_change":"2024-09-14T11:14:04.120305+0000","last_active":"2024-09-14T11:56:14.886913+0000","last_peered":"2024-09-14T11:56:14.886913+0000","last_clean":"2024-09-14T11:56:14.886913+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:14.886913+0000","last_undegraded":"2024-09-14T11:56:14.886913+0000","last_fullsized":"2024-09-14T11:56:14.886913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:30.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245368,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":667,"num_read_kb":10770,"num_write":1182,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790754+0000","last_change":"2024-09-14T11:14:08.136472+0000","last_active":"2024-09-14T11:53:45.790754+0000","last_peered":"2024-09-14T11:53:45.790754+0000","last_clean":"2024-09-14T11:53:45.790754+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:53:45.790754+0000","last_undegraded":"2024-09-14T11:53:45.790754+0000","last_fullsized":"2024-09-14T11:53:45.790754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:13.023971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.930797+0000","last_change":"2024-09-14T11:14:10.152603+0000","last_active":"2024-09-14T11:56:13.930797+0000","last_peered":"2024-09-14T11:56:13.930797+0000","last_clean":"2024-09-14T11:56:13.930797+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:13.930797+0000","last_undegraded":"2024-09-14T11:56:13.930797+0000","last_fullsized":"2024-09-14T11:56:13.930797+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:04.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.887234+0000","last_change":"2024-09-14T11:14:12.153956+0000","last_active":"2024-09-14T11:51:44.887234+0000","last_peered":"2024-09-14T11:51:44.887234+0000","last_clean":"2024-09-14T11:51:44.887234+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:51:44.887234+0000","last_undegraded":"2024-09-14T11:51:44.887234+0000","last_fullsized":"2024-09-14T11:51:44.887234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:06.820196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'231","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.069083+0000","last_change":"2024-09-14T11:14:14.159808+0000","last_active":"2024-09-14T11:54:25.069083+0000","last_peered":"2024-09-14T11:54:25.069083+0000","last_clean":"2024-09-14T11:54:25.069083+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:54:25.069083+0000","last_undegraded":"2024-09-14T11:54:25.069083+0000","last_fullsized":"2024-09-14T11:54:25.069083+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:54.636606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'495","reported_seq":2082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622438+0000","last_change":"2024-09-14T11:14:06.115825+0000","last_active":"2024-09-14T11:55:41.622438+0000","last_peered":"2024-09-14T11:55:41.622438+0000","last_clean":"2024-09-14T11:55:41.622438+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:55:41.622438+0000","last_undegraded":"2024-09-14T11:55:41.622438+0000","last_fullsized":"2024-09-14T11:55:41.622438+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:59.337368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.619156+0000","last_change":"2024-09-14T11:14:04.123750+0000","last_active":"2024-09-14T11:56:15.619156+0000","last_peered":"2024-09-14T11:56:15.619156+0000","last_clean":"2024-09-14T11:56:15.619156+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:15.619156+0000","last_undegraded":"2024-09-14T11:56:15.619156+0000","last_fullsized":"2024-09-14T11:56:15.619156+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:35.861181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.774310+0000","last_change":"2024-09-14T11:14:08.137009+0000","last_active":"2024-09-14T11:51:40.774310+0000","last_peered":"2024-09-14T11:51:40.774310+0000","last_clean":"2024-09-14T11:51:40.774310+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:51:40.774310+0000","last_undegraded":"2024-09-14T11:51:40.774310+0000","last_fullsized":"2024-09-14T11:51:40.774310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.777442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'292","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.905574+0000","last_change":"2024-09-14T11:14:10.154505+0000","last_active":"2024-09-14T11:56:14.905574+0000","last_peered":"2024-09-14T11:56:14.905574+0000","last_clean":"2024-09-14T11:56:14.905574+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:14.905574+0000","last_undegraded":"2024-09-14T11:56:14.905574+0000","last_fullsized":"2024-09-14T11:56:14.905574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.388017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.891069+0000","last_change":"2024-09-14T11:14:12.149836+0000","last_active":"2024-09-14T11:52:19.891069+0000","last_peered":"2024-09-14T11:52:19.891069+0000","last_clean":"2024-09-14T11:52:19.891069+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:52:19.891069+0000","last_undegraded":"2024-09-14T11:52:19.891069+0000","last_fullsized":"2024-09-14T11:52:19.891069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:32.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'144","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.744952+0000","last_change":"2024-09-14T11:14:14.162000+0000","last_active":"2024-09-14T11:55:42.744952+0000","last_peered":"2024-09-14T11:55:42.744952+0000","last_clean":"2024-09-14T11:55:42.744952+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:55:42.744952+0000","last_undegraded":"2024-09-14T11:55:42.744952+0000","last_fullsized":"2024-09-14T11:55:42.744952+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'419","reported_seq":2018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.546724+0000","last_change":"2024-09-14T11:14:06.123837+0000","last_active":"2024-09-14T11:54:08.546724+0000","last_peered":"2024-09-14T11:54:08.546724+0000","last_clean":"2024-09-14T11:54:08.546724+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:54:08.546724+0000","last_undegraded":"2024-09-14T11:54:08.546724+0000","last_fullsized":"2024-09-14T11:54:08.546724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:37.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'336","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.874282+0000","last_change":"2024-09-14T11:14:04.131548+0000","last_active":"2024-09-14T11:56:14.874282+0000","last_peered":"2024-09-14T11:56:14.874282+0000","last_clean":"2024-09-14T11:56:14.874282+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:14.874282+0000","last_undegraded":"2024-09-14T11:56:14.874282+0000","last_fullsized":"2024-09-14T11:56:14.874282+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.843269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020451,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":527,"num_read_kb":46731,"num_write":1083,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.886602+0000","last_change":"2024-09-14T11:14:08.137590+0000","last_active":"2024-09-14T11:51:39.886602+0000","last_peered":"2024-09-14T11:51:39.886602+0000","last_clean":"2024-09-14T11:51:39.886602+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:51:39.886602+0000","last_undegraded":"2024-09-14T11:51:39.886602+0000","last_fullsized":"2024-09-14T11:51:39.886602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:47.658963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'81","reported_seq":593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.853482+0000","last_change":"2024-09-14T11:14:10.148590+0000","last_active":"2024-09-14T11:54:18.853482+0000","last_peered":"2024-09-14T11:54:18.853482+0000","last_clean":"2024-09-14T11:54:18.853482+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:54:18.853482+0000","last_undegraded":"2024-09-14T11:54:18.853482+0000","last_fullsized":"2024-09-14T11:54:18.853482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:10.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.741161+0000","last_change":"2024-09-14T11:14:12.152664+0000","last_active":"2024-09-14T11:56:13.741161+0000","last_peered":"2024-09-14T11:56:13.741161+0000","last_clean":"2024-09-14T11:56:13.741161+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:13.741161+0000","last_undegraded":"2024-09-14T11:56:13.741161+0000","last_fullsized":"2024-09-14T11:56:13.741161+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:48.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":602,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.739702+0000","last_change":"2024-09-14T11:14:14.162036+0000","last_active":"2024-09-14T11:55:42.739702+0000","last_peered":"2024-09-14T11:55:42.739702+0000","last_clean":"2024-09-14T11:55:42.739702+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:55:42.739702+0000","last_undegraded":"2024-09-14T11:55:42.739702+0000","last_fullsized":"2024-09-14T11:55:42.739702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.951880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'913","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622796+0000","last_change":"2024-09-14T11:14:06.120190+0000","last_active":"2024-09-14T11:55:41.622796+0000","last_peered":"2024-09-14T11:55:41.622796+0000","last_clean":"2024-09-14T11:55:41.622796+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:55:41.622796+0000","last_undegraded":"2024-09-14T11:55:41.622796+0000","last_fullsized":"2024-09-14T11:55:41.622796+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:35.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633326+0000","last_change":"2024-09-14T11:14:04.123412+0000","last_active":"2024-09-14T11:56:15.633326+0000","last_peered":"2024-09-14T11:56:15.633326+0000","last_clean":"2024-09-14T11:56:15.633326+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:15.633326+0000","last_undegraded":"2024-09-14T11:56:15.633326+0000","last_fullsized":"2024-09-14T11:56:15.633326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.337185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.774628+0000","last_change":"2024-09-14T11:14:08.138426+0000","last_active":"2024-09-14T11:51:39.774628+0000","last_peered":"2024-09-14T11:51:39.774628+0000","last_clean":"2024-09-14T11:51:39.774628+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:51:39.774628+0000","last_undegraded":"2024-09-14T11:51:39.774628+0000","last_fullsized":"2024-09-14T11:51:39.774628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:56.436534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'298","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.242404+0000","last_change":"2024-09-14T11:14:10.149256+0000","last_active":"2024-09-14T11:56:15.242404+0000","last_peered":"2024-09-14T11:56:15.242404+0000","last_clean":"2024-09-14T11:56:15.242404+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:15.242404+0000","last_undegraded":"2024-09-14T11:56:15.242404+0000","last_fullsized":"2024-09-14T11:56:15.242404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:47.592442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896607+0000","last_change":"2024-09-14T11:14:12.150595+0000","last_active":"2024-09-14T11:52:54.896607+0000","last_peered":"2024-09-14T11:52:54.896607+0000","last_clean":"2024-09-14T11:52:54.896607+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:52:54.896607+0000","last_undegraded":"2024-09-14T11:52:54.896607+0000","last_fullsized":"2024-09-14T11:52:54.896607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:47.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.835967+0000","last_change":"2024-09-14T11:14:14.159475+0000","last_active":"2024-09-14T11:53:58.835967+0000","last_peered":"2024-09-14T11:53:58.835967+0000","last_clean":"2024-09-14T11:53:58.835967+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:53:58.835967+0000","last_undegraded":"2024-09-14T11:53:58.835967+0000","last_fullsized":"2024-09-14T11:53:58.835967+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:45.105897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.456474+0000","last_change":"2024-09-14T11:14:06.120205+0000","last_active":"2024-09-14T11:54:24.456474+0000","last_peered":"2024-09-14T11:54:24.456474+0000","last_clean":"2024-09-14T11:54:24.456474+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:54:24.456474+0000","last_undegraded":"2024-09-14T11:54:24.456474+0000","last_fullsized":"2024-09-14T11:54:24.456474+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:27.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.606584+0000","last_change":"2024-09-14T11:14:04.127561+0000","last_active":"2024-09-14T11:56:15.606584+0000","last_peered":"2024-09-14T11:56:15.606584+0000","last_clean":"2024-09-14T11:56:15.606584+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:15.606584+0000","last_undegraded":"2024-09-14T11:56:15.606584+0000","last_fullsized":"2024-09-14T11:56:15.606584+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:28.538642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.021483+0000","last_change":"2024-09-14T11:14:08.133404+0000","last_active":"2024-09-14T11:51:41.021483+0000","last_peered":"2024-09-14T11:51:41.021483+0000","last_clean":"2024-09-14T11:51:41.021483+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:51:41.021483+0000","last_undegraded":"2024-09-14T11:51:41.021483+0000","last_fullsized":"2024-09-14T11:51:41.021483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.597866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'259","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.703138+0000","last_change":"2024-09-14T11:14:10.152035+0000","last_active":"2024-09-14T11:55:42.703138+0000","last_peered":"2024-09-14T11:55:42.703138+0000","last_clean":"2024-09-14T11:55:42.703138+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:55:42.703138+0000","last_undegraded":"2024-09-14T11:55:42.703138+0000","last_fullsized":"2024-09-14T11:55:42.703138+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.459789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52410,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":411,"num_read_kb":861,"num_write":338,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.785014+0000","last_change":"2024-09-14T11:14:12.151730+0000","last_active":"2024-09-14T11:53:05.785014+0000","last_peered":"2024-09-14T11:53:05.785014+0000","last_clean":"2024-09-14T11:53:05.785014+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:53:05.785014+0000","last_undegraded":"2024-09-14T11:53:05.785014+0000","last_fullsized":"2024-09-14T11:53:05.785014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:44.746381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'326","reported_seq":1757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.782919+0000","last_change":"2024-09-14T11:14:06.118920+0000","last_active":"2024-09-14T11:54:07.782919+0000","last_peered":"2024-09-14T11:54:07.782919+0000","last_clean":"2024-09-14T11:54:07.782919+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:54:07.782919+0000","last_undegraded":"2024-09-14T11:54:07.782919+0000","last_fullsized":"2024-09-14T11:54:07.782919+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:18.730208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'332","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.859521+0000","last_change":"2024-09-14T11:14:04.123599+0000","last_active":"2024-09-14T11:56:14.859521+0000","last_peered":"2024-09-14T11:56:14.859521+0000","last_clean":"2024-09-14T11:56:14.859521+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:14.859521+0000","last_undegraded":"2024-09-14T11:56:14.859521+0000","last_fullsized":"2024-09-14T11:56:14.859521+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.290130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27602,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":552,"num_read_kb":1005,"num_write":1003,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.782950+0000","last_change":"2024-09-14T11:14:08.137705+0000","last_active":"2024-09-14T11:52:50.782950+0000","last_peered":"2024-09-14T11:52:50.782950+0000","last_clean":"2024-09-14T11:52:50.782950+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:52:50.782950+0000","last_undegraded":"2024-09-14T11:52:50.782950+0000","last_fullsized":"2024-09-14T11:52:50.782950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:21.751164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'227","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.785868+0000","last_change":"2024-09-14T11:14:10.155049+0000","last_active":"2024-09-14T11:56:14.785868+0000","last_peered":"2024-09-14T11:56:14.785868+0000","last_clean":"2024-09-14T11:56:14.785868+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:14.785868+0000","last_undegraded":"2024-09-14T11:56:14.785868+0000","last_fullsized":"2024-09-14T11:56:14.785868+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.366018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.775077+0000","last_change":"2024-09-14T11:14:12.150674+0000","last_active":"2024-09-14T11:51:45.775077+0000","last_peered":"2024-09-14T11:51:45.775077+0000","last_clean":"2024-09-14T11:51:45.775077+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:51:45.775077+0000","last_undegraded":"2024-09-14T11:51:45.775077+0000","last_fullsized":"2024-09-14T11:51:45.775077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:49.433914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'147","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.024834+0000","last_change":"2024-09-14T11:14:14.161497+0000","last_active":"2024-09-14T11:54:25.024834+0000","last_peered":"2024-09-14T11:54:25.024834+0000","last_clean":"2024-09-14T11:54:25.024834+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:54:25.024834+0000","last_undegraded":"2024-09-14T11:54:25.024834+0000","last_fullsized":"2024-09-14T11:54:25.024834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:34.625158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2254,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.547132+0000","last_change":"2024-09-14T11:14:06.130562+0000","last_active":"2024-09-14T11:54:26.547132+0000","last_peered":"2024-09-14T11:54:26.547132+0000","last_clean":"2024-09-14T11:54:26.547132+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:54:26.547132+0000","last_undegraded":"2024-09-14T11:54:26.547132+0000","last_fullsized":"2024-09-14T11:54:26.547132+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:50.157895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'315","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.863491+0000","last_change":"2024-09-14T11:14:04.128727+0000","last_active":"2024-09-14T11:56:14.863491+0000","last_peered":"2024-09-14T11:56:14.863491+0000","last_clean":"2024-09-14T11:56:14.863491+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:14.863491+0000","last_undegraded":"2024-09-14T11:56:14.863491+0000","last_fullsized":"2024-09-14T11:56:14.863491+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.665738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975596,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":653,"num_read_kb":5062,"num_write":1054,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895731+0000","last_change":"2024-09-14T11:14:08.134254+0000","last_active":"2024-09-14T11:52:54.895731+0000","last_peered":"2024-09-14T11:52:54.895731+0000","last_clean":"2024-09-14T11:52:54.895731+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:52:54.895731+0000","last_undegraded":"2024-09-14T11:52:54.895731+0000","last_fullsized":"2024-09-14T11:52:54.895731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:52.559637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'315","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.965179+0000","last_change":"2024-09-14T11:14:10.151521+0000","last_active":"2024-09-14T11:56:14.965179+0000","last_peered":"2024-09-14T11:56:14.965179+0000","last_clean":"2024-09-14T11:56:14.965179+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:14.965179+0000","last_undegraded":"2024-09-14T11:56:14.965179+0000","last_fullsized":"2024-09-14T11:56:14.965179+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:57.363193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.888499+0000","last_change":"2024-09-14T11:14:12.152149+0000","last_active":"2024-09-14T11:51:44.888499+0000","last_peered":"2024-09-14T11:51:44.888499+0000","last_clean":"2024-09-14T11:51:44.888499+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:51:44.888499+0000","last_undegraded":"2024-09-14T11:51:44.888499+0000","last_fullsized":"2024-09-14T11:51:44.888499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.701102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'114","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.619651+0000","last_change":"2024-09-14T11:14:14.160202+0000","last_active":"2024-09-14T11:55:41.619651+0000","last_peered":"2024-09-14T11:55:41.619651+0000","last_clean":"2024-09-14T11:55:41.619651+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:55:41.619651+0000","last_undegraded":"2024-09-14T11:55:41.619651+0000","last_fullsized":"2024-09-14T11:55:41.619651+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:39.404108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'433","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935365+0000","last_change":"2024-09-14T11:14:06.130413+0000","last_active":"2024-09-14T11:54:09.935365+0000","last_peered":"2024-09-14T11:54:09.935365+0000","last_clean":"2024-09-14T11:54:09.935365+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:54:09.935365+0000","last_undegraded":"2024-09-14T11:54:09.935365+0000","last_fullsized":"2024-09-14T11:54:09.935365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:11.813244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633603+0000","last_change":"2024-09-14T11:14:04.137347+0000","last_active":"2024-09-14T11:56:15.633603+0000","last_peered":"2024-09-14T11:56:15.633603+0000","last_clean":"2024-09-14T11:56:15.633603+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:15.633603+0000","last_undegraded":"2024-09-14T11:56:15.633603+0000","last_fullsized":"2024-09-14T11:56:15.633603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:12.340493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'537","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540930+0000","last_change":"2024-09-14T11:14:06.127358+0000","last_active":"2024-09-14T11:54:04.540930+0000","last_peered":"2024-09-14T11:54:04.540930+0000","last_clean":"2024-09-14T11:54:04.540930+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:54:04.540930+0000","last_undegraded":"2024-09-14T11:54:04.540930+0000","last_fullsized":"2024-09-14T11:54:04.540930+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.425756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'341","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.712479+0000","last_change":"2024-09-14T11:14:04.118653+0000","last_active":"2024-09-14T11:56:14.712479+0000","last_peered":"2024-09-14T11:56:14.712479+0000","last_clean":"2024-09-14T11:56:14.712479+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:14.712479+0000","last_undegraded":"2024-09-14T11:56:14.712479+0000","last_fullsized":"2024-09-14T11:56:14.712479+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:13.808933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3533357,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":540,"num_read_kb":5548,"num_write":1089,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1188","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462084+0000","last_change":"2024-09-14T11:14:06.123772+0000","last_active":"2024-09-14T11:54:24.462084+0000","last_peered":"2024-09-14T11:54:24.462084+0000","last_clean":"2024-09-14T11:54:24.462084+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:54:24.462084+0000","last_undegraded":"2024-09-14T11:54:24.462084+0000","last_fullsized":"2024-09-14T11:54:24.462084+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:26.689879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615626+0000","last_change":"2024-09-14T11:14:04.124321+0000","last_active":"2024-09-14T11:56:15.615626+0000","last_peered":"2024-09-14T11:56:15.615626+0000","last_clean":"2024-09-14T11:56:15.615626+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:15.615626+0000","last_undegraded":"2024-09-14T11:56:15.615626+0000","last_fullsized":"2024-09-14T11:56:15.615626+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:47.955033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'459","reported_seq":2193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262421+0000","last_change":"2024-09-14T11:14:06.124181+0000","last_active":"2024-09-14T11:54:09.262421+0000","last_peered":"2024-09-14T11:54:09.262421+0000","last_clean":"2024-09-14T11:54:09.262421+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:54:09.262421+0000","last_undegraded":"2024-09-14T11:54:09.262421+0000","last_fullsized":"2024-09-14T11:54:09.262421+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:13.371439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'312","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.900742+0000","last_change":"2024-09-14T11:14:04.123362+0000","last_active":"2024-09-14T11:56:14.900742+0000","last_peered":"2024-09-14T11:56:14.900742+0000","last_clean":"2024-09-14T11:56:14.900742+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:14.900742+0000","last_undegraded":"2024-09-14T11:56:14.900742+0000","last_fullsized":"2024-09-14T11:56:14.900742+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.168395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3656166,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":583,"num_read_kb":9527,"num_write":1057,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'417","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261739+0000","last_change":"2024-09-14T11:14:06.128550+0000","last_active":"2024-09-14T11:54:09.261739+0000","last_peered":"2024-09-14T11:54:09.261739+0000","last_clean":"2024-09-14T11:54:09.261739+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:54:09.261739+0000","last_undegraded":"2024-09-14T11:54:09.261739+0000","last_fullsized":"2024-09-14T11:54:09.261739+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:02.461046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'313","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.875272+0000","last_change":"2024-09-14T11:14:04.122779+0000","last_active":"2024-09-14T11:56:14.875272+0000","last_peered":"2024-09-14T11:56:14.875272+0000","last_clean":"2024-09-14T11:56:14.875272+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:14.875272+0000","last_undegraded":"2024-09-14T11:56:14.875272+0000","last_fullsized":"2024-09-14T11:56:14.875272+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:12.163971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656073,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":626,"num_read_kb":10971,"num_write":1133,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'779","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540032+0000","last_change":"2024-09-14T11:14:06.130234+0000","last_active":"2024-09-14T11:54:04.540032+0000","last_peered":"2024-09-14T11:54:04.540032+0000","last_clean":"2024-09-14T11:54:04.540032+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:54:04.540032+0000","last_undegraded":"2024-09-14T11:54:04.540032+0000","last_fullsized":"2024-09-14T11:54:04.540032+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:46.526972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'379","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.879373+0000","last_change":"2024-09-14T11:14:04.112512+0000","last_active":"2024-09-14T11:56:14.879373+0000","last_peered":"2024-09-14T11:56:14.879373+0000","last_clean":"2024-09-14T11:56:14.879373+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:14.879373+0000","last_undegraded":"2024-09-14T11:56:14.879373+0000","last_fullsized":"2024-09-14T11:56:14.879373+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:27.221991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984864,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":934,"num_read_kb":11029,"num_write":1159,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'408","reported_seq":1927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546902+0000","last_change":"2024-09-14T11:14:06.116873+0000","last_active":"2024-09-14T11:54:26.546902+0000","last_peered":"2024-09-14T11:54:26.546902+0000","last_clean":"2024-09-14T11:54:26.546902+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:54:26.546902+0000","last_undegraded":"2024-09-14T11:54:26.546902+0000","last_fullsized":"2024-09-14T11:54:26.546902+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.999726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'373","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751186+0000","last_change":"2024-09-14T11:14:38.342285+0000","last_active":"2024-09-14T11:56:14.751186+0000","last_peered":"2024-09-14T11:56:14.751186+0000","last_clean":"2024-09-14T11:56:14.751186+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:14.751186+0000","last_undegraded":"2024-09-14T11:56:14.751186+0000","last_fullsized":"2024-09-14T11:56:14.751186+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:29.747736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":944,"num_read_kb":685,"num_write":1212,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'542","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.934942+0000","last_change":"2024-09-14T11:14:06.129076+0000","last_active":"2024-09-14T11:54:09.934942+0000","last_peered":"2024-09-14T11:54:09.934942+0000","last_clean":"2024-09-14T11:54:09.934942+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:54:09.934942+0000","last_undegraded":"2024-09-14T11:54:09.934942+0000","last_fullsized":"2024-09-14T11:54:09.934942+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:59.804760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'282","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.865575+0000","last_change":"2024-09-14T11:14:04.136228+0000","last_active":"2024-09-14T11:56:14.865575+0000","last_peered":"2024-09-14T11:56:14.865575+0000","last_clean":"2024-09-14T11:56:14.865575+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:14.865575+0000","last_undegraded":"2024-09-14T11:56:14.865575+0000","last_fullsized":"2024-09-14T11:56:14.865575+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:56.091790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2168,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":899,"num_read_kb":80980,"num_write":993,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'485","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630227+0000","last_change":"2024-09-14T11:14:06.134085+0000","last_active":"2024-09-14T11:55:41.630227+0000","last_peered":"2024-09-14T11:55:41.630227+0000","last_clean":"2024-09-14T11:55:41.630227+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:55:41.630227+0000","last_undegraded":"2024-09-14T11:55:41.630227+0000","last_fullsized":"2024-09-14T11:55:41.630227+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:23.324462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.584249+0000","last_change":"2024-09-14T11:14:04.120745+0000","last_active":"2024-09-14T11:56:15.584249+0000","last_peered":"2024-09-14T11:56:15.584249+0000","last_clean":"2024-09-14T11:56:15.584249+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:15.584249+0000","last_undegraded":"2024-09-14T11:56:15.584249+0000","last_fullsized":"2024-09-14T11:56:15.584249+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.093196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'419","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935731+0000","last_change":"2024-09-14T11:14:06.121086+0000","last_active":"2024-09-14T11:54:09.935731+0000","last_peered":"2024-09-14T11:54:09.935731+0000","last_clean":"2024-09-14T11:54:09.935731+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:54:09.935731+0000","last_undegraded":"2024-09-14T11:54:09.935731+0000","last_fullsized":"2024-09-14T11:54:09.935731+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:36.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'346","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.883516+0000","last_change":"2024-09-14T11:14:04.118390+0000","last_active":"2024-09-14T11:56:14.883516+0000","last_peered":"2024-09-14T11:56:14.883516+0000","last_clean":"2024-09-14T11:56:14.883516+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:14.883516+0000","last_undegraded":"2024-09-14T11:56:14.883516+0000","last_fullsized":"2024-09-14T11:56:14.883516+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:49.436222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31120,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":552,"num_read_kb":30121,"num_write":1016,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'413","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725240+0000","last_change":"2024-09-14T11:14:06.132235+0000","last_active":"2024-09-14T11:54:06.725240+0000","last_peered":"2024-09-14T11:54:06.725240+0000","last_clean":"2024-09-14T11:54:06.725240+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:54:06.725240+0000","last_undegraded":"2024-09-14T11:54:06.725240+0000","last_fullsized":"2024-09-14T11:54:06.725240+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:50.899051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.640403+0000","last_change":"2024-09-14T11:14:04.131711+0000","last_active":"2024-09-14T11:56:15.640403+0000","last_peered":"2024-09-14T11:56:15.640403+0000","last_clean":"2024-09-14T11:56:15.640403+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:15.640403+0000","last_undegraded":"2024-09-14T11:56:15.640403+0000","last_fullsized":"2024-09-14T11:56:15.640403+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:26.386858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'815","reported_seq":2398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114472+0000","last_change":"2024-09-14T11:14:06.130289+0000","last_active":"2024-09-14T11:54:27.114472+0000","last_peered":"2024-09-14T11:54:27.114472+0000","last_clean":"2024-09-14T11:54:27.114472+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:54:27.114472+0000","last_undegraded":"2024-09-14T11:54:27.114472+0000","last_fullsized":"2024-09-14T11:54:27.114472+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:55.217977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'274","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.897119+0000","last_change":"2024-09-14T11:14:04.137105+0000","last_active":"2024-09-14T11:56:14.897119+0000","last_peered":"2024-09-14T11:56:14.897119+0000","last_clean":"2024-09-14T11:56:14.897119+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:14.897119+0000","last_undegraded":"2024-09-14T11:56:14.897119+0000","last_fullsized":"2024-09-14T11:56:14.897119+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:13.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6928313,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":385,"num_read_kb":33889,"num_write":863,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'381","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.621727+0000","last_change":"2024-09-14T11:14:06.130068+0000","last_active":"2024-09-14T11:55:41.621727+0000","last_peered":"2024-09-14T11:55:41.621727+0000","last_clean":"2024-09-14T11:55:41.621727+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:55:41.621727+0000","last_undegraded":"2024-09-14T11:55:41.621727+0000","last_fullsized":"2024-09-14T11:55:41.621727+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:39.243281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.620139+0000","last_change":"2024-09-14T11:14:38.195137+0000","last_active":"2024-09-14T11:56:15.620139+0000","last_peered":"2024-09-14T11:56:15.620139+0000","last_clean":"2024-09-14T11:56:15.620139+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:15.620139+0000","last_undegraded":"2024-09-14T11:56:15.620139+0000","last_fullsized":"2024-09-14T11:56:15.620139+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:31.310723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546426+0000","last_change":"2024-09-14T11:14:06.125029+0000","last_active":"2024-09-14T11:54:26.546426+0000","last_peered":"2024-09-14T11:54:26.546426+0000","last_clean":"2024-09-14T11:54:26.546426+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:54:26.546426+0000","last_undegraded":"2024-09-14T11:54:26.546426+0000","last_fullsized":"2024-09-14T11:54:26.546426+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:21.648012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'460","reported_seq":1188,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.755808+0000","last_change":"2024-09-14T11:14:04.136230+0000","last_active":"2024-09-14T11:56:14.755808+0000","last_peered":"2024-09-14T11:56:14.755808+0000","last_clean":"2024-09-14T11:56:14.755808+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:14.755808+0000","last_undegraded":"2024-09-14T11:56:14.755808+0000","last_fullsized":"2024-09-14T11:56:14.755808+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246530,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1141,"num_read_kb":1914,"num_write":1383,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'474","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783207+0000","last_change":"2024-09-14T11:14:06.128570+0000","last_active":"2024-09-14T11:54:07.783207+0000","last_peered":"2024-09-14T11:54:07.783207+0000","last_clean":"2024-09-14T11:54:07.783207+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:54:07.783207+0000","last_undegraded":"2024-09-14T11:54:07.783207+0000","last_fullsized":"2024-09-14T11:54:07.783207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.751883+0000","last_change":"2024-09-14T11:14:04.117766+0000","last_active":"2024-09-14T11:56:14.751883+0000","last_peered":"2024-09-14T11:56:14.751883+0000","last_clean":"2024-09-14T11:56:14.751883+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:14.751883+0000","last_undegraded":"2024-09-14T11:56:14.751883+0000","last_fullsized":"2024-09-14T11:56:14.751883+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:32.550269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8013749,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":531,"num_read_kb":47806,"num_write":1050,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'444","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725116+0000","last_change":"2024-09-14T11:14:06.124232+0000","last_active":"2024-09-14T11:54:06.725116+0000","last_peered":"2024-09-14T11:54:06.725116+0000","last_clean":"2024-09-14T11:54:06.725116+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:54:06.725116+0000","last_undegraded":"2024-09-14T11:54:06.725116+0000","last_fullsized":"2024-09-14T11:54:06.725116+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:46.127557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615982+0000","last_change":"2024-09-14T11:14:04.128834+0000","last_active":"2024-09-14T11:56:15.615982+0000","last_peered":"2024-09-14T11:56:15.615982+0000","last_clean":"2024-09-14T11:56:15.615982+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:15.615982+0000","last_undegraded":"2024-09-14T11:56:15.615982+0000","last_fullsized":"2024-09-14T11:56:15.615982+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:37.995845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615334+0000","last_change":"2024-09-14T11:14:38.193534+0000","last_active":"2024-09-14T11:56:15.615334+0000","last_peered":"2024-09-14T11:56:15.615334+0000","last_clean":"2024-09-14T11:56:15.615334+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:15.615334+0000","last_undegraded":"2024-09-14T11:56:15.615334+0000","last_fullsized":"2024-09-14T11:56:15.615334+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.503196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'499","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461479+0000","last_change":"2024-09-14T11:14:06.134114+0000","last_active":"2024-09-14T11:54:24.461479+0000","last_peered":"2024-09-14T11:54:24.461479+0000","last_clean":"2024-09-14T11:54:24.461479+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:54:24.461479+0000","last_undegraded":"2024-09-14T11:54:24.461479+0000","last_fullsized":"2024-09-14T11:54:24.461479+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:15.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'332","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.818324+0000","last_change":"2024-09-14T11:14:04.121552+0000","last_active":"2024-09-14T11:56:14.818324+0000","last_peered":"2024-09-14T11:56:14.818324+0000","last_clean":"2024-09-14T11:56:14.818324+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:14.818324+0000","last_undegraded":"2024-09-14T11:56:14.818324+0000","last_fullsized":"2024-09-14T11:56:14.818324+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704768,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":667,"num_read_kb":183365,"num_write":1166,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546904+0000","last_change":"2024-09-14T11:14:06.130886+0000","last_active":"2024-09-14T11:54:26.546904+0000","last_peered":"2024-09-14T11:54:26.546904+0000","last_clean":"2024-09-14T11:54:26.546904+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:54:26.546904+0000","last_undegraded":"2024-09-14T11:54:26.546904+0000","last_fullsized":"2024-09-14T11:54:26.546904+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:55.595674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":627,"ondisk_log_size":627,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1693090,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17359,"num_read_kb":35854,"num_write":14609,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1130496,"data_stored":783760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2037,"ondisk_log_size":2037,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3689,"ondisk_log_size":3689,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":194891002,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":0,"num_read":42947,"num_read_kb":2244654,"num_write":71545,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":269365248,"data_stored":269365248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3570,"ondisk_log_size":3570,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":130,"num_read_kb":174309,"num_write":150,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":59768832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":32594424,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":122,"num_read_kb":174255,"num_write":144,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":54657024,"data_stored":54654665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509955,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318188,"kb_used_data":62004,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94053652,"statfs":{"total":96636764160,"available":96310939648,"internally_reserved":0,"allocated":63492096,"data_stored":61539547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509956,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166576,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205264,"statfs":{"total":96636764160,"available":96466190336,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509954,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542658,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388084,"kb_used_data":103936,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93983756,"statfs":{"total":96636764160,"available":96239366144,"internally_reserved":0,"allocated":106430464,"data_stored":104414681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542661,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":119312,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":122175488,"data_stored":120173426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542659,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202848,"kb_used_data":109148,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94168992,"statfs":{"total":96636764160,"available":96429047808,"internally_reserved":0,"allocated":111767552,"data_stored":109843385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542658,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316596,"kb_used_data":150816,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94055244,"statfs":{"total":96636764160,"available":96312569856,"internally_reserved":0,"allocated":154435584,"data_stored":152440708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542657,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347636,"kb_used_data":95580,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94024204,"statfs":{"total":96636764160,"available":96280784896,"internally_reserved":0,"allocated":97873920,"data_stored":95880257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60837888,"data_stored":60837888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39305216,"data_stored":39305216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28925952,"data_stored":28925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":56725504,"data_stored":56725504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60817408,"data_stored":60817408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":129533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":248005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":173177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":187067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":8437031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:56:18.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:56:18.710 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:18.711 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":263,"fsid":"f85ecd3e-0d2a-4fc4-af19-77cc3f51f4a2","created":"2024-09-14T11:13:32.678370+0000","modified":"2024-09-14T11:41:16.853603+0000","last_up_change":"2024-09-14T11:13:45.016880+0000","last_in_change":"2024-09-14T11:13:35.258429+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:13:44.957911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:13:51.059126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:14:02.095539+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:14:04.434900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:14:06.288832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:14:08.194359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:14:10.159002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:14:12.218018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:29:08.686766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:30:43.050305+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:30:45.803966+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:41:14.405515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69b24cba-07e3-488d-9165-d9252455bb4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6809","nonce":1380065119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6811","nonce":1380065119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6815","nonce":1380065119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":1380065119},{"type":"v1","addr":"172.21.15.94:6813","nonce":1380065119}]},"public_addr":"172.21.15.94:6809/1380065119","cluster_addr":"172.21.15.94:6811/1380065119","heartbeat_back_addr":"172.21.15.94:6815/1380065119","heartbeat_front_addr":"172.21.15.94:6813/1380065119","state":["exists","up"]},{"osd":1,"uuid":"9f3c274d-8ed6-4b84-acee-3e84aa0dc9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6825","nonce":3025939706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6827","nonce":3025939706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6831","nonce":3025939706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":3025939706},{"type":"v1","addr":"172.21.15.94:6829","nonce":3025939706}]},"public_addr":"172.21.15.94:6825/3025939706","cluster_addr":"172.21.15.94:6827/3025939706","heartbeat_back_addr":"172.21.15.94:6831/3025939706","heartbeat_front_addr":"172.21.15.94:6829/3025939706","state":["exists","up"]},{"osd":2,"uuid":"3bfb670b-c35c-4f4b-8784-63031ad32917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6801","nonce":3451614010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6803","nonce":3451614010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6807","nonce":3451614010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":3451614010},{"type":"v1","addr":"172.21.15.94:6805","nonce":3451614010}]},"public_addr":"172.21.15.94:6801/3451614010","cluster_addr":"172.21.15.94:6803/3451614010","heartbeat_back_addr":"172.21.15.94:6807/3451614010","heartbeat_front_addr":"172.21.15.94:6805/3451614010","state":["exists","up"]},{"osd":3,"uuid":"46d5e363-d726-4e2b-9546-25fabe47cb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6817","nonce":3920654385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6819","nonce":3920654385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6823","nonce":3920654385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":3920654385},{"type":"v1","addr":"172.21.15.94:6821","nonce":3920654385}]},"public_addr":"172.21.15.94:6817/3920654385","cluster_addr":"172.21.15.94:6819/3920654385","heartbeat_back_addr":"172.21.15.94:6823/3920654385","heartbeat_front_addr":"172.21.15.94:6821/3920654385","state":["exists","up"]},{"osd":4,"uuid":"f6318ce5-62e1-4efa-a89c-c60c56eaa758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6817","nonce":3011823175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6819","nonce":3011823175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6823","nonce":3011823175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3011823175},{"type":"v1","addr":"172.21.15.131:6821","nonce":3011823175}]},"public_addr":"172.21.15.131:6817/3011823175","cluster_addr":"172.21.15.131:6819/3011823175","heartbeat_back_addr":"172.21.15.131:6823/3011823175","heartbeat_front_addr":"172.21.15.131:6821/3011823175","state":["exists","up"]},{"osd":5,"uuid":"40ebe9c1-15f5-4c34-a254-a0848dbb06e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6827","nonce":3170580125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6829","nonce":3170580125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6833","nonce":3170580125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3170580125},{"type":"v1","addr":"172.21.15.131:6831","nonce":3170580125}]},"public_addr":"172.21.15.131:6827/3170580125","cluster_addr":"172.21.15.131:6829/3170580125","heartbeat_back_addr":"172.21.15.131:6833/3170580125","heartbeat_front_addr":"172.21.15.131:6831/3170580125","state":["exists","up"]},{"osd":6,"uuid":"b2d113ce-dff0-4150-92bd-8a71cbd7838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6809","nonce":340730180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6811","nonce":340730180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6815","nonce":340730180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":340730180},{"type":"v1","addr":"172.21.15.131:6813","nonce":340730180}]},"public_addr":"172.21.15.131:6809/340730180","cluster_addr":"172.21.15.131:6811/340730180","heartbeat_back_addr":"172.21.15.131:6815/340730180","heartbeat_front_addr":"172.21.15.131:6813/340730180","state":["exists","up"]},{"osd":7,"uuid":"fcbd82ba-349b-4e8a-b912-4149d35fe84d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6801","nonce":2577403967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6803","nonce":2577403967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6807","nonce":2577403967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2577403967},{"type":"v1","addr":"172.21.15.131:6805","nonce":2577403967}]},"public_addr":"172.21.15.131:6801/2577403967","cluster_addr":"172.21.15.131:6803/2577403967","heartbeat_back_addr":"172.21.15.131:6807/2577403967","heartbeat_front_addr":"172.21.15.131:6805/2577403967","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.623890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.022312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.331272+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.651698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.848409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:42.086848+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.338391+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:13:41.068013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.26","mappings":[{"from":6,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":0,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]},{"pgid":"67.19","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:56:19.724 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:56:19.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:19.874 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:19.874 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:19.874 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:19.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:56:20.189 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:56:20.203 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:56:20.203 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:20.340 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:20.340 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:20.340 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:20.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:56:20.648 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:56:20.661 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:56:20.661 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:20.798 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:20.798 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:20.799 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:20.809 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:56:21.110 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:56:21.123 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:56:21.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:21.260 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:21.260 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:21.260 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:21.270 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:56:21.570 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:56:21.583 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:56:21.583 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:21.720 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:21.720 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:21.720 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:21.730 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:56:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:56:22.045 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:56:22.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:22.183 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:22.194 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:56:22.494 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:56:22.508 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:56:22.508 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:22.645 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:22.645 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:22.645 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:22.656 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:56:22.959 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:56:22.971 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:56:22.972 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:56:23.109 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-14T11:56:23.109 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:56:23.109 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-14T11:56:23.119 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:56:23.417 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:56:23.430 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:56:23.753 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:23.764 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:56:23.766 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1535,"stamp":"2024-09-14T11:56:21.916746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43992737,"num_objects":740,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":310307,"num_read_kb":2858305,"num_write":163686,"num_write_kb":2485845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12934,"ondisk_log_size":12934,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1686712,"kb_used_data":96824,"kb_used_omap":12,"kb_used_meta":1588915,"kb_avail":753288008,"statfs":{"total":773094113280,"available":771366920192,"internally_reserved":0,"allocated":99147776,"data_stored":83483642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1627049520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-688877687,"num_objects":-4093,"num_object_clones":0,"num_object_copies":-12243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4093,"num_whiteouts":0,"num_read":4577,"num_read_kb":4120,"num_write":4342,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005168"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039779+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:53:46.039779+0000","last_peered":"2024-09-14T11:53:46.039779+0000","last_clean":"2024-09-14T11:53:46.039779+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:53:46.039779+0000","last_undegraded":"2024-09-14T11:53:46.039779+0000","last_fullsized":"2024-09-14T11:53:46.039779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:51.058211+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:55:51.058211+0000","last_peered":"2024-09-14T11:55:51.058211+0000","last_clean":"2024-09-14T11:55:51.058211+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:55:51.058211+0000","last_undegraded":"2024-09-14T11:55:51.058211+0000","last_fullsized":"2024-09-14T11:55:51.058211+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.781550+0000","last_change":"2024-09-14T11:41:15.877777+0000","last_active":"2024-09-14T11:53:49.781550+0000","last_peered":"2024-09-14T11:53:49.781550+0000","last_clean":"2024-09-14T11:53:49.781550+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:53:49.781550+0000","last_undegraded":"2024-09-14T11:53:49.781550+0000","last_fullsized":"2024-09-14T11:53:49.781550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.018964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.917468+0000","last_change":"2024-09-14T11:30:44.720933+0000","last_active":"2024-09-14T11:55:44.917468+0000","last_peered":"2024-09-14T11:55:44.917468+0000","last_clean":"2024-09-14T11:55:44.917468+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:55:44.917468+0000","last_undegraded":"2024-09-14T11:55:44.917468+0000","last_fullsized":"2024-09-14T11:55:44.917468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:46.706797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777983+0000","last_change":"2024-09-14T11:29:10.325552+0000","last_active":"2024-09-14T11:53:14.777983+0000","last_peered":"2024-09-14T11:53:14.777983+0000","last_clean":"2024-09-14T11:53:14.777983+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:53:14.777983+0000","last_undegraded":"2024-09-14T11:53:14.777983+0000","last_fullsized":"2024-09-14T11:53:14.777983+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:26.043474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.787081+0000","last_change":"2024-09-14T11:41:15.870239+0000","last_active":"2024-09-14T11:53:20.787081+0000","last_peered":"2024-09-14T11:53:20.787081+0000","last_clean":"2024-09-14T11:53:20.787081+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:53:20.787081+0000","last_undegraded":"2024-09-14T11:53:20.787081+0000","last_fullsized":"2024-09-14T11:53:20.787081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:07.125369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918925+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:55:49.918925+0000","last_peered":"2024-09-14T11:55:49.918925+0000","last_clean":"2024-09-14T11:55:49.918925+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:55:49.918925+0000","last_undegraded":"2024-09-14T11:55:49.918925+0000","last_fullsized":"2024-09-14T11:55:49.918925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.788503+0000","last_change":"2024-09-14T11:30:44.718407+0000","last_active":"2024-09-14T11:54:49.788503+0000","last_peered":"2024-09-14T11:54:49.788503+0000","last_clean":"2024-09-14T11:54:49.788503+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:54:49.788503+0000","last_undegraded":"2024-09-14T11:54:49.788503+0000","last_fullsized":"2024-09-14T11:54:49.788503+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:51.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.075756+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:53:31.075756+0000","last_peered":"2024-09-14T11:53:31.075756+0000","last_clean":"2024-09-14T11:53:31.075756+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:53:31.075756+0000","last_undegraded":"2024-09-14T11:53:31.075756+0000","last_fullsized":"2024-09-14T11:53:31.075756+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:51.990371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896093+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:52:54.896093+0000","last_peered":"2024-09-14T11:52:54.896093+0000","last_clean":"2024-09-14T11:52:54.896093+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:52:54.896093+0000","last_undegraded":"2024-09-14T11:52:54.896093+0000","last_fullsized":"2024-09-14T11:52:54.896093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:47.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.884913+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:51:39.884913+0000","last_peered":"2024-09-14T11:51:39.884913+0000","last_clean":"2024-09-14T11:51:39.884913+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:51:39.884913+0000","last_undegraded":"2024-09-14T11:51:39.884913+0000","last_fullsized":"2024-09-14T11:51:39.884913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:06.934022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.328043+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:52:32.328043+0000","last_peered":"2024-09-14T11:52:32.328043+0000","last_clean":"2024-09-14T11:52:32.328043+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:52:32.328043+0000","last_undegraded":"2024-09-14T11:52:32.328043+0000","last_fullsized":"2024-09-14T11:52:32.328043+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.704261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.780910+0000","last_change":"2024-09-14T11:30:47.742222+0000","last_active":"2024-09-14T11:52:35.780910+0000","last_peered":"2024-09-14T11:52:35.780910+0000","last_clean":"2024-09-14T11:52:35.780910+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:52:35.780910+0000","last_undegraded":"2024-09-14T11:52:35.780910+0000","last_fullsized":"2024-09-14T11:52:35.780910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:53.632539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.773815+0000","last_change":"2024-09-14T11:29:10.322697+0000","last_active":"2024-09-14T11:51:40.773815+0000","last_peered":"2024-09-14T11:51:40.773815+0000","last_clean":"2024-09-14T11:51:40.773815+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:51:40.773815+0000","last_undegraded":"2024-09-14T11:51:40.773815+0000","last_fullsized":"2024-09-14T11:51:40.773815+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:58.258272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797042+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:53:49.797042+0000","last_peered":"2024-09-14T11:53:49.797042+0000","last_clean":"2024-09-14T11:53:49.797042+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:53:49.797042+0000","last_undegraded":"2024-09-14T11:53:49.797042+0000","last_fullsized":"2024-09-14T11:53:49.797042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.063452+0000","last_change":"2024-09-14T11:30:47.735777+0000","last_active":"2024-09-14T11:56:14.063452+0000","last_peered":"2024-09-14T11:56:14.063452+0000","last_clean":"2024-09-14T11:56:14.063452+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:14.063452+0000","last_undegraded":"2024-09-14T11:56:14.063452+0000","last_fullsized":"2024-09-14T11:56:14.063452+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:09.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797081+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:53:49.797081+0000","last_peered":"2024-09-14T11:53:49.797081+0000","last_clean":"2024-09-14T11:53:49.797081+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:53:49.797081+0000","last_undegraded":"2024-09-14T11:53:49.797081+0000","last_fullsized":"2024-09-14T11:53:49.797081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.862359+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:56:13.862359+0000","last_peered":"2024-09-14T11:56:13.862359+0000","last_clean":"2024-09-14T11:56:13.862359+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:56:13.862359+0000","last_undegraded":"2024-09-14T11:56:13.862359+0000","last_fullsized":"2024-09-14T11:56:13.862359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17456,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899090+0000","last_change":"2024-09-14T11:29:10.322726+0000","last_active":"2024-09-14T11:53:19.899090+0000","last_peered":"2024-09-14T11:53:19.899090+0000","last_clean":"2024-09-14T11:53:19.899090+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:53:19.899090+0000","last_undegraded":"2024-09-14T11:53:19.899090+0000","last_fullsized":"2024-09-14T11:53:19.899090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:47.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.911945+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:54:59.911945+0000","last_peered":"2024-09-14T11:54:59.911945+0000","last_clean":"2024-09-14T11:54:59.911945+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:54:59.911945+0000","last_undegraded":"2024-09-14T11:54:59.911945+0000","last_fullsized":"2024-09-14T11:54:59.911945+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022348+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:51:46.022348+0000","last_peered":"2024-09-14T11:51:46.022348+0000","last_clean":"2024-09-14T11:51:46.022348+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:51:46.022348+0000","last_undegraded":"2024-09-14T11:51:46.022348+0000","last_fullsized":"2024-09-14T11:51:46.022348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:09.499277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.775890+0000","last_change":"2024-09-14T11:41:15.871132+0000","last_active":"2024-09-14T11:52:59.775890+0000","last_peered":"2024-09-14T11:52:59.775890+0000","last_clean":"2024-09-14T11:52:59.775890+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:52:59.775890+0000","last_undegraded":"2024-09-14T11:52:59.775890+0000","last_fullsized":"2024-09-14T11:52:59.775890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:52.619076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.887227+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:51:54.887227+0000","last_peered":"2024-09-14T11:51:54.887227+0000","last_clean":"2024-09-14T11:51:54.887227+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:51:54.887227+0000","last_undegraded":"2024-09-14T11:51:54.887227+0000","last_fullsized":"2024-09-14T11:51:54.887227+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.766752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.789048+0000","last_change":"2024-09-14T11:30:44.715477+0000","last_active":"2024-09-14T11:54:54.789048+0000","last_peered":"2024-09-14T11:54:54.789048+0000","last_clean":"2024-09-14T11:54:54.789048+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:54:54.789048+0000","last_undegraded":"2024-09-14T11:54:54.789048+0000","last_fullsized":"2024-09-14T11:54:54.789048+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:47.193927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.905463+0000","last_change":"2024-09-14T11:29:10.321195+0000","last_active":"2024-09-14T11:53:26.905463+0000","last_peered":"2024-09-14T11:53:26.905463+0000","last_clean":"2024-09-14T11:53:26.905463+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:53:26.905463+0000","last_undegraded":"2024-09-14T11:53:26.905463+0000","last_fullsized":"2024-09-14T11:53:26.905463+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:38.747021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.911403+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:54:54.911403+0000","last_peered":"2024-09-14T11:54:54.911403+0000","last_clean":"2024-09-14T11:54:54.911403+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:54:54.911403+0000","last_undegraded":"2024-09-14T11:54:54.911403+0000","last_fullsized":"2024-09-14T11:54:54.911403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887752+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:51:49.887752+0000","last_peered":"2024-09-14T11:51:49.887752+0000","last_clean":"2024-09-14T11:51:49.887752+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:51:49.887752+0000","last_undegraded":"2024-09-14T11:51:49.887752+0000","last_fullsized":"2024-09-14T11:51:49.887752+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:48.649434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.795879+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.795879+0000","last_peered":"2024-09-14T11:56:13.795879+0000","last_clean":"2024-09-14T11:56:13.795879+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.795879+0000","last_undegraded":"2024-09-14T11:56:13.795879+0000","last_fullsized":"2024-09-14T11:56:13.795879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:13.281310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.887721+0000","last_change":"2024-09-14T11:30:47.735047+0000","last_active":"2024-09-14T11:51:49.887721+0000","last_peered":"2024-09-14T11:51:49.887721+0000","last_clean":"2024-09-14T11:51:49.887721+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:51:49.887721+0000","last_undegraded":"2024-09-14T11:51:49.887721+0000","last_fullsized":"2024-09-14T11:51:49.887721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:04.517023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.904880+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:54:04.904880+0000","last_peered":"2024-09-14T11:54:04.904880+0000","last_clean":"2024-09-14T11:54:04.904880+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:54:04.904880+0000","last_undegraded":"2024-09-14T11:54:04.904880+0000","last_fullsized":"2024-09-14T11:54:04.904880+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:06.177114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.886468+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:51:49.886468+0000","last_peered":"2024-09-14T11:51:49.886468+0000","last_clean":"2024-09-14T11:51:49.886468+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:51:49.886468+0000","last_undegraded":"2024-09-14T11:51:49.886468+0000","last_fullsized":"2024-09-14T11:51:49.886468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:39.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.774516+0000","last_change":"2024-09-14T11:30:44.718710+0000","last_active":"2024-09-14T11:51:45.774516+0000","last_peered":"2024-09-14T11:51:45.774516+0000","last_clean":"2024-09-14T11:51:45.774516+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:51:45.774516+0000","last_undegraded":"2024-09-14T11:51:45.774516+0000","last_fullsized":"2024-09-14T11:51:45.774516+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:50.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.288212+0000","last_change":"2024-09-14T11:29:10.311886+0000","last_active":"2024-09-14T11:53:31.288212+0000","last_peered":"2024-09-14T11:53:31.288212+0000","last_clean":"2024-09-14T11:53:31.288212+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:53:31.288212+0000","last_undegraded":"2024-09-14T11:53:31.288212+0000","last_fullsized":"2024-09-14T11:53:31.288212+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:59.142362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794592+0000","last_change":"2024-09-14T11:30:47.739387+0000","last_active":"2024-09-14T11:54:10.794592+0000","last_peered":"2024-09-14T11:54:10.794592+0000","last_clean":"2024-09-14T11:54:10.794592+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:54:10.794592+0000","last_undegraded":"2024-09-14T11:54:10.794592+0000","last_fullsized":"2024-09-14T11:54:10.794592+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.980753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022300+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:51:46.022300+0000","last_peered":"2024-09-14T11:51:46.022300+0000","last_clean":"2024-09-14T11:51:46.022300+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:51:46.022300+0000","last_undegraded":"2024-09-14T11:51:46.022300+0000","last_fullsized":"2024-09-14T11:51:46.022300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:44.955288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.770544+0000","last_change":"2024-09-14T11:41:15.868312+0000","last_active":"2024-09-14T11:52:14.770544+0000","last_peered":"2024-09-14T11:52:14.770544+0000","last_clean":"2024-09-14T11:52:14.770544+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:52:14.770544+0000","last_undegraded":"2024-09-14T11:52:14.770544+0000","last_fullsized":"2024-09-14T11:52:14.770544+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:13.069995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777960+0000","last_change":"2024-09-14T11:30:44.719858+0000","last_active":"2024-09-14T11:53:14.777960+0000","last_peered":"2024-09-14T11:53:14.777960+0000","last_clean":"2024-09-14T11:53:14.777960+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:53:14.777960+0000","last_undegraded":"2024-09-14T11:53:14.777960+0000","last_fullsized":"2024-09-14T11:53:14.777960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.415891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.041236+0000","last_change":"2024-09-14T11:29:10.324751+0000","last_active":"2024-09-14T11:53:56.041236+0000","last_peered":"2024-09-14T11:53:56.041236+0000","last_clean":"2024-09-14T11:53:56.041236+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:53:56.041236+0000","last_undegraded":"2024-09-14T11:53:56.041236+0000","last_fullsized":"2024-09-14T11:53:56.041236+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:56.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.777049+0000","last_change":"2024-09-14T11:41:15.865744+0000","last_active":"2024-09-14T11:52:05.777049+0000","last_peered":"2024-09-14T11:52:05.777049+0000","last_clean":"2024-09-14T11:52:05.777049+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:52:05.777049+0000","last_undegraded":"2024-09-14T11:52:05.777049+0000","last_fullsized":"2024-09-14T11:52:05.777049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:25.011776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792258+0000","last_change":"2024-09-14T11:29:10.325256+0000","last_active":"2024-09-14T11:53:55.792258+0000","last_peered":"2024-09-14T11:53:55.792258+0000","last_clean":"2024-09-14T11:53:55.792258+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:53:55.792258+0000","last_undegraded":"2024-09-14T11:53:55.792258+0000","last_fullsized":"2024-09-14T11:53:55.792258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.015196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.778952+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:52:09.778952+0000","last_peered":"2024-09-14T11:52:09.778952+0000","last_clean":"2024-09-14T11:52:09.778952+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:52:09.778952+0000","last_undegraded":"2024-09-14T11:52:09.778952+0000","last_fullsized":"2024-09-14T11:52:09.778952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:30.781685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.022660+0000","last_change":"2024-09-14T11:30:44.717178+0000","last_active":"2024-09-14T11:56:15.022660+0000","last_peered":"2024-09-14T11:56:15.022660+0000","last_clean":"2024-09-14T11:56:15.022660+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:56:15.022660+0000","last_undegraded":"2024-09-14T11:56:15.022660+0000","last_fullsized":"2024-09-14T11:56:15.022660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.604554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.782090+0000","last_change":"2024-09-14T11:29:10.320629+0000","last_active":"2024-09-14T11:53:54.782090+0000","last_peered":"2024-09-14T11:53:54.782090+0000","last_clean":"2024-09-14T11:53:54.782090+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:53:54.782090+0000","last_undegraded":"2024-09-14T11:53:54.782090+0000","last_fullsized":"2024-09-14T11:53:54.782090+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:20.168734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892148+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:52:29.892148+0000","last_peered":"2024-09-14T11:52:29.892148+0000","last_clean":"2024-09-14T11:52:29.892148+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:52:29.892148+0000","last_undegraded":"2024-09-14T11:52:29.892148+0000","last_fullsized":"2024-09-14T11:52:29.892148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:38.823344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912541+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:14.912541+0000","last_peered":"2024-09-14T11:56:14.912541+0000","last_clean":"2024-09-14T11:56:14.912541+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:14.912541+0000","last_undegraded":"2024-09-14T11:56:14.912541+0000","last_fullsized":"2024-09-14T11:56:14.912541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.014650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893118+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:52:24.893118+0000","last_peered":"2024-09-14T11:52:24.893118+0000","last_clean":"2024-09-14T11:52:24.893118+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:52:24.893118+0000","last_undegraded":"2024-09-14T11:52:24.893118+0000","last_fullsized":"2024-09-14T11:52:24.893118+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:57.259600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785620+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:52:29.785620+0000","last_peered":"2024-09-14T11:52:29.785620+0000","last_clean":"2024-09-14T11:52:29.785620+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:52:29.785620+0000","last_undegraded":"2024-09-14T11:52:29.785620+0000","last_fullsized":"2024-09-14T11:52:29.785620+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:58.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891569+0000","last_change":"2024-09-14T11:30:44.713694+0000","last_active":"2024-09-14T11:52:24.891569+0000","last_peered":"2024-09-14T11:52:24.891569+0000","last_clean":"2024-09-14T11:52:24.891569+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:52:24.891569+0000","last_undegraded":"2024-09-14T11:52:24.891569+0000","last_fullsized":"2024-09-14T11:52:24.891569+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:40.066993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.790581+0000","last_change":"2024-09-14T11:29:10.321325+0000","last_active":"2024-09-14T11:53:04.790581+0000","last_peered":"2024-09-14T11:53:04.790581+0000","last_clean":"2024-09-14T11:53:04.790581+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:53:04.790581+0000","last_undegraded":"2024-09-14T11:53:04.790581+0000","last_fullsized":"2024-09-14T11:53:04.790581+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:02.452550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912099+0000","last_change":"2024-09-14T11:30:47.737000+0000","last_active":"2024-09-14T11:56:14.912099+0000","last_peered":"2024-09-14T11:56:14.912099+0000","last_clean":"2024-09-14T11:56:14.912099+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:56:14.912099+0000","last_undegraded":"2024-09-14T11:56:14.912099+0000","last_fullsized":"2024-09-14T11:56:14.912099+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:03.413738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.908537+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:54:34.908537+0000","last_peered":"2024-09-14T11:54:34.908537+0000","last_clean":"2024-09-14T11:54:34.908537+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:54:34.908537+0000","last_undegraded":"2024-09-14T11:54:34.908537+0000","last_fullsized":"2024-09-14T11:54:34.908537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:33.383073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786619+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:52:34.786619+0000","last_peered":"2024-09-14T11:52:34.786619+0000","last_clean":"2024-09-14T11:52:34.786619+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:52:34.786619+0000","last_undegraded":"2024-09-14T11:52:34.786619+0000","last_fullsized":"2024-09-14T11:52:34.786619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:02.318969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784088+0000","last_change":"2024-09-14T11:29:10.322148+0000","last_active":"2024-09-14T11:53:00.784088+0000","last_peered":"2024-09-14T11:53:00.784088+0000","last_clean":"2024-09-14T11:53:00.784088+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:53:00.784088+0000","last_undegraded":"2024-09-14T11:53:00.784088+0000","last_fullsized":"2024-09-14T11:53:00.784088+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.995810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.815040+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:55:44.815040+0000","last_peered":"2024-09-14T11:55:44.815040+0000","last_clean":"2024-09-14T11:55:44.815040+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:55:44.815040+0000","last_undegraded":"2024-09-14T11:55:44.815040+0000","last_fullsized":"2024-09-14T11:55:44.815040+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.938139+0000","last_change":"2024-09-14T11:30:44.720970+0000","last_active":"2024-09-14T11:56:13.938139+0000","last_peered":"2024-09-14T11:56:13.938139+0000","last_clean":"2024-09-14T11:56:13.938139+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:56:13.938139+0000","last_undegraded":"2024-09-14T11:56:13.938139+0000","last_fullsized":"2024-09-14T11:56:13.938139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:44.416082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784182+0000","last_change":"2024-09-14T11:29:10.322645+0000","last_active":"2024-09-14T11:53:00.784182+0000","last_peered":"2024-09-14T11:53:00.784182+0000","last_clean":"2024-09-14T11:53:00.784182+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:53:00.784182+0000","last_undegraded":"2024-09-14T11:53:00.784182+0000","last_fullsized":"2024-09-14T11:53:00.784182+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:51.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785838+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:52:29.785838+0000","last_peered":"2024-09-14T11:52:29.785838+0000","last_clean":"2024-09-14T11:52:29.785838+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:52:29.785838+0000","last_undegraded":"2024-09-14T11:52:29.785838+0000","last_fullsized":"2024-09-14T11:52:29.785838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:07.281823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.047286+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:54:36.047286+0000","last_peered":"2024-09-14T11:54:36.047286+0000","last_clean":"2024-09-14T11:54:36.047286+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:54:36.047286+0000","last_undegraded":"2024-09-14T11:54:36.047286+0000","last_fullsized":"2024-09-14T11:54:36.047286+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:34.901574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801180+0000","last_change":"2024-09-14T11:29:10.323320+0000","last_active":"2024-09-14T11:54:14.801180+0000","last_peered":"2024-09-14T11:54:14.801180+0000","last_clean":"2024-09-14T11:54:14.801180+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:54:14.801180+0000","last_undegraded":"2024-09-14T11:54:14.801180+0000","last_fullsized":"2024-09-14T11:54:14.801180+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:18.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.799375+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:54:40.799375+0000","last_peered":"2024-09-14T11:54:40.799375+0000","last_clean":"2024-09-14T11:54:40.799375+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:54:40.799375+0000","last_undegraded":"2024-09-14T11:54:40.799375+0000","last_fullsized":"2024-09-14T11:54:40.799375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.613026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.784752+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:52:24.784752+0000","last_peered":"2024-09-14T11:52:24.784752+0000","last_clean":"2024-09-14T11:52:24.784752+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:52:24.784752+0000","last_undegraded":"2024-09-14T11:52:24.784752+0000","last_fullsized":"2024-09-14T11:52:24.784752+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:46.872224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905103+0000","last_change":"2024-09-14T11:29:10.321492+0000","last_active":"2024-09-14T11:54:09.905103+0000","last_peered":"2024-09-14T11:54:09.905103+0000","last_clean":"2024-09-14T11:54:09.905103+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:54:09.905103+0000","last_undegraded":"2024-09-14T11:54:09.905103+0000","last_fullsized":"2024-09-14T11:54:09.905103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:01.698920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.770106+0000","last_change":"2024-09-14T11:41:15.869275+0000","last_active":"2024-09-14T11:52:09.770106+0000","last_peered":"2024-09-14T11:52:09.770106+0000","last_clean":"2024-09-14T11:52:09.770106+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:52:09.770106+0000","last_undegraded":"2024-09-14T11:52:09.770106+0000","last_fullsized":"2024-09-14T11:52:09.770106+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:58.504841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902212+0000","last_change":"2024-09-14T11:30:47.734644+0000","last_active":"2024-09-14T11:53:44.902212+0000","last_peered":"2024-09-14T11:53:44.902212+0000","last_clean":"2024-09-14T11:53:44.902212+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:53:44.902212+0000","last_undegraded":"2024-09-14T11:53:44.902212+0000","last_fullsized":"2024-09-14T11:53:44.902212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:00.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.788562+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:52:49.788562+0000","last_peered":"2024-09-14T11:52:49.788562+0000","last_clean":"2024-09-14T11:52:49.788562+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:52:49.788562+0000","last_undegraded":"2024-09-14T11:52:49.788562+0000","last_fullsized":"2024-09-14T11:52:49.788562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:27.988666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043510+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:54:11.043510+0000","last_peered":"2024-09-14T11:54:11.043510+0000","last_clean":"2024-09-14T11:54:11.043510+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:54:11.043510+0000","last_undegraded":"2024-09-14T11:54:11.043510+0000","last_fullsized":"2024-09-14T11:54:11.043510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.891635+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:52:09.891635+0000","last_peered":"2024-09-14T11:52:09.891635+0000","last_clean":"2024-09-14T11:52:09.891635+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:52:09.891635+0000","last_undegraded":"2024-09-14T11:52:09.891635+0000","last_fullsized":"2024-09-14T11:52:09.891635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:47.380694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.049498+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:54:51.049498+0000","last_peered":"2024-09-14T11:54:51.049498+0000","last_clean":"2024-09-14T11:54:51.049498+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:54:51.049498+0000","last_undegraded":"2024-09-14T11:54:51.049498+0000","last_fullsized":"2024-09-14T11:54:51.049498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.117139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794642+0000","last_change":"2024-09-14T11:29:10.319801+0000","last_active":"2024-09-14T11:54:10.794642+0000","last_peered":"2024-09-14T11:54:10.794642+0000","last_clean":"2024-09-14T11:54:10.794642+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:54:10.794642+0000","last_undegraded":"2024-09-14T11:54:10.794642+0000","last_fullsized":"2024-09-14T11:54:10.794642+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:43.613741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790704+0000","last_change":"2024-09-14T11:30:47.742418+0000","last_active":"2024-09-14T11:53:45.790704+0000","last_peered":"2024-09-14T11:53:45.790704+0000","last_clean":"2024-09-14T11:53:45.790704+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:53:45.790704+0000","last_undegraded":"2024-09-14T11:53:45.790704+0000","last_fullsized":"2024-09-14T11:53:45.790704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:46.735010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'11","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.024411+0000","last_change":"2024-09-14T11:30:44.713119+0000","last_active":"2024-09-14T11:56:15.024411+0000","last_peered":"2024-09-14T11:56:15.024411+0000","last_clean":"2024-09-14T11:56:15.024411+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:56:15.024411+0000","last_undegraded":"2024-09-14T11:56:15.024411+0000","last_fullsized":"2024-09-14T11:56:15.024411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:45.277861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794558+0000","last_change":"2024-09-14T11:29:10.321339+0000","last_active":"2024-09-14T11:54:10.794558+0000","last_peered":"2024-09-14T11:54:10.794558+0000","last_clean":"2024-09-14T11:54:10.794558+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:54:10.794558+0000","last_undegraded":"2024-09-14T11:54:10.794558+0000","last_fullsized":"2024-09-14T11:54:10.794558+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:57.698726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790015+0000","last_change":"2024-09-14T11:30:44.721204+0000","last_active":"2024-09-14T11:53:40.790015+0000","last_peered":"2024-09-14T11:53:40.790015+0000","last_clean":"2024-09-14T11:53:40.790015+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:53:40.790015+0000","last_undegraded":"2024-09-14T11:53:40.790015+0000","last_fullsized":"2024-09-14T11:53:40.790015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.676688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792100+0000","last_change":"2024-09-14T11:29:10.324357+0000","last_active":"2024-09-14T11:53:14.792100+0000","last_peered":"2024-09-14T11:53:14.792100+0000","last_clean":"2024-09-14T11:53:14.792100+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:53:14.792100+0000","last_undegraded":"2024-09-14T11:53:14.792100+0000","last_fullsized":"2024-09-14T11:53:14.792100+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:35.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'328","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.628456+0000","last_change":"2024-09-14T11:14:04.132821+0000","last_active":"2024-09-14T11:56:15.628456+0000","last_peered":"2024-09-14T11:56:15.628456+0000","last_clean":"2024-09-14T11:56:15.628456+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:15.628456+0000","last_undegraded":"2024-09-14T11:56:15.628456+0000","last_fullsized":"2024-09-14T11:56:15.628456+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:20.604907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":2359,"num_write":1145,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1592","reported_seq":3377,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461746+0000","last_change":"2024-09-14T11:14:06.121950+0000","last_active":"2024-09-14T11:54:24.461746+0000","last_peered":"2024-09-14T11:54:24.461746+0000","last_clean":"2024-09-14T11:54:24.461746+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:54:24.461746+0000","last_undegraded":"2024-09-14T11:54:24.461746+0000","last_fullsized":"2024-09-14T11:54:24.461746+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.554941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'344","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615615+0000","last_change":"2024-09-14T11:14:04.126728+0000","last_active":"2024-09-14T11:56:15.615615+0000","last_peered":"2024-09-14T11:56:15.615615+0000","last_clean":"2024-09-14T11:56:15.615615+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:15.615615+0000","last_undegraded":"2024-09-14T11:56:15.615615+0000","last_fullsized":"2024-09-14T11:56:15.615615+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:41.626044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":643,"num_read_kb":6703,"num_write":1183,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'561","reported_seq":2237,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622076+0000","last_change":"2024-09-14T11:14:06.123174+0000","last_active":"2024-09-14T11:55:41.622076+0000","last_peered":"2024-09-14T11:55:41.622076+0000","last_clean":"2024-09-14T11:55:41.622076+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:55:41.622076+0000","last_undegraded":"2024-09-14T11:55:41.622076+0000","last_fullsized":"2024-09-14T11:55:41.622076+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:37.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'350","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.621102+0000","last_change":"2024-09-14T11:14:04.122664+0000","last_active":"2024-09-14T11:56:15.621102+0000","last_peered":"2024-09-14T11:56:15.621102+0000","last_clean":"2024-09-14T11:56:15.621102+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:15.621102+0000","last_undegraded":"2024-09-14T11:56:15.621102+0000","last_fullsized":"2024-09-14T11:56:15.621102+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":11794,"num_write":1143,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'475","reported_seq":2251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.537995+0000","last_change":"2024-09-14T11:14:06.124737+0000","last_active":"2024-09-14T11:54:26.537995+0000","last_peered":"2024-09-14T11:54:26.537995+0000","last_clean":"2024-09-14T11:54:26.537995+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:54:26.537995+0000","last_undegraded":"2024-09-14T11:54:26.537995+0000","last_fullsized":"2024-09-14T11:54:26.537995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:38.559640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.618263+0000","last_change":"2024-09-14T11:14:04.128237+0000","last_active":"2024-09-14T11:56:15.618263+0000","last_peered":"2024-09-14T11:56:15.618263+0000","last_clean":"2024-09-14T11:56:15.618263+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:15.618263+0000","last_undegraded":"2024-09-14T11:56:15.618263+0000","last_fullsized":"2024-09-14T11:56:15.618263+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:22.273382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1060","reported_seq":2767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540504+0000","last_change":"2024-09-14T11:14:06.134846+0000","last_active":"2024-09-14T11:54:04.540504+0000","last_peered":"2024-09-14T11:54:04.540504+0000","last_clean":"2024-09-14T11:54:04.540504+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:54:04.540504+0000","last_undegraded":"2024-09-14T11:54:04.540504+0000","last_fullsized":"2024-09-14T11:54:04.540504+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:16.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'351","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.610453+0000","last_change":"2024-09-14T11:14:04.121928+0000","last_active":"2024-09-14T11:56:15.610453+0000","last_peered":"2024-09-14T11:56:15.610453+0000","last_clean":"2024-09-14T11:56:15.610453+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:15.610453+0000","last_undegraded":"2024-09-14T11:56:15.610453+0000","last_fullsized":"2024-09-14T11:56:15.610453+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:49.409365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":626,"num_read_kb":64951,"num_write":1173,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'462","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.795372+0000","last_change":"2024-09-14T11:14:06.131212+0000","last_active":"2024-09-14T11:54:15.795372+0000","last_peered":"2024-09-14T11:54:15.795372+0000","last_clean":"2024-09-14T11:54:15.795372+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:54:15.795372+0000","last_undegraded":"2024-09-14T11:54:15.795372+0000","last_fullsized":"2024-09-14T11:54:15.795372+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:20.091159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.586411+0000","last_change":"2024-09-14T11:14:04.134464+0000","last_active":"2024-09-14T11:56:15.586411+0000","last_peered":"2024-09-14T11:56:15.586411+0000","last_clean":"2024-09-14T11:56:15.586411+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:15.586411+0000","last_undegraded":"2024-09-14T11:56:15.586411+0000","last_fullsized":"2024-09-14T11:56:15.586411+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:30.803104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'797","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.547089+0000","last_change":"2024-09-14T11:14:06.123280+0000","last_active":"2024-09-14T11:54:08.547089+0000","last_peered":"2024-09-14T11:54:08.547089+0000","last_clean":"2024-09-14T11:54:08.547089+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:54:08.547089+0000","last_undegraded":"2024-09-14T11:54:08.547089+0000","last_fullsized":"2024-09-14T11:54:08.547089+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:47.903630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'298","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.585319+0000","last_change":"2024-09-14T11:14:04.123532+0000","last_active":"2024-09-14T11:56:15.585319+0000","last_peered":"2024-09-14T11:56:15.585319+0000","last_clean":"2024-09-14T11:56:15.585319+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:15.585319+0000","last_undegraded":"2024-09-14T11:56:15.585319+0000","last_fullsized":"2024-09-14T11:56:15.585319+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:19.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":10089,"num_write":838,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'969","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114339+0000","last_change":"2024-09-14T11:14:38.192581+0000","last_active":"2024-09-14T11:54:27.114339+0000","last_peered":"2024-09-14T11:54:27.114339+0000","last_clean":"2024-09-14T11:54:27.114339+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:54:27.114339+0000","last_undegraded":"2024-09-14T11:54:27.114339+0000","last_fullsized":"2024-09-14T11:54:27.114339+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":900,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:55.081995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'304","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.630472+0000","last_change":"2024-09-14T11:14:04.133635+0000","last_active":"2024-09-14T11:56:15.630472+0000","last_peered":"2024-09-14T11:56:15.630472+0000","last_clean":"2024-09-14T11:56:15.630472+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:15.630472+0000","last_undegraded":"2024-09-14T11:56:15.630472+0000","last_fullsized":"2024-09-14T11:56:15.630472+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:20.488960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":712,"num_read_kb":31980,"num_write":1004,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'456","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113514+0000","last_change":"2024-09-14T11:14:06.120786+0000","last_active":"2024-09-14T11:54:27.113514+0000","last_peered":"2024-09-14T11:54:27.113514+0000","last_clean":"2024-09-14T11:54:27.113514+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:54:27.113514+0000","last_undegraded":"2024-09-14T11:54:27.113514+0000","last_fullsized":"2024-09-14T11:54:27.113514+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:54.953125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'842","reported_seq":2512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114073+0000","last_change":"2024-09-14T11:14:06.124595+0000","last_active":"2024-09-14T11:54:27.114073+0000","last_peered":"2024-09-14T11:54:27.114073+0000","last_clean":"2024-09-14T11:54:27.114073+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:54:27.114073+0000","last_undegraded":"2024-09-14T11:54:27.114073+0000","last_fullsized":"2024-09-14T11:54:27.114073+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:05.222764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.640344+0000","last_change":"2024-09-14T11:14:38.194800+0000","last_active":"2024-09-14T11:56:15.640344+0000","last_peered":"2024-09-14T11:56:15.640344+0000","last_clean":"2024-09-14T11:56:15.640344+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:15.640344+0000","last_undegraded":"2024-09-14T11:56:15.640344+0000","last_fullsized":"2024-09-14T11:56:15.640344+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.771928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":694,"num_read_kb":5626,"num_write":1163,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1033","reported_seq":2958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.113832+0000","last_change":"2024-09-14T11:14:06.123475+0000","last_active":"2024-09-14T11:54:27.113832+0000","last_peered":"2024-09-14T11:54:27.113832+0000","last_clean":"2024-09-14T11:54:27.113832+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:54:27.113832+0000","last_undegraded":"2024-09-14T11:54:27.113832+0000","last_fullsized":"2024-09-14T11:54:27.113832+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1000,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:19.165857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.556657+0000","last_change":"2024-09-14T11:14:04.127657+0000","last_active":"2024-09-14T11:56:15.556657+0000","last_peered":"2024-09-14T11:56:15.556657+0000","last_clean":"2024-09-14T11:56:15.556657+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:15.556657+0000","last_undegraded":"2024-09-14T11:56:15.556657+0000","last_fullsized":"2024-09-14T11:56:15.556657+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:06.672463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114354+0000","last_change":"2024-09-14T11:14:06.126958+0000","last_active":"2024-09-14T11:54:27.114354+0000","last_peered":"2024-09-14T11:54:27.114354+0000","last_clean":"2024-09-14T11:54:27.114354+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:54:27.114354+0000","last_undegraded":"2024-09-14T11:54:27.114354+0000","last_fullsized":"2024-09-14T11:54:27.114354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:26.370068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.544255+0000","last_change":"2024-09-14T11:14:04.124069+0000","last_active":"2024-09-14T11:56:15.544255+0000","last_peered":"2024-09-14T11:56:15.544255+0000","last_clean":"2024-09-14T11:56:15.544255+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:15.544255+0000","last_undegraded":"2024-09-14T11:56:15.544255+0000","last_fullsized":"2024-09-14T11:56:15.544255+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:34.849444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'797","reported_seq":2341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.716592+0000","last_change":"2024-09-14T11:14:06.121906+0000","last_active":"2024-09-14T11:53:56.716592+0000","last_peered":"2024-09-14T11:53:56.716592+0000","last_clean":"2024-09-14T11:53:56.716592+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:53:56.716592+0000","last_undegraded":"2024-09-14T11:53:56.716592+0000","last_fullsized":"2024-09-14T11:53:56.716592+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:09.756613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.581006+0000","last_change":"2024-09-14T11:14:04.134028+0000","last_active":"2024-09-14T11:56:15.581006+0000","last_peered":"2024-09-14T11:56:15.581006+0000","last_clean":"2024-09-14T11:56:15.581006+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:15.581006+0000","last_undegraded":"2024-09-14T11:56:15.581006+0000","last_fullsized":"2024-09-14T11:56:15.581006+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:15.221483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'452","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546378+0000","last_change":"2024-09-14T11:14:06.126750+0000","last_active":"2024-09-14T11:54:26.546378+0000","last_peered":"2024-09-14T11:54:26.546378+0000","last_clean":"2024-09-14T11:54:26.546378+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:54:26.546378+0000","last_undegraded":"2024-09-14T11:54:26.546378+0000","last_fullsized":"2024-09-14T11:54:26.546378+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:36.058072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'426","reported_seq":1154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.571674+0000","last_change":"2024-09-14T11:14:04.124388+0000","last_active":"2024-09-14T11:56:15.571674+0000","last_peered":"2024-09-14T11:56:15.571674+0000","last_clean":"2024-09-14T11:56:15.571674+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:15.571674+0000","last_undegraded":"2024-09-14T11:56:15.571674+0000","last_fullsized":"2024-09-14T11:56:15.571674+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:48.709233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1042,"num_read_kb":31602,"num_write":1294,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'449","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262318+0000","last_change":"2024-09-14T11:14:06.120737+0000","last_active":"2024-09-14T11:54:09.262318+0000","last_peered":"2024-09-14T11:54:09.262318+0000","last_clean":"2024-09-14T11:54:09.262318+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:54:09.262318+0000","last_undegraded":"2024-09-14T11:54:09.262318+0000","last_fullsized":"2024-09-14T11:54:09.262318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:08.169000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'326","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.602482+0000","last_change":"2024-09-14T11:14:04.131958+0000","last_active":"2024-09-14T11:56:15.602482+0000","last_peered":"2024-09-14T11:56:15.602482+0000","last_clean":"2024-09-14T11:56:15.602482+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:15.602482+0000","last_undegraded":"2024-09-14T11:56:15.602482+0000","last_fullsized":"2024-09-14T11:56:15.602482+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:07.141707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048824,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":49467,"num_write":1023,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'149","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.173403+0000","last_change":"2024-09-14T11:14:14.157140+0000","last_active":"2024-09-14T11:54:27.173403+0000","last_peered":"2024-09-14T11:54:27.173403+0000","last_clean":"2024-09-14T11:54:27.173403+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:54:27.173403+0000","last_undegraded":"2024-09-14T11:54:27.173403+0000","last_fullsized":"2024-09-14T11:54:27.173403+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'472","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462103+0000","last_change":"2024-09-14T11:14:06.114316+0000","last_active":"2024-09-14T11:54:24.462103+0000","last_peered":"2024-09-14T11:54:24.462103+0000","last_clean":"2024-09-14T11:54:24.462103+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:54:24.462103+0000","last_undegraded":"2024-09-14T11:54:24.462103+0000","last_fullsized":"2024-09-14T11:54:24.462103+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:27.459152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'350","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.566484+0000","last_change":"2024-09-14T11:14:04.130305+0000","last_active":"2024-09-14T11:56:15.566484+0000","last_peered":"2024-09-14T11:56:15.566484+0000","last_clean":"2024-09-14T11:56:15.566484+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:15.566484+0000","last_undegraded":"2024-09-14T11:56:15.566484+0000","last_fullsized":"2024-09-14T11:56:15.566484+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:34.333098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":64658,"num_write":1071,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032244+0000","last_change":"2024-09-14T11:14:08.133120+0000","last_active":"2024-09-14T11:52:51.032244+0000","last_peered":"2024-09-14T11:52:51.032244+0000","last_clean":"2024-09-14T11:52:51.032244+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:52:51.032244+0000","last_undegraded":"2024-09-14T11:52:51.032244+0000","last_fullsized":"2024-09-14T11:52:51.032244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:46.516129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.396646+0000","last_change":"2024-09-14T11:14:10.155409+0000","last_active":"2024-09-14T11:56:14.396646+0000","last_peered":"2024-09-14T11:56:14.396646+0000","last_clean":"2024-09-14T11:56:14.396646+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:14.396646+0000","last_undegraded":"2024-09-14T11:56:14.396646+0000","last_fullsized":"2024-09-14T11:56:14.396646+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:46.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.789188+0000","last_change":"2024-09-14T11:14:12.146041+0000","last_active":"2024-09-14T11:52:54.789188+0000","last_peered":"2024-09-14T11:52:54.789188+0000","last_clean":"2024-09-14T11:52:54.789188+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:52:54.789188+0000","last_undegraded":"2024-09-14T11:52:54.789188+0000","last_fullsized":"2024-09-14T11:52:54.789188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:07.310103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2525","reported_seq":4350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.558442+0000","last_change":"2024-09-14T11:14:14.162522+0000","last_active":"2024-09-14T11:54:26.558442+0000","last_peered":"2024-09-14T11:54:26.558442+0000","last_clean":"2024-09-14T11:54:26.558442+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:54:26.558442+0000","last_undegraded":"2024-09-14T11:54:26.558442+0000","last_fullsized":"2024-09-14T11:54:26.558442+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.242957+0000","last_change":"2024-09-14T11:14:06.123796+0000","last_active":"2024-09-14T11:53:58.242957+0000","last_peered":"2024-09-14T11:53:58.242957+0000","last_clean":"2024-09-14T11:53:58.242957+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:53:58.242957+0000","last_undegraded":"2024-09-14T11:53:58.242957+0000","last_fullsized":"2024-09-14T11:53:58.242957+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.088566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'386","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.644328+0000","last_change":"2024-09-14T11:14:04.119220+0000","last_active":"2024-09-14T11:56:15.644328+0000","last_peered":"2024-09-14T11:56:15.644328+0000","last_clean":"2024-09-14T11:56:15.644328+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:15.644328+0000","last_undegraded":"2024-09-14T11:56:15.644328+0000","last_fullsized":"2024-09-14T11:56:15.644328+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:38.371093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":676,"num_read_kb":35601,"num_write":1215,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"37'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.737726+0000","last_change":"2024-09-14T11:14:08.135860+0000","last_active":"2024-09-14T11:56:13.737726+0000","last_peered":"2024-09-14T11:56:13.737726+0000","last_clean":"2024-09-14T11:56:13.737726+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:13.737726+0000","last_undegraded":"2024-09-14T11:56:13.737726+0000","last_fullsized":"2024-09-14T11:56:13.737726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:46.310304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'85","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.820592+0000","last_change":"2024-09-14T11:14:10.148306+0000","last_active":"2024-09-14T11:54:18.820592+0000","last_peered":"2024-09-14T11:54:18.820592+0000","last_clean":"2024-09-14T11:54:18.820592+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:54:18.820592+0000","last_undegraded":"2024-09-14T11:54:18.820592+0000","last_fullsized":"2024-09-14T11:54:18.820592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:24.120046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783507+0000","last_change":"2024-09-14T11:14:12.155662+0000","last_active":"2024-09-14T11:52:55.783507+0000","last_peered":"2024-09-14T11:52:55.783507+0000","last_clean":"2024-09-14T11:52:55.783507+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:52:55.783507+0000","last_undegraded":"2024-09-14T11:52:55.783507+0000","last_fullsized":"2024-09-14T11:52:55.783507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.540261+0000","last_change":"2024-09-14T11:14:14.154923+0000","last_active":"2024-09-14T11:53:52.540261+0000","last_peered":"2024-09-14T11:53:52.540261+0000","last_clean":"2024-09-14T11:53:52.540261+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:53:52.540261+0000","last_undegraded":"2024-09-14T11:53:52.540261+0000","last_fullsized":"2024-09-14T11:53:52.540261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:08.154888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'429","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.932863+0000","last_change":"2024-09-14T11:14:06.134060+0000","last_active":"2024-09-14T11:54:02.932863+0000","last_peered":"2024-09-14T11:54:02.932863+0000","last_clean":"2024-09-14T11:54:02.932863+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:54:02.932863+0000","last_undegraded":"2024-09-14T11:54:02.932863+0000","last_fullsized":"2024-09-14T11:54:02.932863+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:50.929113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'407","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.607728+0000","last_change":"2024-09-14T11:14:04.131269+0000","last_active":"2024-09-14T11:56:15.607728+0000","last_peered":"2024-09-14T11:56:15.607728+0000","last_clean":"2024-09-14T11:56:15.607728+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:15.607728+0000","last_undegraded":"2024-09-14T11:56:15.607728+0000","last_fullsized":"2024-09-14T11:56:15.607728+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.204839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":815,"num_read_kb":18319,"num_write":1414,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.894797+0000","last_change":"2024-09-14T11:14:08.134301+0000","last_active":"2024-09-14T11:52:49.894797+0000","last_peered":"2024-09-14T11:52:49.894797+0000","last_clean":"2024-09-14T11:52:49.894797+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:52:49.894797+0000","last_undegraded":"2024-09-14T11:52:49.894797+0000","last_fullsized":"2024-09-14T11:52:49.894797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.190597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'98","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.838179+0000","last_change":"2024-09-14T11:14:10.152502+0000","last_active":"2024-09-14T11:54:18.838179+0000","last_peered":"2024-09-14T11:54:18.838179+0000","last_clean":"2024-09-14T11:54:18.838179+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:54:18.838179+0000","last_undegraded":"2024-09-14T11:54:18.838179+0000","last_fullsized":"2024-09-14T11:54:18.838179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:42.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'773","reported_seq":4564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.255849+0000","last_change":"2024-09-14T11:14:12.146612+0000","last_active":"2024-09-14T11:56:15.255849+0000","last_peered":"2024-09-14T11:56:15.255849+0000","last_clean":"2024-09-14T11:56:15.255849+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:15.255849+0000","last_undegraded":"2024-09-14T11:56:15.255849+0000","last_fullsized":"2024-09-14T11:56:15.255849+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:59.916147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.603559+0000","last_change":"2024-09-14T11:14:14.157146+0000","last_active":"2024-09-14T11:54:26.603559+0000","last_peered":"2024-09-14T11:54:26.603559+0000","last_clean":"2024-09-14T11:54:26.603559+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:54:26.603559+0000","last_undegraded":"2024-09-14T11:54:26.603559+0000","last_fullsized":"2024-09-14T11:54:26.603559+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'525","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.725224+0000","last_change":"2024-09-14T11:14:38.194359+0000","last_active":"2024-09-14T11:54:03.725224+0000","last_peered":"2024-09-14T11:54:03.725224+0000","last_clean":"2024-09-14T11:54:03.725224+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:54:03.725224+0000","last_undegraded":"2024-09-14T11:54:03.725224+0000","last_fullsized":"2024-09-14T11:54:03.725224+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:56.602770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.572772+0000","last_change":"2024-09-14T11:14:04.128674+0000","last_active":"2024-09-14T11:56:15.572772+0000","last_peered":"2024-09-14T11:56:15.572772+0000","last_clean":"2024-09-14T11:56:15.572772+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:15.572772+0000","last_undegraded":"2024-09-14T11:56:15.572772+0000","last_fullsized":"2024-09-14T11:56:15.572772+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:18.487246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032273+0000","last_change":"2024-09-14T11:14:08.132713+0000","last_active":"2024-09-14T11:52:51.032273+0000","last_peered":"2024-09-14T11:52:51.032273+0000","last_clean":"2024-09-14T11:52:51.032273+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:52:51.032273+0000","last_undegraded":"2024-09-14T11:52:51.032273+0000","last_fullsized":"2024-09-14T11:52:51.032273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.166831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'250","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.104576+0000","last_change":"2024-09-14T11:14:10.151136+0000","last_active":"2024-09-14T11:56:14.104576+0000","last_peered":"2024-09-14T11:56:14.104576+0000","last_clean":"2024-09-14T11:56:14.104576+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:14.104576+0000","last_undegraded":"2024-09-14T11:56:14.104576+0000","last_fullsized":"2024-09-14T11:56:14.104576+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.560101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'790","reported_seq":2552,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.663564+0000","last_change":"2024-09-14T11:14:12.152920+0000","last_active":"2024-09-14T11:56:15.663564+0000","last_peered":"2024-09-14T11:56:15.663564+0000","last_clean":"2024-09-14T11:56:15.663564+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:15.663564+0000","last_undegraded":"2024-09-14T11:56:15.663564+0000","last_fullsized":"2024-09-14T11:56:15.663564+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:33.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1226","reported_seq":2881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358325+0000","last_change":"2024-09-14T11:14:06.125762+0000","last_active":"2024-09-14T11:54:05.358325+0000","last_peered":"2024-09-14T11:54:05.358325+0000","last_clean":"2024-09-14T11:54:05.358325+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:54:05.358325+0000","last_undegraded":"2024-09-14T11:54:05.358325+0000","last_fullsized":"2024-09-14T11:54:05.358325+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":1200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:18.791358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'358","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627835+0000","last_change":"2024-09-14T11:14:04.130569+0000","last_active":"2024-09-14T11:56:15.627835+0000","last_peered":"2024-09-14T11:56:15.627835+0000","last_clean":"2024-09-14T11:56:15.627835+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:15.627835+0000","last_undegraded":"2024-09-14T11:56:15.627835+0000","last_fullsized":"2024-09-14T11:56:15.627835+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:07.122939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":41733,"num_write":1105,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.791334+0000","last_change":"2024-09-14T11:14:08.133899+0000","last_active":"2024-09-14T11:53:09.791334+0000","last_peered":"2024-09-14T11:53:09.791334+0000","last_clean":"2024-09-14T11:53:09.791334+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:53:09.791334+0000","last_undegraded":"2024-09-14T11:53:09.791334+0000","last_fullsized":"2024-09-14T11:53:09.791334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:53.760916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'355","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.626523+0000","last_change":"2024-09-14T11:14:10.148253+0000","last_active":"2024-09-14T11:56:14.626523+0000","last_peered":"2024-09-14T11:56:14.626523+0000","last_clean":"2024-09-14T11:56:14.626523+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:14.626523+0000","last_undegraded":"2024-09-14T11:56:14.626523+0000","last_fullsized":"2024-09-14T11:56:14.626523+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:31.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892192+0000","last_change":"2024-09-14T11:14:12.146180+0000","last_active":"2024-09-14T11:52:29.892192+0000","last_peered":"2024-09-14T11:52:29.892192+0000","last_clean":"2024-09-14T11:52:29.892192+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:52:29.892192+0000","last_undegraded":"2024-09-14T11:52:29.892192+0000","last_fullsized":"2024-09-14T11:52:29.892192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:08.096291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'551","reported_seq":1353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.743153+0000","last_change":"2024-09-14T11:14:14.163358+0000","last_active":"2024-09-14T11:55:42.743153+0000","last_peered":"2024-09-14T11:55:42.743153+0000","last_clean":"2024-09-14T11:55:42.743153+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:55:42.743153+0000","last_undegraded":"2024-09-14T11:55:42.743153+0000","last_fullsized":"2024-09-14T11:55:42.743153+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.528715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'805","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783202+0000","last_change":"2024-09-14T11:14:06.122574+0000","last_active":"2024-09-14T11:54:07.783202+0000","last_peered":"2024-09-14T11:54:07.783202+0000","last_clean":"2024-09-14T11:54:07.783202+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:54:07.783202+0000","last_undegraded":"2024-09-14T11:54:07.783202+0000","last_fullsized":"2024-09-14T11:54:07.783202+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:48.369389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'313","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.499391+0000","last_change":"2024-09-14T11:14:38.341826+0000","last_active":"2024-09-14T11:56:15.499391+0000","last_peered":"2024-09-14T11:56:15.499391+0000","last_clean":"2024-09-14T11:56:15.499391+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:15.499391+0000","last_undegraded":"2024-09-14T11:56:15.499391+0000","last_fullsized":"2024-09-14T11:56:15.499391+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:15.557976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":67475,"num_write":1031,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777294+0000","last_change":"2024-09-14T11:14:08.128050+0000","last_active":"2024-09-14T11:53:09.777294+0000","last_peered":"2024-09-14T11:53:09.777294+0000","last_clean":"2024-09-14T11:53:09.777294+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:53:09.777294+0000","last_undegraded":"2024-09-14T11:53:09.777294+0000","last_fullsized":"2024-09-14T11:53:09.777294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:20.497715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'293","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.357605+0000","last_change":"2024-09-14T11:14:10.154690+0000","last_active":"2024-09-14T11:56:15.357605+0000","last_peered":"2024-09-14T11:56:15.357605+0000","last_clean":"2024-09-14T11:56:15.357605+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:56:15.357605+0000","last_undegraded":"2024-09-14T11:56:15.357605+0000","last_fullsized":"2024-09-14T11:56:15.357605+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:11.627375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49558,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1126,"num_write":402,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899412+0000","last_change":"2024-09-14T11:14:12.151137+0000","last_active":"2024-09-14T11:53:19.899412+0000","last_peered":"2024-09-14T11:53:19.899412+0000","last_clean":"2024-09-14T11:53:19.899412+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:53:19.899412+0000","last_undegraded":"2024-09-14T11:53:19.899412+0000","last_fullsized":"2024-09-14T11:53:19.899412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:29.769264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'118","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.889408+0000","last_change":"2024-09-14T11:14:14.157438+0000","last_active":"2024-09-14T11:55:32.889408+0000","last_peered":"2024-09-14T11:55:32.889408+0000","last_clean":"2024-09-14T11:55:32.889408+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:55:32.889408+0000","last_undegraded":"2024-09-14T11:55:32.889408+0000","last_fullsized":"2024-09-14T11:55:32.889408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:00.893536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1038","reported_seq":2737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935378+0000","last_change":"2024-09-14T11:14:06.128782+0000","last_active":"2024-09-14T11:54:09.935378+0000","last_peered":"2024-09-14T11:54:09.935378+0000","last_clean":"2024-09-14T11:54:09.935378+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:54:09.935378+0000","last_undegraded":"2024-09-14T11:54:09.935378+0000","last_fullsized":"2024-09-14T11:54:09.935378+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:45.064796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'294","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.580759+0000","last_change":"2024-09-14T11:14:04.126361+0000","last_active":"2024-09-14T11:56:15.580759+0000","last_peered":"2024-09-14T11:56:15.580759+0000","last_clean":"2024-09-14T11:56:15.580759+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:15.580759+0000","last_undegraded":"2024-09-14T11:56:15.580759+0000","last_fullsized":"2024-09-14T11:56:15.580759+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:57.417770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":31073,"num_write":909,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771841+0000","last_change":"2024-09-14T11:14:08.126954+0000","last_active":"2024-09-14T11:52:24.771841+0000","last_peered":"2024-09-14T11:52:24.771841+0000","last_clean":"2024-09-14T11:52:24.771841+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:52:24.771841+0000","last_undegraded":"2024-09-14T11:52:24.771841+0000","last_fullsized":"2024-09-14T11:52:24.771841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:45.136292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'300","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.732982+0000","last_change":"2024-09-14T11:14:10.152183+0000","last_active":"2024-09-14T11:56:14.732982+0000","last_peered":"2024-09-14T11:56:14.732982+0000","last_clean":"2024-09-14T11:56:14.732982+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:14.732982+0000","last_undegraded":"2024-09-14T11:56:14.732982+0000","last_fullsized":"2024-09-14T11:56:14.732982+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.467798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":4045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.441275+0000","last_change":"2024-09-14T11:14:12.147169+0000","last_active":"2024-09-14T11:56:15.441275+0000","last_peered":"2024-09-14T11:56:15.441275+0000","last_clean":"2024-09-14T11:56:15.441275+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:15.441275+0000","last_undegraded":"2024-09-14T11:56:15.441275+0000","last_fullsized":"2024-09-14T11:56:15.441275+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:25.604563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573078+0000","last_change":"2024-09-14T11:14:14.159513+0000","last_active":"2024-09-14T11:55:41.573078+0000","last_peered":"2024-09-14T11:55:41.573078+0000","last_clean":"2024-09-14T11:55:41.573078+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:55:41.573078+0000","last_undegraded":"2024-09-14T11:55:41.573078+0000","last_fullsized":"2024-09-14T11:55:41.573078+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.781431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'412","reported_seq":1898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630266+0000","last_change":"2024-09-14T11:14:06.131730+0000","last_active":"2024-09-14T11:55:41.630266+0000","last_peered":"2024-09-14T11:55:41.630266+0000","last_clean":"2024-09-14T11:55:41.630266+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:55:41.630266+0000","last_undegraded":"2024-09-14T11:55:41.630266+0000","last_fullsized":"2024-09-14T11:55:41.630266+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:31.948943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627548+0000","last_change":"2024-09-14T11:14:04.129793+0000","last_active":"2024-09-14T11:56:15.627548+0000","last_peered":"2024-09-14T11:56:15.627548+0000","last_clean":"2024-09-14T11:56:15.627548+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:15.627548+0000","last_undegraded":"2024-09-14T11:56:15.627548+0000","last_fullsized":"2024-09-14T11:56:15.627548+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:25.783947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.778424+0000","last_change":"2024-09-14T11:14:08.138126+0000","last_active":"2024-09-14T11:53:19.778424+0000","last_peered":"2024-09-14T11:53:19.778424+0000","last_clean":"2024-09-14T11:53:19.778424+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:53:19.778424+0000","last_undegraded":"2024-09-14T11:53:19.778424+0000","last_fullsized":"2024-09-14T11:53:19.778424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.320143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'495","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.532436+0000","last_change":"2024-09-14T11:14:10.155037+0000","last_active":"2024-09-14T11:56:15.532436+0000","last_peered":"2024-09-14T11:56:15.532436+0000","last_clean":"2024-09-14T11:56:15.532436+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:15.532436+0000","last_undegraded":"2024-09-14T11:56:15.532436+0000","last_fullsized":"2024-09-14T11:56:15.532436+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:11.589031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99468,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":885,"num_read_kb":2186,"num_write":738,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777908+0000","last_change":"2024-09-14T11:14:12.150404+0000","last_active":"2024-09-14T11:53:14.777908+0000","last_peered":"2024-09-14T11:53:14.777908+0000","last_clean":"2024-09-14T11:53:14.777908+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:53:14.777908+0000","last_undegraded":"2024-09-14T11:53:14.777908+0000","last_fullsized":"2024-09-14T11:53:14.777908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:35.156152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.719675+0000","last_change":"2024-09-14T11:14:14.158980+0000","last_active":"2024-09-14T11:53:53.719675+0000","last_peered":"2024-09-14T11:53:53.719675+0000","last_clean":"2024-09-14T11:53:53.719675+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:53:53.719675+0000","last_undegraded":"2024-09-14T11:53:53.719675+0000","last_fullsized":"2024-09-14T11:53:53.719675+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'845","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540265+0000","last_change":"2024-09-14T11:14:06.121080+0000","last_active":"2024-09-14T11:54:04.540265+0000","last_peered":"2024-09-14T11:54:04.540265+0000","last_clean":"2024-09-14T11:54:04.540265+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:54:04.540265+0000","last_undegraded":"2024-09-14T11:54:04.540265+0000","last_fullsized":"2024-09-14T11:54:04.540265+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.620906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'386","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.624531+0000","last_change":"2024-09-14T11:14:04.123630+0000","last_active":"2024-09-14T11:56:15.624531+0000","last_peered":"2024-09-14T11:56:15.624531+0000","last_clean":"2024-09-14T11:56:15.624531+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:15.624531+0000","last_undegraded":"2024-09-14T11:56:15.624531+0000","last_fullsized":"2024-09-14T11:56:15.624531+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.120592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":715,"num_read_kb":16906,"num_write":1227,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771872+0000","last_change":"2024-09-14T11:14:08.130949+0000","last_active":"2024-09-14T11:52:24.771872+0000","last_peered":"2024-09-14T11:52:24.771872+0000","last_clean":"2024-09-14T11:52:24.771872+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:52:24.771872+0000","last_undegraded":"2024-09-14T11:52:24.771872+0000","last_fullsized":"2024-09-14T11:52:24.771872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:57.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.591066+0000","last_change":"2024-09-14T11:14:10.152305+0000","last_active":"2024-09-14T11:56:15.591066+0000","last_peered":"2024-09-14T11:56:15.591066+0000","last_clean":"2024-09-14T11:56:15.591066+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:15.591066+0000","last_undegraded":"2024-09-14T11:56:15.591066+0000","last_fullsized":"2024-09-14T11:56:15.591066+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:30.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894361+0000","last_change":"2024-09-14T11:14:12.155158+0000","last_active":"2024-09-14T11:52:34.894361+0000","last_peered":"2024-09-14T11:52:34.894361+0000","last_clean":"2024-09-14T11:52:34.894361+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:52:34.894361+0000","last_undegraded":"2024-09-14T11:52:34.894361+0000","last_fullsized":"2024-09-14T11:52:34.894361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:57.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.891276+0000","last_change":"2024-09-14T11:14:14.161551+0000","last_active":"2024-09-14T11:55:32.891276+0000","last_peered":"2024-09-14T11:55:32.891276+0000","last_clean":"2024-09-14T11:55:32.891276+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:55:32.891276+0000","last_undegraded":"2024-09-14T11:55:32.891276+0000","last_fullsized":"2024-09-14T11:55:32.891276+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:31.034926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1643","reported_seq":3307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.620971+0000","last_change":"2024-09-14T11:14:06.121979+0000","last_active":"2024-09-14T11:55:41.620971+0000","last_peered":"2024-09-14T11:55:41.620971+0000","last_clean":"2024-09-14T11:55:41.620971+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:55:41.620971+0000","last_undegraded":"2024-09-14T11:55:41.620971+0000","last_fullsized":"2024-09-14T11:55:41.620971+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1600,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.503786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596591+0000","last_change":"2024-09-14T11:14:04.126591+0000","last_active":"2024-09-14T11:56:15.596591+0000","last_peered":"2024-09-14T11:56:15.596591+0000","last_clean":"2024-09-14T11:56:15.596591+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:15.596591+0000","last_undegraded":"2024-09-14T11:56:15.596591+0000","last_fullsized":"2024-09-14T11:56:15.596591+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:36.129660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891630+0000","last_change":"2024-09-14T11:14:08.137550+0000","last_active":"2024-09-14T11:52:24.891630+0000","last_peered":"2024-09-14T11:52:24.891630+0000","last_clean":"2024-09-14T11:52:24.891630+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:52:24.891630+0000","last_undegraded":"2024-09-14T11:52:24.891630+0000","last_fullsized":"2024-09-14T11:52:24.891630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:25.401132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'294","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.186050+0000","last_change":"2024-09-14T11:14:10.147623+0000","last_active":"2024-09-14T11:56:15.186050+0000","last_peered":"2024-09-14T11:56:15.186050+0000","last_clean":"2024-09-14T11:56:15.186050+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:56:15.186050+0000","last_undegraded":"2024-09-14T11:56:15.186050+0000","last_fullsized":"2024-09-14T11:56:15.186050+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:59.040566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69648,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1150,"num_write":402,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'761","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.980060+0000","last_change":"2024-09-14T11:14:12.150811+0000","last_active":"2024-09-14T11:56:14.980060+0000","last_peered":"2024-09-14T11:56:14.980060+0000","last_clean":"2024-09-14T11:56:14.980060+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:14.980060+0000","last_undegraded":"2024-09-14T11:56:14.980060+0000","last_fullsized":"2024-09-14T11:56:14.980060+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:59.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'145","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.116982+0000","last_change":"2024-09-14T11:14:14.152510+0000","last_active":"2024-09-14T11:54:26.116982+0000","last_peered":"2024-09-14T11:54:26.116982+0000","last_clean":"2024-09-14T11:54:26.116982+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:54:26.116982+0000","last_undegraded":"2024-09-14T11:54:26.116982+0000","last_fullsized":"2024-09-14T11:54:26.116982+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.358932+0000","last_change":"2024-09-14T11:14:06.129574+0000","last_active":"2024-09-14T11:54:05.358932+0000","last_peered":"2024-09-14T11:54:05.358932+0000","last_clean":"2024-09-14T11:54:05.358932+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:54:05.358932+0000","last_undegraded":"2024-09-14T11:54:05.358932+0000","last_fullsized":"2024-09-14T11:54:05.358932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.251050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.627434+0000","last_change":"2024-09-14T11:14:04.121041+0000","last_active":"2024-09-14T11:56:15.627434+0000","last_peered":"2024-09-14T11:56:15.627434+0000","last_clean":"2024-09-14T11:56:15.627434+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:15.627434+0000","last_undegraded":"2024-09-14T11:56:15.627434+0000","last_fullsized":"2024-09-14T11:56:15.627434+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:42.473136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.724714+0000","last_change":"2024-09-14T11:14:08.137840+0000","last_active":"2024-09-14T11:56:13.724714+0000","last_peered":"2024-09-14T11:56:13.724714+0000","last_clean":"2024-09-14T11:56:13.724714+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:13.724714+0000","last_undegraded":"2024-09-14T11:56:13.724714+0000","last_fullsized":"2024-09-14T11:56:13.724714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.414460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'79","reported_seq":592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.808261+0000","last_change":"2024-09-14T11:14:10.153344+0000","last_active":"2024-09-14T11:54:18.808261+0000","last_peered":"2024-09-14T11:54:18.808261+0000","last_clean":"2024-09-14T11:54:18.808261+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:54:18.808261+0000","last_undegraded":"2024-09-14T11:54:18.808261+0000","last_fullsized":"2024-09-14T11:54:18.808261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:08.968908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.745724+0000","last_change":"2024-09-14T11:14:12.154356+0000","last_active":"2024-09-14T11:56:13.745724+0000","last_peered":"2024-09-14T11:56:13.745724+0000","last_clean":"2024-09-14T11:56:13.745724+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:13.745724+0000","last_undegraded":"2024-09-14T11:56:13.745724+0000","last_fullsized":"2024-09-14T11:56:13.745724+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:48.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.169895+0000","last_change":"2024-09-14T11:14:14.157483+0000","last_active":"2024-09-14T11:54:27.169895+0000","last_peered":"2024-09-14T11:54:27.169895+0000","last_clean":"2024-09-14T11:54:27.169895+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:54:27.169895+0000","last_undegraded":"2024-09-14T11:54:27.169895+0000","last_fullsized":"2024-09-14T11:54:27.169895+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:28.829014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'510","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546442+0000","last_change":"2024-09-14T11:14:06.118633+0000","last_active":"2024-09-14T11:54:26.546442+0000","last_peered":"2024-09-14T11:54:26.546442+0000","last_clean":"2024-09-14T11:54:26.546442+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:54:26.546442+0000","last_undegraded":"2024-09-14T11:54:26.546442+0000","last_fullsized":"2024-09-14T11:54:26.546442+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:05.940637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.549351+0000","last_change":"2024-09-14T11:14:04.114747+0000","last_active":"2024-09-14T11:56:15.549351+0000","last_peered":"2024-09-14T11:56:15.549351+0000","last_clean":"2024-09-14T11:56:15.549351+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:15.549351+0000","last_undegraded":"2024-09-14T11:56:15.549351+0000","last_fullsized":"2024-09-14T11:56:15.549351+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:09.164037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":524,"num_write":1137,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:25.780132+0000","last_change":"2024-09-14T11:14:08.136517+0000","last_active":"2024-09-14T11:52:25.780132+0000","last_peered":"2024-09-14T11:52:25.780132+0000","last_clean":"2024-09-14T11:52:25.780132+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:52:25.780132+0000","last_undegraded":"2024-09-14T11:52:25.780132+0000","last_fullsized":"2024-09-14T11:52:25.780132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:22.745520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'358","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.456163+0000","last_change":"2024-09-14T11:14:10.153476+0000","last_active":"2024-09-14T11:56:14.456163+0000","last_peered":"2024-09-14T11:56:14.456163+0000","last_clean":"2024-09-14T11:56:14.456163+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:14.456163+0000","last_undegraded":"2024-09-14T11:56:14.456163+0000","last_fullsized":"2024-09-14T11:56:14.456163+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:16.395304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:30.780175+0000","last_change":"2024-09-14T11:14:12.154775+0000","last_active":"2024-09-14T11:52:30.780175+0000","last_peered":"2024-09-14T11:52:30.780175+0000","last_clean":"2024-09-14T11:52:30.780175+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:52:30.780175+0000","last_undegraded":"2024-09-14T11:52:30.780175+0000","last_fullsized":"2024-09-14T11:52:30.780175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:42.202687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'182","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.542886+0000","last_change":"2024-09-14T11:14:14.155863+0000","last_active":"2024-09-14T11:54:08.542886+0000","last_peered":"2024-09-14T11:54:08.542886+0000","last_clean":"2024-09-14T11:54:08.542886+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:54:08.542886+0000","last_undegraded":"2024-09-14T11:54:08.542886+0000","last_fullsized":"2024-09-14T11:54:08.542886+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'464","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114499+0000","last_change":"2024-09-14T11:14:06.128526+0000","last_active":"2024-09-14T11:54:27.114499+0000","last_peered":"2024-09-14T11:54:27.114499+0000","last_clean":"2024-09-14T11:54:27.114499+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:54:27.114499+0000","last_undegraded":"2024-09-14T11:54:27.114499+0000","last_fullsized":"2024-09-14T11:54:27.114499+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:37.682655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798596+0000","last_change":"2024-09-14T11:13:46.583902+0000","last_active":"2024-09-14T11:53:59.798596+0000","last_peered":"2024-09-14T11:53:59.798596+0000","last_clean":"2024-09-14T11:53:59.798596+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:53:59.798596+0000","last_undegraded":"2024-09-14T11:53:59.798596+0000","last_fullsized":"2024-09-14T11:53:59.798596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:45.016880+0000","last_clean_scrub_stamp":"2024-09-14T11:13:45.016880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:42.599632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037656+0000","last_change":"2024-09-14T11:13:55.061443+0000","last_active":"2024-09-14T11:53:31.037656+0000","last_peered":"2024-09-14T11:53:31.037656+0000","last_clean":"2024-09-14T11:53:31.037656+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:53:31.037656+0000","last_undegraded":"2024-09-14T11:53:31.037656+0000","last_fullsized":"2024-09-14T11:53:31.037656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.405400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'341","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.645404+0000","last_change":"2024-09-14T11:14:38.194463+0000","last_active":"2024-09-14T11:56:15.645404+0000","last_peered":"2024-09-14T11:56:15.645404+0000","last_clean":"2024-09-14T11:56:15.645404+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:15.645404+0000","last_undegraded":"2024-09-14T11:56:15.645404+0000","last_fullsized":"2024-09-14T11:56:15.645404+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:55.622697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":748,"num_read_kb":7472,"num_write":1023,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.796289+0000","last_change":"2024-09-14T11:14:08.127046+0000","last_active":"2024-09-14T11:53:44.796289+0000","last_peered":"2024-09-14T11:53:44.796289+0000","last_clean":"2024-09-14T11:53:44.796289+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:53:44.796289+0000","last_undegraded":"2024-09-14T11:53:44.796289+0000","last_fullsized":"2024-09-14T11:53:44.796289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:28.320083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.067086+0000","last_change":"2024-09-14T11:14:10.150205+0000","last_active":"2024-09-14T11:56:15.067086+0000","last_peered":"2024-09-14T11:56:15.067086+0000","last_clean":"2024-09-14T11:56:15.067086+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:15.067086+0000","last_undegraded":"2024-09-14T11:56:15.067086+0000","last_fullsized":"2024-09-14T11:56:15.067086+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:59.627142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899257+0000","last_change":"2024-09-14T11:14:12.153336+0000","last_active":"2024-09-14T11:53:14.899257+0000","last_peered":"2024-09-14T11:53:14.899257+0000","last_clean":"2024-09-14T11:53:14.899257+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:53:14.899257+0000","last_undegraded":"2024-09-14T11:53:14.899257+0000","last_fullsized":"2024-09-14T11:53:14.899257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:44.740572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.171650+0000","last_change":"2024-09-14T11:14:14.160899+0000","last_active":"2024-09-14T11:54:27.171650+0000","last_peered":"2024-09-14T11:54:27.171650+0000","last_clean":"2024-09-14T11:54:27.171650+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:54:27.171650+0000","last_undegraded":"2024-09-14T11:54:27.171650+0000","last_fullsized":"2024-09-14T11:54:27.171650+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:04.990449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1362","reported_seq":3132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461598+0000","last_change":"2024-09-14T11:14:06.132529+0000","last_active":"2024-09-14T11:54:24.461598+0000","last_peered":"2024-09-14T11:54:24.461598+0000","last_clean":"2024-09-14T11:54:24.461598+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:54:24.461598+0000","last_undegraded":"2024-09-14T11:54:24.461598+0000","last_fullsized":"2024-09-14T11:54:24.461598+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:28.977740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.799455+0000","last_change":"2024-09-14T11:13:55.444087+0000","last_active":"2024-09-14T11:54:04.799455+0000","last_peered":"2024-09-14T11:54:04.799455+0000","last_clean":"2024-09-14T11:54:04.799455+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:54:04.799455+0000","last_undegraded":"2024-09-14T11:54:04.799455+0000","last_fullsized":"2024-09-14T11:54:04.799455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:50.328668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'362","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596481+0000","last_change":"2024-09-14T11:14:04.129263+0000","last_active":"2024-09-14T11:56:15.596481+0000","last_peered":"2024-09-14T11:56:15.596481+0000","last_clean":"2024-09-14T11:56:15.596481+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:15.596481+0000","last_undegraded":"2024-09-14T11:56:15.596481+0000","last_fullsized":"2024-09-14T11:56:15.596481+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:09.002526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029253,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":615,"num_read_kb":6150,"num_write":1149,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.034937+0000","last_change":"2024-09-14T11:14:08.132493+0000","last_active":"2024-09-14T11:53:11.034937+0000","last_peered":"2024-09-14T11:53:11.034937+0000","last_clean":"2024-09-14T11:53:11.034937+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:53:11.034937+0000","last_undegraded":"2024-09-14T11:53:11.034937+0000","last_fullsized":"2024-09-14T11:53:11.034937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:47.392912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1257","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.408704+0000","last_change":"2024-09-14T11:14:10.149170+0000","last_active":"2024-09-14T11:56:15.408704+0000","last_peered":"2024-09-14T11:56:15.408704+0000","last_clean":"2024-09-14T11:56:15.408704+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:15.408704+0000","last_undegraded":"2024-09-14T11:56:15.408704+0000","last_fullsized":"2024-09-14T11:56:15.408704+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:28.655782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1958,"num_read_kb":3608,"num_write":1054,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798697+0000","last_change":"2024-09-14T11:14:12.148579+0000","last_active":"2024-09-14T11:53:59.798697+0000","last_peered":"2024-09-14T11:53:59.798697+0000","last_clean":"2024-09-14T11:53:59.798697+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:53:59.798697+0000","last_undegraded":"2024-09-14T11:53:59.798697+0000","last_fullsized":"2024-09-14T11:53:59.798697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:34.551801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'132","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.544059+0000","last_change":"2024-09-14T11:14:14.146054+0000","last_active":"2024-09-14T11:54:26.544059+0000","last_peered":"2024-09-14T11:54:26.544059+0000","last_clean":"2024-09-14T11:54:26.544059+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:54:26.544059+0000","last_undegraded":"2024-09-14T11:54:26.544059+0000","last_fullsized":"2024-09-14T11:54:26.544059+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'782","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114491+0000","last_change":"2024-09-14T11:14:06.121305+0000","last_active":"2024-09-14T11:54:27.114491+0000","last_peered":"2024-09-14T11:54:27.114491+0000","last_clean":"2024-09-14T11:54:27.114491+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:54:27.114491+0000","last_undegraded":"2024-09-14T11:54:27.114491+0000","last_fullsized":"2024-09-14T11:54:27.114491+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:09.239590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.779410+0000","last_change":"2024-09-14T11:13:55.235478+0000","last_active":"2024-09-14T11:53:29.779410+0000","last_peered":"2024-09-14T11:53:29.779410+0000","last_clean":"2024-09-14T11:53:29.779410+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:53:29.779410+0000","last_undegraded":"2024-09-14T11:53:29.779410+0000","last_fullsized":"2024-09-14T11:53:29.779410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:17.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'342","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.423369+0000","last_change":"2024-09-14T11:14:04.124056+0000","last_active":"2024-09-14T11:56:15.423369+0000","last_peered":"2024-09-14T11:56:15.423369+0000","last_clean":"2024-09-14T11:56:15.423369+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:15.423369+0000","last_undegraded":"2024-09-14T11:56:15.423369+0000","last_fullsized":"2024-09-14T11:56:15.423369+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:04.512560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":72010,"num_write":1138,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.777365+0000","last_change":"2024-09-14T11:14:08.136300+0000","last_active":"2024-09-14T11:53:09.777365+0000","last_peered":"2024-09-14T11:53:09.777365+0000","last_clean":"2024-09-14T11:53:09.777365+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:53:09.777365+0000","last_undegraded":"2024-09-14T11:53:09.777365+0000","last_fullsized":"2024-09-14T11:53:09.777365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.813468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'251","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.881867+0000","last_change":"2024-09-14T11:14:10.150542+0000","last_active":"2024-09-14T11:55:42.881867+0000","last_peered":"2024-09-14T11:55:42.881867+0000","last_clean":"2024-09-14T11:55:42.881867+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:55:42.881867+0000","last_undegraded":"2024-09-14T11:55:42.881867+0000","last_fullsized":"2024-09-14T11:55:42.881867+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:40.011295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903323+0000","last_change":"2024-09-14T11:14:12.151445+0000","last_active":"2024-09-14T11:53:49.903323+0000","last_peered":"2024-09-14T11:53:49.903323+0000","last_clean":"2024-09-14T11:53:49.903323+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:53:49.903323+0000","last_undegraded":"2024-09-14T11:53:49.903323+0000","last_fullsized":"2024-09-14T11:53:49.903323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:44.622819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'267","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.261950+0000","last_change":"2024-09-14T11:14:14.160808+0000","last_active":"2024-09-14T11:54:27.261950+0000","last_peered":"2024-09-14T11:54:27.261950+0000","last_clean":"2024-09-14T11:54:27.261950+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:54:27.261950+0000","last_undegraded":"2024-09-14T11:54:27.261950+0000","last_fullsized":"2024-09-14T11:54:27.261950+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:19.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'430","reported_seq":2125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261834+0000","last_change":"2024-09-14T11:14:06.126970+0000","last_active":"2024-09-14T11:54:09.261834+0000","last_peered":"2024-09-14T11:54:09.261834+0000","last_clean":"2024-09-14T11:54:09.261834+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:54:09.261834+0000","last_undegraded":"2024-09-14T11:54:09.261834+0000","last_fullsized":"2024-09-14T11:54:09.261834+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.633196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.037624+0000","last_change":"2024-09-14T11:13:55.061980+0000","last_active":"2024-09-14T11:53:31.037624+0000","last_peered":"2024-09-14T11:53:31.037624+0000","last_clean":"2024-09-14T11:53:31.037624+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:53:31.037624+0000","last_undegraded":"2024-09-14T11:53:31.037624+0000","last_fullsized":"2024-09-14T11:53:31.037624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.193759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'323","reported_seq":1126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.525929+0000","last_change":"2024-09-14T11:14:38.192227+0000","last_active":"2024-09-14T11:56:15.525929+0000","last_peered":"2024-09-14T11:56:15.525929+0000","last_clean":"2024-09-14T11:56:15.525929+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:15.525929+0000","last_undegraded":"2024-09-14T11:56:15.525929+0000","last_fullsized":"2024-09-14T11:56:15.525929+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:28.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1238,"num_read_kb":7389,"num_write":1100,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903347+0000","last_change":"2024-09-14T11:14:08.128824+0000","last_active":"2024-09-14T11:53:49.903347+0000","last_peered":"2024-09-14T11:53:49.903347+0000","last_clean":"2024-09-14T11:53:49.903347+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:53:49.903347+0000","last_undegraded":"2024-09-14T11:53:49.903347+0000","last_fullsized":"2024-09-14T11:53:49.903347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:21.240092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914906+0000","last_change":"2024-09-14T11:14:10.153993+0000","last_active":"2024-09-14T11:55:19.914906+0000","last_peered":"2024-09-14T11:55:19.914906+0000","last_clean":"2024-09-14T11:55:19.914906+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:55:19.914906+0000","last_undegraded":"2024-09-14T11:55:19.914906+0000","last_fullsized":"2024-09-14T11:55:19.914906+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:30.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786573+0000","last_change":"2024-09-14T11:14:12.155597+0000","last_active":"2024-09-14T11:53:15.786573+0000","last_peered":"2024-09-14T11:53:15.786573+0000","last_clean":"2024-09-14T11:53:15.786573+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:53:15.786573+0000","last_undegraded":"2024-09-14T11:53:15.786573+0000","last_fullsized":"2024-09-14T11:53:15.786573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:57.628565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.459335+0000","last_change":"2024-09-14T11:14:14.159918+0000","last_active":"2024-09-14T11:54:24.459335+0000","last_peered":"2024-09-14T11:54:24.459335+0000","last_clean":"2024-09-14T11:54:24.459335+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:54:24.459335+0000","last_undegraded":"2024-09-14T11:54:24.459335+0000","last_fullsized":"2024-09-14T11:54:24.459335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'456","reported_seq":2014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540230+0000","last_change":"2024-09-14T11:14:06.123387+0000","last_active":"2024-09-14T11:54:04.540230+0000","last_peered":"2024-09-14T11:54:04.540230+0000","last_clean":"2024-09-14T11:54:04.540230+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:54:04.540230+0000","last_undegraded":"2024-09-14T11:54:04.540230+0000","last_fullsized":"2024-09-14T11:54:04.540230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.573555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.596601+0000","last_change":"2024-09-14T11:14:04.122373+0000","last_active":"2024-09-14T11:56:15.596601+0000","last_peered":"2024-09-14T11:56:15.596601+0000","last_clean":"2024-09-14T11:56:15.596601+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:15.596601+0000","last_undegraded":"2024-09-14T11:56:15.596601+0000","last_fullsized":"2024-09-14T11:56:15.596601+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.435958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.900264+0000","last_change":"2024-09-14T11:13:55.056584+0000","last_active":"2024-09-14T11:53:29.900264+0000","last_peered":"2024-09-14T11:53:29.900264+0000","last_clean":"2024-09-14T11:53:29.900264+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:53:29.900264+0000","last_undegraded":"2024-09-14T11:53:29.900264+0000","last_fullsized":"2024-09-14T11:53:29.900264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:16.582761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902721+0000","last_change":"2024-09-14T11:14:08.133183+0000","last_active":"2024-09-14T11:53:44.902721+0000","last_peered":"2024-09-14T11:53:44.902721+0000","last_clean":"2024-09-14T11:53:44.902721+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:53:44.902721+0000","last_undegraded":"2024-09-14T11:53:44.902721+0000","last_fullsized":"2024-09-14T11:53:44.902721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:59.309932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'539","reported_seq":1197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.129709+0000","last_change":"2024-09-14T11:14:10.149213+0000","last_active":"2024-09-14T11:56:15.129709+0000","last_peered":"2024-09-14T11:56:15.129709+0000","last_clean":"2024-09-14T11:56:15.129709+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:15.129709+0000","last_undegraded":"2024-09-14T11:56:15.129709+0000","last_fullsized":"2024-09-14T11:56:15.129709+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:41.451954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":943,"num_read_kb":2151,"num_write":772,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791397+0000","last_change":"2024-09-14T11:14:12.151179+0000","last_active":"2024-09-14T11:53:50.791397+0000","last_peered":"2024-09-14T11:53:50.791397+0000","last_clean":"2024-09-14T11:53:50.791397+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:53:50.791397+0000","last_undegraded":"2024-09-14T11:53:50.791397+0000","last_fullsized":"2024-09-14T11:53:50.791397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:00.606325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'163","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.780862+0000","last_change":"2024-09-14T11:14:14.155856+0000","last_active":"2024-09-14T11:54:07.780862+0000","last_peered":"2024-09-14T11:54:07.780862+0000","last_clean":"2024-09-14T11:54:07.780862+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:54:07.780862+0000","last_undegraded":"2024-09-14T11:54:07.780862+0000","last_fullsized":"2024-09-14T11:54:07.780862+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:06.203953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'751","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462007+0000","last_change":"2024-09-14T11:14:06.133092+0000","last_active":"2024-09-14T11:54:24.462007+0000","last_peered":"2024-09-14T11:54:24.462007+0000","last_clean":"2024-09-14T11:54:24.462007+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:54:24.462007+0000","last_undegraded":"2024-09-14T11:54:24.462007+0000","last_fullsized":"2024-09-14T11:54:24.462007+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:34.029629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'346","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.550092+0000","last_change":"2024-09-14T11:14:04.126657+0000","last_active":"2024-09-14T11:56:15.550092+0000","last_peered":"2024-09-14T11:56:15.550092+0000","last_clean":"2024-09-14T11:56:15.550092+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:15.550092+0000","last_undegraded":"2024-09-14T11:56:15.550092+0000","last_fullsized":"2024-09-14T11:56:15.550092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.821826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":25654,"num_write":1001,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795376+0000","last_change":"2024-09-14T11:13:55.444042+0000","last_active":"2024-09-14T11:53:39.795376+0000","last_peered":"2024-09-14T11:53:39.795376+0000","last_clean":"2024-09-14T11:53:39.795376+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:53:39.795376+0000","last_undegraded":"2024-09-14T11:53:39.795376+0000","last_fullsized":"2024-09-14T11:53:39.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:57.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790686+0000","last_change":"2024-09-14T11:14:08.130246+0000","last_active":"2024-09-14T11:53:45.790686+0000","last_peered":"2024-09-14T11:53:45.790686+0000","last_clean":"2024-09-14T11:53:45.790686+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:53:45.790686+0000","last_undegraded":"2024-09-14T11:53:45.790686+0000","last_fullsized":"2024-09-14T11:53:45.790686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:01.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.533448+0000","last_change":"2024-09-14T11:14:10.139669+0000","last_active":"2024-09-14T11:54:47.533448+0000","last_peered":"2024-09-14T11:54:47.533448+0000","last_clean":"2024-09-14T11:54:47.533448+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:54:47.533448+0000","last_undegraded":"2024-09-14T11:54:47.533448+0000","last_fullsized":"2024-09-14T11:54:47.533448+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:53.709411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'810","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.658795+0000","last_change":"2024-09-14T11:14:12.147417+0000","last_active":"2024-09-14T11:56:15.658795+0000","last_peered":"2024-09-14T11:56:15.658795+0000","last_clean":"2024-09-14T11:56:15.658795+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:15.658795+0000","last_undegraded":"2024-09-14T11:56:15.658795+0000","last_fullsized":"2024-09-14T11:56:15.658795+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.126531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'93","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.910691+0000","last_change":"2024-09-14T11:14:14.157125+0000","last_active":"2024-09-14T11:54:49.910691+0000","last_peered":"2024-09-14T11:54:49.910691+0000","last_clean":"2024-09-14T11:54:49.910691+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:54:49.910691+0000","last_undegraded":"2024-09-14T11:54:49.910691+0000","last_fullsized":"2024-09-14T11:54:49.910691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:21.815471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'359","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906023+0000","last_change":"2024-09-14T11:14:06.125720+0000","last_active":"2024-09-14T11:54:14.906023+0000","last_peered":"2024-09-14T11:54:14.906023+0000","last_clean":"2024-09-14T11:54:14.906023+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:54:14.906023+0000","last_undegraded":"2024-09-14T11:54:14.906023+0000","last_fullsized":"2024-09-14T11:54:14.906023+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:46.137614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'336","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633063+0000","last_change":"2024-09-14T11:14:38.192877+0000","last_active":"2024-09-14T11:56:15.633063+0000","last_peered":"2024-09-14T11:56:15.633063+0000","last_clean":"2024-09-14T11:56:15.633063+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:15.633063+0000","last_undegraded":"2024-09-14T11:56:15.633063+0000","last_fullsized":"2024-09-14T11:56:15.633063+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:30.960755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":1407,"num_write":989,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895813+0000","last_change":"2024-09-14T11:13:55.056703+0000","last_active":"2024-09-14T11:52:54.895813+0000","last_peered":"2024-09-14T11:52:54.895813+0000","last_clean":"2024-09-14T11:52:54.895813+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:52:54.895813+0000","last_undegraded":"2024-09-14T11:52:54.895813+0000","last_fullsized":"2024-09-14T11:52:54.895813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:18.548308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790665+0000","last_change":"2024-09-14T11:14:08.135691+0000","last_active":"2024-09-14T11:53:45.790665+0000","last_peered":"2024-09-14T11:53:45.790665+0000","last_clean":"2024-09-14T11:53:45.790665+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:53:45.790665+0000","last_undegraded":"2024-09-14T11:53:45.790665+0000","last_fullsized":"2024-09-14T11:53:45.790665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:47.242553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'99","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.842534+0000","last_change":"2024-09-14T11:14:10.151595+0000","last_active":"2024-09-14T11:54:18.842534+0000","last_peered":"2024-09-14T11:54:18.842534+0000","last_clean":"2024-09-14T11:54:18.842534+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:54:18.842534+0000","last_undegraded":"2024-09-14T11:54:18.842534+0000","last_fullsized":"2024-09-14T11:54:18.842534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:13.188765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'790","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.622789+0000","last_change":"2024-09-14T11:14:12.153305+0000","last_active":"2024-09-14T11:56:15.622789+0000","last_peered":"2024-09-14T11:56:15.622789+0000","last_clean":"2024-09-14T11:56:15.622789+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:15.622789+0000","last_undegraded":"2024-09-14T11:56:15.622789+0000","last_fullsized":"2024-09-14T11:56:15.622789+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:43.896569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'327","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573474+0000","last_change":"2024-09-14T11:14:14.156952+0000","last_active":"2024-09-14T11:55:41.573474+0000","last_peered":"2024-09-14T11:55:41.573474+0000","last_clean":"2024-09-14T11:55:41.573474+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:55:41.573474+0000","last_undegraded":"2024-09-14T11:55:41.573474+0000","last_fullsized":"2024-09-14T11:55:41.573474+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:32.686915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1137","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546620+0000","last_change":"2024-09-14T11:14:06.126733+0000","last_active":"2024-09-14T11:54:26.546620+0000","last_peered":"2024-09-14T11:54:26.546620+0000","last_clean":"2024-09-14T11:54:26.546620+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:54:26.546620+0000","last_undegraded":"2024-09-14T11:54:26.546620+0000","last_fullsized":"2024-09-14T11:54:26.546620+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:23.487750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'384","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.624391+0000","last_change":"2024-09-14T11:14:04.122866+0000","last_active":"2024-09-14T11:56:15.624391+0000","last_peered":"2024-09-14T11:56:15.624391+0000","last_clean":"2024-09-14T11:56:15.624391+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:15.624391+0000","last_undegraded":"2024-09-14T11:56:15.624391+0000","last_fullsized":"2024-09-14T11:56:15.624391+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:50.491022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":7233,"num_write":1301,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783429+0000","last_change":"2024-09-14T11:13:55.443870+0000","last_active":"2024-09-14T11:52:55.783429+0000","last_peered":"2024-09-14T11:52:55.783429+0000","last_clean":"2024-09-14T11:52:55.783429+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:52:55.783429+0000","last_undegraded":"2024-09-14T11:52:55.783429+0000","last_fullsized":"2024-09-14T11:52:55.783429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:13:52.032855+0000","last_clean_scrub_stamp":"2024-09-14T11:13:52.032855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:39.836436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.905998+0000","last_change":"2024-09-14T11:14:08.133929+0000","last_active":"2024-09-14T11:54:14.905998+0000","last_peered":"2024-09-14T11:54:14.905998+0000","last_clean":"2024-09-14T11:54:14.905998+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:54:14.905998+0000","last_undegraded":"2024-09-14T11:54:14.905998+0000","last_fullsized":"2024-09-14T11:54:14.905998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.740629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'761","reported_seq":1466,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.475935+0000","last_change":"2024-09-14T11:14:10.152020+0000","last_active":"2024-09-14T11:56:15.475935+0000","last_peered":"2024-09-14T11:56:15.475935+0000","last_clean":"2024-09-14T11:56:15.475935+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:15.475935+0000","last_undegraded":"2024-09-14T11:56:15.475935+0000","last_fullsized":"2024-09-14T11:56:15.475935+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:50.734251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1362,"num_read_kb":3256,"num_write":1124,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903071+0000","last_change":"2024-09-14T11:14:12.151322+0000","last_active":"2024-09-14T11:53:49.903071+0000","last_peered":"2024-09-14T11:53:49.903071+0000","last_clean":"2024-09-14T11:53:49.903071+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:53:49.903071+0000","last_undegraded":"2024-09-14T11:53:49.903071+0000","last_fullsized":"2024-09-14T11:53:49.903071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:55.159584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.544659+0000","last_change":"2024-09-14T11:14:14.164267+0000","last_active":"2024-09-14T11:54:08.544659+0000","last_peered":"2024-09-14T11:54:08.544659+0000","last_clean":"2024-09-14T11:54:08.544659+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:54:08.544659+0000","last_undegraded":"2024-09-14T11:54:08.544659+0000","last_fullsized":"2024-09-14T11:54:08.544659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:05.688641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'143","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.219226+0000","last_change":"2024-09-14T11:14:14.160222+0000","last_active":"2024-09-14T11:54:27.219226+0000","last_peered":"2024-09-14T11:54:27.219226+0000","last_clean":"2024-09-14T11:54:27.219226+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:54:27.219226+0000","last_undegraded":"2024-09-14T11:54:27.219226+0000","last_fullsized":"2024-09-14T11:54:27.219226+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:30.394037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'430","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783769+0000","last_change":"2024-09-14T11:14:06.128783+0000","last_active":"2024-09-14T11:54:07.783769+0000","last_peered":"2024-09-14T11:54:07.783769+0000","last_clean":"2024-09-14T11:54:07.783769+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:54:07.783769+0000","last_undegraded":"2024-09-14T11:54:07.783769+0000","last_fullsized":"2024-09-14T11:54:07.783769+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:11.200312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633344+0000","last_change":"2024-09-14T11:14:04.130995+0000","last_active":"2024-09-14T11:56:15.633344+0000","last_peered":"2024-09-14T11:56:15.633344+0000","last_clean":"2024-09-14T11:56:15.633344+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:15.633344+0000","last_undegraded":"2024-09-14T11:56:15.633344+0000","last_fullsized":"2024-09-14T11:56:15.633344+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:00.303178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.713330+0000","last_change":"2024-09-14T11:14:08.137606+0000","last_active":"2024-09-14T11:56:13.713330+0000","last_peered":"2024-09-14T11:56:13.713330+0000","last_clean":"2024-09-14T11:56:13.713330+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:13.713330+0000","last_undegraded":"2024-09-14T11:56:13.713330+0000","last_fullsized":"2024-09-14T11:56:13.713330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.107289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'263","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.676370+0000","last_change":"2024-09-14T11:14:10.149828+0000","last_active":"2024-09-14T11:56:14.676370+0000","last_peered":"2024-09-14T11:56:14.676370+0000","last_clean":"2024-09-14T11:56:14.676370+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:14.676370+0000","last_undegraded":"2024-09-14T11:56:14.676370+0000","last_fullsized":"2024-09-14T11:56:14.676370+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.820903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903614+0000","last_change":"2024-09-14T11:14:12.152653+0000","last_active":"2024-09-14T11:53:54.903614+0000","last_peered":"2024-09-14T11:53:54.903614+0000","last_clean":"2024-09-14T11:53:54.903614+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:53:54.903614+0000","last_undegraded":"2024-09-14T11:53:54.903614+0000","last_fullsized":"2024-09-14T11:53:54.903614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:35.385522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.111496+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:27.111496+0000","last_peered":"2024-09-14T11:54:27.111496+0000","last_clean":"2024-09-14T11:54:27.111496+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:27.111496+0000","last_undegraded":"2024-09-14T11:54:27.111496+0000","last_fullsized":"2024-09-14T11:54:27.111496+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'780","reported_seq":2399,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262003+0000","last_change":"2024-09-14T11:14:06.131159+0000","last_active":"2024-09-14T11:54:09.262003+0000","last_peered":"2024-09-14T11:54:09.262003+0000","last_clean":"2024-09-14T11:54:09.262003+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:54:09.262003+0000","last_undegraded":"2024-09-14T11:54:09.262003+0000","last_fullsized":"2024-09-14T11:54:09.262003+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:12.994438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'373","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.514472+0000","last_change":"2024-09-14T11:14:04.136243+0000","last_active":"2024-09-14T11:56:15.514472+0000","last_peered":"2024-09-14T11:56:15.514472+0000","last_clean":"2024-09-14T11:56:15.514472+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:15.514472+0000","last_undegraded":"2024-09-14T11:56:15.514472+0000","last_fullsized":"2024-09-14T11:56:15.514472+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:43.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":24187,"num_write":1164,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903109+0000","last_change":"2024-09-14T11:14:08.132760+0000","last_active":"2024-09-14T11:53:49.903109+0000","last_peered":"2024-09-14T11:53:49.903109+0000","last_clean":"2024-09-14T11:53:49.903109+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:53:49.903109+0000","last_undegraded":"2024-09-14T11:53:49.903109+0000","last_fullsized":"2024-09-14T11:53:49.903109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.260856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'48","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.684887+0000","last_change":"2024-09-14T11:14:10.148065+0000","last_active":"2024-09-14T11:54:18.684887+0000","last_peered":"2024-09-14T11:54:18.684887+0000","last_clean":"2024-09-14T11:54:18.684887+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:54:18.684887+0000","last_undegraded":"2024-09-14T11:54:18.684887+0000","last_fullsized":"2024-09-14T11:54:18.684887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:38.290868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797903+0000","last_change":"2024-09-14T11:14:12.150881+0000","last_active":"2024-09-14T11:53:54.797903+0000","last_peered":"2024-09-14T11:53:54.797903+0000","last_clean":"2024-09-14T11:53:54.797903+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:53:54.797903+0000","last_undegraded":"2024-09-14T11:53:54.797903+0000","last_fullsized":"2024-09-14T11:53:54.797903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:58.272068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'218","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.536299+0000","last_change":"2024-09-14T11:14:14.153783+0000","last_active":"2024-09-14T11:54:26.536299+0000","last_peered":"2024-09-14T11:54:26.536299+0000","last_clean":"2024-09-14T11:54:26.536299+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:54:26.536299+0000","last_undegraded":"2024-09-14T11:54:26.536299+0000","last_fullsized":"2024-09-14T11:54:26.536299+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:47.004373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'913","reported_seq":2649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.628932+0000","last_change":"2024-09-14T11:14:06.125324+0000","last_active":"2024-09-14T11:55:41.628932+0000","last_peered":"2024-09-14T11:55:41.628932+0000","last_clean":"2024-09-14T11:55:41.628932+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:55:41.628932+0000","last_undegraded":"2024-09-14T11:55:41.628932+0000","last_fullsized":"2024-09-14T11:55:41.628932+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:01.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.616179+0000","last_change":"2024-09-14T11:14:04.125695+0000","last_active":"2024-09-14T11:56:15.616179+0000","last_peered":"2024-09-14T11:56:15.616179+0000","last_clean":"2024-09-14T11:56:15.616179+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:15.616179+0000","last_undegraded":"2024-09-14T11:56:15.616179+0000","last_fullsized":"2024-09-14T11:56:15.616179+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:38.353380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.796955+0000","last_change":"2024-09-14T11:14:08.136483+0000","last_active":"2024-09-14T11:53:49.796955+0000","last_peered":"2024-09-14T11:53:49.796955+0000","last_clean":"2024-09-14T11:53:49.796955+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:53:49.796955+0000","last_undegraded":"2024-09-14T11:53:49.796955+0000","last_fullsized":"2024-09-14T11:53:49.796955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:28.874481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.055458+0000","last_change":"2024-09-14T11:14:10.151225+0000","last_active":"2024-09-14T11:56:14.055458+0000","last_peered":"2024-09-14T11:56:14.055458+0000","last_clean":"2024-09-14T11:56:14.055458+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:14.055458+0000","last_undegraded":"2024-09-14T11:56:14.055458+0000","last_fullsized":"2024-09-14T11:56:14.055458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:07.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792203+0000","last_change":"2024-09-14T11:14:12.152706+0000","last_active":"2024-09-14T11:53:55.792203+0000","last_peered":"2024-09-14T11:53:55.792203+0000","last_clean":"2024-09-14T11:53:55.792203+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:53:55.792203+0000","last_undegraded":"2024-09-14T11:53:55.792203+0000","last_fullsized":"2024-09-14T11:53:55.792203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:02.677520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'129","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.902922+0000","last_change":"2024-09-14T11:14:14.163359+0000","last_active":"2024-09-14T11:54:26.902922+0000","last_peered":"2024-09-14T11:54:26.902922+0000","last_clean":"2024-09-14T11:54:26.902922+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:54:26.902922+0000","last_undegraded":"2024-09-14T11:54:26.902922+0000","last_fullsized":"2024-09-14T11:54:26.902922+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'564","reported_seq":2291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629178+0000","last_change":"2024-09-14T11:14:06.114979+0000","last_active":"2024-09-14T11:55:41.629178+0000","last_peered":"2024-09-14T11:55:41.629178+0000","last_clean":"2024-09-14T11:55:41.629178+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:55:41.629178+0000","last_undegraded":"2024-09-14T11:55:41.629178+0000","last_fullsized":"2024-09-14T11:55:41.629178+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:34.196492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.641913+0000","last_change":"2024-09-14T11:14:04.123707+0000","last_active":"2024-09-14T11:56:15.641913+0000","last_peered":"2024-09-14T11:56:15.641913+0000","last_clean":"2024-09-14T11:56:15.641913+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:15.641913+0000","last_undegraded":"2024-09-14T11:56:15.641913+0000","last_fullsized":"2024-09-14T11:56:15.641913+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:47.655600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":715,"num_read_kb":20814,"num_write":1368,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791400+0000","last_change":"2024-09-14T11:14:08.138146+0000","last_active":"2024-09-14T11:53:50.791400+0000","last_peered":"2024-09-14T11:53:50.791400+0000","last_clean":"2024-09-14T11:53:50.791400+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:53:50.791400+0000","last_undegraded":"2024-09-14T11:53:50.791400+0000","last_fullsized":"2024-09-14T11:53:50.791400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.928629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'266","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.855796+0000","last_change":"2024-09-14T11:14:10.151325+0000","last_active":"2024-09-14T11:56:13.855796+0000","last_peered":"2024-09-14T11:56:13.855796+0000","last_clean":"2024-09-14T11:56:13.855796+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:13.855796+0000","last_undegraded":"2024-09-14T11:56:13.855796+0000","last_fullsized":"2024-09-14T11:56:13.855796+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:32.211592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903894+0000","last_change":"2024-09-14T11:14:12.154497+0000","last_active":"2024-09-14T11:53:54.903894+0000","last_peered":"2024-09-14T11:53:54.903894+0000","last_clean":"2024-09-14T11:53:54.903894+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:53:54.903894+0000","last_undegraded":"2024-09-14T11:53:54.903894+0000","last_fullsized":"2024-09-14T11:53:54.903894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:27.388051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114150+0000","last_change":"2024-09-14T11:14:06.128364+0000","last_active":"2024-09-14T11:54:27.114150+0000","last_peered":"2024-09-14T11:54:27.114150+0000","last_clean":"2024-09-14T11:54:27.114150+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:54:27.114150+0000","last_undegraded":"2024-09-14T11:54:27.114150+0000","last_fullsized":"2024-09-14T11:54:27.114150+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.420636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.559564+0000","last_change":"2024-09-14T11:14:04.124479+0000","last_active":"2024-09-14T11:56:15.559564+0000","last_peered":"2024-09-14T11:56:15.559564+0000","last_clean":"2024-09-14T11:56:15.559564+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:15.559564+0000","last_undegraded":"2024-09-14T11:56:15.559564+0000","last_fullsized":"2024-09-14T11:56:15.559564+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:07.746886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":1976,"num_write":1075,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906070+0000","last_change":"2024-09-14T11:14:08.125925+0000","last_active":"2024-09-14T11:54:14.906070+0000","last_peered":"2024-09-14T11:54:14.906070+0000","last_clean":"2024-09-14T11:54:14.906070+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:54:14.906070+0000","last_undegraded":"2024-09-14T11:54:14.906070+0000","last_fullsized":"2024-09-14T11:54:14.906070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:37.664162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'493","reported_seq":1119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.653964+0000","last_change":"2024-09-14T11:14:10.149612+0000","last_active":"2024-09-14T11:56:15.653964+0000","last_peered":"2024-09-14T11:56:15.653964+0000","last_clean":"2024-09-14T11:56:15.653964+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:15.653964+0000","last_undegraded":"2024-09-14T11:56:15.653964+0000","last_fullsized":"2024-09-14T11:56:15.653964+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:51.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100440,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2109,"num_write":762,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022383+0000","last_change":"2024-09-14T11:14:12.152526+0000","last_active":"2024-09-14T11:51:46.022383+0000","last_peered":"2024-09-14T11:51:46.022383+0000","last_clean":"2024-09-14T11:51:46.022383+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:51:46.022383+0000","last_undegraded":"2024-09-14T11:51:46.022383+0000","last_fullsized":"2024-09-14T11:51:46.022383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.316198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.457622+0000","last_change":"2024-09-14T11:14:14.153440+0000","last_active":"2024-09-14T11:54:24.457622+0000","last_peered":"2024-09-14T11:54:24.457622+0000","last_clean":"2024-09-14T11:54:24.457622+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:54:24.457622+0000","last_undegraded":"2024-09-14T11:54:24.457622+0000","last_fullsized":"2024-09-14T11:54:24.457622+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.457388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'412","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.629660+0000","last_change":"2024-09-14T11:14:06.133265+0000","last_active":"2024-09-14T11:55:41.629660+0000","last_peered":"2024-09-14T11:55:41.629660+0000","last_clean":"2024-09-14T11:55:41.629660+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:55:41.629660+0000","last_undegraded":"2024-09-14T11:55:41.629660+0000","last_fullsized":"2024-09-14T11:55:41.629660+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:39.380862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'351","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.607097+0000","last_change":"2024-09-14T11:14:04.120305+0000","last_active":"2024-09-14T11:56:15.607097+0000","last_peered":"2024-09-14T11:56:15.607097+0000","last_clean":"2024-09-14T11:56:15.607097+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:15.607097+0000","last_undegraded":"2024-09-14T11:56:15.607097+0000","last_fullsized":"2024-09-14T11:56:15.607097+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:30.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":10770,"num_write":1202,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790754+0000","last_change":"2024-09-14T11:14:08.136472+0000","last_active":"2024-09-14T11:53:45.790754+0000","last_peered":"2024-09-14T11:53:45.790754+0000","last_clean":"2024-09-14T11:53:45.790754+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:53:45.790754+0000","last_undegraded":"2024-09-14T11:53:45.790754+0000","last_fullsized":"2024-09-14T11:53:45.790754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:13.023971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.930797+0000","last_change":"2024-09-14T11:14:10.152603+0000","last_active":"2024-09-14T11:56:13.930797+0000","last_peered":"2024-09-14T11:56:13.930797+0000","last_clean":"2024-09-14T11:56:13.930797+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:13.930797+0000","last_undegraded":"2024-09-14T11:56:13.930797+0000","last_fullsized":"2024-09-14T11:56:13.930797+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:04.752732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.887234+0000","last_change":"2024-09-14T11:14:12.153956+0000","last_active":"2024-09-14T11:51:44.887234+0000","last_peered":"2024-09-14T11:51:44.887234+0000","last_clean":"2024-09-14T11:51:44.887234+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:51:44.887234+0000","last_undegraded":"2024-09-14T11:51:44.887234+0000","last_fullsized":"2024-09-14T11:51:44.887234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:06.820196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'231","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.069083+0000","last_change":"2024-09-14T11:14:14.159808+0000","last_active":"2024-09-14T11:54:25.069083+0000","last_peered":"2024-09-14T11:54:25.069083+0000","last_clean":"2024-09-14T11:54:25.069083+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:54:25.069083+0000","last_undegraded":"2024-09-14T11:54:25.069083+0000","last_fullsized":"2024-09-14T11:54:25.069083+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:54.636606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'495","reported_seq":2082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622438+0000","last_change":"2024-09-14T11:14:06.115825+0000","last_active":"2024-09-14T11:55:41.622438+0000","last_peered":"2024-09-14T11:55:41.622438+0000","last_clean":"2024-09-14T11:55:41.622438+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:55:41.622438+0000","last_undegraded":"2024-09-14T11:55:41.622438+0000","last_fullsized":"2024-09-14T11:55:41.622438+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:59.337368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.619156+0000","last_change":"2024-09-14T11:14:04.123750+0000","last_active":"2024-09-14T11:56:15.619156+0000","last_peered":"2024-09-14T11:56:15.619156+0000","last_clean":"2024-09-14T11:56:15.619156+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:15.619156+0000","last_undegraded":"2024-09-14T11:56:15.619156+0000","last_fullsized":"2024-09-14T11:56:15.619156+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:35.861181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:40.774310+0000","last_change":"2024-09-14T11:14:08.137009+0000","last_active":"2024-09-14T11:51:40.774310+0000","last_peered":"2024-09-14T11:51:40.774310+0000","last_clean":"2024-09-14T11:51:40.774310+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:51:40.774310+0000","last_undegraded":"2024-09-14T11:51:40.774310+0000","last_fullsized":"2024-09-14T11:51:40.774310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:14.777442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'292","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.905574+0000","last_change":"2024-09-14T11:14:10.154505+0000","last_active":"2024-09-14T11:56:14.905574+0000","last_peered":"2024-09-14T11:56:14.905574+0000","last_clean":"2024-09-14T11:56:14.905574+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:14.905574+0000","last_undegraded":"2024-09-14T11:56:14.905574+0000","last_fullsized":"2024-09-14T11:56:14.905574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.388017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906262+0000","last_change":"2024-09-14T11:14:12.149836+0000","last_active":"2024-09-14T11:54:19.906262+0000","last_peered":"2024-09-14T11:54:19.906262+0000","last_clean":"2024-09-14T11:54:19.906262+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:54:19.906262+0000","last_undegraded":"2024-09-14T11:54:19.906262+0000","last_fullsized":"2024-09-14T11:54:19.906262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:32.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'144","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.744952+0000","last_change":"2024-09-14T11:14:14.162000+0000","last_active":"2024-09-14T11:55:42.744952+0000","last_peered":"2024-09-14T11:55:42.744952+0000","last_clean":"2024-09-14T11:55:42.744952+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:55:42.744952+0000","last_undegraded":"2024-09-14T11:55:42.744952+0000","last_fullsized":"2024-09-14T11:55:42.744952+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'419","reported_seq":2018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.546724+0000","last_change":"2024-09-14T11:14:06.123837+0000","last_active":"2024-09-14T11:54:08.546724+0000","last_peered":"2024-09-14T11:54:08.546724+0000","last_clean":"2024-09-14T11:54:08.546724+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:54:08.546724+0000","last_undegraded":"2024-09-14T11:54:08.546724+0000","last_fullsized":"2024-09-14T11:54:08.546724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:37.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.640268+0000","last_change":"2024-09-14T11:14:04.131548+0000","last_active":"2024-09-14T11:56:15.640268+0000","last_peered":"2024-09-14T11:56:15.640268+0000","last_clean":"2024-09-14T11:56:15.640268+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:15.640268+0000","last_undegraded":"2024-09-14T11:56:15.640268+0000","last_fullsized":"2024-09-14T11:56:15.640268+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.843269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":46735,"num_write":1109,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.886602+0000","last_change":"2024-09-14T11:14:08.137590+0000","last_active":"2024-09-14T11:51:39.886602+0000","last_peered":"2024-09-14T11:51:39.886602+0000","last_clean":"2024-09-14T11:51:39.886602+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:51:39.886602+0000","last_undegraded":"2024-09-14T11:51:39.886602+0000","last_fullsized":"2024-09-14T11:51:39.886602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:47.658963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'81","reported_seq":594,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.796147+0000","last_change":"2024-09-14T11:14:10.148590+0000","last_active":"2024-09-14T11:54:20.796147+0000","last_peered":"2024-09-14T11:54:20.796147+0000","last_clean":"2024-09-14T11:54:20.796147+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:54:20.796147+0000","last_undegraded":"2024-09-14T11:54:20.796147+0000","last_fullsized":"2024-09-14T11:54:20.796147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:10.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.741161+0000","last_change":"2024-09-14T11:14:12.152664+0000","last_active":"2024-09-14T11:56:13.741161+0000","last_peered":"2024-09-14T11:56:13.741161+0000","last_clean":"2024-09-14T11:56:13.741161+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:13.741161+0000","last_undegraded":"2024-09-14T11:56:13.741161+0000","last_fullsized":"2024-09-14T11:56:13.741161+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:48.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":602,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.739702+0000","last_change":"2024-09-14T11:14:14.162036+0000","last_active":"2024-09-14T11:55:42.739702+0000","last_peered":"2024-09-14T11:55:42.739702+0000","last_clean":"2024-09-14T11:55:42.739702+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:55:42.739702+0000","last_undegraded":"2024-09-14T11:55:42.739702+0000","last_fullsized":"2024-09-14T11:55:42.739702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.951880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'913","reported_seq":2468,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.622796+0000","last_change":"2024-09-14T11:14:06.120190+0000","last_active":"2024-09-14T11:55:41.622796+0000","last_peered":"2024-09-14T11:55:41.622796+0000","last_clean":"2024-09-14T11:55:41.622796+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:55:41.622796+0000","last_undegraded":"2024-09-14T11:55:41.622796+0000","last_fullsized":"2024-09-14T11:55:41.622796+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:35.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633326+0000","last_change":"2024-09-14T11:14:04.123412+0000","last_active":"2024-09-14T11:56:15.633326+0000","last_peered":"2024-09-14T11:56:15.633326+0000","last_clean":"2024-09-14T11:56:15.633326+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:15.633326+0000","last_undegraded":"2024-09-14T11:56:15.633326+0000","last_fullsized":"2024-09-14T11:56:15.633326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.337185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.774628+0000","last_change":"2024-09-14T11:14:08.138426+0000","last_active":"2024-09-14T11:51:39.774628+0000","last_peered":"2024-09-14T11:51:39.774628+0000","last_clean":"2024-09-14T11:51:39.774628+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:51:39.774628+0000","last_undegraded":"2024-09-14T11:51:39.774628+0000","last_fullsized":"2024-09-14T11:51:39.774628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:56.436534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'298","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.242404+0000","last_change":"2024-09-14T11:14:10.149256+0000","last_active":"2024-09-14T11:56:15.242404+0000","last_peered":"2024-09-14T11:56:15.242404+0000","last_clean":"2024-09-14T11:56:15.242404+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:15.242404+0000","last_undegraded":"2024-09-14T11:56:15.242404+0000","last_fullsized":"2024-09-14T11:56:15.242404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:47.592442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896607+0000","last_change":"2024-09-14T11:14:12.150595+0000","last_active":"2024-09-14T11:52:54.896607+0000","last_peered":"2024-09-14T11:52:54.896607+0000","last_clean":"2024-09-14T11:52:54.896607+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:52:54.896607+0000","last_undegraded":"2024-09-14T11:52:54.896607+0000","last_fullsized":"2024-09-14T11:52:54.896607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:47.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.835967+0000","last_change":"2024-09-14T11:14:14.159475+0000","last_active":"2024-09-14T11:53:58.835967+0000","last_peered":"2024-09-14T11:53:58.835967+0000","last_clean":"2024-09-14T11:53:58.835967+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:53:58.835967+0000","last_undegraded":"2024-09-14T11:53:58.835967+0000","last_fullsized":"2024-09-14T11:53:58.835967+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:45.105897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.456474+0000","last_change":"2024-09-14T11:14:06.120205+0000","last_active":"2024-09-14T11:54:24.456474+0000","last_peered":"2024-09-14T11:54:24.456474+0000","last_clean":"2024-09-14T11:54:24.456474+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:54:24.456474+0000","last_undegraded":"2024-09-14T11:54:24.456474+0000","last_fullsized":"2024-09-14T11:54:24.456474+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:27.253321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.606584+0000","last_change":"2024-09-14T11:14:04.127561+0000","last_active":"2024-09-14T11:56:15.606584+0000","last_peered":"2024-09-14T11:56:15.606584+0000","last_clean":"2024-09-14T11:56:15.606584+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:15.606584+0000","last_undegraded":"2024-09-14T11:56:15.606584+0000","last_fullsized":"2024-09-14T11:56:15.606584+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:28.538642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.021483+0000","last_change":"2024-09-14T11:14:08.133404+0000","last_active":"2024-09-14T11:51:41.021483+0000","last_peered":"2024-09-14T11:51:41.021483+0000","last_clean":"2024-09-14T11:51:41.021483+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:51:41.021483+0000","last_undegraded":"2024-09-14T11:51:41.021483+0000","last_fullsized":"2024-09-14T11:51:41.021483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:49.597866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'263","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.296545+0000","last_change":"2024-09-14T11:14:10.152035+0000","last_active":"2024-09-14T11:56:15.296545+0000","last_peered":"2024-09-14T11:56:15.296545+0000","last_clean":"2024-09-14T11:56:15.296545+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:56:15.296545+0000","last_undegraded":"2024-09-14T11:56:15.296545+0000","last_fullsized":"2024-09-14T11:56:15.296545+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.459789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":976,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.785014+0000","last_change":"2024-09-14T11:14:12.151730+0000","last_active":"2024-09-14T11:53:05.785014+0000","last_peered":"2024-09-14T11:53:05.785014+0000","last_clean":"2024-09-14T11:53:05.785014+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:53:05.785014+0000","last_undegraded":"2024-09-14T11:53:05.785014+0000","last_fullsized":"2024-09-14T11:53:05.785014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:44.746381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'326","reported_seq":1757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.782919+0000","last_change":"2024-09-14T11:14:06.118920+0000","last_active":"2024-09-14T11:54:07.782919+0000","last_peered":"2024-09-14T11:54:07.782919+0000","last_clean":"2024-09-14T11:54:07.782919+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:54:07.782919+0000","last_undegraded":"2024-09-14T11:54:07.782919+0000","last_fullsized":"2024-09-14T11:54:07.782919+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:18.730208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'364","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.583773+0000","last_change":"2024-09-14T11:14:04.123599+0000","last_active":"2024-09-14T11:56:15.583773+0000","last_peered":"2024-09-14T11:56:15.583773+0000","last_clean":"2024-09-14T11:56:15.583773+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:15.583773+0000","last_undegraded":"2024-09-14T11:56:15.583773+0000","last_fullsized":"2024-09-14T11:56:15.583773+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.290130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":1005,"num_write":1035,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.782950+0000","last_change":"2024-09-14T11:14:08.137705+0000","last_active":"2024-09-14T11:52:50.782950+0000","last_peered":"2024-09-14T11:52:50.782950+0000","last_clean":"2024-09-14T11:52:50.782950+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:52:50.782950+0000","last_undegraded":"2024-09-14T11:52:50.782950+0000","last_fullsized":"2024-09-14T11:52:50.782950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:21.751164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'227","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.785868+0000","last_change":"2024-09-14T11:14:10.155049+0000","last_active":"2024-09-14T11:56:14.785868+0000","last_peered":"2024-09-14T11:56:14.785868+0000","last_clean":"2024-09-14T11:56:14.785868+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:14.785868+0000","last_undegraded":"2024-09-14T11:56:14.785868+0000","last_fullsized":"2024-09-14T11:56:14.785868+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.366018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.775077+0000","last_change":"2024-09-14T11:14:12.150674+0000","last_active":"2024-09-14T11:51:45.775077+0000","last_peered":"2024-09-14T11:51:45.775077+0000","last_clean":"2024-09-14T11:51:45.775077+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:51:45.775077+0000","last_undegraded":"2024-09-14T11:51:45.775077+0000","last_fullsized":"2024-09-14T11:51:45.775077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:49.433914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'147","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.024834+0000","last_change":"2024-09-14T11:14:14.161497+0000","last_active":"2024-09-14T11:54:25.024834+0000","last_peered":"2024-09-14T11:54:25.024834+0000","last_clean":"2024-09-14T11:54:25.024834+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:54:25.024834+0000","last_undegraded":"2024-09-14T11:54:25.024834+0000","last_fullsized":"2024-09-14T11:54:25.024834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:34.625158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2254,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.547132+0000","last_change":"2024-09-14T11:14:06.130562+0000","last_active":"2024-09-14T11:54:26.547132+0000","last_peered":"2024-09-14T11:54:26.547132+0000","last_clean":"2024-09-14T11:54:26.547132+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:54:26.547132+0000","last_undegraded":"2024-09-14T11:54:26.547132+0000","last_fullsized":"2024-09-14T11:54:26.547132+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:50.157895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'335","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.589625+0000","last_change":"2024-09-14T11:14:04.128727+0000","last_active":"2024-09-14T11:56:15.589625+0000","last_peered":"2024-09-14T11:56:15.589625+0000","last_clean":"2024-09-14T11:56:15.589625+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:15.589625+0000","last_undegraded":"2024-09-14T11:56:15.589625+0000","last_fullsized":"2024-09-14T11:56:15.589625+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:33.665738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":673,"num_read_kb":5062,"num_write":1074,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.895731+0000","last_change":"2024-09-14T11:14:08.134254+0000","last_active":"2024-09-14T11:52:54.895731+0000","last_peered":"2024-09-14T11:52:54.895731+0000","last_clean":"2024-09-14T11:52:54.895731+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:52:54.895731+0000","last_undegraded":"2024-09-14T11:52:54.895731+0000","last_fullsized":"2024-09-14T11:52:54.895731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:52.559637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'315","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.965179+0000","last_change":"2024-09-14T11:14:10.151521+0000","last_active":"2024-09-14T11:56:14.965179+0000","last_peered":"2024-09-14T11:56:14.965179+0000","last_clean":"2024-09-14T11:56:14.965179+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:14.965179+0000","last_undegraded":"2024-09-14T11:56:14.965179+0000","last_fullsized":"2024-09-14T11:56:14.965179+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:57.363193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.888499+0000","last_change":"2024-09-14T11:14:12.152149+0000","last_active":"2024-09-14T11:51:44.888499+0000","last_peered":"2024-09-14T11:51:44.888499+0000","last_clean":"2024-09-14T11:51:44.888499+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:51:44.888499+0000","last_undegraded":"2024-09-14T11:51:44.888499+0000","last_fullsized":"2024-09-14T11:51:44.888499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.701102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'114","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.619651+0000","last_change":"2024-09-14T11:14:14.160202+0000","last_active":"2024-09-14T11:55:41.619651+0000","last_peered":"2024-09-14T11:55:41.619651+0000","last_clean":"2024-09-14T11:55:41.619651+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:55:41.619651+0000","last_undegraded":"2024-09-14T11:55:41.619651+0000","last_fullsized":"2024-09-14T11:55:41.619651+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:39.404108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'433","reported_seq":1874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935365+0000","last_change":"2024-09-14T11:14:06.130413+0000","last_active":"2024-09-14T11:54:09.935365+0000","last_peered":"2024-09-14T11:54:09.935365+0000","last_clean":"2024-09-14T11:54:09.935365+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:54:09.935365+0000","last_undegraded":"2024-09-14T11:54:09.935365+0000","last_fullsized":"2024-09-14T11:54:09.935365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:11.813244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633603+0000","last_change":"2024-09-14T11:14:04.137347+0000","last_active":"2024-09-14T11:56:15.633603+0000","last_peered":"2024-09-14T11:56:15.633603+0000","last_clean":"2024-09-14T11:56:15.633603+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:15.633603+0000","last_undegraded":"2024-09-14T11:56:15.633603+0000","last_fullsized":"2024-09-14T11:56:15.633603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:12.340493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'537","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540930+0000","last_change":"2024-09-14T11:14:06.127358+0000","last_active":"2024-09-14T11:54:04.540930+0000","last_peered":"2024-09-14T11:54:04.540930+0000","last_clean":"2024-09-14T11:54:04.540930+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:54:04.540930+0000","last_undegraded":"2024-09-14T11:54:04.540930+0000","last_fullsized":"2024-09-14T11:54:04.540930+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.425756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'380","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.618101+0000","last_change":"2024-09-14T11:14:04.118653+0000","last_active":"2024-09-14T11:56:15.618101+0000","last_peered":"2024-09-14T11:56:15.618101+0000","last_clean":"2024-09-14T11:56:15.618101+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:15.618101+0000","last_undegraded":"2024-09-14T11:56:15.618101+0000","last_fullsized":"2024-09-14T11:56:15.618101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:13.808933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":5548,"num_write":1128,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1188","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462084+0000","last_change":"2024-09-14T11:14:06.123772+0000","last_active":"2024-09-14T11:54:24.462084+0000","last_peered":"2024-09-14T11:54:24.462084+0000","last_clean":"2024-09-14T11:54:24.462084+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:54:24.462084+0000","last_undegraded":"2024-09-14T11:54:24.462084+0000","last_fullsized":"2024-09-14T11:54:24.462084+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:26.689879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615626+0000","last_change":"2024-09-14T11:14:04.124321+0000","last_active":"2024-09-14T11:56:15.615626+0000","last_peered":"2024-09-14T11:56:15.615626+0000","last_clean":"2024-09-14T11:56:15.615626+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:15.615626+0000","last_undegraded":"2024-09-14T11:56:15.615626+0000","last_fullsized":"2024-09-14T11:56:15.615626+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:47.955033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'459","reported_seq":2193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.262421+0000","last_change":"2024-09-14T11:14:06.124181+0000","last_active":"2024-09-14T11:54:09.262421+0000","last_peered":"2024-09-14T11:54:09.262421+0000","last_clean":"2024-09-14T11:54:09.262421+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:54:09.262421+0000","last_undegraded":"2024-09-14T11:54:09.262421+0000","last_fullsized":"2024-09-14T11:54:09.262421+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:13.371439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.630155+0000","last_change":"2024-09-14T11:14:04.123362+0000","last_active":"2024-09-14T11:56:15.630155+0000","last_peered":"2024-09-14T11:56:15.630155+0000","last_clean":"2024-09-14T11:56:15.630155+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:15.630155+0000","last_undegraded":"2024-09-14T11:56:15.630155+0000","last_fullsized":"2024-09-14T11:56:15.630155+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.168395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":9527,"num_write":1076,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'417","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.261739+0000","last_change":"2024-09-14T11:14:06.128550+0000","last_active":"2024-09-14T11:54:09.261739+0000","last_peered":"2024-09-14T11:54:09.261739+0000","last_clean":"2024-09-14T11:54:09.261739+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:54:09.261739+0000","last_undegraded":"2024-09-14T11:54:09.261739+0000","last_fullsized":"2024-09-14T11:54:09.261739+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:02.461046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'329","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.584728+0000","last_change":"2024-09-14T11:14:04.122779+0000","last_active":"2024-09-14T11:56:15.584728+0000","last_peered":"2024-09-14T11:56:15.584728+0000","last_clean":"2024-09-14T11:56:15.584728+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:15.584728+0000","last_undegraded":"2024-09-14T11:56:15.584728+0000","last_fullsized":"2024-09-14T11:56:15.584728+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:12.163971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":10973,"num_write":1149,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'779","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.540032+0000","last_change":"2024-09-14T11:14:06.130234+0000","last_active":"2024-09-14T11:54:04.540032+0000","last_peered":"2024-09-14T11:54:04.540032+0000","last_clean":"2024-09-14T11:54:04.540032+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:54:04.540032+0000","last_undegraded":"2024-09-14T11:54:04.540032+0000","last_fullsized":"2024-09-14T11:54:04.540032+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:46.526972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'404","reported_seq":1125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.600668+0000","last_change":"2024-09-14T11:14:04.112512+0000","last_active":"2024-09-14T11:56:15.600668+0000","last_peered":"2024-09-14T11:56:15.600668+0000","last_clean":"2024-09-14T11:56:15.600668+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:15.600668+0000","last_undegraded":"2024-09-14T11:56:15.600668+0000","last_fullsized":"2024-09-14T11:56:15.600668+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:27.221991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":959,"num_read_kb":11029,"num_write":1184,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'408","reported_seq":1927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546902+0000","last_change":"2024-09-14T11:14:06.116873+0000","last_active":"2024-09-14T11:54:26.546902+0000","last_peered":"2024-09-14T11:54:26.546902+0000","last_clean":"2024-09-14T11:54:26.546902+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:54:26.546902+0000","last_undegraded":"2024-09-14T11:54:26.546902+0000","last_fullsized":"2024-09-14T11:54:26.546902+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.999726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'401","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.610526+0000","last_change":"2024-09-14T11:14:38.342285+0000","last_active":"2024-09-14T11:56:15.610526+0000","last_peered":"2024-09-14T11:56:15.610526+0000","last_clean":"2024-09-14T11:56:15.610526+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:15.610526+0000","last_undegraded":"2024-09-14T11:56:15.610526+0000","last_fullsized":"2024-09-14T11:56:15.610526+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:29.747736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":972,"num_read_kb":685,"num_write":1240,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'542","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.934942+0000","last_change":"2024-09-14T11:14:06.129076+0000","last_active":"2024-09-14T11:54:09.934942+0000","last_peered":"2024-09-14T11:54:09.934942+0000","last_clean":"2024-09-14T11:54:09.934942+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:54:09.934942+0000","last_undegraded":"2024-09-14T11:54:09.934942+0000","last_fullsized":"2024-09-14T11:54:09.934942+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:59.804760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'301","reported_seq":1046,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.571822+0000","last_change":"2024-09-14T11:14:04.136228+0000","last_active":"2024-09-14T11:56:15.571822+0000","last_peered":"2024-09-14T11:56:15.571822+0000","last_clean":"2024-09-14T11:56:15.571822+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:15.571822+0000","last_undegraded":"2024-09-14T11:56:15.571822+0000","last_fullsized":"2024-09-14T11:56:15.571822+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:56.091790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":918,"num_read_kb":80980,"num_write":1012,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'485","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.630227+0000","last_change":"2024-09-14T11:14:06.134085+0000","last_active":"2024-09-14T11:55:41.630227+0000","last_peered":"2024-09-14T11:55:41.630227+0000","last_clean":"2024-09-14T11:55:41.630227+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:55:41.630227+0000","last_undegraded":"2024-09-14T11:55:41.630227+0000","last_fullsized":"2024-09-14T11:55:41.630227+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:23.324462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.584249+0000","last_change":"2024-09-14T11:14:04.120745+0000","last_active":"2024-09-14T11:56:15.584249+0000","last_peered":"2024-09-14T11:56:15.584249+0000","last_clean":"2024-09-14T11:56:15.584249+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:15.584249+0000","last_undegraded":"2024-09-14T11:56:15.584249+0000","last_fullsized":"2024-09-14T11:56:15.584249+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.093196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'419","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.935731+0000","last_change":"2024-09-14T11:14:06.121086+0000","last_active":"2024-09-14T11:54:09.935731+0000","last_peered":"2024-09-14T11:54:09.935731+0000","last_clean":"2024-09-14T11:54:09.935731+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:54:09.935731+0000","last_undegraded":"2024-09-14T11:54:09.935731+0000","last_fullsized":"2024-09-14T11:54:09.935731+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:36.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'365","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.625368+0000","last_change":"2024-09-14T11:14:04.118390+0000","last_active":"2024-09-14T11:56:15.625368+0000","last_peered":"2024-09-14T11:56:15.625368+0000","last_clean":"2024-09-14T11:56:15.625368+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:15.625368+0000","last_undegraded":"2024-09-14T11:56:15.625368+0000","last_fullsized":"2024-09-14T11:56:15.625368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:49.436222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":571,"num_read_kb":30121,"num_write":1035,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'413","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725240+0000","last_change":"2024-09-14T11:14:06.132235+0000","last_active":"2024-09-14T11:54:06.725240+0000","last_peered":"2024-09-14T11:54:06.725240+0000","last_clean":"2024-09-14T11:54:06.725240+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:54:06.725240+0000","last_undegraded":"2024-09-14T11:54:06.725240+0000","last_fullsized":"2024-09-14T11:54:06.725240+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:50.899051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.640403+0000","last_change":"2024-09-14T11:14:04.131711+0000","last_active":"2024-09-14T11:56:15.640403+0000","last_peered":"2024-09-14T11:56:15.640403+0000","last_clean":"2024-09-14T11:56:15.640403+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:15.640403+0000","last_undegraded":"2024-09-14T11:56:15.640403+0000","last_fullsized":"2024-09-14T11:56:15.640403+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:26.386858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'815","reported_seq":2398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114472+0000","last_change":"2024-09-14T11:14:06.130289+0000","last_active":"2024-09-14T11:54:27.114472+0000","last_peered":"2024-09-14T11:54:27.114472+0000","last_clean":"2024-09-14T11:54:27.114472+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:54:27.114472+0000","last_undegraded":"2024-09-14T11:54:27.114472+0000","last_fullsized":"2024-09-14T11:54:27.114472+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:55.217977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'300","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.649950+0000","last_change":"2024-09-14T11:14:04.137105+0000","last_active":"2024-09-14T11:56:15.649950+0000","last_peered":"2024-09-14T11:56:15.649950+0000","last_clean":"2024-09-14T11:56:15.649950+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:15.649950+0000","last_undegraded":"2024-09-14T11:56:15.649950+0000","last_fullsized":"2024-09-14T11:56:15.649950+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:13.626692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":33889,"num_write":889,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'381","reported_seq":1834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.621727+0000","last_change":"2024-09-14T11:14:06.130068+0000","last_active":"2024-09-14T11:55:41.621727+0000","last_peered":"2024-09-14T11:55:41.621727+0000","last_clean":"2024-09-14T11:55:41.621727+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:55:41.621727+0000","last_undegraded":"2024-09-14T11:55:41.621727+0000","last_fullsized":"2024-09-14T11:55:41.621727+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:39.243281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.620139+0000","last_change":"2024-09-14T11:14:38.195137+0000","last_active":"2024-09-14T11:56:15.620139+0000","last_peered":"2024-09-14T11:56:15.620139+0000","last_clean":"2024-09-14T11:56:15.620139+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:15.620139+0000","last_undegraded":"2024-09-14T11:56:15.620139+0000","last_fullsized":"2024-09-14T11:56:15.620139+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:31.310723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546426+0000","last_change":"2024-09-14T11:14:06.125029+0000","last_active":"2024-09-14T11:54:26.546426+0000","last_peered":"2024-09-14T11:54:26.546426+0000","last_clean":"2024-09-14T11:54:26.546426+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:54:26.546426+0000","last_undegraded":"2024-09-14T11:54:26.546426+0000","last_fullsized":"2024-09-14T11:54:26.546426+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:21.648012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'488","reported_seq":1216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.566653+0000","last_change":"2024-09-14T11:14:04.136230+0000","last_active":"2024-09-14T11:56:15.566653+0000","last_peered":"2024-09-14T11:56:15.566653+0000","last_clean":"2024-09-14T11:56:15.566653+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:15.566653+0000","last_undegraded":"2024-09-14T11:56:15.566653+0000","last_fullsized":"2024-09-14T11:56:15.566653+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.026866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1169,"num_read_kb":1914,"num_write":1411,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'474","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783207+0000","last_change":"2024-09-14T11:14:06.128570+0000","last_active":"2024-09-14T11:54:07.783207+0000","last_peered":"2024-09-14T11:54:07.783207+0000","last_clean":"2024-09-14T11:54:07.783207+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:54:07.783207+0000","last_undegraded":"2024-09-14T11:54:07.783207+0000","last_fullsized":"2024-09-14T11:54:07.783207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'370","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.610375+0000","last_change":"2024-09-14T11:14:04.117766+0000","last_active":"2024-09-14T11:56:15.610375+0000","last_peered":"2024-09-14T11:56:15.610375+0000","last_clean":"2024-09-14T11:56:15.610375+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:15.610375+0000","last_undegraded":"2024-09-14T11:56:15.610375+0000","last_fullsized":"2024-09-14T11:56:15.610375+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:32.550269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":47810,"num_write":1093,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'444","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.725116+0000","last_change":"2024-09-14T11:14:06.124232+0000","last_active":"2024-09-14T11:54:06.725116+0000","last_peered":"2024-09-14T11:54:06.725116+0000","last_clean":"2024-09-14T11:54:06.725116+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:54:06.725116+0000","last_undegraded":"2024-09-14T11:54:06.725116+0000","last_fullsized":"2024-09-14T11:54:06.725116+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:46.127557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615982+0000","last_change":"2024-09-14T11:14:04.128834+0000","last_active":"2024-09-14T11:56:15.615982+0000","last_peered":"2024-09-14T11:56:15.615982+0000","last_clean":"2024-09-14T11:56:15.615982+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:15.615982+0000","last_undegraded":"2024-09-14T11:56:15.615982+0000","last_fullsized":"2024-09-14T11:56:15.615982+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:37.995845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.615334+0000","last_change":"2024-09-14T11:14:38.193534+0000","last_active":"2024-09-14T11:56:15.615334+0000","last_peered":"2024-09-14T11:56:15.615334+0000","last_clean":"2024-09-14T11:56:15.615334+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:15.615334+0000","last_undegraded":"2024-09-14T11:56:15.615334+0000","last_fullsized":"2024-09-14T11:56:15.615334+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.503196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'499","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.461479+0000","last_change":"2024-09-14T11:14:06.134114+0000","last_active":"2024-09-14T11:54:24.461479+0000","last_peered":"2024-09-14T11:54:24.461479+0000","last_clean":"2024-09-14T11:54:24.461479+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:54:24.461479+0000","last_undegraded":"2024-09-14T11:54:24.461479+0000","last_fullsized":"2024-09-14T11:54:24.461479+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:15.629350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'359","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.633831+0000","last_change":"2024-09-14T11:14:04.121552+0000","last_active":"2024-09-14T11:56:15.633831+0000","last_peered":"2024-09-14T11:56:15.633831+0000","last_clean":"2024-09-14T11:56:15.633831+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:15.633831+0000","last_undegraded":"2024-09-14T11:56:15.633831+0000","last_fullsized":"2024-09-14T11:56:15.633831+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:03.091084+0000","last_clean_scrub_stamp":"2024-09-14T11:14:03.091084+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":694,"num_read_kb":183365,"num_write":1193,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546904+0000","last_change":"2024-09-14T11:14:06.130886+0000","last_active":"2024-09-14T11:54:26.546904+0000","last_peered":"2024-09-14T11:54:26.546904+0000","last_clean":"2024-09-14T11:54:26.546904+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:54:26.546904+0000","last_undegraded":"2024-09-14T11:54:26.546904+0000","last_fullsized":"2024-09-14T11:54:26.546904+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:55.595674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":642,"ondisk_log_size":642,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1608537,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17476,"num_read_kb":36987,"num_write":14663,"num_write_kb":11713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3689,"ondisk_log_size":3689,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":41776745,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44044,"num_read_kb":2244679,"num_write":72642,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64241664,"data_stored":64241664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3767,"ondisk_log_size":3767,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174309,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174255,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509956,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271888,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94099952,"statfs":{"total":96636764160,"available":96358350848,"internally_reserved":0,"allocated":10334208,"data_stored":8385962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509957,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166576,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205264,"statfs":{"total":96636764160,"available":96466190336,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509955,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127280,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94244560,"statfs":{"total":96636764160,"available":96506429440,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542659,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300516,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94071324,"statfs":{"total":96636764160,"available":96329035776,"internally_reserved":0,"allocated":8335360,"data_stored":6347071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542662,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273752,"kb_used_data":11956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098088,"statfs":{"total":96636764160,"available":96356442112,"internally_reserved":0,"allocated":12242944,"data_stored":10281542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267909575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542660,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98336,"kb_used_data":12960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94273504,"statfs":{"total":96636764160,"available":96536068096,"internally_reserved":0,"allocated":13271040,"data_stored":11361506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542659,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168748,"kb_used_data":11276,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94203092,"statfs":{"total":96636764160,"available":96463966208,"internally_reserved":0,"allocated":11546624,"data_stored":9590010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542658,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279616,"kb_used_data":17924,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94092224,"statfs":{"total":96636764160,"available":96350437376,"internally_reserved":0,"allocated":18354176,"data_stored":16376601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13529088,"data_stored":13529088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7331840,"data_stored":7331840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8024064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.830 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.831 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.832 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.833 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.834 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.835 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.836 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.837 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.838 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.839 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.840 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.841 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.842 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.843 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.844 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.845 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.846 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.847 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.848 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.849 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.850 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.851 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:13:45.016880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.852 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.853 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.854 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.855 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.856 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:13:52.032855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=13, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.857 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.858 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.859 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.860 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.861 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.862 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.863 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.864 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.865 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.866 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.867 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.868 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.868 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:14:03.091084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.868 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:23.868 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:56:43.869 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:56:44.205 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:56:44.215 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:56:44.217 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1546,"stamp":"2024-09-14T11:56:43.927295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43992737,"num_objects":740,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":310307,"num_read_kb":2858305,"num_write":163686,"num_write_kb":2485845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30279,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12875,"ondisk_log_size":12875,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1685880,"kb_used_data":96824,"kb_used_omap":12,"kb_used_meta":1588915,"kb_avail":753288840,"statfs":{"total":773094113280,"available":771367772160,"internally_reserved":0,"allocated":99147776,"data_stored":83483642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1627049520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24798,"num_omap_keys":100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005886"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039779+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:53:46.039779+0000","last_peered":"2024-09-14T11:53:46.039779+0000","last_clean":"2024-09-14T11:53:46.039779+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:53:46.039779+0000","last_undegraded":"2024-09-14T11:53:46.039779+0000","last_fullsized":"2024-09-14T11:53:46.039779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:51.058211+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:55:51.058211+0000","last_peered":"2024-09-14T11:55:51.058211+0000","last_clean":"2024-09-14T11:55:51.058211+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:55:51.058211+0000","last_undegraded":"2024-09-14T11:55:51.058211+0000","last_fullsized":"2024-09-14T11:55:51.058211+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.781550+0000","last_change":"2024-09-14T11:41:15.877777+0000","last_active":"2024-09-14T11:53:49.781550+0000","last_peered":"2024-09-14T11:53:49.781550+0000","last_clean":"2024-09-14T11:53:49.781550+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:53:49.781550+0000","last_undegraded":"2024-09-14T11:53:49.781550+0000","last_fullsized":"2024-09-14T11:53:49.781550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.018964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.917468+0000","last_change":"2024-09-14T11:30:44.720933+0000","last_active":"2024-09-14T11:55:44.917468+0000","last_peered":"2024-09-14T11:55:44.917468+0000","last_clean":"2024-09-14T11:55:44.917468+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:55:44.917468+0000","last_undegraded":"2024-09-14T11:55:44.917468+0000","last_fullsized":"2024-09-14T11:55:44.917468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:46.706797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777983+0000","last_change":"2024-09-14T11:29:10.325552+0000","last_active":"2024-09-14T11:53:14.777983+0000","last_peered":"2024-09-14T11:53:14.777983+0000","last_clean":"2024-09-14T11:53:14.777983+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:53:14.777983+0000","last_undegraded":"2024-09-14T11:53:14.777983+0000","last_fullsized":"2024-09-14T11:53:14.777983+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:26.043474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.787081+0000","last_change":"2024-09-14T11:41:15.870239+0000","last_active":"2024-09-14T11:53:20.787081+0000","last_peered":"2024-09-14T11:53:20.787081+0000","last_clean":"2024-09-14T11:53:20.787081+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:53:20.787081+0000","last_undegraded":"2024-09-14T11:53:20.787081+0000","last_fullsized":"2024-09-14T11:53:20.787081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:07.125369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918925+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:55:49.918925+0000","last_peered":"2024-09-14T11:55:49.918925+0000","last_clean":"2024-09-14T11:55:49.918925+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:55:49.918925+0000","last_undegraded":"2024-09-14T11:55:49.918925+0000","last_fullsized":"2024-09-14T11:55:49.918925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.788503+0000","last_change":"2024-09-14T11:30:44.718407+0000","last_active":"2024-09-14T11:54:49.788503+0000","last_peered":"2024-09-14T11:54:49.788503+0000","last_clean":"2024-09-14T11:54:49.788503+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:54:49.788503+0000","last_undegraded":"2024-09-14T11:54:49.788503+0000","last_fullsized":"2024-09-14T11:54:49.788503+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:51.367513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905404+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:54:09.905404+0000","last_peered":"2024-09-14T11:54:09.905404+0000","last_clean":"2024-09-14T11:54:09.905404+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:54:09.905404+0000","last_undegraded":"2024-09-14T11:54:09.905404+0000","last_fullsized":"2024-09-14T11:54:09.905404+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896093+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:52:54.896093+0000","last_peered":"2024-09-14T11:52:54.896093+0000","last_clean":"2024-09-14T11:52:54.896093+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:52:54.896093+0000","last_undegraded":"2024-09-14T11:52:54.896093+0000","last_fullsized":"2024-09-14T11:52:54.896093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:47.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905503+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:54:09.905503+0000","last_peered":"2024-09-14T11:54:09.905503+0000","last_clean":"2024-09-14T11:54:09.905503+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:54:09.905503+0000","last_undegraded":"2024-09-14T11:54:09.905503+0000","last_fullsized":"2024-09-14T11:54:09.905503+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905454+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:54:09.905454+0000","last_peered":"2024-09-14T11:54:09.905454+0000","last_clean":"2024-09-14T11:54:09.905454+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:54:09.905454+0000","last_undegraded":"2024-09-14T11:54:09.905454+0000","last_fullsized":"2024-09-14T11:54:09.905454+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.780910+0000","last_change":"2024-09-14T11:30:47.742222+0000","last_active":"2024-09-14T11:52:35.780910+0000","last_peered":"2024-09-14T11:52:35.780910+0000","last_clean":"2024-09-14T11:52:35.780910+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:52:35.780910+0000","last_undegraded":"2024-09-14T11:52:35.780910+0000","last_fullsized":"2024-09-14T11:52:35.780910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:53.632539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794608+0000","last_change":"2024-09-14T11:29:10.322697+0000","last_active":"2024-09-14T11:54:10.794608+0000","last_peered":"2024-09-14T11:54:10.794608+0000","last_clean":"2024-09-14T11:54:10.794608+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:54:10.794608+0000","last_undegraded":"2024-09-14T11:54:10.794608+0000","last_fullsized":"2024-09-14T11:54:10.794608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797042+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:53:49.797042+0000","last_peered":"2024-09-14T11:53:49.797042+0000","last_clean":"2024-09-14T11:53:49.797042+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:53:49.797042+0000","last_undegraded":"2024-09-14T11:53:49.797042+0000","last_fullsized":"2024-09-14T11:53:49.797042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.063452+0000","last_change":"2024-09-14T11:30:47.735777+0000","last_active":"2024-09-14T11:56:14.063452+0000","last_peered":"2024-09-14T11:56:14.063452+0000","last_clean":"2024-09-14T11:56:14.063452+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:14.063452+0000","last_undegraded":"2024-09-14T11:56:14.063452+0000","last_fullsized":"2024-09-14T11:56:14.063452+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:09.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797081+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:53:49.797081+0000","last_peered":"2024-09-14T11:53:49.797081+0000","last_clean":"2024-09-14T11:53:49.797081+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:53:49.797081+0000","last_undegraded":"2024-09-14T11:53:49.797081+0000","last_fullsized":"2024-09-14T11:53:49.797081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.862359+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:56:13.862359+0000","last_peered":"2024-09-14T11:56:13.862359+0000","last_clean":"2024-09-14T11:56:13.862359+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:56:13.862359+0000","last_undegraded":"2024-09-14T11:56:13.862359+0000","last_fullsized":"2024-09-14T11:56:13.862359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17456,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899090+0000","last_change":"2024-09-14T11:29:10.322726+0000","last_active":"2024-09-14T11:53:19.899090+0000","last_peered":"2024-09-14T11:53:19.899090+0000","last_clean":"2024-09-14T11:53:19.899090+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:53:19.899090+0000","last_undegraded":"2024-09-14T11:53:19.899090+0000","last_fullsized":"2024-09-14T11:53:19.899090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:47.099787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.911945+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:54:59.911945+0000","last_peered":"2024-09-14T11:54:59.911945+0000","last_clean":"2024-09-14T11:54:59.911945+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:54:59.911945+0000","last_undegraded":"2024-09-14T11:54:59.911945+0000","last_fullsized":"2024-09-14T11:54:59.911945+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.042769+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:54:06.042769+0000","last_peered":"2024-09-14T11:54:06.042769+0000","last_clean":"2024-09-14T11:54:06.042769+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:54:06.042769+0000","last_undegraded":"2024-09-14T11:54:06.042769+0000","last_fullsized":"2024-09-14T11:54:06.042769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.775890+0000","last_change":"2024-09-14T11:41:15.871132+0000","last_active":"2024-09-14T11:52:59.775890+0000","last_peered":"2024-09-14T11:52:59.775890+0000","last_clean":"2024-09-14T11:52:59.775890+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:52:59.775890+0000","last_undegraded":"2024-09-14T11:52:59.775890+0000","last_fullsized":"2024-09-14T11:52:59.775890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:52.619076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906092+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:54:14.906092+0000","last_peered":"2024-09-14T11:54:14.906092+0000","last_clean":"2024-09-14T11:54:14.906092+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:54:14.906092+0000","last_undegraded":"2024-09-14T11:54:14.906092+0000","last_fullsized":"2024-09-14T11:54:14.906092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.789048+0000","last_change":"2024-09-14T11:30:44.715477+0000","last_active":"2024-09-14T11:54:54.789048+0000","last_peered":"2024-09-14T11:54:54.789048+0000","last_clean":"2024-09-14T11:54:54.789048+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:54:54.789048+0000","last_undegraded":"2024-09-14T11:54:54.789048+0000","last_fullsized":"2024-09-14T11:54:54.789048+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:47.193927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.905463+0000","last_change":"2024-09-14T11:29:10.321195+0000","last_active":"2024-09-14T11:53:26.905463+0000","last_peered":"2024-09-14T11:53:26.905463+0000","last_clean":"2024-09-14T11:53:26.905463+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:53:26.905463+0000","last_undegraded":"2024-09-14T11:53:26.905463+0000","last_fullsized":"2024-09-14T11:53:26.905463+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:38.747021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.911403+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:54:54.911403+0000","last_peered":"2024-09-14T11:54:54.911403+0000","last_clean":"2024-09-14T11:54:54.911403+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:54:54.911403+0000","last_undegraded":"2024-09-14T11:54:54.911403+0000","last_fullsized":"2024-09-14T11:54:54.911403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905077+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:54:09.905077+0000","last_peered":"2024-09-14T11:54:09.905077+0000","last_clean":"2024-09-14T11:54:09.905077+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:54:09.905077+0000","last_undegraded":"2024-09-14T11:54:09.905077+0000","last_fullsized":"2024-09-14T11:54:09.905077+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.938800+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.938800+0000","last_peered":"2024-09-14T11:56:13.938800+0000","last_clean":"2024-09-14T11:56:13.938800+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.938800+0000","last_undegraded":"2024-09-14T11:56:13.938800+0000","last_fullsized":"2024-09-14T11:56:13.938800+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905015+0000","last_change":"2024-09-14T11:30:47.735047+0000","last_active":"2024-09-14T11:54:09.905015+0000","last_peered":"2024-09-14T11:54:09.905015+0000","last_clean":"2024-09-14T11:54:09.905015+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:54:09.905015+0000","last_undegraded":"2024-09-14T11:54:09.905015+0000","last_fullsized":"2024-09-14T11:54:09.905015+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.003047+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:56:14.003047+0000","last_peered":"2024-09-14T11:56:14.003047+0000","last_clean":"2024-09-14T11:56:14.003047+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:56:14.003047+0000","last_undegraded":"2024-09-14T11:56:14.003047+0000","last_fullsized":"2024-09-14T11:56:14.003047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905488+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:54:09.905488+0000","last_peered":"2024-09-14T11:54:09.905488+0000","last_clean":"2024-09-14T11:54:09.905488+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:54:09.905488+0000","last_undegraded":"2024-09-14T11:54:09.905488+0000","last_fullsized":"2024-09-14T11:54:09.905488+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.793766+0000","last_change":"2024-09-14T11:30:44.718710+0000","last_active":"2024-09-14T11:54:05.793766+0000","last_peered":"2024-09-14T11:54:05.793766+0000","last_clean":"2024-09-14T11:54:05.793766+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:54:05.793766+0000","last_undegraded":"2024-09-14T11:54:05.793766+0000","last_fullsized":"2024-09-14T11:54:05.793766+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.288212+0000","last_change":"2024-09-14T11:29:10.311886+0000","last_active":"2024-09-14T11:53:31.288212+0000","last_peered":"2024-09-14T11:53:31.288212+0000","last_clean":"2024-09-14T11:53:31.288212+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:53:31.288212+0000","last_undegraded":"2024-09-14T11:53:31.288212+0000","last_fullsized":"2024-09-14T11:53:31.288212+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:59.142362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.135295+0000","last_change":"2024-09-14T11:30:47.739387+0000","last_active":"2024-09-14T11:56:15.135295+0000","last_peered":"2024-09-14T11:56:15.135295+0000","last_clean":"2024-09-14T11:56:15.135295+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:56:15.135295+0000","last_undegraded":"2024-09-14T11:56:15.135295+0000","last_fullsized":"2024-09-14T11:56:15.135295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.042753+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:54:06.042753+0000","last_peered":"2024-09-14T11:54:06.042753+0000","last_clean":"2024-09-14T11:54:06.042753+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:54:06.042753+0000","last_undegraded":"2024-09-14T11:54:06.042753+0000","last_fullsized":"2024-09-14T11:54:06.042753+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.785278+0000","last_change":"2024-09-14T11:41:15.868312+0000","last_active":"2024-09-14T11:54:24.785278+0000","last_peered":"2024-09-14T11:54:24.785278+0000","last_clean":"2024-09-14T11:54:24.785278+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:54:24.785278+0000","last_undegraded":"2024-09-14T11:54:24.785278+0000","last_fullsized":"2024-09-14T11:54:24.785278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777960+0000","last_change":"2024-09-14T11:30:44.719858+0000","last_active":"2024-09-14T11:53:14.777960+0000","last_peered":"2024-09-14T11:53:14.777960+0000","last_clean":"2024-09-14T11:53:14.777960+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:53:14.777960+0000","last_undegraded":"2024-09-14T11:53:14.777960+0000","last_fullsized":"2024-09-14T11:53:14.777960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.415891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.041236+0000","last_change":"2024-09-14T11:29:10.324751+0000","last_active":"2024-09-14T11:53:56.041236+0000","last_peered":"2024-09-14T11:53:56.041236+0000","last_clean":"2024-09-14T11:53:56.041236+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:53:56.041236+0000","last_undegraded":"2024-09-14T11:53:56.041236+0000","last_fullsized":"2024-09-14T11:53:56.041236+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:56.216560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.795313+0000","last_change":"2024-09-14T11:41:15.865744+0000","last_active":"2024-09-14T11:54:15.795313+0000","last_peered":"2024-09-14T11:54:15.795313+0000","last_clean":"2024-09-14T11:54:15.795313+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:54:15.795313+0000","last_undegraded":"2024-09-14T11:54:15.795313+0000","last_fullsized":"2024-09-14T11:54:15.795313+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792258+0000","last_change":"2024-09-14T11:29:10.325256+0000","last_active":"2024-09-14T11:53:55.792258+0000","last_peered":"2024-09-14T11:53:55.792258+0000","last_clean":"2024-09-14T11:53:55.792258+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:53:55.792258+0000","last_undegraded":"2024-09-14T11:53:55.792258+0000","last_fullsized":"2024-09-14T11:53:55.792258+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:29.015196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.801938+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:54:19.801938+0000","last_peered":"2024-09-14T11:54:19.801938+0000","last_clean":"2024-09-14T11:54:19.801938+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:54:19.801938+0000","last_undegraded":"2024-09-14T11:54:19.801938+0000","last_fullsized":"2024-09-14T11:54:19.801938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'9","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.022660+0000","last_change":"2024-09-14T11:30:44.717178+0000","last_active":"2024-09-14T11:56:15.022660+0000","last_peered":"2024-09-14T11:56:15.022660+0000","last_clean":"2024-09-14T11:56:15.022660+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:56:15.022660+0000","last_undegraded":"2024-09-14T11:56:15.022660+0000","last_fullsized":"2024-09-14T11:56:15.022660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:24.604554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.782090+0000","last_change":"2024-09-14T11:29:10.320629+0000","last_active":"2024-09-14T11:53:54.782090+0000","last_peered":"2024-09-14T11:53:54.782090+0000","last_clean":"2024-09-14T11:53:54.782090+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:53:54.782090+0000","last_undegraded":"2024-09-14T11:53:54.782090+0000","last_fullsized":"2024-09-14T11:53:54.782090+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:20.168734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892148+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:52:29.892148+0000","last_peered":"2024-09-14T11:52:29.892148+0000","last_clean":"2024-09-14T11:52:29.892148+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:52:29.892148+0000","last_undegraded":"2024-09-14T11:52:29.892148+0000","last_fullsized":"2024-09-14T11:52:29.892148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:38.823344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912541+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:14.912541+0000","last_peered":"2024-09-14T11:56:14.912541+0000","last_clean":"2024-09-14T11:56:14.912541+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:14.912541+0000","last_undegraded":"2024-09-14T11:56:14.912541+0000","last_fullsized":"2024-09-14T11:56:14.912541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:09.014650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.893118+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:52:24.893118+0000","last_peered":"2024-09-14T11:52:24.893118+0000","last_clean":"2024-09-14T11:52:24.893118+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:52:24.893118+0000","last_undegraded":"2024-09-14T11:52:24.893118+0000","last_fullsized":"2024-09-14T11:52:24.893118+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:57.259600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785620+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:52:29.785620+0000","last_peered":"2024-09-14T11:52:29.785620+0000","last_clean":"2024-09-14T11:52:29.785620+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:52:29.785620+0000","last_undegraded":"2024-09-14T11:52:29.785620+0000","last_fullsized":"2024-09-14T11:52:29.785620+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:58.445697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.891569+0000","last_change":"2024-09-14T11:30:44.713694+0000","last_active":"2024-09-14T11:52:24.891569+0000","last_peered":"2024-09-14T11:52:24.891569+0000","last_clean":"2024-09-14T11:52:24.891569+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:52:24.891569+0000","last_undegraded":"2024-09-14T11:52:24.891569+0000","last_fullsized":"2024-09-14T11:52:24.891569+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:40.066993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.790581+0000","last_change":"2024-09-14T11:29:10.321325+0000","last_active":"2024-09-14T11:53:04.790581+0000","last_peered":"2024-09-14T11:53:04.790581+0000","last_clean":"2024-09-14T11:53:04.790581+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:53:04.790581+0000","last_undegraded":"2024-09-14T11:53:04.790581+0000","last_fullsized":"2024-09-14T11:53:04.790581+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:02.452550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.912099+0000","last_change":"2024-09-14T11:30:47.737000+0000","last_active":"2024-09-14T11:56:14.912099+0000","last_peered":"2024-09-14T11:56:14.912099+0000","last_clean":"2024-09-14T11:56:14.912099+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:56:14.912099+0000","last_undegraded":"2024-09-14T11:56:14.912099+0000","last_fullsized":"2024-09-14T11:56:14.912099+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:03.413738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.908537+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:54:34.908537+0000","last_peered":"2024-09-14T11:54:34.908537+0000","last_clean":"2024-09-14T11:54:34.908537+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:54:34.908537+0000","last_undegraded":"2024-09-14T11:54:34.908537+0000","last_fullsized":"2024-09-14T11:54:34.908537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:33.383073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786619+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:52:34.786619+0000","last_peered":"2024-09-14T11:52:34.786619+0000","last_clean":"2024-09-14T11:52:34.786619+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:52:34.786619+0000","last_undegraded":"2024-09-14T11:52:34.786619+0000","last_fullsized":"2024-09-14T11:52:34.786619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:02.318969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784088+0000","last_change":"2024-09-14T11:29:10.322148+0000","last_active":"2024-09-14T11:53:00.784088+0000","last_peered":"2024-09-14T11:53:00.784088+0000","last_clean":"2024-09-14T11:53:00.784088+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:53:00.784088+0000","last_undegraded":"2024-09-14T11:53:00.784088+0000","last_fullsized":"2024-09-14T11:53:00.784088+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.995810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.815040+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:55:44.815040+0000","last_peered":"2024-09-14T11:55:44.815040+0000","last_clean":"2024-09-14T11:55:44.815040+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:55:44.815040+0000","last_undegraded":"2024-09-14T11:55:44.815040+0000","last_fullsized":"2024-09-14T11:55:44.815040+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.938139+0000","last_change":"2024-09-14T11:30:44.720970+0000","last_active":"2024-09-14T11:56:13.938139+0000","last_peered":"2024-09-14T11:56:13.938139+0000","last_clean":"2024-09-14T11:56:13.938139+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:56:13.938139+0000","last_undegraded":"2024-09-14T11:56:13.938139+0000","last_fullsized":"2024-09-14T11:56:13.938139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:44.416082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.784182+0000","last_change":"2024-09-14T11:29:10.322645+0000","last_active":"2024-09-14T11:53:00.784182+0000","last_peered":"2024-09-14T11:53:00.784182+0000","last_clean":"2024-09-14T11:53:00.784182+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:53:00.784182+0000","last_undegraded":"2024-09-14T11:53:00.784182+0000","last_fullsized":"2024-09-14T11:53:00.784182+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:51.139308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785838+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:52:29.785838+0000","last_peered":"2024-09-14T11:52:29.785838+0000","last_clean":"2024-09-14T11:52:29.785838+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:52:29.785838+0000","last_undegraded":"2024-09-14T11:52:29.785838+0000","last_fullsized":"2024-09-14T11:52:29.785838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:07.281823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.047286+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:54:36.047286+0000","last_peered":"2024-09-14T11:54:36.047286+0000","last_clean":"2024-09-14T11:54:36.047286+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:54:36.047286+0000","last_undegraded":"2024-09-14T11:54:36.047286+0000","last_fullsized":"2024-09-14T11:54:36.047286+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:34.901574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801180+0000","last_change":"2024-09-14T11:29:10.323320+0000","last_active":"2024-09-14T11:54:14.801180+0000","last_peered":"2024-09-14T11:54:14.801180+0000","last_clean":"2024-09-14T11:54:14.801180+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:54:14.801180+0000","last_undegraded":"2024-09-14T11:54:14.801180+0000","last_fullsized":"2024-09-14T11:54:14.801180+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:18.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.799375+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:54:40.799375+0000","last_peered":"2024-09-14T11:54:40.799375+0000","last_clean":"2024-09-14T11:54:40.799375+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:54:40.799375+0000","last_undegraded":"2024-09-14T11:54:40.799375+0000","last_fullsized":"2024-09-14T11:54:40.799375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.613026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.784752+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:52:24.784752+0000","last_peered":"2024-09-14T11:52:24.784752+0000","last_clean":"2024-09-14T11:52:24.784752+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:52:24.784752+0000","last_undegraded":"2024-09-14T11:52:24.784752+0000","last_fullsized":"2024-09-14T11:52:24.784752+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:46.872224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905103+0000","last_change":"2024-09-14T11:29:10.321492+0000","last_active":"2024-09-14T11:54:09.905103+0000","last_peered":"2024-09-14T11:54:09.905103+0000","last_clean":"2024-09-14T11:54:09.905103+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:54:09.905103+0000","last_undegraded":"2024-09-14T11:54:09.905103+0000","last_fullsized":"2024-09-14T11:54:09.905103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:01.698920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":21,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.784673+0000","last_change":"2024-09-14T11:41:15.869275+0000","last_active":"2024-09-14T11:54:19.784673+0000","last_peered":"2024-09-14T11:54:19.784673+0000","last_clean":"2024-09-14T11:54:19.784673+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:54:19.784673+0000","last_undegraded":"2024-09-14T11:54:19.784673+0000","last_fullsized":"2024-09-14T11:54:19.784673+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902212+0000","last_change":"2024-09-14T11:30:47.734644+0000","last_active":"2024-09-14T11:53:44.902212+0000","last_peered":"2024-09-14T11:53:44.902212+0000","last_clean":"2024-09-14T11:53:44.902212+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:53:44.902212+0000","last_undegraded":"2024-09-14T11:53:44.902212+0000","last_fullsized":"2024-09-14T11:53:44.902212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:00.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.788562+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:52:49.788562+0000","last_peered":"2024-09-14T11:52:49.788562+0000","last_clean":"2024-09-14T11:52:49.788562+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:52:49.788562+0000","last_undegraded":"2024-09-14T11:52:49.788562+0000","last_fullsized":"2024-09-14T11:52:49.788562+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:27.988666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043510+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:54:11.043510+0000","last_peered":"2024-09-14T11:54:11.043510+0000","last_clean":"2024-09-14T11:54:11.043510+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:54:11.043510+0000","last_undegraded":"2024-09-14T11:54:11.043510+0000","last_fullsized":"2024-09-14T11:54:11.043510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906570+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:54:19.906570+0000","last_peered":"2024-09-14T11:54:19.906570+0000","last_clean":"2024-09-14T11:54:19.906570+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:54:19.906570+0000","last_undegraded":"2024-09-14T11:54:19.906570+0000","last_fullsized":"2024-09-14T11:54:19.906570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.049498+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:54:51.049498+0000","last_peered":"2024-09-14T11:54:51.049498+0000","last_clean":"2024-09-14T11:54:51.049498+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:54:51.049498+0000","last_undegraded":"2024-09-14T11:54:51.049498+0000","last_fullsized":"2024-09-14T11:54:51.049498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.117139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794642+0000","last_change":"2024-09-14T11:29:10.319801+0000","last_active":"2024-09-14T11:54:10.794642+0000","last_peered":"2024-09-14T11:54:10.794642+0000","last_clean":"2024-09-14T11:54:10.794642+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:54:10.794642+0000","last_undegraded":"2024-09-14T11:54:10.794642+0000","last_fullsized":"2024-09-14T11:54:10.794642+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:43.613741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790704+0000","last_change":"2024-09-14T11:30:47.742418+0000","last_active":"2024-09-14T11:53:45.790704+0000","last_peered":"2024-09-14T11:53:45.790704+0000","last_clean":"2024-09-14T11:53:45.790704+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:53:45.790704+0000","last_undegraded":"2024-09-14T11:53:45.790704+0000","last_fullsized":"2024-09-14T11:53:45.790704+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:46.735010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'11","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.024411+0000","last_change":"2024-09-14T11:30:44.713119+0000","last_active":"2024-09-14T11:56:15.024411+0000","last_peered":"2024-09-14T11:56:15.024411+0000","last_clean":"2024-09-14T11:56:15.024411+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:56:15.024411+0000","last_undegraded":"2024-09-14T11:56:15.024411+0000","last_fullsized":"2024-09-14T11:56:15.024411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:45.277861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794558+0000","last_change":"2024-09-14T11:29:10.321339+0000","last_active":"2024-09-14T11:54:10.794558+0000","last_peered":"2024-09-14T11:54:10.794558+0000","last_clean":"2024-09-14T11:54:10.794558+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:54:10.794558+0000","last_undegraded":"2024-09-14T11:54:10.794558+0000","last_fullsized":"2024-09-14T11:54:10.794558+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:57.698726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790015+0000","last_change":"2024-09-14T11:30:44.721204+0000","last_active":"2024-09-14T11:53:40.790015+0000","last_peered":"2024-09-14T11:53:40.790015+0000","last_clean":"2024-09-14T11:53:40.790015+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:53:40.790015+0000","last_undegraded":"2024-09-14T11:53:40.790015+0000","last_fullsized":"2024-09-14T11:53:40.790015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:12.676688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792100+0000","last_change":"2024-09-14T11:29:10.324357+0000","last_active":"2024-09-14T11:53:14.792100+0000","last_peered":"2024-09-14T11:53:14.792100+0000","last_clean":"2024-09-14T11:53:14.792100+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:53:14.792100+0000","last_undegraded":"2024-09-14T11:53:14.792100+0000","last_fullsized":"2024-09-14T11:53:14.792100+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:35.317007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'328","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.457995+0000","last_change":"2024-09-14T11:56:32.457995+0000","last_active":"2024-09-14T11:56:32.457995+0000","last_peered":"2024-09-14T11:56:32.457995+0000","last_clean":"2024-09-14T11:56:32.457995+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:32.457995+0000","last_undegraded":"2024-09-14T11:56:32.457995+0000","last_fullsized":"2024-09-14T11:56:32.457995+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.457886+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:42.457035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":2359,"num_write":1145,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1593","reported_seq":3387,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.733167+0000","last_change":"2024-09-14T11:56:40.733167+0000","last_active":"2024-09-14T11:56:40.733167+0000","last_peered":"2024-09-14T11:56:40.733167+0000","last_clean":"2024-09-14T11:56:40.733167+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:56:40.733167+0000","last_undegraded":"2024-09-14T11:56:40.733167+0000","last_fullsized":"2024-09-14T11:56:40.733167+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1593","last_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_deep_scrub":"263'1593","last_deep_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.733084+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.184612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'344","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.843948+0000","last_change":"2024-09-14T11:56:25.843948+0000","last_active":"2024-09-14T11:56:25.843948+0000","last_peered":"2024-09-14T11:56:25.843948+0000","last_clean":"2024-09-14T11:56:25.843948+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:25.843948+0000","last_undegraded":"2024-09-14T11:56:25.843948+0000","last_fullsized":"2024-09-14T11:56:25.843948+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.843781+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:39.876965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":643,"num_read_kb":6703,"num_write":1183,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'563","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.583527+0000","last_change":"2024-09-14T11:56:39.583472+0000","last_active":"2024-09-14T11:56:39.583527+0000","last_peered":"2024-09-14T11:56:39.583527+0000","last_clean":"2024-09-14T11:56:39.583527+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:56:39.583527+0000","last_undegraded":"2024-09-14T11:56:39.583527+0000","last_fullsized":"2024-09-14T11:56:39.583527+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'563","last_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_deep_scrub":"263'563","last_deep_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.583358+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.041135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'350","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.490371+0000","last_change":"2024-09-14T11:56:29.490371+0000","last_active":"2024-09-14T11:56:29.490371+0000","last_peered":"2024-09-14T11:56:29.490371+0000","last_clean":"2024-09-14T11:56:29.490371+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:29.490371+0000","last_undegraded":"2024-09-14T11:56:29.490371+0000","last_fullsized":"2024-09-14T11:56:29.490371+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.490240+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:19.905307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":11794,"num_write":1143,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'481","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.761132+0000","last_change":"2024-09-14T11:56:40.761132+0000","last_active":"2024-09-14T11:56:40.761132+0000","last_peered":"2024-09-14T11:56:40.761132+0000","last_clean":"2024-09-14T11:56:40.761132+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:56:40.761132+0000","last_undegraded":"2024-09-14T11:56:40.761132+0000","last_fullsized":"2024-09-14T11:56:40.761132+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.761000+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:10.670888+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.751856+0000","last_change":"2024-09-14T11:56:37.751856+0000","last_active":"2024-09-14T11:56:37.751856+0000","last_peered":"2024-09-14T11:56:37.751856+0000","last_clean":"2024-09-14T11:56:37.751856+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:37.751856+0000","last_undegraded":"2024-09-14T11:56:37.751856+0000","last_fullsized":"2024-09-14T11:56:37.751856+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.751721+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:52.423497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1061","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.655563+0000","last_change":"2024-09-14T11:56:38.655504+0000","last_active":"2024-09-14T11:56:38.655563+0000","last_peered":"2024-09-14T11:56:38.655563+0000","last_clean":"2024-09-14T11:56:38.655563+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:56:38.655563+0000","last_undegraded":"2024-09-14T11:56:38.655563+0000","last_fullsized":"2024-09-14T11:56:38.655563+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1061","last_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_deep_scrub":"263'1061","last_deep_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.655414+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:06.267363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'351","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.566767+0000","last_change":"2024-09-14T11:56:37.566767+0000","last_active":"2024-09-14T11:56:37.566767+0000","last_peered":"2024-09-14T11:56:37.566767+0000","last_clean":"2024-09-14T11:56:37.566767+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:37.566767+0000","last_undegraded":"2024-09-14T11:56:37.566767+0000","last_fullsized":"2024-09-14T11:56:37.566767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.566631+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:27.502397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":626,"num_read_kb":64951,"num_write":1173,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'466","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.235997+0000","last_change":"2024-09-14T11:56:34.235997+0000","last_active":"2024-09-14T11:56:34.235997+0000","last_peered":"2024-09-14T11:56:34.235997+0000","last_clean":"2024-09-14T11:56:34.235997+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:56:34.235997+0000","last_undegraded":"2024-09-14T11:56:34.235997+0000","last_fullsized":"2024-09-14T11:56:34.235997+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.235902+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:32.784865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.776617+0000","last_change":"2024-09-14T11:56:34.776532+0000","last_active":"2024-09-14T11:56:34.776617+0000","last_peered":"2024-09-14T11:56:34.776617+0000","last_clean":"2024-09-14T11:56:34.776617+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:34.776617+0000","last_undegraded":"2024-09-14T11:56:34.776617+0000","last_fullsized":"2024-09-14T11:56:34.776617+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.776385+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.314618+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'797","reported_seq":2428,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.547089+0000","last_change":"2024-09-14T11:14:06.123280+0000","last_active":"2024-09-14T11:54:08.547089+0000","last_peered":"2024-09-14T11:54:08.547089+0000","last_clean":"2024-09-14T11:54:08.547089+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:54:08.547089+0000","last_undegraded":"2024-09-14T11:54:08.547089+0000","last_fullsized":"2024-09-14T11:54:08.547089+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:47.903630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'298","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.494965+0000","last_change":"2024-09-14T11:56:31.494896+0000","last_active":"2024-09-14T11:56:31.494965+0000","last_peered":"2024-09-14T11:56:31.494965+0000","last_clean":"2024-09-14T11:56:31.494965+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:31.494965+0000","last_undegraded":"2024-09-14T11:56:31.494965+0000","last_fullsized":"2024-09-14T11:56:31.494965+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.494814+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:22.737796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":10089,"num_write":838,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'969","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.114339+0000","last_change":"2024-09-14T11:14:38.192581+0000","last_active":"2024-09-14T11:54:27.114339+0000","last_peered":"2024-09-14T11:54:27.114339+0000","last_clean":"2024-09-14T11:54:27.114339+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:54:27.114339+0000","last_undegraded":"2024-09-14T11:54:27.114339+0000","last_fullsized":"2024-09-14T11:54:27.114339+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":900,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:55.081995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'304","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.076723+0000","last_change":"2024-09-14T11:56:31.076616+0000","last_active":"2024-09-14T11:56:31.076723+0000","last_peered":"2024-09-14T11:56:31.076723+0000","last_clean":"2024-09-14T11:56:31.076723+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:31.076723+0000","last_undegraded":"2024-09-14T11:56:31.076723+0000","last_fullsized":"2024-09-14T11:56:31.076723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.076451+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:08.379985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":712,"num_read_kb":31980,"num_write":1004,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'457","reported_seq":1989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.852513+0000","last_change":"2024-09-14T11:56:30.852513+0000","last_active":"2024-09-14T11:56:30.852513+0000","last_peered":"2024-09-14T11:56:30.852513+0000","last_clean":"2024-09-14T11:56:30.852513+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:56:30.852513+0000","last_undegraded":"2024-09-14T11:56:30.852513+0000","last_fullsized":"2024-09-14T11:56:30.852513+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.852429+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:32.993438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'844","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.751896+0000","last_change":"2024-09-14T11:56:38.751896+0000","last_active":"2024-09-14T11:56:38.751896+0000","last_peered":"2024-09-14T11:56:38.751896+0000","last_clean":"2024-09-14T11:56:38.751896+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:56:38.751896+0000","last_undegraded":"2024-09-14T11:56:38.751896+0000","last_fullsized":"2024-09-14T11:56:38.751896+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'844","last_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_deep_scrub":"263'844","last_deep_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.751800+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:31.522430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.518468+0000","last_change":"2024-09-14T11:56:29.518468+0000","last_active":"2024-09-14T11:56:29.518468+0000","last_peered":"2024-09-14T11:56:29.518468+0000","last_clean":"2024-09-14T11:56:29.518468+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:29.518468+0000","last_undegraded":"2024-09-14T11:56:29.518468+0000","last_fullsized":"2024-09-14T11:56:29.518468+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.518308+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:50.599905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":694,"num_read_kb":5626,"num_write":1163,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1035","reported_seq":2968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.559633+0000","last_change":"2024-09-14T11:56:38.559633+0000","last_active":"2024-09-14T11:56:38.559633+0000","last_peered":"2024-09-14T11:56:38.559633+0000","last_clean":"2024-09-14T11:56:38.559633+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:56:38.559633+0000","last_undegraded":"2024-09-14T11:56:38.559633+0000","last_fullsized":"2024-09-14T11:56:38.559633+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1035","last_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_deep_scrub":"263'1035","last_deep_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.559545+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:59.274734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.210958+0000","last_change":"2024-09-14T11:56:28.210958+0000","last_active":"2024-09-14T11:56:28.210958+0000","last_peered":"2024-09-14T11:56:28.210958+0000","last_clean":"2024-09-14T11:56:28.210958+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:28.210958+0000","last_undegraded":"2024-09-14T11:56:28.210958+0000","last_fullsized":"2024-09-14T11:56:28.210958+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.210845+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:07.178497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.732926+0000","last_change":"2024-09-14T11:56:39.732926+0000","last_active":"2024-09-14T11:56:39.732926+0000","last_peered":"2024-09-14T11:56:39.732926+0000","last_clean":"2024-09-14T11:56:39.732926+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:56:39.732926+0000","last_undegraded":"2024-09-14T11:56:39.732926+0000","last_fullsized":"2024-09-14T11:56:39.732926+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.732833+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:56.461549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.221091+0000","last_change":"2024-09-14T11:56:29.221091+0000","last_active":"2024-09-14T11:56:29.221091+0000","last_peered":"2024-09-14T11:56:29.221091+0000","last_clean":"2024-09-14T11:56:29.221091+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:29.221091+0000","last_undegraded":"2024-09-14T11:56:29.221091+0000","last_fullsized":"2024-09-14T11:56:29.221091+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.220978+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.320306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'801","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.875354+0000","last_change":"2024-09-14T11:56:28.875354+0000","last_active":"2024-09-14T11:56:28.875354+0000","last_peered":"2024-09-14T11:56:28.875354+0000","last_clean":"2024-09-14T11:56:28.875354+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:56:28.875354+0000","last_undegraded":"2024-09-14T11:56:28.875354+0000","last_fullsized":"2024-09-14T11:56:28.875354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'801","last_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_deep_scrub":"263'801","last_deep_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.875262+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:43.441720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.735385+0000","last_change":"2024-09-14T11:56:25.735385+0000","last_active":"2024-09-14T11:56:25.735385+0000","last_peered":"2024-09-14T11:56:25.735385+0000","last_clean":"2024-09-14T11:56:25.735385+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:25.735385+0000","last_undegraded":"2024-09-14T11:56:25.735385+0000","last_fullsized":"2024-09-14T11:56:25.735385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.735245+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:43.758913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'455","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.828599+0000","last_change":"2024-09-14T11:56:31.828599+0000","last_active":"2024-09-14T11:56:31.828599+0000","last_peered":"2024-09-14T11:56:31.828599+0000","last_clean":"2024-09-14T11:56:31.828599+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:56:31.828599+0000","last_undegraded":"2024-09-14T11:56:31.828599+0000","last_fullsized":"2024-09-14T11:56:31.828599+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'455","last_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_deep_scrub":"263'455","last_deep_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.828518+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:25.639201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":693,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'426","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.027590+0000","last_change":"2024-09-14T11:56:30.027590+0000","last_active":"2024-09-14T11:56:30.027590+0000","last_peered":"2024-09-14T11:56:30.027590+0000","last_clean":"2024-09-14T11:56:30.027590+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:30.027590+0000","last_undegraded":"2024-09-14T11:56:30.027590+0000","last_fullsized":"2024-09-14T11:56:30.027590+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.027445+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.053487+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1042,"num_read_kb":31602,"num_write":1294,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'450","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.793178+0000","last_change":"2024-09-14T11:56:39.793178+0000","last_active":"2024-09-14T11:56:39.793178+0000","last_peered":"2024-09-14T11:56:39.793178+0000","last_clean":"2024-09-14T11:56:39.793178+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:56:39.793178+0000","last_undegraded":"2024-09-14T11:56:39.793178+0000","last_fullsized":"2024-09-14T11:56:39.793178+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.793094+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.783508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'326","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.526665+0000","last_change":"2024-09-14T11:56:28.526665+0000","last_active":"2024-09-14T11:56:28.526665+0000","last_peered":"2024-09-14T11:56:28.526665+0000","last_clean":"2024-09-14T11:56:28.526665+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:28.526665+0000","last_undegraded":"2024-09-14T11:56:28.526665+0000","last_fullsized":"2024-09-14T11:56:28.526665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.526538+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:23.545261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048824,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":49467,"num_write":1023,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'149","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.173403+0000","last_change":"2024-09-14T11:14:14.157140+0000","last_active":"2024-09-14T11:54:27.173403+0000","last_peered":"2024-09-14T11:54:27.173403+0000","last_clean":"2024-09-14T11:54:27.173403+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:54:27.173403+0000","last_undegraded":"2024-09-14T11:54:27.173403+0000","last_fullsized":"2024-09-14T11:54:27.173403+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'472","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.462103+0000","last_change":"2024-09-14T11:14:06.114316+0000","last_active":"2024-09-14T11:54:24.462103+0000","last_peered":"2024-09-14T11:54:24.462103+0000","last_clean":"2024-09-14T11:54:24.462103+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:54:24.462103+0000","last_undegraded":"2024-09-14T11:54:24.462103+0000","last_fullsized":"2024-09-14T11:54:24.462103+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:27.459152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'350","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.558262+0000","last_change":"2024-09-14T11:56:27.558262+0000","last_active":"2024-09-14T11:56:27.558262+0000","last_peered":"2024-09-14T11:56:27.558262+0000","last_clean":"2024-09-14T11:56:27.558262+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:27.558262+0000","last_undegraded":"2024-09-14T11:56:27.558262+0000","last_fullsized":"2024-09-14T11:56:27.558262+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.558151+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:00.824858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":64658,"num_write":1071,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032244+0000","last_change":"2024-09-14T11:14:08.133120+0000","last_active":"2024-09-14T11:52:51.032244+0000","last_peered":"2024-09-14T11:52:51.032244+0000","last_clean":"2024-09-14T11:52:51.032244+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:52:51.032244+0000","last_undegraded":"2024-09-14T11:52:51.032244+0000","last_fullsized":"2024-09-14T11:52:51.032244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:46.516129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.396646+0000","last_change":"2024-09-14T11:14:10.155409+0000","last_active":"2024-09-14T11:56:14.396646+0000","last_peered":"2024-09-14T11:56:14.396646+0000","last_clean":"2024-09-14T11:56:14.396646+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:14.396646+0000","last_undegraded":"2024-09-14T11:56:14.396646+0000","last_fullsized":"2024-09-14T11:56:14.396646+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:46.814527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.789188+0000","last_change":"2024-09-14T11:14:12.146041+0000","last_active":"2024-09-14T11:52:54.789188+0000","last_peered":"2024-09-14T11:52:54.789188+0000","last_clean":"2024-09-14T11:52:54.789188+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:52:54.789188+0000","last_undegraded":"2024-09-14T11:52:54.789188+0000","last_fullsized":"2024-09-14T11:52:54.789188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:07.310103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2525","reported_seq":4350,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.558442+0000","last_change":"2024-09-14T11:14:14.162522+0000","last_active":"2024-09-14T11:54:26.558442+0000","last_peered":"2024-09-14T11:54:26.558442+0000","last_clean":"2024-09-14T11:54:26.558442+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:54:26.558442+0000","last_undegraded":"2024-09-14T11:54:26.558442+0000","last_fullsized":"2024-09-14T11:54:26.558442+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.790192+0000","last_change":"2024-09-14T11:56:36.790192+0000","last_active":"2024-09-14T11:56:36.790192+0000","last_peered":"2024-09-14T11:56:36.790192+0000","last_clean":"2024-09-14T11:56:36.790192+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:56:36.790192+0000","last_undegraded":"2024-09-14T11:56:36.790192+0000","last_fullsized":"2024-09-14T11:56:36.790192+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.790080+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:27.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'386","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.505419+0000","last_change":"2024-09-14T11:56:20.505419+0000","last_active":"2024-09-14T11:56:20.505419+0000","last_peered":"2024-09-14T11:56:20.505419+0000","last_clean":"2024-09-14T11:56:20.505419+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:20.505419+0000","last_undegraded":"2024-09-14T11:56:20.505419+0000","last_fullsized":"2024-09-14T11:56:20.505419+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.505297+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:34.623393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":676,"num_read_kb":35601,"num_write":1215,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"37'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.737726+0000","last_change":"2024-09-14T11:14:08.135860+0000","last_active":"2024-09-14T11:56:13.737726+0000","last_peered":"2024-09-14T11:56:13.737726+0000","last_clean":"2024-09-14T11:56:13.737726+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:13.737726+0000","last_undegraded":"2024-09-14T11:56:13.737726+0000","last_fullsized":"2024-09-14T11:56:13.737726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:46.310304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'85","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.820592+0000","last_change":"2024-09-14T11:14:10.148306+0000","last_active":"2024-09-14T11:54:18.820592+0000","last_peered":"2024-09-14T11:54:18.820592+0000","last_clean":"2024-09-14T11:54:18.820592+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:54:18.820592+0000","last_undegraded":"2024-09-14T11:54:18.820592+0000","last_fullsized":"2024-09-14T11:54:18.820592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:24.120046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.783507+0000","last_change":"2024-09-14T11:14:12.155662+0000","last_active":"2024-09-14T11:52:55.783507+0000","last_peered":"2024-09-14T11:52:55.783507+0000","last_clean":"2024-09-14T11:52:55.783507+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:52:55.783507+0000","last_undegraded":"2024-09-14T11:52:55.783507+0000","last_fullsized":"2024-09-14T11:52:55.783507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:57.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.540261+0000","last_change":"2024-09-14T11:14:14.154923+0000","last_active":"2024-09-14T11:53:52.540261+0000","last_peered":"2024-09-14T11:53:52.540261+0000","last_clean":"2024-09-14T11:53:52.540261+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:53:52.540261+0000","last_undegraded":"2024-09-14T11:53:52.540261+0000","last_fullsized":"2024-09-14T11:53:52.540261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:08.154888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'431","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.546641+0000","last_change":"2024-09-14T11:56:34.546641+0000","last_active":"2024-09-14T11:56:34.546641+0000","last_peered":"2024-09-14T11:56:34.546641+0000","last_clean":"2024-09-14T11:56:34.546641+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:56:34.546641+0000","last_undegraded":"2024-09-14T11:56:34.546641+0000","last_fullsized":"2024-09-14T11:56:34.546641+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.546557+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:09.879015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'407","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.512674+0000","last_change":"2024-09-14T11:56:25.512674+0000","last_active":"2024-09-14T11:56:25.512674+0000","last_peered":"2024-09-14T11:56:25.512674+0000","last_clean":"2024-09-14T11:56:25.512674+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:25.512674+0000","last_undegraded":"2024-09-14T11:56:25.512674+0000","last_fullsized":"2024-09-14T11:56:25.512674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.512545+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:59.346574+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":815,"num_read_kb":18319,"num_write":1414,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.196211+0000","last_change":"2024-09-14T11:56:39.196211+0000","last_active":"2024-09-14T11:56:39.196211+0000","last_peered":"2024-09-14T11:56:39.196211+0000","last_clean":"2024-09-14T11:56:39.196211+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:56:39.196211+0000","last_undegraded":"2024-09-14T11:56:39.196211+0000","last_fullsized":"2024-09-14T11:56:39.196211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.196121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'98","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.838179+0000","last_change":"2024-09-14T11:14:10.152502+0000","last_active":"2024-09-14T11:54:18.838179+0000","last_peered":"2024-09-14T11:54:18.838179+0000","last_clean":"2024-09-14T11:54:18.838179+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:54:18.838179+0000","last_undegraded":"2024-09-14T11:54:18.838179+0000","last_fullsized":"2024-09-14T11:54:18.838179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:42.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'773","reported_seq":4564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.255849+0000","last_change":"2024-09-14T11:14:12.146612+0000","last_active":"2024-09-14T11:56:15.255849+0000","last_peered":"2024-09-14T11:56:15.255849+0000","last_clean":"2024-09-14T11:56:15.255849+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:15.255849+0000","last_undegraded":"2024-09-14T11:56:15.255849+0000","last_fullsized":"2024-09-14T11:56:15.255849+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:59.916147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.603559+0000","last_change":"2024-09-14T11:14:14.157146+0000","last_active":"2024-09-14T11:54:26.603559+0000","last_peered":"2024-09-14T11:54:26.603559+0000","last_clean":"2024-09-14T11:54:26.603559+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:54:26.603559+0000","last_undegraded":"2024-09-14T11:54:26.603559+0000","last_fullsized":"2024-09-14T11:54:26.603559+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'527","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.833061+0000","last_change":"2024-09-14T11:56:26.833061+0000","last_active":"2024-09-14T11:56:26.833061+0000","last_peered":"2024-09-14T11:56:26.833061+0000","last_clean":"2024-09-14T11:56:26.833061+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:56:26.833061+0000","last_undegraded":"2024-09-14T11:56:26.833061+0000","last_fullsized":"2024-09-14T11:56:26.833061+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.832975+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:55.872822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.106600+0000","last_change":"2024-09-14T11:56:24.106600+0000","last_active":"2024-09-14T11:56:24.106600+0000","last_peered":"2024-09-14T11:56:24.106600+0000","last_clean":"2024-09-14T11:56:24.106600+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:24.106600+0000","last_undegraded":"2024-09-14T11:56:24.106600+0000","last_fullsized":"2024-09-14T11:56:24.106600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.106406+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:03.759033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.032273+0000","last_change":"2024-09-14T11:14:08.132713+0000","last_active":"2024-09-14T11:52:51.032273+0000","last_peered":"2024-09-14T11:52:51.032273+0000","last_clean":"2024-09-14T11:52:51.032273+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:52:51.032273+0000","last_undegraded":"2024-09-14T11:52:51.032273+0000","last_fullsized":"2024-09-14T11:52:51.032273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.166831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'250","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.104576+0000","last_change":"2024-09-14T11:14:10.151136+0000","last_active":"2024-09-14T11:56:14.104576+0000","last_peered":"2024-09-14T11:56:14.104576+0000","last_clean":"2024-09-14T11:56:14.104576+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:14.104576+0000","last_undegraded":"2024-09-14T11:56:14.104576+0000","last_fullsized":"2024-09-14T11:56:14.104576+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.560101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'790","reported_seq":2552,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.663564+0000","last_change":"2024-09-14T11:14:12.152920+0000","last_active":"2024-09-14T11:56:15.663564+0000","last_peered":"2024-09-14T11:56:15.663564+0000","last_clean":"2024-09-14T11:56:15.663564+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:15.663564+0000","last_undegraded":"2024-09-14T11:56:15.663564+0000","last_fullsized":"2024-09-14T11:56:15.663564+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:33.470705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1229","reported_seq":2892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.771034+0000","last_change":"2024-09-14T11:56:35.771034+0000","last_active":"2024-09-14T11:56:35.771034+0000","last_peered":"2024-09-14T11:56:35.771034+0000","last_clean":"2024-09-14T11:56:35.771034+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:56:35.771034+0000","last_undegraded":"2024-09-14T11:56:35.771034+0000","last_fullsized":"2024-09-14T11:56:35.771034+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1229","last_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_deep_scrub":"263'1229","last_deep_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.770916+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":1200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:33.485010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'358","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.557531+0000","last_change":"2024-09-14T11:56:28.557531+0000","last_active":"2024-09-14T11:56:28.557531+0000","last_peered":"2024-09-14T11:56:28.557531+0000","last_clean":"2024-09-14T11:56:28.557531+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:28.557531+0000","last_undegraded":"2024-09-14T11:56:28.557531+0000","last_fullsized":"2024-09-14T11:56:28.557531+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.557427+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:28.224602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":41733,"num_write":1105,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.791334+0000","last_change":"2024-09-14T11:14:08.133899+0000","last_active":"2024-09-14T11:53:09.791334+0000","last_peered":"2024-09-14T11:53:09.791334+0000","last_clean":"2024-09-14T11:53:09.791334+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:53:09.791334+0000","last_undegraded":"2024-09-14T11:53:09.791334+0000","last_fullsized":"2024-09-14T11:53:09.791334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:53.760916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'355","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.626523+0000","last_change":"2024-09-14T11:14:10.148253+0000","last_active":"2024-09-14T11:56:14.626523+0000","last_peered":"2024-09-14T11:56:14.626523+0000","last_clean":"2024-09-14T11:56:14.626523+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:14.626523+0000","last_undegraded":"2024-09-14T11:56:14.626523+0000","last_fullsized":"2024-09-14T11:56:14.626523+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:31.054267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.892192+0000","last_change":"2024-09-14T11:14:12.146180+0000","last_active":"2024-09-14T11:52:29.892192+0000","last_peered":"2024-09-14T11:52:29.892192+0000","last_clean":"2024-09-14T11:52:29.892192+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:52:29.892192+0000","last_undegraded":"2024-09-14T11:52:29.892192+0000","last_fullsized":"2024-09-14T11:52:29.892192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:08.096291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'551","reported_seq":1353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.743153+0000","last_change":"2024-09-14T11:14:14.163358+0000","last_active":"2024-09-14T11:55:42.743153+0000","last_peered":"2024-09-14T11:55:42.743153+0000","last_clean":"2024-09-14T11:55:42.743153+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:55:42.743153+0000","last_undegraded":"2024-09-14T11:55:42.743153+0000","last_fullsized":"2024-09-14T11:55:42.743153+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:33.528715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'806","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.715525+0000","last_change":"2024-09-14T11:56:27.715525+0000","last_active":"2024-09-14T11:56:27.715525+0000","last_peered":"2024-09-14T11:56:27.715525+0000","last_clean":"2024-09-14T11:56:27.715525+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:56:27.715525+0000","last_undegraded":"2024-09-14T11:56:27.715525+0000","last_fullsized":"2024-09-14T11:56:27.715525+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.715433+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:50.726219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'313","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.855003+0000","last_change":"2024-09-14T11:56:32.855003+0000","last_active":"2024-09-14T11:56:32.855003+0000","last_peered":"2024-09-14T11:56:32.855003+0000","last_clean":"2024-09-14T11:56:32.855003+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:32.855003+0000","last_undegraded":"2024-09-14T11:56:32.855003+0000","last_fullsized":"2024-09-14T11:56:32.855003+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.854894+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:57.072216+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":67475,"num_write":1031,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.846368+0000","last_change":"2024-09-14T11:56:34.846368+0000","last_active":"2024-09-14T11:56:34.846368+0000","last_peered":"2024-09-14T11:56:34.846368+0000","last_clean":"2024-09-14T11:56:34.846368+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:56:34.846368+0000","last_undegraded":"2024-09-14T11:56:34.846368+0000","last_fullsized":"2024-09-14T11:56:34.846368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.846285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:47.433018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'293","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.357605+0000","last_change":"2024-09-14T11:14:10.154690+0000","last_active":"2024-09-14T11:56:15.357605+0000","last_peered":"2024-09-14T11:56:15.357605+0000","last_clean":"2024-09-14T11:56:15.357605+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:56:15.357605+0000","last_undegraded":"2024-09-14T11:56:15.357605+0000","last_fullsized":"2024-09-14T11:56:15.357605+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:11.627375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49558,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1126,"num_write":402,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899412+0000","last_change":"2024-09-14T11:14:12.151137+0000","last_active":"2024-09-14T11:53:19.899412+0000","last_peered":"2024-09-14T11:53:19.899412+0000","last_clean":"2024-09-14T11:53:19.899412+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:53:19.899412+0000","last_undegraded":"2024-09-14T11:53:19.899412+0000","last_fullsized":"2024-09-14T11:53:19.899412+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:29.769264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'118","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.889408+0000","last_change":"2024-09-14T11:14:14.157438+0000","last_active":"2024-09-14T11:55:32.889408+0000","last_peered":"2024-09-14T11:55:32.889408+0000","last_clean":"2024-09-14T11:55:32.889408+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:55:32.889408+0000","last_undegraded":"2024-09-14T11:55:32.889408+0000","last_fullsized":"2024-09-14T11:55:32.889408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:00.893536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1042","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.270323+0000","last_change":"2024-09-14T11:56:30.270323+0000","last_active":"2024-09-14T11:56:30.270323+0000","last_peered":"2024-09-14T11:56:30.270323+0000","last_clean":"2024-09-14T11:56:30.270323+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:56:30.270323+0000","last_undegraded":"2024-09-14T11:56:30.270323+0000","last_fullsized":"2024-09-14T11:56:30.270323+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1042","last_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_deep_scrub":"263'1042","last_deep_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.270230+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.888140+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'294","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.494772+0000","last_change":"2024-09-14T11:56:24.494772+0000","last_active":"2024-09-14T11:56:24.494772+0000","last_peered":"2024-09-14T11:56:24.494772+0000","last_clean":"2024-09-14T11:56:24.494772+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:24.494772+0000","last_undegraded":"2024-09-14T11:56:24.494772+0000","last_fullsized":"2024-09-14T11:56:24.494772+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.494631+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:43.745446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":31073,"num_write":909,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.899748+0000","last_change":"2024-09-14T11:56:36.899748+0000","last_active":"2024-09-14T11:56:36.899748+0000","last_peered":"2024-09-14T11:56:36.899748+0000","last_clean":"2024-09-14T11:56:36.899748+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:56:36.899748+0000","last_undegraded":"2024-09-14T11:56:36.899748+0000","last_fullsized":"2024-09-14T11:56:36.899748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.899653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:58.910589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'300","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.732982+0000","last_change":"2024-09-14T11:14:10.152183+0000","last_active":"2024-09-14T11:56:14.732982+0000","last_peered":"2024-09-14T11:56:14.732982+0000","last_clean":"2024-09-14T11:56:14.732982+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:14.732982+0000","last_undegraded":"2024-09-14T11:56:14.732982+0000","last_fullsized":"2024-09-14T11:56:14.732982+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.467798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'792","reported_seq":4045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.441275+0000","last_change":"2024-09-14T11:14:12.147169+0000","last_active":"2024-09-14T11:56:15.441275+0000","last_peered":"2024-09-14T11:56:15.441275+0000","last_clean":"2024-09-14T11:56:15.441275+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:15.441275+0000","last_undegraded":"2024-09-14T11:56:15.441275+0000","last_fullsized":"2024-09-14T11:56:15.441275+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:25.604563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573078+0000","last_change":"2024-09-14T11:14:14.159513+0000","last_active":"2024-09-14T11:55:41.573078+0000","last_peered":"2024-09-14T11:55:41.573078+0000","last_clean":"2024-09-14T11:55:41.573078+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:55:41.573078+0000","last_undegraded":"2024-09-14T11:55:41.573078+0000","last_fullsized":"2024-09-14T11:55:41.573078+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.781431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'415","reported_seq":1909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.549234+0000","last_change":"2024-09-14T11:56:31.549234+0000","last_active":"2024-09-14T11:56:31.549234+0000","last_peered":"2024-09-14T11:56:31.549234+0000","last_clean":"2024-09-14T11:56:31.549234+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:56:31.549234+0000","last_undegraded":"2024-09-14T11:56:31.549234+0000","last_fullsized":"2024-09-14T11:56:31.549234+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.549129+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:03.979018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.841315+0000","last_change":"2024-09-14T11:56:26.841315+0000","last_active":"2024-09-14T11:56:26.841315+0000","last_peered":"2024-09-14T11:56:26.841315+0000","last_clean":"2024-09-14T11:56:26.841315+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:26.841315+0000","last_undegraded":"2024-09-14T11:56:26.841315+0000","last_fullsized":"2024-09-14T11:56:26.841315+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.841218+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:23.553496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.881630+0000","last_change":"2024-09-14T11:56:37.881630+0000","last_active":"2024-09-14T11:56:37.881630+0000","last_peered":"2024-09-14T11:56:37.881630+0000","last_clean":"2024-09-14T11:56:37.881630+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:56:37.881630+0000","last_undegraded":"2024-09-14T11:56:37.881630+0000","last_fullsized":"2024-09-14T11:56:37.881630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.881540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:26.348899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'495","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.532436+0000","last_change":"2024-09-14T11:14:10.155037+0000","last_active":"2024-09-14T11:56:15.532436+0000","last_peered":"2024-09-14T11:56:15.532436+0000","last_clean":"2024-09-14T11:56:15.532436+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:15.532436+0000","last_undegraded":"2024-09-14T11:56:15.532436+0000","last_fullsized":"2024-09-14T11:56:15.532436+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:11.589031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99468,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":885,"num_read_kb":2186,"num_write":738,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.777908+0000","last_change":"2024-09-14T11:14:12.150404+0000","last_active":"2024-09-14T11:53:14.777908+0000","last_peered":"2024-09-14T11:53:14.777908+0000","last_clean":"2024-09-14T11:53:14.777908+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:53:14.777908+0000","last_undegraded":"2024-09-14T11:53:14.777908+0000","last_fullsized":"2024-09-14T11:53:14.777908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:35.156152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.719675+0000","last_change":"2024-09-14T11:14:14.158980+0000","last_active":"2024-09-14T11:53:53.719675+0000","last_peered":"2024-09-14T11:53:53.719675+0000","last_clean":"2024-09-14T11:53:53.719675+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:53:53.719675+0000","last_undegraded":"2024-09-14T11:53:53.719675+0000","last_fullsized":"2024-09-14T11:53:53.719675+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'847","reported_seq":2521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.698744+0000","last_change":"2024-09-14T11:56:28.698744+0000","last_active":"2024-09-14T11:56:28.698744+0000","last_peered":"2024-09-14T11:56:28.698744+0000","last_clean":"2024-09-14T11:56:28.698744+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:56:28.698744+0000","last_undegraded":"2024-09-14T11:56:28.698744+0000","last_fullsized":"2024-09-14T11:56:28.698744+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'847","last_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_deep_scrub":"263'847","last_deep_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.698654+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":800,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:40.307674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'386","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.114483+0000","last_change":"2024-09-14T11:56:22.114483+0000","last_active":"2024-09-14T11:56:22.114483+0000","last_peered":"2024-09-14T11:56:22.114483+0000","last_clean":"2024-09-14T11:56:22.114483+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:22.114483+0000","last_undegraded":"2024-09-14T11:56:22.114483+0000","last_fullsized":"2024-09-14T11:56:22.114483+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.114372+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:40.637875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":715,"num_read_kb":16906,"num_write":1227,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.771872+0000","last_change":"2024-09-14T11:14:08.130949+0000","last_active":"2024-09-14T11:52:24.771872+0000","last_peered":"2024-09-14T11:52:24.771872+0000","last_clean":"2024-09-14T11:52:24.771872+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:52:24.771872+0000","last_undegraded":"2024-09-14T11:52:24.771872+0000","last_fullsized":"2024-09-14T11:52:24.771872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:57.885759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.591066+0000","last_change":"2024-09-14T11:14:10.152305+0000","last_active":"2024-09-14T11:56:15.591066+0000","last_peered":"2024-09-14T11:56:15.591066+0000","last_clean":"2024-09-14T11:56:15.591066+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:15.591066+0000","last_undegraded":"2024-09-14T11:56:15.591066+0000","last_fullsized":"2024-09-14T11:56:15.591066+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:30.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894361+0000","last_change":"2024-09-14T11:14:12.155158+0000","last_active":"2024-09-14T11:52:34.894361+0000","last_peered":"2024-09-14T11:52:34.894361+0000","last_clean":"2024-09-14T11:52:34.894361+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:52:34.894361+0000","last_undegraded":"2024-09-14T11:52:34.894361+0000","last_fullsized":"2024-09-14T11:52:34.894361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:57.899880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.891276+0000","last_change":"2024-09-14T11:14:14.161551+0000","last_active":"2024-09-14T11:55:32.891276+0000","last_peered":"2024-09-14T11:55:32.891276+0000","last_clean":"2024-09-14T11:55:32.891276+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:55:32.891276+0000","last_undegraded":"2024-09-14T11:55:32.891276+0000","last_fullsized":"2024-09-14T11:55:32.891276+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:31.034926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1644","reported_seq":3316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.715837+0000","last_change":"2024-09-14T11:56:29.715837+0000","last_active":"2024-09-14T11:56:29.715837+0000","last_peered":"2024-09-14T11:56:29.715837+0000","last_clean":"2024-09-14T11:56:29.715837+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:56:29.715837+0000","last_undegraded":"2024-09-14T11:56:29.715837+0000","last_fullsized":"2024-09-14T11:56:29.715837+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1644","last_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_deep_scrub":"263'1644","last_deep_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.715743+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:27.695414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.233890+0000","last_change":"2024-09-14T11:56:27.233890+0000","last_active":"2024-09-14T11:56:27.233890+0000","last_peered":"2024-09-14T11:56:27.233890+0000","last_clean":"2024-09-14T11:56:27.233890+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:27.233890+0000","last_undegraded":"2024-09-14T11:56:27.233890+0000","last_fullsized":"2024-09-14T11:56:27.233890+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.233781+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.725234+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.739989+0000","last_change":"2024-09-14T11:56:37.739989+0000","last_active":"2024-09-14T11:56:37.739989+0000","last_peered":"2024-09-14T11:56:37.739989+0000","last_clean":"2024-09-14T11:56:37.739989+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:56:37.739989+0000","last_undegraded":"2024-09-14T11:56:37.739989+0000","last_fullsized":"2024-09-14T11:56:37.739989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.739899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:13.301117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'294","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.186050+0000","last_change":"2024-09-14T11:14:10.147623+0000","last_active":"2024-09-14T11:56:15.186050+0000","last_peered":"2024-09-14T11:56:15.186050+0000","last_clean":"2024-09-14T11:56:15.186050+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:56:15.186050+0000","last_undegraded":"2024-09-14T11:56:15.186050+0000","last_fullsized":"2024-09-14T11:56:15.186050+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:59.040566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69648,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1150,"num_write":402,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'761","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.980060+0000","last_change":"2024-09-14T11:14:12.150811+0000","last_active":"2024-09-14T11:56:14.980060+0000","last_peered":"2024-09-14T11:56:14.980060+0000","last_clean":"2024-09-14T11:56:14.980060+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:14.980060+0000","last_undegraded":"2024-09-14T11:56:14.980060+0000","last_fullsized":"2024-09-14T11:56:14.980060+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:59.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'145","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.116982+0000","last_change":"2024-09-14T11:14:14.152510+0000","last_active":"2024-09-14T11:54:26.116982+0000","last_peered":"2024-09-14T11:54:26.116982+0000","last_clean":"2024-09-14T11:54:26.116982+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:54:26.116982+0000","last_undegraded":"2024-09-14T11:54:26.116982+0000","last_fullsized":"2024-09-14T11:54:26.116982+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.721902+0000","last_change":"2024-09-14T11:56:30.721902+0000","last_active":"2024-09-14T11:56:30.721902+0000","last_peered":"2024-09-14T11:56:30.721902+0000","last_clean":"2024-09-14T11:56:30.721902+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:56:30.721902+0000","last_undegraded":"2024-09-14T11:56:30.721902+0000","last_fullsized":"2024-09-14T11:56:30.721902+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.721816+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:19.890041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.691511+0000","last_change":"2024-09-14T11:56:24.691511+0000","last_active":"2024-09-14T11:56:24.691511+0000","last_peered":"2024-09-14T11:56:24.691511+0000","last_clean":"2024-09-14T11:56:24.691511+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:24.691511+0000","last_undegraded":"2024-09-14T11:56:24.691511+0000","last_fullsized":"2024-09-14T11:56:24.691511+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.691405+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:19.223818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.724714+0000","last_change":"2024-09-14T11:14:08.137840+0000","last_active":"2024-09-14T11:56:13.724714+0000","last_peered":"2024-09-14T11:56:13.724714+0000","last_clean":"2024-09-14T11:56:13.724714+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:13.724714+0000","last_undegraded":"2024-09-14T11:56:13.724714+0000","last_fullsized":"2024-09-14T11:56:13.724714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.414460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'79","reported_seq":592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.808261+0000","last_change":"2024-09-14T11:14:10.153344+0000","last_active":"2024-09-14T11:54:18.808261+0000","last_peered":"2024-09-14T11:54:18.808261+0000","last_clean":"2024-09-14T11:54:18.808261+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:54:18.808261+0000","last_undegraded":"2024-09-14T11:54:18.808261+0000","last_fullsized":"2024-09-14T11:54:18.808261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:08.968908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.230789+0000","last_change":"2024-09-14T11:56:40.230789+0000","last_active":"2024-09-14T11:56:40.230789+0000","last_peered":"2024-09-14T11:56:40.230789+0000","last_clean":"2024-09-14T11:56:40.230789+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:40.230789+0000","last_undegraded":"2024-09-14T11:56:40.230789+0000","last_fullsized":"2024-09-14T11:56:40.230789+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.230641+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:25.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.169895+0000","last_change":"2024-09-14T11:14:14.157483+0000","last_active":"2024-09-14T11:54:27.169895+0000","last_peered":"2024-09-14T11:54:27.169895+0000","last_clean":"2024-09-14T11:54:27.169895+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:54:27.169895+0000","last_undegraded":"2024-09-14T11:54:27.169895+0000","last_fullsized":"2024-09-14T11:54:27.169895+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:28.829014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'513","reported_seq":2136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.782245+0000","last_change":"2024-09-14T11:56:31.782245+0000","last_active":"2024-09-14T11:56:31.782245+0000","last_peered":"2024-09-14T11:56:31.782245+0000","last_clean":"2024-09-14T11:56:31.782245+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:56:31.782245+0000","last_undegraded":"2024-09-14T11:56:31.782245+0000","last_fullsized":"2024-09-14T11:56:31.782245+0000","mapping_epoch":27,"log_start":"263'501","ondisk_log_start":"263'501","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.782127+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:24.425090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.073606+0000","last_change":"2024-09-14T11:56:23.073606+0000","last_active":"2024-09-14T11:56:23.073606+0000","last_peered":"2024-09-14T11:56:23.073606+0000","last_clean":"2024-09-14T11:56:23.073606+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:23.073606+0000","last_undegraded":"2024-09-14T11:56:23.073606+0000","last_fullsized":"2024-09-14T11:56:23.073606+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.073522+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.269212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":524,"num_write":1137,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:25.780132+0000","last_change":"2024-09-14T11:14:08.136517+0000","last_active":"2024-09-14T11:52:25.780132+0000","last_peered":"2024-09-14T11:52:25.780132+0000","last_clean":"2024-09-14T11:52:25.780132+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:52:25.780132+0000","last_undegraded":"2024-09-14T11:52:25.780132+0000","last_fullsized":"2024-09-14T11:52:25.780132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:22.745520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'358","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.456163+0000","last_change":"2024-09-14T11:14:10.153476+0000","last_active":"2024-09-14T11:56:14.456163+0000","last_peered":"2024-09-14T11:56:14.456163+0000","last_clean":"2024-09-14T11:56:14.456163+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:14.456163+0000","last_undegraded":"2024-09-14T11:56:14.456163+0000","last_fullsized":"2024-09-14T11:56:14.456163+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:16.395304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.232538+0000","last_change":"2024-09-14T11:56:39.232538+0000","last_active":"2024-09-14T11:56:39.232538+0000","last_peered":"2024-09-14T11:56:39.232538+0000","last_clean":"2024-09-14T11:56:39.232538+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:56:39.232538+0000","last_undegraded":"2024-09-14T11:56:39.232538+0000","last_fullsized":"2024-09-14T11:56:39.232538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.232412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:21.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'182","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.542886+0000","last_change":"2024-09-14T11:14:14.155863+0000","last_active":"2024-09-14T11:54:08.542886+0000","last_peered":"2024-09-14T11:54:08.542886+0000","last_clean":"2024-09-14T11:54:08.542886+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:54:08.542886+0000","last_undegraded":"2024-09-14T11:54:08.542886+0000","last_fullsized":"2024-09-14T11:54:08.542886+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'466","reported_seq":1965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.229172+0000","last_change":"2024-09-14T11:56:31.229172+0000","last_active":"2024-09-14T11:56:31.229172+0000","last_peered":"2024-09-14T11:56:31.229172+0000","last_clean":"2024-09-14T11:56:31.229172+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:56:31.229172+0000","last_undegraded":"2024-09-14T11:56:31.229172+0000","last_fullsized":"2024-09-14T11:56:31.229172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.229089+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:26.332777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.479532+0000","last_change":"2024-09-14T11:56:23.479532+0000","last_active":"2024-09-14T11:56:23.479532+0000","last_peered":"2024-09-14T11:56:23.479532+0000","last_clean":"2024-09-14T11:56:23.479532+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:56:23.479532+0000","last_undegraded":"2024-09-14T11:56:23.479532+0000","last_fullsized":"2024-09-14T11:56:23.479532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.479446+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.972281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.780627+0000","last_change":"2024-09-14T11:56:23.780627+0000","last_active":"2024-09-14T11:56:23.780627+0000","last_peered":"2024-09-14T11:56:23.780627+0000","last_clean":"2024-09-14T11:56:23.780627+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:56:23.780627+0000","last_undegraded":"2024-09-14T11:56:23.780627+0000","last_fullsized":"2024-09-14T11:56:23.780627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.780539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:19.285862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.893049+0000","last_change":"2024-09-14T11:56:23.893049+0000","last_active":"2024-09-14T11:56:23.893049+0000","last_peered":"2024-09-14T11:56:23.893049+0000","last_clean":"2024-09-14T11:56:23.893049+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:23.893049+0000","last_undegraded":"2024-09-14T11:56:23.893049+0000","last_fullsized":"2024-09-14T11:56:23.893049+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.892977+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:13.522054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":748,"num_read_kb":7472,"num_write":1023,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.796289+0000","last_change":"2024-09-14T11:14:08.127046+0000","last_active":"2024-09-14T11:53:44.796289+0000","last_peered":"2024-09-14T11:53:44.796289+0000","last_clean":"2024-09-14T11:53:44.796289+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:53:44.796289+0000","last_undegraded":"2024-09-14T11:53:44.796289+0000","last_fullsized":"2024-09-14T11:53:44.796289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:28.320083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1441,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.067086+0000","last_change":"2024-09-14T11:14:10.150205+0000","last_active":"2024-09-14T11:56:15.067086+0000","last_peered":"2024-09-14T11:56:15.067086+0000","last_clean":"2024-09-14T11:56:15.067086+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:15.067086+0000","last_undegraded":"2024-09-14T11:56:15.067086+0000","last_fullsized":"2024-09-14T11:56:15.067086+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:59.627142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899257+0000","last_change":"2024-09-14T11:14:12.153336+0000","last_active":"2024-09-14T11:53:14.899257+0000","last_peered":"2024-09-14T11:53:14.899257+0000","last_clean":"2024-09-14T11:53:14.899257+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:53:14.899257+0000","last_undegraded":"2024-09-14T11:53:14.899257+0000","last_fullsized":"2024-09-14T11:53:14.899257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:44.740572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'186","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.171650+0000","last_change":"2024-09-14T11:14:14.160899+0000","last_active":"2024-09-14T11:54:27.171650+0000","last_peered":"2024-09-14T11:54:27.171650+0000","last_clean":"2024-09-14T11:54:27.171650+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:54:27.171650+0000","last_undegraded":"2024-09-14T11:54:27.171650+0000","last_fullsized":"2024-09-14T11:54:27.171650+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:04.990449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1366","reported_seq":3144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.521567+0000","last_change":"2024-09-14T11:56:30.521567+0000","last_active":"2024-09-14T11:56:30.521567+0000","last_peered":"2024-09-14T11:56:30.521567+0000","last_clean":"2024-09-14T11:56:30.521567+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:56:30.521567+0000","last_undegraded":"2024-09-14T11:56:30.521567+0000","last_fullsized":"2024-09-14T11:56:30.521567+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1366","last_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_deep_scrub":"263'1366","last_deep_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.521471+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:00.605893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.538138+0000","last_change":"2024-09-14T11:56:26.538138+0000","last_active":"2024-09-14T11:56:26.538138+0000","last_peered":"2024-09-14T11:56:26.538138+0000","last_clean":"2024-09-14T11:56:26.538138+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:56:26.538138+0000","last_undegraded":"2024-09-14T11:56:26.538138+0000","last_fullsized":"2024-09-14T11:56:26.538138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.538048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:14.343027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'362","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.498768+0000","last_change":"2024-09-14T11:56:23.498768+0000","last_active":"2024-09-14T11:56:23.498768+0000","last_peered":"2024-09-14T11:56:23.498768+0000","last_clean":"2024-09-14T11:56:23.498768+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:23.498768+0000","last_undegraded":"2024-09-14T11:56:23.498768+0000","last_fullsized":"2024-09-14T11:56:23.498768+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.498682+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:31.939526+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029253,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":615,"num_read_kb":6150,"num_write":1149,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.034937+0000","last_change":"2024-09-14T11:14:08.132493+0000","last_active":"2024-09-14T11:53:11.034937+0000","last_peered":"2024-09-14T11:53:11.034937+0000","last_clean":"2024-09-14T11:53:11.034937+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:53:11.034937+0000","last_undegraded":"2024-09-14T11:53:11.034937+0000","last_fullsized":"2024-09-14T11:53:11.034937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:47.392912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1257","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.408704+0000","last_change":"2024-09-14T11:14:10.149170+0000","last_active":"2024-09-14T11:56:15.408704+0000","last_peered":"2024-09-14T11:56:15.408704+0000","last_clean":"2024-09-14T11:56:15.408704+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:15.408704+0000","last_undegraded":"2024-09-14T11:56:15.408704+0000","last_fullsized":"2024-09-14T11:56:15.408704+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:28.655782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1958,"num_read_kb":3608,"num_write":1054,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.798697+0000","last_change":"2024-09-14T11:14:12.148579+0000","last_active":"2024-09-14T11:53:59.798697+0000","last_peered":"2024-09-14T11:53:59.798697+0000","last_clean":"2024-09-14T11:53:59.798697+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:53:59.798697+0000","last_undegraded":"2024-09-14T11:53:59.798697+0000","last_fullsized":"2024-09-14T11:53:59.798697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:34.551801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'132","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.544059+0000","last_change":"2024-09-14T11:14:14.146054+0000","last_active":"2024-09-14T11:54:26.544059+0000","last_peered":"2024-09-14T11:54:26.544059+0000","last_clean":"2024-09-14T11:54:26.544059+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:54:26.544059+0000","last_undegraded":"2024-09-14T11:54:26.544059+0000","last_fullsized":"2024-09-14T11:54:26.544059+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:41.000005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'786","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.813513+0000","last_change":"2024-09-14T11:56:30.813513+0000","last_active":"2024-09-14T11:56:30.813513+0000","last_peered":"2024-09-14T11:56:30.813513+0000","last_clean":"2024-09-14T11:56:30.813513+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:56:30.813513+0000","last_undegraded":"2024-09-14T11:56:30.813513+0000","last_fullsized":"2024-09-14T11:56:30.813513+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'786","last_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_deep_scrub":"263'786","last_deep_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.813419+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:18.621682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.949954+0000","last_change":"2024-09-14T11:56:21.949954+0000","last_active":"2024-09-14T11:56:21.949954+0000","last_peered":"2024-09-14T11:56:21.949954+0000","last_clean":"2024-09-14T11:56:21.949954+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:56:21.949954+0000","last_undegraded":"2024-09-14T11:56:21.949954+0000","last_fullsized":"2024-09-14T11:56:21.949954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.949882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:24.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'342","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.834358+0000","last_change":"2024-09-14T11:56:22.834358+0000","last_active":"2024-09-14T11:56:22.834358+0000","last_peered":"2024-09-14T11:56:22.834358+0000","last_clean":"2024-09-14T11:56:22.834358+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:22.834358+0000","last_undegraded":"2024-09-14T11:56:22.834358+0000","last_fullsized":"2024-09-14T11:56:22.834358+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.834283+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":72010,"num_write":1138,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.862175+0000","last_change":"2024-09-14T11:56:35.862175+0000","last_active":"2024-09-14T11:56:35.862175+0000","last_peered":"2024-09-14T11:56:35.862175+0000","last_clean":"2024-09-14T11:56:35.862175+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:56:35.862175+0000","last_undegraded":"2024-09-14T11:56:35.862175+0000","last_fullsized":"2024-09-14T11:56:35.862175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.862069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:42.054433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'251","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.881867+0000","last_change":"2024-09-14T11:14:10.150542+0000","last_active":"2024-09-14T11:55:42.881867+0000","last_peered":"2024-09-14T11:55:42.881867+0000","last_clean":"2024-09-14T11:55:42.881867+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:55:42.881867+0000","last_undegraded":"2024-09-14T11:55:42.881867+0000","last_fullsized":"2024-09-14T11:55:42.881867+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:40.011295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903323+0000","last_change":"2024-09-14T11:14:12.151445+0000","last_active":"2024-09-14T11:53:49.903323+0000","last_peered":"2024-09-14T11:53:49.903323+0000","last_clean":"2024-09-14T11:53:49.903323+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:53:49.903323+0000","last_undegraded":"2024-09-14T11:53:49.903323+0000","last_fullsized":"2024-09-14T11:53:49.903323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:44.622819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'267","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.261950+0000","last_change":"2024-09-14T11:14:14.160808+0000","last_active":"2024-09-14T11:54:27.261950+0000","last_peered":"2024-09-14T11:54:27.261950+0000","last_clean":"2024-09-14T11:54:27.261950+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:54:27.261950+0000","last_undegraded":"2024-09-14T11:54:27.261950+0000","last_fullsized":"2024-09-14T11:54:27.261950+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:19.370208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'432","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.782814+0000","last_change":"2024-09-14T11:56:29.782814+0000","last_active":"2024-09-14T11:56:29.782814+0000","last_peered":"2024-09-14T11:56:29.782814+0000","last_clean":"2024-09-14T11:56:29.782814+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:56:29.782814+0000","last_undegraded":"2024-09-14T11:56:29.782814+0000","last_fullsized":"2024-09-14T11:56:29.782814+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.782725+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:08.803503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.822497+0000","last_change":"2024-09-14T11:56:22.822497+0000","last_active":"2024-09-14T11:56:22.822497+0000","last_peered":"2024-09-14T11:56:22.822497+0000","last_clean":"2024-09-14T11:56:22.822497+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:56:22.822497+0000","last_undegraded":"2024-09-14T11:56:22.822497+0000","last_fullsized":"2024-09-14T11:56:22.822497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.822377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:42.113203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'323","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.913200+0000","last_change":"2024-09-14T11:56:22.913200+0000","last_active":"2024-09-14T11:56:22.913200+0000","last_peered":"2024-09-14T11:56:22.913200+0000","last_clean":"2024-09-14T11:56:22.913200+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:22.913200+0000","last_undegraded":"2024-09-14T11:56:22.913200+0000","last_fullsized":"2024-09-14T11:56:22.913200+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.913114+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:18.574527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1238,"num_read_kb":7389,"num_write":1100,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903347+0000","last_change":"2024-09-14T11:14:08.128824+0000","last_active":"2024-09-14T11:53:49.903347+0000","last_peered":"2024-09-14T11:53:49.903347+0000","last_clean":"2024-09-14T11:53:49.903347+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:53:49.903347+0000","last_undegraded":"2024-09-14T11:53:49.903347+0000","last_fullsized":"2024-09-14T11:53:49.903347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:21.240092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'121","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914906+0000","last_change":"2024-09-14T11:14:10.153993+0000","last_active":"2024-09-14T11:55:19.914906+0000","last_peered":"2024-09-14T11:55:19.914906+0000","last_clean":"2024-09-14T11:55:19.914906+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:55:19.914906+0000","last_undegraded":"2024-09-14T11:55:19.914906+0000","last_fullsized":"2024-09-14T11:55:19.914906+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:30.799078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.237710+0000","last_change":"2024-09-14T11:56:38.237710+0000","last_active":"2024-09-14T11:56:38.237710+0000","last_peered":"2024-09-14T11:56:38.237710+0000","last_clean":"2024-09-14T11:56:38.237710+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:56:38.237710+0000","last_undegraded":"2024-09-14T11:56:38.237710+0000","last_fullsized":"2024-09-14T11:56:38.237710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.237609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.821273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.459335+0000","last_change":"2024-09-14T11:14:14.159918+0000","last_active":"2024-09-14T11:54:24.459335+0000","last_peered":"2024-09-14T11:54:24.459335+0000","last_clean":"2024-09-14T11:54:24.459335+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:54:24.459335+0000","last_undegraded":"2024-09-14T11:54:24.459335+0000","last_fullsized":"2024-09-14T11:54:24.459335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'460","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.810118+0000","last_change":"2024-09-14T11:56:28.810118+0000","last_active":"2024-09-14T11:56:28.810118+0000","last_peered":"2024-09-14T11:56:28.810118+0000","last_clean":"2024-09-14T11:56:28.810118+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:56:28.810118+0000","last_undegraded":"2024-09-14T11:56:28.810118+0000","last_fullsized":"2024-09-14T11:56:28.810118+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.810021+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.644059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.828138+0000","last_change":"2024-09-14T11:56:24.828138+0000","last_active":"2024-09-14T11:56:24.828138+0000","last_peered":"2024-09-14T11:56:24.828138+0000","last_clean":"2024-09-14T11:56:24.828138+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:24.828138+0000","last_undegraded":"2024-09-14T11:56:24.828138+0000","last_fullsized":"2024-09-14T11:56:24.828138+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.828029+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:30.652084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.916705+0000","last_change":"2024-09-14T11:56:20.916705+0000","last_active":"2024-09-14T11:56:20.916705+0000","last_peered":"2024-09-14T11:56:20.916705+0000","last_clean":"2024-09-14T11:56:20.916705+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:56:20.916705+0000","last_undegraded":"2024-09-14T11:56:20.916705+0000","last_fullsized":"2024-09-14T11:56:20.916705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.916627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:12.576482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.649519+0000","last_change":"2024-09-14T11:56:39.649519+0000","last_active":"2024-09-14T11:56:39.649519+0000","last_peered":"2024-09-14T11:56:39.649519+0000","last_clean":"2024-09-14T11:56:39.649519+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:56:39.649519+0000","last_undegraded":"2024-09-14T11:56:39.649519+0000","last_fullsized":"2024-09-14T11:56:39.649519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.649433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:03.443069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'539","reported_seq":1197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.129709+0000","last_change":"2024-09-14T11:14:10.149213+0000","last_active":"2024-09-14T11:56:15.129709+0000","last_peered":"2024-09-14T11:56:15.129709+0000","last_clean":"2024-09-14T11:56:15.129709+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:15.129709+0000","last_undegraded":"2024-09-14T11:56:15.129709+0000","last_fullsized":"2024-09-14T11:56:15.129709+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:41.451954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":943,"num_read_kb":2151,"num_write":772,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.791397+0000","last_change":"2024-09-14T11:14:12.151179+0000","last_active":"2024-09-14T11:53:50.791397+0000","last_peered":"2024-09-14T11:53:50.791397+0000","last_clean":"2024-09-14T11:53:50.791397+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:53:50.791397+0000","last_undegraded":"2024-09-14T11:53:50.791397+0000","last_fullsized":"2024-09-14T11:53:50.791397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:00.606325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'163","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.780862+0000","last_change":"2024-09-14T11:14:14.155856+0000","last_active":"2024-09-14T11:54:07.780862+0000","last_peered":"2024-09-14T11:54:07.780862+0000","last_clean":"2024-09-14T11:54:07.780862+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:54:07.780862+0000","last_undegraded":"2024-09-14T11:54:07.780862+0000","last_fullsized":"2024-09-14T11:54:07.780862+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:06.203953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'755","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562539+0000","last_change":"2024-09-14T11:56:32.562539+0000","last_active":"2024-09-14T11:56:32.562539+0000","last_peered":"2024-09-14T11:56:32.562539+0000","last_clean":"2024-09-14T11:56:32.562539+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:56:32.562539+0000","last_undegraded":"2024-09-14T11:56:32.562539+0000","last_fullsized":"2024-09-14T11:56:32.562539+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.562454+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:52.777172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'346","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.813989+0000","last_change":"2024-09-14T11:56:26.813989+0000","last_active":"2024-09-14T11:56:26.813989+0000","last_peered":"2024-09-14T11:56:26.813989+0000","last_clean":"2024-09-14T11:56:26.813989+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:26.813989+0000","last_undegraded":"2024-09-14T11:56:26.813989+0000","last_fullsized":"2024-09-14T11:56:26.813989+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.813888+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:55.071316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":25654,"num_write":1001,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.485112+0000","last_change":"2024-09-14T11:56:34.485112+0000","last_active":"2024-09-14T11:56:34.485112+0000","last_peered":"2024-09-14T11:56:34.485112+0000","last_clean":"2024-09-14T11:56:34.485112+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:56:34.485112+0000","last_undegraded":"2024-09-14T11:56:34.485112+0000","last_fullsized":"2024-09-14T11:56:34.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.485023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.746684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.247905+0000","last_change":"2024-09-14T11:56:35.247905+0000","last_active":"2024-09-14T11:56:35.247905+0000","last_peered":"2024-09-14T11:56:35.247905+0000","last_clean":"2024-09-14T11:56:35.247905+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:56:35.247905+0000","last_undegraded":"2024-09-14T11:56:35.247905+0000","last_fullsized":"2024-09-14T11:56:35.247905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.247811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.168290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.533448+0000","last_change":"2024-09-14T11:14:10.139669+0000","last_active":"2024-09-14T11:54:47.533448+0000","last_peered":"2024-09-14T11:54:47.533448+0000","last_clean":"2024-09-14T11:54:47.533448+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:54:47.533448+0000","last_undegraded":"2024-09-14T11:54:47.533448+0000","last_fullsized":"2024-09-14T11:54:47.533448+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:53.709411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'810","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.658795+0000","last_change":"2024-09-14T11:14:12.147417+0000","last_active":"2024-09-14T11:56:15.658795+0000","last_peered":"2024-09-14T11:56:15.658795+0000","last_clean":"2024-09-14T11:56:15.658795+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:15.658795+0000","last_undegraded":"2024-09-14T11:56:15.658795+0000","last_fullsized":"2024-09-14T11:56:15.658795+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.126531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'93","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.910691+0000","last_change":"2024-09-14T11:14:14.157125+0000","last_active":"2024-09-14T11:54:49.910691+0000","last_peered":"2024-09-14T11:54:49.910691+0000","last_clean":"2024-09-14T11:54:49.910691+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:54:49.910691+0000","last_undegraded":"2024-09-14T11:54:49.910691+0000","last_fullsized":"2024-09-14T11:54:49.910691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:21.815471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'360","reported_seq":1842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.042831+0000","last_change":"2024-09-14T11:56:33.042831+0000","last_active":"2024-09-14T11:56:33.042831+0000","last_peered":"2024-09-14T11:56:33.042831+0000","last_clean":"2024-09-14T11:56:33.042831+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:56:33.042831+0000","last_undegraded":"2024-09-14T11:56:33.042831+0000","last_fullsized":"2024-09-14T11:56:33.042831+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.042715+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:58.519932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'336","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.879898+0000","last_change":"2024-09-14T11:56:24.879898+0000","last_active":"2024-09-14T11:56:24.879898+0000","last_peered":"2024-09-14T11:56:24.879898+0000","last_clean":"2024-09-14T11:56:24.879898+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:24.879898+0000","last_undegraded":"2024-09-14T11:56:24.879898+0000","last_fullsized":"2024-09-14T11:56:24.879898+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.879817+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:17.339902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":1407,"num_write":989,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.878547+0000","last_change":"2024-09-14T11:56:21.878547+0000","last_active":"2024-09-14T11:56:21.878547+0000","last_peered":"2024-09-14T11:56:21.878547+0000","last_clean":"2024-09-14T11:56:21.878547+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:56:21.878547+0000","last_undegraded":"2024-09-14T11:56:21.878547+0000","last_fullsized":"2024-09-14T11:56:21.878547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.878477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:14.405917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790665+0000","last_change":"2024-09-14T11:14:08.135691+0000","last_active":"2024-09-14T11:53:45.790665+0000","last_peered":"2024-09-14T11:53:45.790665+0000","last_clean":"2024-09-14T11:53:45.790665+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:53:45.790665+0000","last_undegraded":"2024-09-14T11:53:45.790665+0000","last_fullsized":"2024-09-14T11:53:45.790665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:47.242553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'99","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.842534+0000","last_change":"2024-09-14T11:14:10.151595+0000","last_active":"2024-09-14T11:54:18.842534+0000","last_peered":"2024-09-14T11:54:18.842534+0000","last_clean":"2024-09-14T11:54:18.842534+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:54:18.842534+0000","last_undegraded":"2024-09-14T11:54:18.842534+0000","last_fullsized":"2024-09-14T11:54:18.842534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:13.188765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'790","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.622789+0000","last_change":"2024-09-14T11:14:12.153305+0000","last_active":"2024-09-14T11:56:15.622789+0000","last_peered":"2024-09-14T11:56:15.622789+0000","last_clean":"2024-09-14T11:56:15.622789+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:15.622789+0000","last_undegraded":"2024-09-14T11:56:15.622789+0000","last_fullsized":"2024-09-14T11:56:15.622789+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:43.896569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'327","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.573474+0000","last_change":"2024-09-14T11:14:14.156952+0000","last_active":"2024-09-14T11:55:41.573474+0000","last_peered":"2024-09-14T11:55:41.573474+0000","last_clean":"2024-09-14T11:55:41.573474+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:55:41.573474+0000","last_undegraded":"2024-09-14T11:55:41.573474+0000","last_fullsized":"2024-09-14T11:55:41.573474+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:32.686915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1138","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.720530+0000","last_change":"2024-09-14T11:56:26.720530+0000","last_active":"2024-09-14T11:56:26.720530+0000","last_peered":"2024-09-14T11:56:26.720530+0000","last_clean":"2024-09-14T11:56:26.720530+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:56:26.720530+0000","last_undegraded":"2024-09-14T11:56:26.720530+0000","last_fullsized":"2024-09-14T11:56:26.720530+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.720427+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:26.572105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'384","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.466221+0000","last_change":"2024-09-14T11:56:21.466221+0000","last_active":"2024-09-14T11:56:21.466221+0000","last_peered":"2024-09-14T11:56:21.466221+0000","last_clean":"2024-09-14T11:56:21.466221+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:21.466221+0000","last_undegraded":"2024-09-14T11:56:21.466221+0000","last_fullsized":"2024-09-14T11:56:21.466221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.466142+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:51.285530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":7233,"num_write":1301,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.096139+0000","last_change":"2024-09-14T11:56:23.096139+0000","last_active":"2024-09-14T11:56:23.096139+0000","last_peered":"2024-09-14T11:56:23.096139+0000","last_clean":"2024-09-14T11:56:23.096139+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:56:23.096139+0000","last_undegraded":"2024-09-14T11:56:23.096139+0000","last_fullsized":"2024-09-14T11:56:23.096139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.096056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:44.997173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.171745+0000","last_change":"2024-09-14T11:56:38.171745+0000","last_active":"2024-09-14T11:56:38.171745+0000","last_peered":"2024-09-14T11:56:38.171745+0000","last_clean":"2024-09-14T11:56:38.171745+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:56:38.171745+0000","last_undegraded":"2024-09-14T11:56:38.171745+0000","last_fullsized":"2024-09-14T11:56:38.171745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.171651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'761","reported_seq":1466,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.475935+0000","last_change":"2024-09-14T11:14:10.152020+0000","last_active":"2024-09-14T11:56:15.475935+0000","last_peered":"2024-09-14T11:56:15.475935+0000","last_clean":"2024-09-14T11:56:15.475935+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:15.475935+0000","last_undegraded":"2024-09-14T11:56:15.475935+0000","last_fullsized":"2024-09-14T11:56:15.475935+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:50.734251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1362,"num_read_kb":3256,"num_write":1124,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903071+0000","last_change":"2024-09-14T11:14:12.151322+0000","last_active":"2024-09-14T11:53:49.903071+0000","last_peered":"2024-09-14T11:53:49.903071+0000","last_clean":"2024-09-14T11:53:49.903071+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:53:49.903071+0000","last_undegraded":"2024-09-14T11:53:49.903071+0000","last_fullsized":"2024-09-14T11:53:49.903071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:55.159584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.544659+0000","last_change":"2024-09-14T11:14:14.164267+0000","last_active":"2024-09-14T11:54:08.544659+0000","last_peered":"2024-09-14T11:54:08.544659+0000","last_clean":"2024-09-14T11:54:08.544659+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:54:08.544659+0000","last_undegraded":"2024-09-14T11:54:08.544659+0000","last_fullsized":"2024-09-14T11:54:08.544659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:05.688641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'143","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.219226+0000","last_change":"2024-09-14T11:14:14.160222+0000","last_active":"2024-09-14T11:54:27.219226+0000","last_peered":"2024-09-14T11:54:27.219226+0000","last_clean":"2024-09-14T11:54:27.219226+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:54:27.219226+0000","last_undegraded":"2024-09-14T11:54:27.219226+0000","last_fullsized":"2024-09-14T11:54:27.219226+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:30.394037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'433","reported_seq":2063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.757762+0000","last_change":"2024-09-14T11:56:31.757762+0000","last_active":"2024-09-14T11:56:31.757762+0000","last_peered":"2024-09-14T11:56:31.757762+0000","last_clean":"2024-09-14T11:56:31.757762+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:56:31.757762+0000","last_undegraded":"2024-09-14T11:56:31.757762+0000","last_fullsized":"2024-09-14T11:56:31.757762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.757652+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:26.947794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.662921+0000","last_change":"2024-09-14T11:56:23.662921+0000","last_active":"2024-09-14T11:56:23.662921+0000","last_peered":"2024-09-14T11:56:23.662921+0000","last_clean":"2024-09-14T11:56:23.662921+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:23.662921+0000","last_undegraded":"2024-09-14T11:56:23.662921+0000","last_fullsized":"2024-09-14T11:56:23.662921+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.662820+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.362361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.764130+0000","last_change":"2024-09-14T11:56:36.764130+0000","last_active":"2024-09-14T11:56:36.764130+0000","last_peered":"2024-09-14T11:56:36.764130+0000","last_clean":"2024-09-14T11:56:36.764130+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:36.764130+0000","last_undegraded":"2024-09-14T11:56:36.764130+0000","last_fullsized":"2024-09-14T11:56:36.764130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.764053+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.131436+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'263","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.676370+0000","last_change":"2024-09-14T11:14:10.149828+0000","last_active":"2024-09-14T11:56:14.676370+0000","last_peered":"2024-09-14T11:56:14.676370+0000","last_clean":"2024-09-14T11:56:14.676370+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:14.676370+0000","last_undegraded":"2024-09-14T11:56:14.676370+0000","last_fullsized":"2024-09-14T11:56:14.676370+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.820903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903614+0000","last_change":"2024-09-14T11:14:12.152653+0000","last_active":"2024-09-14T11:53:54.903614+0000","last_peered":"2024-09-14T11:53:54.903614+0000","last_clean":"2024-09-14T11:53:54.903614+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:53:54.903614+0000","last_undegraded":"2024-09-14T11:53:54.903614+0000","last_fullsized":"2024-09-14T11:53:54.903614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:35.385522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.111496+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:27.111496+0000","last_peered":"2024-09-14T11:54:27.111496+0000","last_clean":"2024-09-14T11:54:27.111496+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:27.111496+0000","last_undegraded":"2024-09-14T11:54:27.111496+0000","last_fullsized":"2024-09-14T11:54:27.111496+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'784","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.737175+0000","last_change":"2024-09-14T11:56:32.737175+0000","last_active":"2024-09-14T11:56:32.737175+0000","last_peered":"2024-09-14T11:56:32.737175+0000","last_clean":"2024-09-14T11:56:32.737175+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:56:32.737175+0000","last_undegraded":"2024-09-14T11:56:32.737175+0000","last_fullsized":"2024-09-14T11:56:32.737175+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'784","last_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_deep_scrub":"263'784","last_deep_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.737071+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:46.307192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'373","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.476776+0000","last_change":"2024-09-14T11:56:30.476776+0000","last_active":"2024-09-14T11:56:30.476776+0000","last_peered":"2024-09-14T11:56:30.476776+0000","last_clean":"2024-09-14T11:56:30.476776+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:30.476776+0000","last_undegraded":"2024-09-14T11:56:30.476776+0000","last_fullsized":"2024-09-14T11:56:30.476776+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.476624+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:37.040267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":24187,"num_write":1164,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903109+0000","last_change":"2024-09-14T11:14:08.132760+0000","last_active":"2024-09-14T11:53:49.903109+0000","last_peered":"2024-09-14T11:53:49.903109+0000","last_clean":"2024-09-14T11:53:49.903109+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:53:49.903109+0000","last_undegraded":"2024-09-14T11:53:49.903109+0000","last_fullsized":"2024-09-14T11:53:49.903109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.260856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'48","reported_seq":545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.684887+0000","last_change":"2024-09-14T11:14:10.148065+0000","last_active":"2024-09-14T11:54:18.684887+0000","last_peered":"2024-09-14T11:54:18.684887+0000","last_clean":"2024-09-14T11:54:18.684887+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:54:18.684887+0000","last_undegraded":"2024-09-14T11:54:18.684887+0000","last_fullsized":"2024-09-14T11:54:18.684887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:38.290868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797903+0000","last_change":"2024-09-14T11:14:12.150881+0000","last_active":"2024-09-14T11:53:54.797903+0000","last_peered":"2024-09-14T11:53:54.797903+0000","last_clean":"2024-09-14T11:53:54.797903+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:53:54.797903+0000","last_undegraded":"2024-09-14T11:53:54.797903+0000","last_fullsized":"2024-09-14T11:53:54.797903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:58.272068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'218","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.536299+0000","last_change":"2024-09-14T11:14:14.153783+0000","last_active":"2024-09-14T11:54:26.536299+0000","last_peered":"2024-09-14T11:54:26.536299+0000","last_clean":"2024-09-14T11:54:26.536299+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:54:26.536299+0000","last_undegraded":"2024-09-14T11:54:26.536299+0000","last_fullsized":"2024-09-14T11:54:26.536299+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:47.004373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'917","reported_seq":2661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.036282+0000","last_change":"2024-09-14T11:56:29.036282+0000","last_active":"2024-09-14T11:56:29.036282+0000","last_peered":"2024-09-14T11:56:29.036282+0000","last_clean":"2024-09-14T11:56:29.036282+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:56:29.036282+0000","last_undegraded":"2024-09-14T11:56:29.036282+0000","last_fullsized":"2024-09-14T11:56:29.036282+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'917","last_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_deep_scrub":"263'917","last_deep_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.036185+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":900,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.766117+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.816297+0000","last_change":"2024-09-14T11:56:25.816297+0000","last_active":"2024-09-14T11:56:25.816297+0000","last_peered":"2024-09-14T11:56:25.816297+0000","last_clean":"2024-09-14T11:56:25.816297+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:25.816297+0000","last_undegraded":"2024-09-14T11:56:25.816297+0000","last_fullsized":"2024-09-14T11:56:25.816297+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.816150+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:23.901347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.796955+0000","last_change":"2024-09-14T11:14:08.136483+0000","last_active":"2024-09-14T11:53:49.796955+0000","last_peered":"2024-09-14T11:53:49.796955+0000","last_clean":"2024-09-14T11:53:49.796955+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:53:49.796955+0000","last_undegraded":"2024-09-14T11:53:49.796955+0000","last_fullsized":"2024-09-14T11:53:49.796955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:28.874481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.055458+0000","last_change":"2024-09-14T11:14:10.151225+0000","last_active":"2024-09-14T11:56:14.055458+0000","last_peered":"2024-09-14T11:56:14.055458+0000","last_clean":"2024-09-14T11:56:14.055458+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:14.055458+0000","last_undegraded":"2024-09-14T11:56:14.055458+0000","last_fullsized":"2024-09-14T11:56:14.055458+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:07.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:55.792203+0000","last_change":"2024-09-14T11:14:12.152706+0000","last_active":"2024-09-14T11:53:55.792203+0000","last_peered":"2024-09-14T11:53:55.792203+0000","last_clean":"2024-09-14T11:53:55.792203+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:53:55.792203+0000","last_undegraded":"2024-09-14T11:53:55.792203+0000","last_fullsized":"2024-09-14T11:53:55.792203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:02.677520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'129","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.902922+0000","last_change":"2024-09-14T11:14:14.163359+0000","last_active":"2024-09-14T11:54:26.902922+0000","last_peered":"2024-09-14T11:54:26.902922+0000","last_clean":"2024-09-14T11:54:26.902922+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:54:26.902922+0000","last_undegraded":"2024-09-14T11:54:26.902922+0000","last_fullsized":"2024-09-14T11:54:26.902922+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:44.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'565","reported_seq":2300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.144947+0000","last_change":"2024-09-14T11:56:36.144947+0000","last_active":"2024-09-14T11:56:36.144947+0000","last_peered":"2024-09-14T11:56:36.144947+0000","last_clean":"2024-09-14T11:56:36.144947+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:56:36.144947+0000","last_undegraded":"2024-09-14T11:56:36.144947+0000","last_fullsized":"2024-09-14T11:56:36.144947+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'565","last_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_deep_scrub":"263'565","last_deep_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.144850+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:25.651462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.513418+0000","last_change":"2024-09-14T11:56:22.513418+0000","last_active":"2024-09-14T11:56:22.513418+0000","last_peered":"2024-09-14T11:56:22.513418+0000","last_clean":"2024-09-14T11:56:22.513418+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:22.513418+0000","last_undegraded":"2024-09-14T11:56:22.513418+0000","last_fullsized":"2024-09-14T11:56:22.513418+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.513319+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.055131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":715,"num_read_kb":20814,"num_write":1368,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.285132+0000","last_change":"2024-09-14T11:56:36.285132+0000","last_active":"2024-09-14T11:56:36.285132+0000","last_peered":"2024-09-14T11:56:36.285132+0000","last_clean":"2024-09-14T11:56:36.285132+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:56:36.285132+0000","last_undegraded":"2024-09-14T11:56:36.285132+0000","last_fullsized":"2024-09-14T11:56:36.285132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.285037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.139207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'266","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.855796+0000","last_change":"2024-09-14T11:14:10.151325+0000","last_active":"2024-09-14T11:56:13.855796+0000","last_peered":"2024-09-14T11:56:13.855796+0000","last_clean":"2024-09-14T11:56:13.855796+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:13.855796+0000","last_undegraded":"2024-09-14T11:56:13.855796+0000","last_fullsized":"2024-09-14T11:56:13.855796+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:32.211592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903894+0000","last_change":"2024-09-14T11:14:12.154497+0000","last_active":"2024-09-14T11:53:54.903894+0000","last_peered":"2024-09-14T11:53:54.903894+0000","last_clean":"2024-09-14T11:53:54.903894+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:53:54.903894+0000","last_undegraded":"2024-09-14T11:53:54.903894+0000","last_fullsized":"2024-09-14T11:53:54.903894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:27.388051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.194337+0000","last_change":"2024-09-14T11:56:32.194337+0000","last_active":"2024-09-14T11:56:32.194337+0000","last_peered":"2024-09-14T11:56:32.194337+0000","last_clean":"2024-09-14T11:56:32.194337+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:56:32.194337+0000","last_undegraded":"2024-09-14T11:56:32.194337+0000","last_fullsized":"2024-09-14T11:56:32.194337+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.194246+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:46.983995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.027053+0000","last_change":"2024-09-14T11:56:24.027053+0000","last_active":"2024-09-14T11:56:24.027053+0000","last_peered":"2024-09-14T11:56:24.027053+0000","last_clean":"2024-09-14T11:56:24.027053+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:24.027053+0000","last_undegraded":"2024-09-14T11:56:24.027053+0000","last_fullsized":"2024-09-14T11:56:24.027053+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.026967+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:04.386753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":1976,"num_write":1075,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906070+0000","last_change":"2024-09-14T11:14:08.125925+0000","last_active":"2024-09-14T11:54:14.906070+0000","last_peered":"2024-09-14T11:54:14.906070+0000","last_clean":"2024-09-14T11:54:14.906070+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:54:14.906070+0000","last_undegraded":"2024-09-14T11:54:14.906070+0000","last_fullsized":"2024-09-14T11:54:14.906070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:37.664162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'493","reported_seq":1120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.654794+0000","last_change":"2024-09-14T11:14:10.149612+0000","last_active":"2024-09-14T11:56:15.654794+0000","last_peered":"2024-09-14T11:56:15.654794+0000","last_clean":"2024-09-14T11:56:15.654794+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:15.654794+0000","last_undegraded":"2024-09-14T11:56:15.654794+0000","last_fullsized":"2024-09-14T11:56:15.654794+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100440,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2109,"num_write":762,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.022383+0000","last_change":"2024-09-14T11:14:12.152526+0000","last_active":"2024-09-14T11:51:46.022383+0000","last_peered":"2024-09-14T11:51:46.022383+0000","last_clean":"2024-09-14T11:51:46.022383+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:51:46.022383+0000","last_undegraded":"2024-09-14T11:51:46.022383+0000","last_fullsized":"2024-09-14T11:51:46.022383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:58.316198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.457622+0000","last_change":"2024-09-14T11:14:14.153440+0000","last_active":"2024-09-14T11:54:24.457622+0000","last_peered":"2024-09-14T11:54:24.457622+0000","last_clean":"2024-09-14T11:54:24.457622+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:54:24.457622+0000","last_undegraded":"2024-09-14T11:54:24.457622+0000","last_fullsized":"2024-09-14T11:54:24.457622+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.457388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'413","reported_seq":1954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.580724+0000","last_change":"2024-09-14T11:56:36.580724+0000","last_active":"2024-09-14T11:56:36.580724+0000","last_peered":"2024-09-14T11:56:36.580724+0000","last_clean":"2024-09-14T11:56:36.580724+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:56:36.580724+0000","last_undegraded":"2024-09-14T11:56:36.580724+0000","last_fullsized":"2024-09-14T11:56:36.580724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.580630+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:57.544918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'351","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.810015+0000","last_change":"2024-09-14T11:56:23.810015+0000","last_active":"2024-09-14T11:56:23.810015+0000","last_peered":"2024-09-14T11:56:23.810015+0000","last_clean":"2024-09-14T11:56:23.810015+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:23.810015+0000","last_undegraded":"2024-09-14T11:56:23.810015+0000","last_fullsized":"2024-09-14T11:56:23.810015+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.809947+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:11.325976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":10770,"num_write":1202,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.246504+0000","last_change":"2024-09-14T11:56:37.246504+0000","last_active":"2024-09-14T11:56:37.246504+0000","last_peered":"2024-09-14T11:56:37.246504+0000","last_clean":"2024-09-14T11:56:37.246504+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:56:37.246504+0000","last_undegraded":"2024-09-14T11:56:37.246504+0000","last_fullsized":"2024-09-14T11:56:37.246504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.246409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:58.990350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.931821+0000","last_change":"2024-09-14T11:14:10.152603+0000","last_active":"2024-09-14T11:56:13.931821+0000","last_peered":"2024-09-14T11:56:13.931821+0000","last_clean":"2024-09-14T11:56:13.931821+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:13.931821+0000","last_undegraded":"2024-09-14T11:56:13.931821+0000","last_fullsized":"2024-09-14T11:56:13.931821+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.887234+0000","last_change":"2024-09-14T11:14:12.153956+0000","last_active":"2024-09-14T11:51:44.887234+0000","last_peered":"2024-09-14T11:51:44.887234+0000","last_clean":"2024-09-14T11:51:44.887234+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:51:44.887234+0000","last_undegraded":"2024-09-14T11:51:44.887234+0000","last_fullsized":"2024-09-14T11:51:44.887234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:06.820196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'231","reported_seq":1111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.069083+0000","last_change":"2024-09-14T11:14:14.159808+0000","last_active":"2024-09-14T11:54:25.069083+0000","last_peered":"2024-09-14T11:54:25.069083+0000","last_clean":"2024-09-14T11:54:25.069083+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:54:25.069083+0000","last_undegraded":"2024-09-14T11:54:25.069083+0000","last_fullsized":"2024-09-14T11:54:25.069083+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:54.636606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'497","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.133993+0000","last_change":"2024-09-14T11:56:35.133928+0000","last_active":"2024-09-14T11:56:35.133993+0000","last_peered":"2024-09-14T11:56:35.133993+0000","last_clean":"2024-09-14T11:56:35.133993+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:56:35.133993+0000","last_undegraded":"2024-09-14T11:56:35.133993+0000","last_fullsized":"2024-09-14T11:56:35.133993+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.133843+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:47.774586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.633798+0000","last_change":"2024-09-14T11:56:22.633722+0000","last_active":"2024-09-14T11:56:22.633798+0000","last_peered":"2024-09-14T11:56:22.633798+0000","last_clean":"2024-09-14T11:56:22.633798+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:22.633798+0000","last_undegraded":"2024-09-14T11:56:22.633798+0000","last_fullsized":"2024-09-14T11:56:22.633798+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.633613+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:24.515854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.794720+0000","last_change":"2024-09-14T11:14:08.137009+0000","last_active":"2024-09-14T11:54:10.794720+0000","last_peered":"2024-09-14T11:54:10.794720+0000","last_clean":"2024-09-14T11:54:10.794720+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:54:10.794720+0000","last_undegraded":"2024-09-14T11:54:10.794720+0000","last_fullsized":"2024-09-14T11:54:10.794720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'292","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.905574+0000","last_change":"2024-09-14T11:14:10.154505+0000","last_active":"2024-09-14T11:56:14.905574+0000","last_peered":"2024-09-14T11:56:14.905574+0000","last_clean":"2024-09-14T11:56:14.905574+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:14.905574+0000","last_undegraded":"2024-09-14T11:56:14.905574+0000","last_fullsized":"2024-09-14T11:56:14.905574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.388017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906262+0000","last_change":"2024-09-14T11:14:12.149836+0000","last_active":"2024-09-14T11:54:19.906262+0000","last_peered":"2024-09-14T11:54:19.906262+0000","last_clean":"2024-09-14T11:54:19.906262+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:54:19.906262+0000","last_undegraded":"2024-09-14T11:54:19.906262+0000","last_fullsized":"2024-09-14T11:54:19.906262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:32.031852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'144","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.744952+0000","last_change":"2024-09-14T11:14:14.162000+0000","last_active":"2024-09-14T11:55:42.744952+0000","last_peered":"2024-09-14T11:55:42.744952+0000","last_clean":"2024-09-14T11:55:42.744952+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:55:42.744952+0000","last_undegraded":"2024-09-14T11:55:42.744952+0000","last_fullsized":"2024-09-14T11:55:42.744952+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:31.214748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'422","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832552+0000","last_change":"2024-09-14T11:56:27.832498+0000","last_active":"2024-09-14T11:56:27.832552+0000","last_peered":"2024-09-14T11:56:27.832552+0000","last_clean":"2024-09-14T11:56:27.832552+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:56:27.832552+0000","last_undegraded":"2024-09-14T11:56:27.832552+0000","last_fullsized":"2024-09-14T11:56:27.832552+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'422","last_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_deep_scrub":"263'422","last_deep_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832415+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:22.843154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.528483+0000","last_change":"2024-09-14T11:56:24.528420+0000","last_active":"2024-09-14T11:56:24.528483+0000","last_peered":"2024-09-14T11:56:24.528483+0000","last_clean":"2024-09-14T11:56:24.528483+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:24.528483+0000","last_undegraded":"2024-09-14T11:56:24.528483+0000","last_fullsized":"2024-09-14T11:56:24.528483+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.528314+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.890618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":46735,"num_write":1109,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.774071+0000","last_change":"2024-09-14T11:56:39.774007+0000","last_active":"2024-09-14T11:56:39.774071+0000","last_peered":"2024-09-14T11:56:39.774071+0000","last_clean":"2024-09-14T11:56:39.774071+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:56:39.774071+0000","last_undegraded":"2024-09-14T11:56:39.774071+0000","last_fullsized":"2024-09-14T11:56:39.774071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.773918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:01.996446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'81","reported_seq":594,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.796147+0000","last_change":"2024-09-14T11:14:10.148590+0000","last_active":"2024-09-14T11:54:20.796147+0000","last_peered":"2024-09-14T11:54:20.796147+0000","last_clean":"2024-09-14T11:54:20.796147+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:54:20.796147+0000","last_undegraded":"2024-09-14T11:54:20.796147+0000","last_fullsized":"2024-09-14T11:54:20.796147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:10.509252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.741161+0000","last_change":"2024-09-14T11:14:12.152664+0000","last_active":"2024-09-14T11:56:13.741161+0000","last_peered":"2024-09-14T11:56:13.741161+0000","last_clean":"2024-09-14T11:56:13.741161+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:13.741161+0000","last_undegraded":"2024-09-14T11:56:13.741161+0000","last_fullsized":"2024-09-14T11:56:13.741161+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:48.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":602,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:42.739702+0000","last_change":"2024-09-14T11:14:14.162036+0000","last_active":"2024-09-14T11:55:42.739702+0000","last_peered":"2024-09-14T11:55:42.739702+0000","last_clean":"2024-09-14T11:55:42.739702+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:55:42.739702+0000","last_undegraded":"2024-09-14T11:55:42.739702+0000","last_fullsized":"2024-09-14T11:55:42.739702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.951880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'915","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.792157+0000","last_change":"2024-09-14T11:56:34.792073+0000","last_active":"2024-09-14T11:56:34.792157+0000","last_peered":"2024-09-14T11:56:34.792157+0000","last_clean":"2024-09-14T11:56:34.792157+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:56:34.792157+0000","last_undegraded":"2024-09-14T11:56:34.792157+0000","last_fullsized":"2024-09-14T11:56:34.792157+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'915","last_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_deep_scrub":"263'915","last_deep_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.791978+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.186719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832779+0000","last_change":"2024-09-14T11:56:27.832718+0000","last_active":"2024-09-14T11:56:27.832779+0000","last_peered":"2024-09-14T11:56:27.832779+0000","last_clean":"2024-09-14T11:56:27.832779+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:27.832779+0000","last_undegraded":"2024-09-14T11:56:27.832779+0000","last_fullsized":"2024-09-14T11:56:27.832779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832588+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:52.609553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.800430+0000","last_change":"2024-09-14T11:14:08.138426+0000","last_active":"2024-09-14T11:54:09.800430+0000","last_peered":"2024-09-14T11:54:09.800430+0000","last_clean":"2024-09-14T11:54:09.800430+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:54:09.800430+0000","last_undegraded":"2024-09-14T11:54:09.800430+0000","last_fullsized":"2024-09-14T11:54:09.800430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'298","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.242404+0000","last_change":"2024-09-14T11:14:10.149256+0000","last_active":"2024-09-14T11:56:15.242404+0000","last_peered":"2024-09-14T11:56:15.242404+0000","last_clean":"2024-09-14T11:56:15.242404+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:15.242404+0000","last_undegraded":"2024-09-14T11:56:15.242404+0000","last_fullsized":"2024-09-14T11:56:15.242404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:47.592442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.896607+0000","last_change":"2024-09-14T11:14:12.150595+0000","last_active":"2024-09-14T11:52:54.896607+0000","last_peered":"2024-09-14T11:52:54.896607+0000","last_clean":"2024-09-14T11:52:54.896607+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:52:54.896607+0000","last_undegraded":"2024-09-14T11:52:54.896607+0000","last_fullsized":"2024-09-14T11:52:54.896607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:47.089549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'118","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.835967+0000","last_change":"2024-09-14T11:14:14.159475+0000","last_active":"2024-09-14T11:53:58.835967+0000","last_peered":"2024-09-14T11:53:58.835967+0000","last_clean":"2024-09-14T11:53:58.835967+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:53:58.835967+0000","last_undegraded":"2024-09-14T11:53:58.835967+0000","last_fullsized":"2024-09-14T11:53:58.835967+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:45.105897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.763122+0000","last_change":"2024-09-14T11:56:33.763020+0000","last_active":"2024-09-14T11:56:33.763122+0000","last_peered":"2024-09-14T11:56:33.763122+0000","last_clean":"2024-09-14T11:56:33.763122+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:56:33.763122+0000","last_undegraded":"2024-09-14T11:56:33.763122+0000","last_fullsized":"2024-09-14T11:56:33.763122+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.762877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:10.689175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.799237+0000","last_change":"2024-09-14T11:56:28.799145+0000","last_active":"2024-09-14T11:56:28.799237+0000","last_peered":"2024-09-14T11:56:28.799237+0000","last_clean":"2024-09-14T11:56:28.799237+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:28.799237+0000","last_undegraded":"2024-09-14T11:56:28.799237+0000","last_fullsized":"2024-09-14T11:56:28.799237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.799019+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.449897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043490+0000","last_change":"2024-09-14T11:14:08.133404+0000","last_active":"2024-09-14T11:54:11.043490+0000","last_peered":"2024-09-14T11:54:11.043490+0000","last_clean":"2024-09-14T11:54:11.043490+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:54:11.043490+0000","last_undegraded":"2024-09-14T11:54:11.043490+0000","last_fullsized":"2024-09-14T11:54:11.043490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'263","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.296545+0000","last_change":"2024-09-14T11:14:10.152035+0000","last_active":"2024-09-14T11:56:15.296545+0000","last_peered":"2024-09-14T11:56:15.296545+0000","last_clean":"2024-09-14T11:56:15.296545+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:56:15.296545+0000","last_undegraded":"2024-09-14T11:56:15.296545+0000","last_fullsized":"2024-09-14T11:56:15.296545+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.459789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":976,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.785014+0000","last_change":"2024-09-14T11:14:12.151730+0000","last_active":"2024-09-14T11:53:05.785014+0000","last_peered":"2024-09-14T11:53:05.785014+0000","last_clean":"2024-09-14T11:53:05.785014+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:53:05.785014+0000","last_undegraded":"2024-09-14T11:53:05.785014+0000","last_fullsized":"2024-09-14T11:53:05.785014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:44.746381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'329","reported_seq":1768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.031151+0000","last_change":"2024-09-14T11:56:32.031151+0000","last_active":"2024-09-14T11:56:32.031151+0000","last_peered":"2024-09-14T11:56:32.031151+0000","last_clean":"2024-09-14T11:56:32.031151+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:56:32.031151+0000","last_undegraded":"2024-09-14T11:56:32.031151+0000","last_fullsized":"2024-09-14T11:56:32.031151+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.031055+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:39.902095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'364","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.015176+0000","last_change":"2024-09-14T11:56:28.015176+0000","last_active":"2024-09-14T11:56:28.015176+0000","last_peered":"2024-09-14T11:56:28.015176+0000","last_clean":"2024-09-14T11:56:28.015176+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:28.015176+0000","last_undegraded":"2024-09-14T11:56:28.015176+0000","last_fullsized":"2024-09-14T11:56:28.015176+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.015080+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:02.166337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":1005,"num_write":1035,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.782950+0000","last_change":"2024-09-14T11:14:08.137705+0000","last_active":"2024-09-14T11:52:50.782950+0000","last_peered":"2024-09-14T11:52:50.782950+0000","last_clean":"2024-09-14T11:52:50.782950+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:52:50.782950+0000","last_undegraded":"2024-09-14T11:52:50.782950+0000","last_fullsized":"2024-09-14T11:52:50.782950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:07.112530+0000","last_clean_scrub_stamp":"2024-09-14T11:14:07.112530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:21.751164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'227","reported_seq":780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.786689+0000","last_change":"2024-09-14T11:14:10.155049+0000","last_active":"2024-09-14T11:56:14.786689+0000","last_peered":"2024-09-14T11:56:14.786689+0000","last_clean":"2024-09-14T11:56:14.786689+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:14.786689+0000","last_undegraded":"2024-09-14T11:56:14.786689+0000","last_fullsized":"2024-09-14T11:56:14.786689+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:45.775077+0000","last_change":"2024-09-14T11:14:12.150674+0000","last_active":"2024-09-14T11:51:45.775077+0000","last_peered":"2024-09-14T11:51:45.775077+0000","last_clean":"2024-09-14T11:51:45.775077+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:51:45.775077+0000","last_undegraded":"2024-09-14T11:51:45.775077+0000","last_fullsized":"2024-09-14T11:51:45.775077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:49.433914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'147","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.024834+0000","last_change":"2024-09-14T11:14:14.161497+0000","last_active":"2024-09-14T11:54:25.024834+0000","last_peered":"2024-09-14T11:54:25.024834+0000","last_clean":"2024-09-14T11:54:25.024834+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:54:25.024834+0000","last_undegraded":"2024-09-14T11:54:25.024834+0000","last_fullsized":"2024-09-14T11:54:25.024834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:34.625158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.730074+0000","last_change":"2024-09-14T11:56:32.730074+0000","last_active":"2024-09-14T11:56:32.730074+0000","last_peered":"2024-09-14T11:56:32.730074+0000","last_clean":"2024-09-14T11:56:32.730074+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:56:32.730074+0000","last_undegraded":"2024-09-14T11:56:32.730074+0000","last_fullsized":"2024-09-14T11:56:32.730074+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.729983+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.217638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'335","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.542389+0000","last_change":"2024-09-14T11:56:26.542389+0000","last_active":"2024-09-14T11:56:26.542389+0000","last_peered":"2024-09-14T11:56:26.542389+0000","last_clean":"2024-09-14T11:56:26.542389+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:26.542389+0000","last_undegraded":"2024-09-14T11:56:26.542389+0000","last_fullsized":"2024-09-14T11:56:26.542389+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.542240+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:49.477686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":673,"num_read_kb":5062,"num_write":1074,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.726990+0000","last_change":"2024-09-14T11:56:38.726990+0000","last_active":"2024-09-14T11:56:38.726990+0000","last_peered":"2024-09-14T11:56:38.726990+0000","last_clean":"2024-09-14T11:56:38.726990+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:56:38.726990+0000","last_undegraded":"2024-09-14T11:56:38.726990+0000","last_fullsized":"2024-09-14T11:56:38.726990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.726904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.234751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'315","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.966066+0000","last_change":"2024-09-14T11:14:10.151521+0000","last_active":"2024-09-14T11:56:14.966066+0000","last_peered":"2024-09-14T11:56:14.966066+0000","last_clean":"2024-09-14T11:56:14.966066+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:14.966066+0000","last_undegraded":"2024-09-14T11:56:14.966066+0000","last_fullsized":"2024-09-14T11:56:14.966066+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:09.126485+0000","last_clean_scrub_stamp":"2024-09-14T11:14:09.126485+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.888499+0000","last_change":"2024-09-14T11:14:12.152149+0000","last_active":"2024-09-14T11:51:44.888499+0000","last_peered":"2024-09-14T11:51:44.888499+0000","last_clean":"2024-09-14T11:51:44.888499+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:51:44.888499+0000","last_undegraded":"2024-09-14T11:51:44.888499+0000","last_fullsized":"2024-09-14T11:51:44.888499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:11.133481+0000","last_clean_scrub_stamp":"2024-09-14T11:14:11.133481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.701102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'114","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:41.632889+0000","last_change":"2024-09-14T11:14:14.160202+0000","last_active":"2024-09-14T11:55:41.632889+0000","last_peered":"2024-09-14T11:55:41.632889+0000","last_clean":"2024-09-14T11:55:41.632889+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:55:41.632889+0000","last_undegraded":"2024-09-14T11:55:41.632889+0000","last_fullsized":"2024-09-14T11:55:41.632889+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'436","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.789928+0000","last_change":"2024-09-14T11:56:35.789928+0000","last_active":"2024-09-14T11:56:35.789928+0000","last_peered":"2024-09-14T11:56:35.789928+0000","last_clean":"2024-09-14T11:56:35.789928+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:56:35.789928+0000","last_undegraded":"2024-09-14T11:56:35.789928+0000","last_fullsized":"2024-09-14T11:56:35.789928+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.789837+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:13.884434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.147968+0000","last_change":"2024-09-14T11:56:25.147968+0000","last_active":"2024-09-14T11:56:25.147968+0000","last_peered":"2024-09-14T11:56:25.147968+0000","last_clean":"2024-09-14T11:56:25.147968+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:25.147968+0000","last_undegraded":"2024-09-14T11:56:25.147968+0000","last_fullsized":"2024-09-14T11:56:25.147968+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.147865+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:36.906313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'539","reported_seq":2256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.747353+0000","last_change":"2024-09-14T11:56:34.747353+0000","last_active":"2024-09-14T11:56:34.747353+0000","last_peered":"2024-09-14T11:56:34.747353+0000","last_clean":"2024-09-14T11:56:34.747353+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:56:34.747353+0000","last_undegraded":"2024-09-14T11:56:34.747353+0000","last_fullsized":"2024-09-14T11:56:34.747353+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'539","last_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_deep_scrub":"263'539","last_deep_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.747258+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.313926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'380","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.841288+0000","last_change":"2024-09-14T11:56:25.841288+0000","last_active":"2024-09-14T11:56:25.841288+0000","last_peered":"2024-09-14T11:56:25.841288+0000","last_clean":"2024-09-14T11:56:25.841288+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:25.841288+0000","last_undegraded":"2024-09-14T11:56:25.841288+0000","last_fullsized":"2024-09-14T11:56:25.841288+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.841167+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.025310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":5548,"num_write":1128,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1192","reported_seq":2827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.736512+0000","last_change":"2024-09-14T11:56:38.736512+0000","last_active":"2024-09-14T11:56:38.736512+0000","last_peered":"2024-09-14T11:56:38.736512+0000","last_clean":"2024-09-14T11:56:38.736512+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:56:38.736512+0000","last_undegraded":"2024-09-14T11:56:38.736512+0000","last_fullsized":"2024-09-14T11:56:38.736512+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1192","last_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_deep_scrub":"263'1192","last_deep_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.736423+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.672754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.805721+0000","last_change":"2024-09-14T11:56:30.805721+0000","last_active":"2024-09-14T11:56:30.805721+0000","last_peered":"2024-09-14T11:56:30.805721+0000","last_clean":"2024-09-14T11:56:30.805721+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:30.805721+0000","last_undegraded":"2024-09-14T11:56:30.805721+0000","last_fullsized":"2024-09-14T11:56:30.805721+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.805550+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:51.121985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'463","reported_seq":2205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.766924+0000","last_change":"2024-09-14T11:56:33.766924+0000","last_active":"2024-09-14T11:56:33.766924+0000","last_peered":"2024-09-14T11:56:33.766924+0000","last_clean":"2024-09-14T11:56:33.766924+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:56:33.766924+0000","last_undegraded":"2024-09-14T11:56:33.766924+0000","last_fullsized":"2024-09-14T11:56:33.766924+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.766839+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:15.603752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2774,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.568939+0000","last_change":"2024-09-14T11:56:25.568939+0000","last_active":"2024-09-14T11:56:25.568939+0000","last_peered":"2024-09-14T11:56:25.568939+0000","last_clean":"2024-09-14T11:56:25.568939+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:25.568939+0000","last_undegraded":"2024-09-14T11:56:25.568939+0000","last_fullsized":"2024-09-14T11:56:25.568939+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.568822+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.874889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":9527,"num_write":1076,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'418","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.093331+0000","last_change":"2024-09-14T11:56:34.093331+0000","last_active":"2024-09-14T11:56:34.093331+0000","last_peered":"2024-09-14T11:56:34.093331+0000","last_clean":"2024-09-14T11:56:34.093331+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:56:34.093331+0000","last_undegraded":"2024-09-14T11:56:34.093331+0000","last_fullsized":"2024-09-14T11:56:34.093331+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.093235+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:56.415972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'329","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.009840+0000","last_change":"2024-09-14T11:56:25.009840+0000","last_active":"2024-09-14T11:56:25.009840+0000","last_peered":"2024-09-14T11:56:25.009840+0000","last_clean":"2024-09-14T11:56:25.009840+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:25.009840+0000","last_undegraded":"2024-09-14T11:56:25.009840+0000","last_fullsized":"2024-09-14T11:56:25.009840+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.009692+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:51.768321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":10973,"num_write":1149,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'781","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.772231+0000","last_change":"2024-09-14T11:56:35.772231+0000","last_active":"2024-09-14T11:56:35.772231+0000","last_peered":"2024-09-14T11:56:35.772231+0000","last_clean":"2024-09-14T11:56:35.772231+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:56:35.772231+0000","last_undegraded":"2024-09-14T11:56:35.772231+0000","last_fullsized":"2024-09-14T11:56:35.772231+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.772148+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:57.596143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.849765+0000","last_change":"2024-09-14T11:56:24.849765+0000","last_active":"2024-09-14T11:56:24.849765+0000","last_peered":"2024-09-14T11:56:24.849765+0000","last_clean":"2024-09-14T11:56:24.849765+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:24.849765+0000","last_undegraded":"2024-09-14T11:56:24.849765+0000","last_fullsized":"2024-09-14T11:56:24.849765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.849561+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:14.537929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":959,"num_read_kb":11029,"num_write":1184,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'411","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.179313+0000","last_change":"2024-09-14T11:56:37.179313+0000","last_active":"2024-09-14T11:56:37.179313+0000","last_peered":"2024-09-14T11:56:37.179313+0000","last_clean":"2024-09-14T11:56:37.179313+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:56:37.179313+0000","last_undegraded":"2024-09-14T11:56:37.179313+0000","last_fullsized":"2024-09-14T11:56:37.179313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.179225+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:59.876690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'401","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.896659+0000","last_change":"2024-09-14T11:56:33.896659+0000","last_active":"2024-09-14T11:56:33.896659+0000","last_peered":"2024-09-14T11:56:33.896659+0000","last_clean":"2024-09-14T11:56:33.896659+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:33.896659+0000","last_undegraded":"2024-09-14T11:56:33.896659+0000","last_fullsized":"2024-09-14T11:56:33.896659+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.896569+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:18.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":972,"num_read_kb":685,"num_write":1240,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'544","reported_seq":2170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.194969+0000","last_change":"2024-09-14T11:56:33.194969+0000","last_active":"2024-09-14T11:56:33.194969+0000","last_peered":"2024-09-14T11:56:33.194969+0000","last_clean":"2024-09-14T11:56:33.194969+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:56:33.194969+0000","last_undegraded":"2024-09-14T11:56:33.194969+0000","last_fullsized":"2024-09-14T11:56:33.194969+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.194868+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.778340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'301","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.998258+0000","last_change":"2024-09-14T11:56:25.998258+0000","last_active":"2024-09-14T11:56:25.998258+0000","last_peered":"2024-09-14T11:56:25.998258+0000","last_clean":"2024-09-14T11:56:25.998258+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:25.998258+0000","last_undegraded":"2024-09-14T11:56:25.998258+0000","last_fullsized":"2024-09-14T11:56:25.998258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.998152+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:52.475288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":918,"num_read_kb":80980,"num_write":1012,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.541399+0000","last_change":"2024-09-14T11:56:35.541399+0000","last_active":"2024-09-14T11:56:35.541399+0000","last_peered":"2024-09-14T11:56:35.541399+0000","last_clean":"2024-09-14T11:56:35.541399+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:56:35.541399+0000","last_undegraded":"2024-09-14T11:56:35.541399+0000","last_fullsized":"2024-09-14T11:56:35.541399+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.541315+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.815826+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.804378+0000","last_change":"2024-09-14T11:56:29.804378+0000","last_active":"2024-09-14T11:56:29.804378+0000","last_peered":"2024-09-14T11:56:29.804378+0000","last_clean":"2024-09-14T11:56:29.804378+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:29.804378+0000","last_undegraded":"2024-09-14T11:56:29.804378+0000","last_fullsized":"2024-09-14T11:56:29.804378+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.804272+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:56.088992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'423","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.710966+0000","last_change":"2024-09-14T11:56:37.710966+0000","last_active":"2024-09-14T11:56:37.710966+0000","last_peered":"2024-09-14T11:56:37.710966+0000","last_clean":"2024-09-14T11:56:37.710966+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:56:37.710966+0000","last_undegraded":"2024-09-14T11:56:37.710966+0000","last_fullsized":"2024-09-14T11:56:37.710966+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.710871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:32.054722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'365","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.007610+0000","last_change":"2024-09-14T11:56:27.007610+0000","last_active":"2024-09-14T11:56:27.007610+0000","last_peered":"2024-09-14T11:56:27.007610+0000","last_clean":"2024-09-14T11:56:27.007610+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:27.007610+0000","last_undegraded":"2024-09-14T11:56:27.007610+0000","last_fullsized":"2024-09-14T11:56:27.007610+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.007472+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:43.410193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":571,"num_read_kb":30121,"num_write":1035,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'415","reported_seq":1912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.869913+0000","last_change":"2024-09-14T11:56:29.869913+0000","last_active":"2024-09-14T11:56:29.869913+0000","last_peered":"2024-09-14T11:56:29.869913+0000","last_clean":"2024-09-14T11:56:29.869913+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:56:29.869913+0000","last_undegraded":"2024-09-14T11:56:29.869913+0000","last_fullsized":"2024-09-14T11:56:29.869913+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.869818+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:11.490799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.844066+0000","last_change":"2024-09-14T11:56:31.844066+0000","last_active":"2024-09-14T11:56:31.844066+0000","last_peered":"2024-09-14T11:56:31.844066+0000","last_clean":"2024-09-14T11:56:31.844066+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:31.844066+0000","last_undegraded":"2024-09-14T11:56:31.844066+0000","last_fullsized":"2024-09-14T11:56:31.844066+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.843966+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:29.756203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'816","reported_seq":2407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.728783+0000","last_change":"2024-09-14T11:56:36.728783+0000","last_active":"2024-09-14T11:56:36.728783+0000","last_peered":"2024-09-14T11:56:36.728783+0000","last_clean":"2024-09-14T11:56:36.728783+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:56:36.728783+0000","last_undegraded":"2024-09-14T11:56:36.728783+0000","last_fullsized":"2024-09-14T11:56:36.728783+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'816","last_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_deep_scrub":"263'816","last_deep_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.728665+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:46.867994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'300","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.563220+0000","last_change":"2024-09-14T11:56:27.563220+0000","last_active":"2024-09-14T11:56:27.563220+0000","last_peered":"2024-09-14T11:56:27.563220+0000","last_clean":"2024-09-14T11:56:27.563220+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:27.563220+0000","last_undegraded":"2024-09-14T11:56:27.563220+0000","last_fullsized":"2024-09-14T11:56:27.563220+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.563050+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.198569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":33889,"num_write":889,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'382","reported_seq":1843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.559792+0000","last_change":"2024-09-14T11:56:36.559792+0000","last_active":"2024-09-14T11:56:36.559792+0000","last_peered":"2024-09-14T11:56:36.559792+0000","last_clean":"2024-09-14T11:56:36.559792+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:56:36.559792+0000","last_undegraded":"2024-09-14T11:56:36.559792+0000","last_fullsized":"2024-09-14T11:56:36.559792+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.559698+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:41.726328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.192037+0000","last_change":"2024-09-14T11:56:26.192037+0000","last_active":"2024-09-14T11:56:26.192037+0000","last_peered":"2024-09-14T11:56:26.192037+0000","last_clean":"2024-09-14T11:56:26.192037+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:26.192037+0000","last_undegraded":"2024-09-14T11:56:26.192037+0000","last_fullsized":"2024-09-14T11:56:26.192037+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.191880+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.808289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'501","reported_seq":2157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513417+0000","last_change":"2024-09-14T11:56:33.513417+0000","last_active":"2024-09-14T11:56:33.513417+0000","last_peered":"2024-09-14T11:56:33.513417+0000","last_clean":"2024-09-14T11:56:33.513417+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:56:33.513417+0000","last_undegraded":"2024-09-14T11:56:33.513417+0000","last_fullsized":"2024-09-14T11:56:33.513417+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.513326+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.516314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'488","reported_seq":1224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.533626+0000","last_change":"2024-09-14T11:56:35.533626+0000","last_active":"2024-09-14T11:56:35.533626+0000","last_peered":"2024-09-14T11:56:35.533626+0000","last_clean":"2024-09-14T11:56:35.533626+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:35.533626+0000","last_undegraded":"2024-09-14T11:56:35.533626+0000","last_fullsized":"2024-09-14T11:56:35.533626+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.533523+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.931408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1169,"num_read_kb":1914,"num_write":1411,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'474","reported_seq":2076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.783207+0000","last_change":"2024-09-14T11:14:06.128570+0000","last_active":"2024-09-14T11:54:07.783207+0000","last_peered":"2024-09-14T11:54:07.783207+0000","last_clean":"2024-09-14T11:54:07.783207+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:54:07.783207+0000","last_undegraded":"2024-09-14T11:54:07.783207+0000","last_fullsized":"2024-09-14T11:54:07.783207+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.692311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'370","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.845355+0000","last_change":"2024-09-14T11:56:38.845355+0000","last_active":"2024-09-14T11:56:38.845355+0000","last_peered":"2024-09-14T11:56:38.845355+0000","last_clean":"2024-09-14T11:56:38.845355+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:38.845355+0000","last_undegraded":"2024-09-14T11:56:38.845355+0000","last_fullsized":"2024-09-14T11:56:38.845355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.845248+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:52.872233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":47810,"num_write":1093,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'445","reported_seq":1979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.440280+0000","last_change":"2024-09-14T11:56:33.440280+0000","last_active":"2024-09-14T11:56:33.440280+0000","last_peered":"2024-09-14T11:56:33.440280+0000","last_clean":"2024-09-14T11:56:33.440280+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:56:33.440280+0000","last_undegraded":"2024-09-14T11:56:33.440280+0000","last_fullsized":"2024-09-14T11:56:33.440280+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.440166+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:03.203426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.814186+0000","last_change":"2024-09-14T11:56:32.814186+0000","last_active":"2024-09-14T11:56:32.814186+0000","last_peered":"2024-09-14T11:56:32.814186+0000","last_clean":"2024-09-14T11:56:32.814186+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:32.814186+0000","last_undegraded":"2024-09-14T11:56:32.814186+0000","last_fullsized":"2024-09-14T11:56:32.814186+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.814090+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.660032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.824437+0000","last_change":"2024-09-14T11:56:33.824437+0000","last_active":"2024-09-14T11:56:33.824437+0000","last_peered":"2024-09-14T11:56:33.824437+0000","last_clean":"2024-09-14T11:56:33.824437+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:33.824437+0000","last_undegraded":"2024-09-14T11:56:33.824437+0000","last_fullsized":"2024-09-14T11:56:33.824437+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.824296+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:37.946754+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'502","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.620855+0000","last_change":"2024-09-14T11:56:37.620855+0000","last_active":"2024-09-14T11:56:37.620855+0000","last_peered":"2024-09-14T11:56:37.620855+0000","last_clean":"2024-09-14T11:56:37.620855+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:56:37.620855+0000","last_undegraded":"2024-09-14T11:56:37.620855+0000","last_fullsized":"2024-09-14T11:56:37.620855+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.620756+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:34.911258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":928,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'359","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.767279+0000","last_change":"2024-09-14T11:56:27.767279+0000","last_active":"2024-09-14T11:56:27.767279+0000","last_peered":"2024-09-14T11:56:27.767279+0000","last_clean":"2024-09-14T11:56:27.767279+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:27.767279+0000","last_undegraded":"2024-09-14T11:56:27.767279+0000","last_fullsized":"2024-09-14T11:56:27.767279+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.767137+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:02.709261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":694,"num_read_kb":183365,"num_write":1193,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.546904+0000","last_change":"2024-09-14T11:14:06.130886+0000","last_active":"2024-09-14T11:54:26.546904+0000","last_peered":"2024-09-14T11:54:26.546904+0000","last_clean":"2024-09-14T11:54:26.546904+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:54:26.546904+0000","last_undegraded":"2024-09-14T11:54:26.546904+0000","last_fullsized":"2024-09-14T11:54:26.546904+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:05.100811+0000","last_clean_scrub_stamp":"2024-09-14T11:14:05.100811+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:55.595674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":642,"ondisk_log_size":642,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1608537,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17476,"num_read_kb":36987,"num_write":14663,"num_write_kb":11713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30279,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3623,"ondisk_log_size":3623,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":41776745,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44044,"num_read_kb":2244679,"num_write":72642,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64241664,"data_stored":64241664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3767,"ondisk_log_size":3767,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174309,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174255,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509960,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271740,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94100100,"statfs":{"total":96636764160,"available":96358502400,"internally_reserved":0,"allocated":10334208,"data_stored":8385962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509961,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166396,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205444,"statfs":{"total":96636764160,"available":96466374656,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509959,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127232,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94244608,"statfs":{"total":96636764160,"available":96506478592,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542663,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300316,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94071524,"statfs":{"total":96636764160,"available":96329240576,"internally_reserved":0,"allocated":8335360,"data_stored":6347071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542666,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273604,"kb_used_data":11956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098236,"statfs":{"total":96636764160,"available":96356593664,"internally_reserved":0,"allocated":12242944,"data_stored":10281542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267909575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542664,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98288,"kb_used_data":12960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94273552,"statfs":{"total":96636764160,"available":96536117248,"internally_reserved":0,"allocated":13271040,"data_stored":11361506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542663,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168732,"kb_used_data":11276,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94203108,"statfs":{"total":96636764160,"available":96463982592,"internally_reserved":0,"allocated":11546624,"data_stored":9590010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542662,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279572,"kb_used_data":17924,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94092268,"statfs":{"total":96636764160,"available":96350482432,"internally_reserved":0,"allocated":18354176,"data_stored":16376601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13529088,"data_stored":13529088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7331840,"data_stored":7331840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8024064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:56:44.231 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.231 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.232 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.233 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.234 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.235 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.236 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.237 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.238 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.239 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.240 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.241 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.242 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.243 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.244 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.245 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.246 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.247 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.248 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.249 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.250 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.251 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.252 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.253 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.254 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.255 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.256 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.257 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.258 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:14:07.112530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:14:09.126485+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:14:11.133481+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.259 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.260 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.260 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:14:05.100811+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:56:44.260 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:57:04.261 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:57:04.599 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:57:04.610 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:57:04.612 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1556,"stamp":"2024-09-14T11:57:03.936003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43992737,"num_objects":740,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":310307,"num_read_kb":2858305,"num_write":163686,"num_write_kb":2485845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740529,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13173,"ondisk_log_size":13173,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1669240,"kb_used_data":96824,"kb_used_omap":12,"kb_used_meta":1572275,"kb_avail":753305480,"statfs":{"total":773094113280,"available":771384811520,"internally_reserved":0,"allocated":99147776,"data_stored":83483642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1610010160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2936,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005455"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039779+0000","last_change":"2024-09-14T11:41:15.870630+0000","last_active":"2024-09-14T11:53:46.039779+0000","last_peered":"2024-09-14T11:53:46.039779+0000","last_clean":"2024-09-14T11:53:46.039779+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:53:46.039779+0000","last_undegraded":"2024-09-14T11:53:46.039779+0000","last_fullsized":"2024-09-14T11:53:46.039779+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.331695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:51.058211+0000","last_change":"2024-09-14T11:30:47.737282+0000","last_active":"2024-09-14T11:55:51.058211+0000","last_peered":"2024-09-14T11:55:51.058211+0000","last_clean":"2024-09-14T11:55:51.058211+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:55:51.058211+0000","last_undegraded":"2024-09-14T11:55:51.058211+0000","last_fullsized":"2024-09-14T11:55:51.058211+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:31.061182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.898836+0000","last_change":"2024-09-14T11:30:44.716386+0000","last_active":"2024-09-14T11:53:14.898836+0000","last_peered":"2024-09-14T11:53:14.898836+0000","last_clean":"2024-09-14T11:53:14.898836+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:53:14.898836+0000","last_undegraded":"2024-09-14T11:53:14.898836+0000","last_fullsized":"2024-09-14T11:53:14.898836+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.231560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905460+0000","last_change":"2024-09-14T11:29:10.318138+0000","last_active":"2024-09-14T11:54:09.905460+0000","last_peered":"2024-09-14T11:54:09.905460+0000","last_clean":"2024-09-14T11:54:09.905460+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:54:09.905460+0000","last_undegraded":"2024-09-14T11:54:09.905460+0000","last_fullsized":"2024-09-14T11:54:09.905460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:41.920856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.930910+0000","last_change":"2024-09-14T11:56:54.930910+0000","last_active":"2024-09-14T11:56:54.930910+0000","last_peered":"2024-09-14T11:56:54.930910+0000","last_clean":"2024-09-14T11:56:54.930910+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:56:54.930910+0000","last_undegraded":"2024-09-14T11:56:54.930910+0000","last_fullsized":"2024-09-14T11:56:54.930910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.930819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:24.220591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.062212+0000","last_change":"2024-09-14T11:30:47.733106+0000","last_active":"2024-09-14T11:56:14.062212+0000","last_peered":"2024-09-14T11:56:14.062212+0000","last_clean":"2024-09-14T11:56:14.062212+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:56:14.062212+0000","last_undegraded":"2024-09-14T11:56:14.062212+0000","last_fullsized":"2024-09-14T11:56:14.062212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:28.411520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.068350+0000","last_change":"2024-09-14T11:56:56.068350+0000","last_active":"2024-09-14T11:56:56.068350+0000","last_peered":"2024-09-14T11:56:56.068350+0000","last_clean":"2024-09-14T11:56:56.068350+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:56:56.068350+0000","last_undegraded":"2024-09-14T11:56:56.068350+0000","last_fullsized":"2024-09-14T11:56:56.068350+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.068263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:51.903194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.956880+0000","last_change":"2024-09-14T11:56:46.956880+0000","last_active":"2024-09-14T11:56:46.956880+0000","last_peered":"2024-09-14T11:56:46.956880+0000","last_clean":"2024-09-14T11:56:46.956880+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:56:46.956880+0000","last_undegraded":"2024-09-14T11:56:46.956880+0000","last_fullsized":"2024-09-14T11:56:46.956880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.956766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:51.738185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.322815+0000","last_change":"2024-09-14T11:56:59.322815+0000","last_active":"2024-09-14T11:56:59.322815+0000","last_peered":"2024-09-14T11:56:59.322815+0000","last_clean":"2024-09-14T11:56:59.322815+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:56:59.322815+0000","last_undegraded":"2024-09-14T11:56:59.322815+0000","last_fullsized":"2024-09-14T11:56:59.322815+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.322702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:12.249136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918925+0000","last_change":"2024-09-14T11:30:47.898040+0000","last_active":"2024-09-14T11:55:49.918925+0000","last_peered":"2024-09-14T11:55:49.918925+0000","last_clean":"2024-09-14T11:55:49.918925+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:55:49.918925+0000","last_undegraded":"2024-09-14T11:55:49.918925+0000","last_fullsized":"2024-09-14T11:55:49.918925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:57.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.915023+0000","last_change":"2024-09-14T11:56:49.915023+0000","last_active":"2024-09-14T11:56:49.915023+0000","last_peered":"2024-09-14T11:56:49.915023+0000","last_clean":"2024-09-14T11:56:49.915023+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:56:49.915023+0000","last_undegraded":"2024-09-14T11:56:49.915023+0000","last_fullsized":"2024-09-14T11:56:49.915023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.914938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:12.204381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905404+0000","last_change":"2024-09-14T11:29:10.313068+0000","last_active":"2024-09-14T11:54:09.905404+0000","last_peered":"2024-09-14T11:54:09.905404+0000","last_clean":"2024-09-14T11:54:09.905404+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:54:09.905404+0000","last_undegraded":"2024-09-14T11:54:09.905404+0000","last_fullsized":"2024-09-14T11:54:09.905404+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.911286+0000","last_change":"2024-09-14T11:30:47.897655+0000","last_active":"2024-09-14T11:54:54.911286+0000","last_peered":"2024-09-14T11:54:54.911286+0000","last_clean":"2024-09-14T11:54:54.911286+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:54:54.911286+0000","last_undegraded":"2024-09-14T11:54:54.911286+0000","last_fullsized":"2024-09-14T11:54:54.911286+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.790078+0000","last_change":"2024-09-14T11:30:44.707240+0000","last_active":"2024-09-14T11:53:40.790078+0000","last_peered":"2024-09-14T11:53:40.790078+0000","last_clean":"2024-09-14T11:53:40.790078+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:53:40.790078+0000","last_undegraded":"2024-09-14T11:53:40.790078+0000","last_fullsized":"2024-09-14T11:53:40.790078+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:47.771971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905503+0000","last_change":"2024-09-14T11:29:10.320430+0000","last_active":"2024-09-14T11:54:09.905503+0000","last_peered":"2024-09-14T11:54:09.905503+0000","last_clean":"2024-09-14T11:54:09.905503+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:54:09.905503+0000","last_undegraded":"2024-09-14T11:54:09.905503+0000","last_fullsized":"2024-09-14T11:54:09.905503+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899479+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:53:19.899479+0000","last_peered":"2024-09-14T11:53:19.899479+0000","last_clean":"2024-09-14T11:53:19.899479+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:53:19.899479+0000","last_undegraded":"2024-09-14T11:53:19.899479+0000","last_fullsized":"2024-09-14T11:53:19.899479+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.856488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.029273+0000","last_change":"2024-09-14T11:31:38.877692+0000","last_active":"2024-09-14T11:52:36.029273+0000","last_peered":"2024-09-14T11:52:36.029273+0000","last_clean":"2024-09-14T11:52:36.029273+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:52:36.029273+0000","last_undegraded":"2024-09-14T11:52:36.029273+0000","last_fullsized":"2024-09-14T11:52:36.029273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:00.898594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893671+0000","last_change":"2024-09-14T11:30:44.719423+0000","last_active":"2024-09-14T11:52:29.893671+0000","last_peered":"2024-09-14T11:52:29.893671+0000","last_clean":"2024-09-14T11:52:29.893671+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:52:29.893671+0000","last_undegraded":"2024-09-14T11:52:29.893671+0000","last_fullsized":"2024-09-14T11:52:29.893671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:36.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905454+0000","last_change":"2024-09-14T11:29:10.325689+0000","last_active":"2024-09-14T11:54:09.905454+0000","last_peered":"2024-09-14T11:54:09.905454+0000","last_clean":"2024-09-14T11:54:09.905454+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:54:09.905454+0000","last_undegraded":"2024-09-14T11:54:09.905454+0000","last_fullsized":"2024-09-14T11:54:09.905454+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.902848+0000","last_change":"2024-09-14T11:41:15.866311+0000","last_active":"2024-09-14T11:53:49.902848+0000","last_peered":"2024-09-14T11:53:49.902848+0000","last_clean":"2024-09-14T11:53:49.902848+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:53:49.902848+0000","last_undegraded":"2024-09-14T11:53:49.902848+0000","last_fullsized":"2024-09-14T11:53:49.902848+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:34.597180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.270094+0000","last_change":"2024-09-14T11:56:56.270094+0000","last_active":"2024-09-14T11:56:56.270094+0000","last_peered":"2024-09-14T11:56:56.270094+0000","last_clean":"2024-09-14T11:56:56.270094+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:56:56.270094+0000","last_undegraded":"2024-09-14T11:56:56.270094+0000","last_fullsized":"2024-09-14T11:56:56.270094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.270012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:44.058197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781204+0000","last_change":"2024-09-14T11:30:44.713199+0000","last_active":"2024-09-14T11:52:35.781204+0000","last_peered":"2024-09-14T11:52:35.781204+0000","last_clean":"2024-09-14T11:52:35.781204+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:52:35.781204+0000","last_undegraded":"2024-09-14T11:52:35.781204+0000","last_fullsized":"2024-09-14T11:52:35.781204+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.175963+0000","last_change":"2024-09-14T11:56:50.175963+0000","last_active":"2024-09-14T11:56:50.175963+0000","last_peered":"2024-09-14T11:56:50.175963+0000","last_clean":"2024-09-14T11:56:50.175963+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:56:50.175963+0000","last_undegraded":"2024-09-14T11:56:50.175963+0000","last_fullsized":"2024-09-14T11:56:50.175963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.175869+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.609485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797042+0000","last_change":"2024-09-14T11:41:15.875121+0000","last_active":"2024-09-14T11:53:49.797042+0000","last_peered":"2024-09-14T11:53:49.797042+0000","last_clean":"2024-09-14T11:53:49.797042+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:53:49.797042+0000","last_undegraded":"2024-09-14T11:53:49.797042+0000","last_fullsized":"2024-09-14T11:53:49.797042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:32.569008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.252142+0000","last_change":"2024-09-14T11:56:57.252142+0000","last_active":"2024-09-14T11:56:57.252142+0000","last_peered":"2024-09-14T11:56:57.252142+0000","last_clean":"2024-09-14T11:56:57.252142+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:57.252142+0000","last_undegraded":"2024-09-14T11:56:57.252142+0000","last_fullsized":"2024-09-14T11:56:57.252142+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.252056+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:33.734708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.786489+0000","last_change":"2024-09-14T11:30:44.718283+0000","last_active":"2024-09-14T11:53:15.786489+0000","last_peered":"2024-09-14T11:53:15.786489+0000","last_clean":"2024-09-14T11:53:15.786489+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:53:15.786489+0000","last_undegraded":"2024-09-14T11:53:15.786489+0000","last_fullsized":"2024-09-14T11:53:15.786489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.806161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899755+0000","last_change":"2024-09-14T11:29:10.323495+0000","last_active":"2024-09-14T11:53:19.899755+0000","last_peered":"2024-09-14T11:53:19.899755+0000","last_clean":"2024-09-14T11:53:19.899755+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:53:19.899755+0000","last_undegraded":"2024-09-14T11:53:19.899755+0000","last_fullsized":"2024-09-14T11:53:19.899755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:24.775447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797081+0000","last_change":"2024-09-14T11:41:15.872181+0000","last_active":"2024-09-14T11:53:49.797081+0000","last_peered":"2024-09-14T11:53:49.797081+0000","last_clean":"2024-09-14T11:53:49.797081+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:53:49.797081+0000","last_undegraded":"2024-09-14T11:53:49.797081+0000","last_fullsized":"2024-09-14T11:53:49.797081+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:06.492494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.862359+0000","last_change":"2024-09-14T11:30:47.739602+0000","last_active":"2024-09-14T11:56:13.862359+0000","last_peered":"2024-09-14T11:56:13.862359+0000","last_clean":"2024-09-14T11:56:13.862359+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:56:13.862359+0000","last_undegraded":"2024-09-14T11:56:13.862359+0000","last_fullsized":"2024-09-14T11:56:13.862359+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:48.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17456,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899185+0000","last_change":"2024-09-14T11:30:44.721458+0000","last_active":"2024-09-14T11:53:14.899185+0000","last_peered":"2024-09-14T11:53:14.899185+0000","last_clean":"2024-09-14T11:53:14.899185+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:53:14.899185+0000","last_undegraded":"2024-09-14T11:53:14.899185+0000","last_fullsized":"2024-09-14T11:53:14.899185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.629453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.051414+0000","last_change":"2024-09-14T11:56:55.051414+0000","last_active":"2024-09-14T11:56:55.051414+0000","last_peered":"2024-09-14T11:56:55.051414+0000","last_clean":"2024-09-14T11:56:55.051414+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:56:55.051414+0000","last_undegraded":"2024-09-14T11:56:55.051414+0000","last_fullsized":"2024-09-14T11:56:55.051414+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.051327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:05.849317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.896352+0000","last_change":"2024-09-14T11:41:15.860565+0000","last_active":"2024-09-14T11:52:59.896352+0000","last_peered":"2024-09-14T11:52:59.896352+0000","last_clean":"2024-09-14T11:52:59.896352+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:52:59.896352+0000","last_undegraded":"2024-09-14T11:52:59.896352+0000","last_fullsized":"2024-09-14T11:52:59.896352+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:54.176728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'6","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.911945+0000","last_change":"2024-09-14T11:30:47.895944+0000","last_active":"2024-09-14T11:54:59.911945+0000","last_peered":"2024-09-14T11:54:59.911945+0000","last_clean":"2024-09-14T11:54:59.911945+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:54:59.911945+0000","last_undegraded":"2024-09-14T11:54:59.911945+0000","last_fullsized":"2024-09-14T11:54:59.911945+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.724755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.042769+0000","last_change":"2024-09-14T11:30:44.719445+0000","last_active":"2024-09-14T11:54:06.042769+0000","last_peered":"2024-09-14T11:54:06.042769+0000","last_clean":"2024-09-14T11:54:06.042769+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:54:06.042769+0000","last_undegraded":"2024-09-14T11:54:06.042769+0000","last_fullsized":"2024-09-14T11:54:06.042769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899857+0000","last_change":"2024-09-14T11:29:10.322395+0000","last_active":"2024-09-14T11:53:19.899857+0000","last_peered":"2024-09-14T11:53:19.899857+0000","last_clean":"2024-09-14T11:53:19.899857+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:53:19.899857+0000","last_undegraded":"2024-09-14T11:53:19.899857+0000","last_fullsized":"2024-09-14T11:53:19.899857+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:09.644821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.914206+0000","last_change":"2024-09-14T11:56:52.914206+0000","last_active":"2024-09-14T11:56:52.914206+0000","last_peered":"2024-09-14T11:56:52.914206+0000","last_clean":"2024-09-14T11:56:52.914206+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:56:52.914206+0000","last_undegraded":"2024-09-14T11:56:52.914206+0000","last_fullsized":"2024-09-14T11:56:52.914206+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.914085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:51.597067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.906092+0000","last_change":"2024-09-14T11:30:47.898502+0000","last_active":"2024-09-14T11:54:14.906092+0000","last_peered":"2024-09-14T11:54:14.906092+0000","last_clean":"2024-09-14T11:54:14.906092+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:54:14.906092+0000","last_undegraded":"2024-09-14T11:54:14.906092+0000","last_fullsized":"2024-09-14T11:54:14.906092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785809+0000","last_change":"2024-09-14T11:30:44.722482+0000","last_active":"2024-09-14T11:52:29.785809+0000","last_peered":"2024-09-14T11:52:29.785809+0000","last_clean":"2024-09-14T11:52:29.785809+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:52:29.785809+0000","last_undegraded":"2024-09-14T11:52:29.785809+0000","last_fullsized":"2024-09-14T11:52:29.785809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:44.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899504+0000","last_change":"2024-09-14T11:29:10.322558+0000","last_active":"2024-09-14T11:53:19.899504+0000","last_peered":"2024-09-14T11:53:19.899504+0000","last_clean":"2024-09-14T11:53:19.899504+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:53:19.899504+0000","last_undegraded":"2024-09-14T11:53:19.899504+0000","last_fullsized":"2024-09-14T11:53:19.899504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.344613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.789722+0000","last_change":"2024-09-14T11:41:15.873699+0000","last_active":"2024-09-14T11:52:59.789722+0000","last_peered":"2024-09-14T11:52:59.789722+0000","last_clean":"2024-09-14T11:52:59.789722+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:52:59.789722+0000","last_undegraded":"2024-09-14T11:52:59.789722+0000","last_fullsized":"2024-09-14T11:52:59.789722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:13.657331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.892791+0000","last_change":"2024-09-14T11:30:47.898162+0000","last_active":"2024-09-14T11:52:34.892791+0000","last_peered":"2024-09-14T11:52:34.892791+0000","last_clean":"2024-09-14T11:52:34.892791+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:52:34.892791+0000","last_undegraded":"2024-09-14T11:52:34.892791+0000","last_fullsized":"2024-09-14T11:52:34.892791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:21.006561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.869491+0000","last_change":"2024-09-14T11:56:48.869491+0000","last_active":"2024-09-14T11:56:48.869491+0000","last_peered":"2024-09-14T11:56:48.869491+0000","last_clean":"2024-09-14T11:56:48.869491+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:56:48.869491+0000","last_undegraded":"2024-09-14T11:56:48.869491+0000","last_fullsized":"2024-09-14T11:56:48.869491+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.869404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:45.392711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.906801+0000","last_change":"2024-09-14T11:56:44.906801+0000","last_active":"2024-09-14T11:56:44.906801+0000","last_peered":"2024-09-14T11:56:44.906801+0000","last_clean":"2024-09-14T11:56:44.906801+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:56:44.906801+0000","last_undegraded":"2024-09-14T11:56:44.906801+0000","last_fullsized":"2024-09-14T11:56:44.906801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.906705+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:43.767361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.032771+0000","last_change":"2024-09-14T11:41:15.871757+0000","last_active":"2024-09-14T11:52:56.032771+0000","last_peered":"2024-09-14T11:52:56.032771+0000","last_clean":"2024-09-14T11:52:56.032771+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:52:56.032771+0000","last_undegraded":"2024-09-14T11:52:56.032771+0000","last_fullsized":"2024-09-14T11:52:56.032771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.781293+0000","last_change":"2024-09-14T11:30:47.742120+0000","last_active":"2024-09-14T11:52:35.781293+0000","last_peered":"2024-09-14T11:52:35.781293+0000","last_clean":"2024-09-14T11:52:35.781293+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:52:35.781293+0000","last_undegraded":"2024-09-14T11:52:35.781293+0000","last_fullsized":"2024-09-14T11:52:35.781293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:27.341762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.911403+0000","last_change":"2024-09-14T11:30:44.721258+0000","last_active":"2024-09-14T11:54:54.911403+0000","last_peered":"2024-09-14T11:54:54.911403+0000","last_clean":"2024-09-14T11:54:54.911403+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:54:54.911403+0000","last_undegraded":"2024-09-14T11:54:54.911403+0000","last_fullsized":"2024-09-14T11:54:54.911403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.901980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786669+0000","last_change":"2024-09-14T11:29:10.325777+0000","last_active":"2024-09-14T11:52:34.786669+0000","last_peered":"2024-09-14T11:52:34.786669+0000","last_clean":"2024-09-14T11:52:34.786669+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:52:34.786669+0000","last_undegraded":"2024-09-14T11:52:34.786669+0000","last_fullsized":"2024-09-14T11:52:34.786669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:04.033627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905077+0000","last_change":"2024-09-14T11:30:47.737735+0000","last_active":"2024-09-14T11:54:09.905077+0000","last_peered":"2024-09-14T11:54:09.905077+0000","last_clean":"2024-09-14T11:54:09.905077+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:54:09.905077+0000","last_undegraded":"2024-09-14T11:54:09.905077+0000","last_fullsized":"2024-09-14T11:54:09.905077+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.938800+0000","last_change":"2024-09-14T11:30:44.717066+0000","last_active":"2024-09-14T11:56:13.938800+0000","last_peered":"2024-09-14T11:56:13.938800+0000","last_clean":"2024-09-14T11:56:13.938800+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:56:13.938800+0000","last_undegraded":"2024-09-14T11:56:13.938800+0000","last_fullsized":"2024-09-14T11:56:13.938800+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.785719+0000","last_change":"2024-09-14T11:29:10.325808+0000","last_active":"2024-09-14T11:52:29.785719+0000","last_peered":"2024-09-14T11:52:29.785719+0000","last_clean":"2024-09-14T11:52:29.785719+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:52:29.785719+0000","last_undegraded":"2024-09-14T11:52:29.785719+0000","last_fullsized":"2024-09-14T11:52:29.785719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.518534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900378+0000","last_change":"2024-09-14T11:41:15.870903+0000","last_active":"2024-09-14T11:53:24.900378+0000","last_peered":"2024-09-14T11:53:24.900378+0000","last_clean":"2024-09-14T11:53:24.900378+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:53:24.900378+0000","last_undegraded":"2024-09-14T11:53:24.900378+0000","last_fullsized":"2024-09-14T11:53:24.900378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:03.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.094951+0000","last_change":"2024-09-14T11:56:58.094951+0000","last_active":"2024-09-14T11:56:58.094951+0000","last_peered":"2024-09-14T11:56:58.094951+0000","last_clean":"2024-09-14T11:56:58.094951+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:56:58.094951+0000","last_undegraded":"2024-09-14T11:56:58.094951+0000","last_fullsized":"2024-09-14T11:56:58.094951+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.094857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:22.727039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:14.003047+0000","last_change":"2024-09-14T11:30:44.714122+0000","last_active":"2024-09-14T11:56:14.003047+0000","last_peered":"2024-09-14T11:56:14.003047+0000","last_clean":"2024-09-14T11:56:14.003047+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:56:14.003047+0000","last_undegraded":"2024-09-14T11:56:14.003047+0000","last_fullsized":"2024-09-14T11:56:14.003047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.893718+0000","last_change":"2024-09-14T11:29:10.316405+0000","last_active":"2024-09-14T11:52:29.893718+0000","last_peered":"2024-09-14T11:52:29.893718+0000","last_clean":"2024-09-14T11:52:29.893718+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:52:29.893718+0000","last_undegraded":"2024-09-14T11:52:29.893718+0000","last_fullsized":"2024-09-14T11:52:29.893718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:32.387888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.905488+0000","last_change":"2024-09-14T11:30:47.739854+0000","last_active":"2024-09-14T11:54:09.905488+0000","last_peered":"2024-09-14T11:54:09.905488+0000","last_clean":"2024-09-14T11:54:09.905488+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:54:09.905488+0000","last_undegraded":"2024-09-14T11:54:09.905488+0000","last_fullsized":"2024-09-14T11:54:09.905488+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.263149+0000","last_change":"2024-09-14T11:56:53.263149+0000","last_active":"2024-09-14T11:56:53.263149+0000","last_peered":"2024-09-14T11:56:53.263149+0000","last_clean":"2024-09-14T11:56:53.263149+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:56:53.263149+0000","last_undegraded":"2024-09-14T11:56:53.263149+0000","last_fullsized":"2024-09-14T11:56:53.263149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.263023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.980419+0000","last_change":"2024-09-14T11:56:59.980419+0000","last_active":"2024-09-14T11:56:59.980419+0000","last_peered":"2024-09-14T11:56:59.980419+0000","last_clean":"2024-09-14T11:56:59.980419+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:56:59.980419+0000","last_undegraded":"2024-09-14T11:56:59.980419+0000","last_fullsized":"2024-09-14T11:56:59.980419+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.980335+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:11.344838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899460+0000","last_change":"2024-09-14T11:41:15.877488+0000","last_active":"2024-09-14T11:53:19.899460+0000","last_peered":"2024-09-14T11:53:19.899460+0000","last_clean":"2024-09-14T11:53:19.899460+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:53:19.899460+0000","last_undegraded":"2024-09-14T11:53:19.899460+0000","last_fullsized":"2024-09-14T11:53:19.899460+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.301118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.283767+0000","last_change":"2024-09-14T11:56:55.283767+0000","last_active":"2024-09-14T11:56:55.283767+0000","last_peered":"2024-09-14T11:56:55.283767+0000","last_clean":"2024-09-14T11:56:55.283767+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:56:55.283767+0000","last_undegraded":"2024-09-14T11:56:55.283767+0000","last_fullsized":"2024-09-14T11:56:55.283767+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.283654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:50.578811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.042753+0000","last_change":"2024-09-14T11:30:44.718162+0000","last_active":"2024-09-14T11:54:06.042753+0000","last_peered":"2024-09-14T11:54:06.042753+0000","last_clean":"2024-09-14T11:54:06.042753+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:54:06.042753+0000","last_undegraded":"2024-09-14T11:54:06.042753+0000","last_fullsized":"2024-09-14T11:54:06.042753+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.891962+0000","last_change":"2024-09-14T11:29:10.315461+0000","last_active":"2024-09-14T11:52:29.891962+0000","last_peered":"2024-09-14T11:52:29.891962+0000","last_clean":"2024-09-14T11:52:29.891962+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:52:29.891962+0000","last_undegraded":"2024-09-14T11:52:29.891962+0000","last_fullsized":"2024-09-14T11:52:29.891962+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:38.057658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.944919+0000","last_change":"2024-09-14T11:56:50.944919+0000","last_active":"2024-09-14T11:56:50.944919+0000","last_peered":"2024-09-14T11:56:50.944919+0000","last_clean":"2024-09-14T11:56:50.944919+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:56:50.944919+0000","last_undegraded":"2024-09-14T11:56:50.944919+0000","last_fullsized":"2024-09-14T11:56:50.944919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.944826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899468+0000","last_change":"2024-09-14T11:30:47.737932+0000","last_active":"2024-09-14T11:53:19.899468+0000","last_peered":"2024-09-14T11:53:19.899468+0000","last_clean":"2024-09-14T11:53:19.899468+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:53:19.899468+0000","last_undegraded":"2024-09-14T11:53:19.899468+0000","last_fullsized":"2024-09-14T11:53:19.899468+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.880823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.792179+0000","last_change":"2024-09-14T11:30:44.720205+0000","last_active":"2024-09-14T11:53:14.792179+0000","last_peered":"2024-09-14T11:53:14.792179+0000","last_clean":"2024-09-14T11:53:14.792179+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:53:14.792179+0000","last_undegraded":"2024-09-14T11:53:14.792179+0000","last_fullsized":"2024-09-14T11:53:14.792179+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:46.748943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:59.904336+0000","last_change":"2024-09-14T11:29:10.318315+0000","last_active":"2024-09-14T11:53:59.904336+0000","last_peered":"2024-09-14T11:53:59.904336+0000","last_clean":"2024-09-14T11:53:59.904336+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:53:59.904336+0000","last_undegraded":"2024-09-14T11:53:59.904336+0000","last_fullsized":"2024-09-14T11:53:59.904336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.626967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786640+0000","last_change":"2024-09-14T11:41:15.872566+0000","last_active":"2024-09-14T11:52:34.786640+0000","last_peered":"2024-09-14T11:52:34.786640+0000","last_clean":"2024-09-14T11:52:34.786640+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:52:34.786640+0000","last_undegraded":"2024-09-14T11:52:34.786640+0000","last_fullsized":"2024-09-14T11:52:34.786640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:25.046391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899441+0000","last_change":"2024-09-14T11:30:47.740588+0000","last_active":"2024-09-14T11:53:19.899441+0000","last_peered":"2024-09-14T11:53:19.899441+0000","last_clean":"2024-09-14T11:53:19.899441+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:53:19.899441+0000","last_undegraded":"2024-09-14T11:53:19.899441+0000","last_fullsized":"2024-09-14T11:53:19.899441+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.092285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.933625+0000","last_change":"2024-09-14T11:56:51.933625+0000","last_active":"2024-09-14T11:56:51.933625+0000","last_peered":"2024-09-14T11:56:51.933625+0000","last_clean":"2024-09-14T11:56:51.933625+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:56:51.933625+0000","last_undegraded":"2024-09-14T11:56:51.933625+0000","last_fullsized":"2024-09-14T11:56:51.933625+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.933536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:59.991027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.668608+0000","last_change":"2024-09-14T11:57:00.668608+0000","last_active":"2024-09-14T11:57:00.668608+0000","last_peered":"2024-09-14T11:57:00.668608+0000","last_clean":"2024-09-14T11:57:00.668608+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:57:00.668608+0000","last_undegraded":"2024-09-14T11:57:00.668608+0000","last_fullsized":"2024-09-14T11:57:00.668608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.668524+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.185828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.283375+0000","last_change":"2024-09-14T11:56:58.283375+0000","last_active":"2024-09-14T11:56:58.283375+0000","last_peered":"2024-09-14T11:56:58.283375+0000","last_clean":"2024-09-14T11:56:58.283375+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:56:58.283375+0000","last_undegraded":"2024-09-14T11:56:58.283375+0000","last_fullsized":"2024-09-14T11:56:58.283375+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.283290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:10.478240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:34.916000+0000","last_change":"2024-09-14T11:30:47.897699+0000","last_active":"2024-09-14T11:55:34.916000+0000","last_peered":"2024-09-14T11:55:34.916000+0000","last_clean":"2024-09-14T11:55:34.916000+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:55:34.916000+0000","last_undegraded":"2024-09-14T11:55:34.916000+0000","last_fullsized":"2024-09-14T11:55:34.916000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:27.255543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.899241+0000","last_change":"2024-09-14T11:30:44.723117+0000","last_active":"2024-09-14T11:53:14.899241+0000","last_peered":"2024-09-14T11:53:14.899241+0000","last_clean":"2024-09-14T11:53:14.899241+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:53:14.899241+0000","last_undegraded":"2024-09-14T11:53:14.899241+0000","last_fullsized":"2024-09-14T11:53:14.899241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:22.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.225945+0000","last_change":"2024-09-14T11:56:51.225945+0000","last_active":"2024-09-14T11:56:51.225945+0000","last_peered":"2024-09-14T11:56:51.225945+0000","last_clean":"2024-09-14T11:56:51.225945+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:56:51.225945+0000","last_undegraded":"2024-09-14T11:56:51.225945+0000","last_fullsized":"2024-09-14T11:56:51.225945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.225829+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:16.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.801938+0000","last_change":"2024-09-14T11:41:15.875956+0000","last_active":"2024-09-14T11:54:19.801938+0000","last_peered":"2024-09-14T11:54:19.801938+0000","last_clean":"2024-09-14T11:54:19.801938+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:54:19.801938+0000","last_undegraded":"2024-09-14T11:54:19.801938+0000","last_fullsized":"2024-09-14T11:54:19.801938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899487+0000","last_change":"2024-09-14T11:30:47.742220+0000","last_active":"2024-09-14T11:53:19.899487+0000","last_peered":"2024-09-14T11:53:19.899487+0000","last_clean":"2024-09-14T11:53:19.899487+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:53:19.899487+0000","last_undegraded":"2024-09-14T11:53:19.899487+0000","last_fullsized":"2024-09-14T11:53:19.899487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.850116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.013241+0000","last_change":"2024-09-14T11:56:53.013241+0000","last_active":"2024-09-14T11:56:53.013241+0000","last_peered":"2024-09-14T11:56:53.013241+0000","last_clean":"2024-09-14T11:56:53.013241+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:56:53.013241+0000","last_undegraded":"2024-09-14T11:56:53.013241+0000","last_fullsized":"2024-09-14T11:56:53.013241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.013141+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.047147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.946131+0000","last_change":"2024-09-14T11:56:45.946131+0000","last_active":"2024-09-14T11:56:45.946131+0000","last_peered":"2024-09-14T11:56:45.946131+0000","last_clean":"2024-09-14T11:56:45.946131+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:56:45.946131+0000","last_undegraded":"2024-09-14T11:56:45.946131+0000","last_fullsized":"2024-09-14T11:56:45.946131+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.946047+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:05.117515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.910049+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:54:44.910049+0000","last_peered":"2024-09-14T11:54:44.910049+0000","last_clean":"2024-09-14T11:54:44.910049+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:54:44.910049+0000","last_undegraded":"2024-09-14T11:54:44.910049+0000","last_fullsized":"2024-09-14T11:54:44.910049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.192166+0000","last_change":"2024-09-14T11:30:47.739172+0000","last_active":"2024-09-14T11:56:15.192166+0000","last_peered":"2024-09-14T11:56:15.192166+0000","last_clean":"2024-09-14T11:56:15.192166+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:56:15.192166+0000","last_undegraded":"2024-09-14T11:56:15.192166+0000","last_fullsized":"2024-09-14T11:56:15.192166+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.908491+0000","last_change":"2024-09-14T11:30:44.722582+0000","last_active":"2024-09-14T11:54:34.908491+0000","last_peered":"2024-09-14T11:54:34.908491+0000","last_clean":"2024-09-14T11:54:34.908491+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:54:34.908491+0000","last_undegraded":"2024-09-14T11:54:34.908491+0000","last_fullsized":"2024-09-14T11:54:34.908491+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.903876+0000","last_change":"2024-09-14T11:29:10.319067+0000","last_active":"2024-09-14T11:53:54.903876+0000","last_peered":"2024-09-14T11:53:54.903876+0000","last_clean":"2024-09-14T11:53:54.903876+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:53:54.903876+0000","last_undegraded":"2024-09-14T11:53:54.903876+0000","last_fullsized":"2024-09-14T11:53:54.903876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:30.532542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.787235+0000","last_change":"2024-09-14T11:41:15.875944+0000","last_active":"2024-09-14T11:52:39.787235+0000","last_peered":"2024-09-14T11:52:39.787235+0000","last_clean":"2024-09-14T11:52:39.787235+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:52:39.787235+0000","last_undegraded":"2024-09-14T11:52:39.787235+0000","last_fullsized":"2024-09-14T11:52:39.787235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:25.980447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.804912+0000","last_change":"2024-09-14T11:30:47.896158+0000","last_active":"2024-09-14T11:54:39.804912+0000","last_peered":"2024-09-14T11:54:39.804912+0000","last_clean":"2024-09-14T11:54:39.804912+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:54:39.804912+0000","last_undegraded":"2024-09-14T11:54:39.804912+0000","last_fullsized":"2024-09-14T11:54:39.804912+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.045891+0000","last_change":"2024-09-14T11:56:54.045891+0000","last_active":"2024-09-14T11:56:54.045891+0000","last_peered":"2024-09-14T11:56:54.045891+0000","last_clean":"2024-09-14T11:56:54.045891+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:56:54.045891+0000","last_undegraded":"2024-09-14T11:56:54.045891+0000","last_fullsized":"2024-09-14T11:56:54.045891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.045797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:35.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.374906+0000","last_change":"2024-09-14T11:56:58.374906+0000","last_active":"2024-09-14T11:56:58.374906+0000","last_peered":"2024-09-14T11:56:58.374906+0000","last_clean":"2024-09-14T11:56:58.374906+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:56:58.374906+0000","last_undegraded":"2024-09-14T11:56:58.374906+0000","last_fullsized":"2024-09-14T11:56:58.374906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.374822+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:02.736281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.786660+0000","last_change":"2024-09-14T11:41:15.874809+0000","last_active":"2024-09-14T11:52:34.786660+0000","last_peered":"2024-09-14T11:52:34.786660+0000","last_clean":"2024-09-14T11:52:34.786660+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:52:34.786660+0000","last_undegraded":"2024-09-14T11:52:34.786660+0000","last_fullsized":"2024-09-14T11:52:34.786660+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:41.446817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.057742+0000","last_change":"2024-09-14T11:56:57.057742+0000","last_active":"2024-09-14T11:56:57.057742+0000","last_peered":"2024-09-14T11:56:57.057742+0000","last_clean":"2024-09-14T11:56:57.057742+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:56:57.057742+0000","last_undegraded":"2024-09-14T11:56:57.057742+0000","last_fullsized":"2024-09-14T11:56:57.057742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.057651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:43.123811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.482087+0000","last_change":"2024-09-14T11:30:44.721451+0000","last_active":"2024-09-14T11:56:15.482087+0000","last_peered":"2024-09-14T11:56:15.482087+0000","last_clean":"2024-09-14T11:56:15.482087+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:56:15.482087+0000","last_undegraded":"2024-09-14T11:56:15.482087+0000","last_fullsized":"2024-09-14T11:56:15.482087+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.845453+0000","last_change":"2024-09-14T11:29:10.322635+0000","last_active":"2024-09-14T11:53:31.845453+0000","last_peered":"2024-09-14T11:53:31.845453+0000","last_clean":"2024-09-14T11:53:31.845453+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:53:31.845453+0000","last_undegraded":"2024-09-14T11:53:31.845453+0000","last_fullsized":"2024-09-14T11:53:31.845453+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:58.963313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:34.894305+0000","last_change":"2024-09-14T11:41:15.867822+0000","last_active":"2024-09-14T11:52:34.894305+0000","last_peered":"2024-09-14T11:52:34.894305+0000","last_clean":"2024-09-14T11:52:34.894305+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:52:34.894305+0000","last_undegraded":"2024-09-14T11:52:34.894305+0000","last_fullsized":"2024-09-14T11:52:34.894305+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.504640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.805775+0000","last_change":"2024-09-14T11:30:47.739362+0000","last_active":"2024-09-14T11:54:44.805775+0000","last_peered":"2024-09-14T11:54:44.805775+0000","last_clean":"2024-09-14T11:54:44.805775+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:54:44.805775+0000","last_undegraded":"2024-09-14T11:54:44.805775+0000","last_fullsized":"2024-09-14T11:54:44.805775+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.796961+0000","last_change":"2024-09-14T11:30:44.718385+0000","last_active":"2024-09-14T11:56:13.796961+0000","last_peered":"2024-09-14T11:56:13.796961+0000","last_clean":"2024-09-14T11:56:13.796961+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:56:13.796961+0000","last_undegraded":"2024-09-14T11:56:13.796961+0000","last_fullsized":"2024-09-14T11:56:13.796961+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:01.202824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.132901+0000","last_change":"2024-09-14T11:56:49.132901+0000","last_active":"2024-09-14T11:56:49.132901+0000","last_peered":"2024-09-14T11:56:49.132901+0000","last_clean":"2024-09-14T11:56:49.132901+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:56:49.132901+0000","last_undegraded":"2024-09-14T11:56:49.132901+0000","last_fullsized":"2024-09-14T11:56:49.132901+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.132808+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:18.076133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.797019+0000","last_change":"2024-09-14T11:41:15.875548+0000","last_active":"2024-09-14T11:53:49.797019+0000","last_peered":"2024-09-14T11:53:49.797019+0000","last_clean":"2024-09-14T11:53:49.797019+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:53:49.797019+0000","last_undegraded":"2024-09-14T11:53:49.797019+0000","last_fullsized":"2024-09-14T11:53:49.797019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:26.984988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:49.918857+0000","last_change":"2024-09-14T11:30:47.735269+0000","last_active":"2024-09-14T11:55:49.918857+0000","last_peered":"2024-09-14T11:55:49.918857+0000","last_clean":"2024-09-14T11:55:49.918857+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:55:49.918857+0000","last_undegraded":"2024-09-14T11:55:49.918857+0000","last_fullsized":"2024-09-14T11:55:49.918857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.259856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.815040+0000","last_change":"2024-09-14T11:30:44.722209+0000","last_active":"2024-09-14T11:55:44.815040+0000","last_peered":"2024-09-14T11:55:44.815040+0000","last_clean":"2024-09-14T11:55:44.815040+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:55:44.815040+0000","last_undegraded":"2024-09-14T11:55:44.815040+0000","last_fullsized":"2024-09-14T11:55:44.815040+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:34.613767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897290+0000","last_change":"2024-09-14T11:29:10.321517+0000","last_active":"2024-09-14T11:52:59.897290+0000","last_peered":"2024-09-14T11:52:59.897290+0000","last_clean":"2024-09-14T11:52:59.897290+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:52:59.897290+0000","last_undegraded":"2024-09-14T11:52:59.897290+0000","last_fullsized":"2024-09-14T11:52:59.897290+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:28.675230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.039822+0000","last_change":"2024-09-14T11:41:15.872563+0000","last_active":"2024-09-14T11:53:46.039822+0000","last_peered":"2024-09-14T11:53:46.039822+0000","last_clean":"2024-09-14T11:53:46.039822+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:53:46.039822+0000","last_undegraded":"2024-09-14T11:53:46.039822+0000","last_fullsized":"2024-09-14T11:53:46.039822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.902741+0000","last_change":"2024-09-14T11:30:47.897486+0000","last_active":"2024-09-14T11:53:44.902741+0000","last_peered":"2024-09-14T11:53:44.902741+0000","last_clean":"2024-09-14T11:53:44.902741+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:53:44.902741+0000","last_undegraded":"2024-09-14T11:53:44.902741+0000","last_fullsized":"2024-09-14T11:53:44.902741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:23.182873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.913761+0000","last_change":"2024-09-14T11:56:47.913761+0000","last_active":"2024-09-14T11:56:47.913761+0000","last_peered":"2024-09-14T11:56:47.913761+0000","last_clean":"2024-09-14T11:56:47.913761+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:56:47.913761+0000","last_undegraded":"2024-09-14T11:56:47.913761+0000","last_fullsized":"2024-09-14T11:56:47.913761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.913640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:12.325543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.144132+0000","last_change":"2024-09-14T11:56:48.144132+0000","last_active":"2024-09-14T11:56:48.144132+0000","last_peered":"2024-09-14T11:56:48.144132+0000","last_clean":"2024-09-14T11:56:48.144132+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:56:48.144132+0000","last_undegraded":"2024-09-14T11:56:48.144132+0000","last_fullsized":"2024-09-14T11:56:48.144132+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.144046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:55.137350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899069+0000","last_change":"2024-09-14T11:41:15.865209+0000","last_active":"2024-09-14T11:53:19.899069+0000","last_peered":"2024-09-14T11:53:19.899069+0000","last_clean":"2024-09-14T11:53:19.899069+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:53:19.899069+0000","last_undegraded":"2024-09-14T11:53:19.899069+0000","last_fullsized":"2024-09-14T11:53:19.899069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.995189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.805068+0000","last_change":"2024-09-14T11:30:47.896196+0000","last_active":"2024-09-14T11:54:39.805068+0000","last_peered":"2024-09-14T11:54:39.805068+0000","last_clean":"2024-09-14T11:54:39.805068+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:54:39.805068+0000","last_undegraded":"2024-09-14T11:54:39.805068+0000","last_fullsized":"2024-09-14T11:54:39.805068+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:13.936958+0000","last_change":"2024-09-14T11:30:44.720277+0000","last_active":"2024-09-14T11:56:13.936958+0000","last_peered":"2024-09-14T11:56:13.936958+0000","last_clean":"2024-09-14T11:56:13.936958+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:56:13.936958+0000","last_undegraded":"2024-09-14T11:56:13.936958+0000","last_fullsized":"2024-09-14T11:56:13.936958+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.334999+0000","last_change":"2024-09-14T11:56:57.334999+0000","last_active":"2024-09-14T11:56:57.334999+0000","last_peered":"2024-09-14T11:56:57.334999+0000","last_clean":"2024-09-14T11:56:57.334999+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:56:57.334999+0000","last_undegraded":"2024-09-14T11:56:57.334999+0000","last_fullsized":"2024-09-14T11:56:57.334999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.334915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.592191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790642+0000","last_change":"2024-09-14T11:41:15.867621+0000","last_active":"2024-09-14T11:53:45.790642+0000","last_peered":"2024-09-14T11:53:45.790642+0000","last_clean":"2024-09-14T11:53:45.790642+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:53:45.790642+0000","last_undegraded":"2024-09-14T11:53:45.790642+0000","last_fullsized":"2024-09-14T11:53:45.790642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:15.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.192700+0000","last_change":"2024-09-14T11:30:47.740075+0000","last_active":"2024-09-14T11:56:15.192700+0000","last_peered":"2024-09-14T11:56:15.192700+0000","last_clean":"2024-09-14T11:56:15.192700+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:56:15.192700+0000","last_undegraded":"2024-09-14T11:56:15.192700+0000","last_fullsized":"2024-09-14T11:56:15.192700+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.804335+0000","last_change":"2024-09-14T11:30:44.721298+0000","last_active":"2024-09-14T11:54:34.804335+0000","last_peered":"2024-09-14T11:54:34.804335+0000","last_clean":"2024-09-14T11:54:34.804335+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:54:34.804335+0000","last_undegraded":"2024-09-14T11:54:34.804335+0000","last_fullsized":"2024-09-14T11:54:34.804335+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.984107+0000","last_change":"2024-09-14T11:56:50.984107+0000","last_active":"2024-09-14T11:56:50.984107+0000","last_peered":"2024-09-14T11:56:50.984107+0000","last_clean":"2024-09-14T11:56:50.984107+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:56:50.984107+0000","last_undegraded":"2024-09-14T11:56:50.984107+0000","last_fullsized":"2024-09-14T11:56:50.984107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.984030+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:46.373826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.885109+0000","last_change":"2024-09-14T11:56:53.885109+0000","last_active":"2024-09-14T11:56:53.885109+0000","last_peered":"2024-09-14T11:56:53.885109+0000","last_clean":"2024-09-14T11:56:53.885109+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:56:53.885109+0000","last_undegraded":"2024-09-14T11:56:53.885109+0000","last_fullsized":"2024-09-14T11:56:53.885109+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.885011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:38.040674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.112834+0000","last_change":"2024-09-14T11:56:59.112834+0000","last_active":"2024-09-14T11:56:59.112834+0000","last_peered":"2024-09-14T11:56:59.112834+0000","last_clean":"2024-09-14T11:56:59.112834+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:56:59.112834+0000","last_undegraded":"2024-09-14T11:56:59.112834+0000","last_fullsized":"2024-09-14T11:56:59.112834+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.112741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:05.850721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.806591+0000","last_change":"2024-09-14T11:30:44.720946+0000","last_active":"2024-09-14T11:54:49.806591+0000","last_peered":"2024-09-14T11:54:49.806591+0000","last_clean":"2024-09-14T11:54:49.806591+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:54:49.806591+0000","last_undegraded":"2024-09-14T11:54:49.806591+0000","last_fullsized":"2024-09-14T11:54:49.806591+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.043510+0000","last_change":"2024-09-14T11:29:10.322832+0000","last_active":"2024-09-14T11:54:11.043510+0000","last_peered":"2024-09-14T11:54:11.043510+0000","last_clean":"2024-09-14T11:54:11.043510+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:54:11.043510+0000","last_undegraded":"2024-09-14T11:54:11.043510+0000","last_fullsized":"2024-09-14T11:54:11.043510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:29:09.297420+0000","last_clean_scrub_stamp":"2024-09-14T11:29:09.297420+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:33.576020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.906570+0000","last_change":"2024-09-14T11:41:15.873472+0000","last_active":"2024-09-14T11:54:19.906570+0000","last_peered":"2024-09-14T11:54:19.906570+0000","last_clean":"2024-09-14T11:54:19.906570+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:54:19.906570+0000","last_undegraded":"2024-09-14T11:54:19.906570+0000","last_fullsized":"2024-09-14T11:54:19.906570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:15.363749+0000","last_change":"2024-09-14T11:30:47.739111+0000","last_active":"2024-09-14T11:56:15.363749+0000","last_peered":"2024-09-14T11:56:15.363749+0000","last_clean":"2024-09-14T11:56:15.363749+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:56:15.363749+0000","last_undegraded":"2024-09-14T11:56:15.363749+0000","last_fullsized":"2024-09-14T11:56:15.363749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.795283+0000","last_change":"2024-09-14T11:30:44.721167+0000","last_active":"2024-09-14T11:53:39.795283+0000","last_peered":"2024-09-14T11:53:39.795283+0000","last_clean":"2024-09-14T11:53:39.795283+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:53:39.795283+0000","last_undegraded":"2024-09-14T11:53:39.795283+0000","last_fullsized":"2024-09-14T11:53:39.795283+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:43.694081+0000","last_clean_scrub_stamp":"2024-09-14T11:30:43.694081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:57.143214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.967461+0000","last_change":"2024-09-14T11:56:58.967461+0000","last_active":"2024-09-14T11:56:58.967461+0000","last_peered":"2024-09-14T11:56:58.967461+0000","last_clean":"2024-09-14T11:56:58.967461+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:56:58.967461+0000","last_undegraded":"2024-09-14T11:56:58.967461+0000","last_fullsized":"2024-09-14T11:56:58.967461+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.967365+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:06.574227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.903310+0000","last_change":"2024-09-14T11:41:15.869943+0000","last_active":"2024-09-14T11:53:49.903310+0000","last_peered":"2024-09-14T11:53:49.903310+0000","last_clean":"2024-09-14T11:53:49.903310+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:53:49.903310+0000","last_undegraded":"2024-09-14T11:53:49.903310+0000","last_fullsized":"2024-09-14T11:53:49.903310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:19.630727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.275179+0000","last_change":"2024-09-14T11:56:54.275179+0000","last_active":"2024-09-14T11:56:54.275179+0000","last_peered":"2024-09-14T11:56:54.275179+0000","last_clean":"2024-09-14T11:56:54.275179+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:56:54.275179+0000","last_undegraded":"2024-09-14T11:56:54.275179+0000","last_fullsized":"2024-09-14T11:56:54.275179+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.275052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:27.168851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'11","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.995693+0000","last_change":"2024-09-14T11:56:51.995693+0000","last_active":"2024-09-14T11:56:51.995693+0000","last_peered":"2024-09-14T11:56:51.995693+0000","last_clean":"2024-09-14T11:56:51.995693+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:56:51.995693+0000","last_undegraded":"2024-09-14T11:56:51.995693+0000","last_fullsized":"2024-09-14T11:56:51.995693+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.995590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:12.438738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.189319+0000","last_change":"2024-09-14T11:56:47.189319+0000","last_active":"2024-09-14T11:56:47.189319+0000","last_peered":"2024-09-14T11:56:47.189319+0000","last_clean":"2024-09-14T11:56:47.189319+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:56:47.189319+0000","last_undegraded":"2024-09-14T11:56:47.189319+0000","last_fullsized":"2024-09-14T11:56:47.189319+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.189227+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:38.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.797955+0000","last_change":"2024-09-14T11:41:15.878310+0000","last_active":"2024-09-14T11:53:54.797955+0000","last_peered":"2024-09-14T11:53:54.797955+0000","last_clean":"2024-09-14T11:53:54.797955+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:53:54.797955+0000","last_undegraded":"2024-09-14T11:53:54.797955+0000","last_fullsized":"2024-09-14T11:53:54.797955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:11.782624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.790694+0000","last_change":"2024-09-14T11:30:47.739918+0000","last_active":"2024-09-14T11:53:45.790694+0000","last_peered":"2024-09-14T11:53:45.790694+0000","last_clean":"2024-09-14T11:53:45.790694+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:53:45.790694+0000","last_undegraded":"2024-09-14T11:53:45.790694+0000","last_fullsized":"2024-09-14T11:53:45.790694+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:46.712917+0000","last_clean_scrub_stamp":"2024-09-14T11:30:46.712917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.079872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.249115+0000","last_change":"2024-09-14T11:56:52.249115+0000","last_active":"2024-09-14T11:56:52.249115+0000","last_peered":"2024-09-14T11:56:52.249115+0000","last_clean":"2024-09-14T11:56:52.249115+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:56:52.249115+0000","last_undegraded":"2024-09-14T11:56:52.249115+0000","last_fullsized":"2024-09-14T11:56:52.249115+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.249025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:41.425368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.353130+0000","last_change":"2024-09-14T11:56:59.353130+0000","last_active":"2024-09-14T11:56:59.353130+0000","last_peered":"2024-09-14T11:56:59.353130+0000","last_clean":"2024-09-14T11:56:59.353130+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:56:59.353130+0000","last_undegraded":"2024-09-14T11:56:59.353130+0000","last_fullsized":"2024-09-14T11:56:59.353130+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.353042+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.218284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'328","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.457995+0000","last_change":"2024-09-14T11:56:32.457995+0000","last_active":"2024-09-14T11:56:32.457995+0000","last_peered":"2024-09-14T11:56:32.457995+0000","last_clean":"2024-09-14T11:56:32.457995+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:32.457995+0000","last_undegraded":"2024-09-14T11:56:32.457995+0000","last_fullsized":"2024-09-14T11:56:32.457995+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.457886+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:42.457035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":2359,"num_write":1145,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1593","reported_seq":3387,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.733167+0000","last_change":"2024-09-14T11:56:40.733167+0000","last_active":"2024-09-14T11:56:40.733167+0000","last_peered":"2024-09-14T11:56:40.733167+0000","last_clean":"2024-09-14T11:56:40.733167+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:56:40.733167+0000","last_undegraded":"2024-09-14T11:56:40.733167+0000","last_fullsized":"2024-09-14T11:56:40.733167+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1593","last_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_deep_scrub":"263'1593","last_deep_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.733084+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.184612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'344","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.843948+0000","last_change":"2024-09-14T11:56:25.843948+0000","last_active":"2024-09-14T11:56:25.843948+0000","last_peered":"2024-09-14T11:56:25.843948+0000","last_clean":"2024-09-14T11:56:25.843948+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:25.843948+0000","last_undegraded":"2024-09-14T11:56:25.843948+0000","last_fullsized":"2024-09-14T11:56:25.843948+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.843781+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:39.876965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":643,"num_read_kb":6703,"num_write":1183,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'563","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.583527+0000","last_change":"2024-09-14T11:56:39.583472+0000","last_active":"2024-09-14T11:56:39.583527+0000","last_peered":"2024-09-14T11:56:39.583527+0000","last_clean":"2024-09-14T11:56:39.583527+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:56:39.583527+0000","last_undegraded":"2024-09-14T11:56:39.583527+0000","last_fullsized":"2024-09-14T11:56:39.583527+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'563","last_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_deep_scrub":"263'563","last_deep_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.583358+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.041135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'350","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.490371+0000","last_change":"2024-09-14T11:56:29.490371+0000","last_active":"2024-09-14T11:56:29.490371+0000","last_peered":"2024-09-14T11:56:29.490371+0000","last_clean":"2024-09-14T11:56:29.490371+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:29.490371+0000","last_undegraded":"2024-09-14T11:56:29.490371+0000","last_fullsized":"2024-09-14T11:56:29.490371+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.490240+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:19.905307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":11794,"num_write":1143,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'481","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.761132+0000","last_change":"2024-09-14T11:56:40.761132+0000","last_active":"2024-09-14T11:56:40.761132+0000","last_peered":"2024-09-14T11:56:40.761132+0000","last_clean":"2024-09-14T11:56:40.761132+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:56:40.761132+0000","last_undegraded":"2024-09-14T11:56:40.761132+0000","last_fullsized":"2024-09-14T11:56:40.761132+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.761000+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:10.670888+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.751856+0000","last_change":"2024-09-14T11:56:37.751856+0000","last_active":"2024-09-14T11:56:37.751856+0000","last_peered":"2024-09-14T11:56:37.751856+0000","last_clean":"2024-09-14T11:56:37.751856+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:37.751856+0000","last_undegraded":"2024-09-14T11:56:37.751856+0000","last_fullsized":"2024-09-14T11:56:37.751856+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.751721+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:52.423497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1061","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.655563+0000","last_change":"2024-09-14T11:56:38.655504+0000","last_active":"2024-09-14T11:56:38.655563+0000","last_peered":"2024-09-14T11:56:38.655563+0000","last_clean":"2024-09-14T11:56:38.655563+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:56:38.655563+0000","last_undegraded":"2024-09-14T11:56:38.655563+0000","last_fullsized":"2024-09-14T11:56:38.655563+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1061","last_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_deep_scrub":"263'1061","last_deep_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.655414+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:06.267363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'351","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.566767+0000","last_change":"2024-09-14T11:56:37.566767+0000","last_active":"2024-09-14T11:56:37.566767+0000","last_peered":"2024-09-14T11:56:37.566767+0000","last_clean":"2024-09-14T11:56:37.566767+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:37.566767+0000","last_undegraded":"2024-09-14T11:56:37.566767+0000","last_fullsized":"2024-09-14T11:56:37.566767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.566631+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:27.502397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":626,"num_read_kb":64951,"num_write":1173,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'466","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.235997+0000","last_change":"2024-09-14T11:56:34.235997+0000","last_active":"2024-09-14T11:56:34.235997+0000","last_peered":"2024-09-14T11:56:34.235997+0000","last_clean":"2024-09-14T11:56:34.235997+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:56:34.235997+0000","last_undegraded":"2024-09-14T11:56:34.235997+0000","last_fullsized":"2024-09-14T11:56:34.235997+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.235902+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:32.784865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.776617+0000","last_change":"2024-09-14T11:56:34.776532+0000","last_active":"2024-09-14T11:56:34.776617+0000","last_peered":"2024-09-14T11:56:34.776617+0000","last_clean":"2024-09-14T11:56:34.776617+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:34.776617+0000","last_undegraded":"2024-09-14T11:56:34.776617+0000","last_fullsized":"2024-09-14T11:56:34.776617+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.776385+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.314618+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'803","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.817046+0000","last_change":"2024-09-14T11:56:42.817046+0000","last_active":"2024-09-14T11:56:42.817046+0000","last_peered":"2024-09-14T11:56:42.817046+0000","last_clean":"2024-09-14T11:56:42.817046+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:56:42.817046+0000","last_undegraded":"2024-09-14T11:56:42.817046+0000","last_fullsized":"2024-09-14T11:56:42.817046+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.816954+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:54.466437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'298","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.494965+0000","last_change":"2024-09-14T11:56:31.494896+0000","last_active":"2024-09-14T11:56:31.494965+0000","last_peered":"2024-09-14T11:56:31.494965+0000","last_clean":"2024-09-14T11:56:31.494965+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:31.494965+0000","last_undegraded":"2024-09-14T11:56:31.494965+0000","last_fullsized":"2024-09-14T11:56:31.494965+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.494814+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:22.737796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":10089,"num_write":838,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'972","reported_seq":2716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.682691+0000","last_change":"2024-09-14T11:56:43.682691+0000","last_active":"2024-09-14T11:56:43.682691+0000","last_peered":"2024-09-14T11:56:43.682691+0000","last_clean":"2024-09-14T11:56:43.682691+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:56:43.682691+0000","last_undegraded":"2024-09-14T11:56:43.682691+0000","last_fullsized":"2024-09-14T11:56:43.682691+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.682597+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:06.195336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3830,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'304","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.076723+0000","last_change":"2024-09-14T11:56:31.076616+0000","last_active":"2024-09-14T11:56:31.076723+0000","last_peered":"2024-09-14T11:56:31.076723+0000","last_clean":"2024-09-14T11:56:31.076723+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:31.076723+0000","last_undegraded":"2024-09-14T11:56:31.076723+0000","last_fullsized":"2024-09-14T11:56:31.076723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.076451+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:08.379985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":712,"num_read_kb":31980,"num_write":1004,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'457","reported_seq":1989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.852513+0000","last_change":"2024-09-14T11:56:30.852513+0000","last_active":"2024-09-14T11:56:30.852513+0000","last_peered":"2024-09-14T11:56:30.852513+0000","last_clean":"2024-09-14T11:56:30.852513+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:56:30.852513+0000","last_undegraded":"2024-09-14T11:56:30.852513+0000","last_fullsized":"2024-09-14T11:56:30.852513+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.852429+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:32.993438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'844","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.751896+0000","last_change":"2024-09-14T11:56:38.751896+0000","last_active":"2024-09-14T11:56:38.751896+0000","last_peered":"2024-09-14T11:56:38.751896+0000","last_clean":"2024-09-14T11:56:38.751896+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:56:38.751896+0000","last_undegraded":"2024-09-14T11:56:38.751896+0000","last_fullsized":"2024-09-14T11:56:38.751896+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'844","last_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_deep_scrub":"263'844","last_deep_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.751800+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:31.522430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.518468+0000","last_change":"2024-09-14T11:56:29.518468+0000","last_active":"2024-09-14T11:56:29.518468+0000","last_peered":"2024-09-14T11:56:29.518468+0000","last_clean":"2024-09-14T11:56:29.518468+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:29.518468+0000","last_undegraded":"2024-09-14T11:56:29.518468+0000","last_fullsized":"2024-09-14T11:56:29.518468+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.518308+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:50.599905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":694,"num_read_kb":5626,"num_write":1163,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1035","reported_seq":2968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.559633+0000","last_change":"2024-09-14T11:56:38.559633+0000","last_active":"2024-09-14T11:56:38.559633+0000","last_peered":"2024-09-14T11:56:38.559633+0000","last_clean":"2024-09-14T11:56:38.559633+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:56:38.559633+0000","last_undegraded":"2024-09-14T11:56:38.559633+0000","last_fullsized":"2024-09-14T11:56:38.559633+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1035","last_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_deep_scrub":"263'1035","last_deep_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.559545+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:59.274734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.210958+0000","last_change":"2024-09-14T11:56:28.210958+0000","last_active":"2024-09-14T11:56:28.210958+0000","last_peered":"2024-09-14T11:56:28.210958+0000","last_clean":"2024-09-14T11:56:28.210958+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:28.210958+0000","last_undegraded":"2024-09-14T11:56:28.210958+0000","last_fullsized":"2024-09-14T11:56:28.210958+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.210845+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:07.178497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.732926+0000","last_change":"2024-09-14T11:56:39.732926+0000","last_active":"2024-09-14T11:56:39.732926+0000","last_peered":"2024-09-14T11:56:39.732926+0000","last_clean":"2024-09-14T11:56:39.732926+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:56:39.732926+0000","last_undegraded":"2024-09-14T11:56:39.732926+0000","last_fullsized":"2024-09-14T11:56:39.732926+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.732833+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:56.461549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.221091+0000","last_change":"2024-09-14T11:56:29.221091+0000","last_active":"2024-09-14T11:56:29.221091+0000","last_peered":"2024-09-14T11:56:29.221091+0000","last_clean":"2024-09-14T11:56:29.221091+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:29.221091+0000","last_undegraded":"2024-09-14T11:56:29.221091+0000","last_fullsized":"2024-09-14T11:56:29.221091+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.220978+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.320306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'801","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.875354+0000","last_change":"2024-09-14T11:56:28.875354+0000","last_active":"2024-09-14T11:56:28.875354+0000","last_peered":"2024-09-14T11:56:28.875354+0000","last_clean":"2024-09-14T11:56:28.875354+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:56:28.875354+0000","last_undegraded":"2024-09-14T11:56:28.875354+0000","last_fullsized":"2024-09-14T11:56:28.875354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'801","last_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_deep_scrub":"263'801","last_deep_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.875262+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:43.441720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.735385+0000","last_change":"2024-09-14T11:56:25.735385+0000","last_active":"2024-09-14T11:56:25.735385+0000","last_peered":"2024-09-14T11:56:25.735385+0000","last_clean":"2024-09-14T11:56:25.735385+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:25.735385+0000","last_undegraded":"2024-09-14T11:56:25.735385+0000","last_fullsized":"2024-09-14T11:56:25.735385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.735245+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:43.758913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'455","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.828599+0000","last_change":"2024-09-14T11:56:31.828599+0000","last_active":"2024-09-14T11:56:31.828599+0000","last_peered":"2024-09-14T11:56:31.828599+0000","last_clean":"2024-09-14T11:56:31.828599+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:56:31.828599+0000","last_undegraded":"2024-09-14T11:56:31.828599+0000","last_fullsized":"2024-09-14T11:56:31.828599+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'455","last_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_deep_scrub":"263'455","last_deep_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.828518+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:25.639201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":693,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'426","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.027590+0000","last_change":"2024-09-14T11:56:30.027590+0000","last_active":"2024-09-14T11:56:30.027590+0000","last_peered":"2024-09-14T11:56:30.027590+0000","last_clean":"2024-09-14T11:56:30.027590+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:30.027590+0000","last_undegraded":"2024-09-14T11:56:30.027590+0000","last_fullsized":"2024-09-14T11:56:30.027590+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.027445+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.053487+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1042,"num_read_kb":31602,"num_write":1294,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'450","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.793178+0000","last_change":"2024-09-14T11:56:39.793178+0000","last_active":"2024-09-14T11:56:39.793178+0000","last_peered":"2024-09-14T11:56:39.793178+0000","last_clean":"2024-09-14T11:56:39.793178+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:56:39.793178+0000","last_undegraded":"2024-09-14T11:56:39.793178+0000","last_fullsized":"2024-09-14T11:56:39.793178+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.793094+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.783508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'326","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.526665+0000","last_change":"2024-09-14T11:56:28.526665+0000","last_active":"2024-09-14T11:56:28.526665+0000","last_peered":"2024-09-14T11:56:28.526665+0000","last_clean":"2024-09-14T11:56:28.526665+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:28.526665+0000","last_undegraded":"2024-09-14T11:56:28.526665+0000","last_fullsized":"2024-09-14T11:56:28.526665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.526538+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:23.545261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048824,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":49467,"num_write":1023,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'152","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.923340+0000","last_change":"2024-09-14T11:56:56.923340+0000","last_active":"2024-09-14T11:56:56.923340+0000","last_peered":"2024-09-14T11:56:56.923340+0000","last_clean":"2024-09-14T11:56:56.923340+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:56:56.923340+0000","last_undegraded":"2024-09-14T11:56:56.923340+0000","last_fullsized":"2024-09-14T11:56:56.923340+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'152","last_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_deep_scrub":"263'152","last_deep_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.923215+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:16.289153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'476","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.251948+0000","last_change":"2024-09-14T11:56:41.251948+0000","last_active":"2024-09-14T11:56:41.251948+0000","last_peered":"2024-09-14T11:56:41.251948+0000","last_clean":"2024-09-14T11:56:41.251948+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:56:41.251948+0000","last_undegraded":"2024-09-14T11:56:41.251948+0000","last_fullsized":"2024-09-14T11:56:41.251948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.251856+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:21.434224+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'350","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.558262+0000","last_change":"2024-09-14T11:56:27.558262+0000","last_active":"2024-09-14T11:56:27.558262+0000","last_peered":"2024-09-14T11:56:27.558262+0000","last_clean":"2024-09-14T11:56:27.558262+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:27.558262+0000","last_undegraded":"2024-09-14T11:56:27.558262+0000","last_fullsized":"2024-09-14T11:56:27.558262+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.558151+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:00.824858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":64658,"num_write":1071,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.763098+0000","last_change":"2024-09-14T11:56:45.763098+0000","last_active":"2024-09-14T11:56:45.763098+0000","last_peered":"2024-09-14T11:56:45.763098+0000","last_clean":"2024-09-14T11:56:45.763098+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:56:45.763098+0000","last_undegraded":"2024-09-14T11:56:45.763098+0000","last_fullsized":"2024-09-14T11:56:45.763098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.763005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:53.301799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'330","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.685731+0000","last_change":"2024-09-14T11:56:44.685731+0000","last_active":"2024-09-14T11:56:44.685731+0000","last_peered":"2024-09-14T11:56:44.685731+0000","last_clean":"2024-09-14T11:56:44.685731+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:44.685731+0000","last_undegraded":"2024-09-14T11:56:44.685731+0000","last_fullsized":"2024-09-14T11:56:44.685731+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.685661+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:21.057194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.423979+0000","last_change":"2024-09-14T11:56:53.423979+0000","last_active":"2024-09-14T11:56:53.423979+0000","last_peered":"2024-09-14T11:56:53.423979+0000","last_clean":"2024-09-14T11:56:53.423979+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:56:53.423979+0000","last_undegraded":"2024-09-14T11:56:53.423979+0000","last_fullsized":"2024-09-14T11:56:53.423979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.423888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:07.799827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2528","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.687669+0000","last_change":"2024-09-14T11:56:59.687669+0000","last_active":"2024-09-14T11:56:59.687669+0000","last_peered":"2024-09-14T11:56:59.687669+0000","last_clean":"2024-09-14T11:56:59.687669+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:56:59.687669+0000","last_undegraded":"2024-09-14T11:56:59.687669+0000","last_fullsized":"2024-09-14T11:56:59.687669+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.687562+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:31.039855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.790192+0000","last_change":"2024-09-14T11:56:36.790192+0000","last_active":"2024-09-14T11:56:36.790192+0000","last_peered":"2024-09-14T11:56:36.790192+0000","last_clean":"2024-09-14T11:56:36.790192+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:56:36.790192+0000","last_undegraded":"2024-09-14T11:56:36.790192+0000","last_fullsized":"2024-09-14T11:56:36.790192+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.790080+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:27.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'386","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.505419+0000","last_change":"2024-09-14T11:56:20.505419+0000","last_active":"2024-09-14T11:56:20.505419+0000","last_peered":"2024-09-14T11:56:20.505419+0000","last_clean":"2024-09-14T11:56:20.505419+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:20.505419+0000","last_undegraded":"2024-09-14T11:56:20.505419+0000","last_fullsized":"2024-09-14T11:56:20.505419+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.505297+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:34.623393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":676,"num_read_kb":35601,"num_write":1215,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"263'4","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.329564+0000","last_change":"2024-09-14T11:56:44.329564+0000","last_active":"2024-09-14T11:56:44.329564+0000","last_peered":"2024-09-14T11:56:44.329564+0000","last_clean":"2024-09-14T11:56:44.329564+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:44.329564+0000","last_undegraded":"2024-09-14T11:56:44.329564+0000","last_fullsized":"2024-09-14T11:56:44.329564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.329492+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:26.816036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'88","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.797123+0000","last_change":"2024-09-14T11:56:47.797123+0000","last_active":"2024-09-14T11:56:47.797123+0000","last_peered":"2024-09-14T11:56:47.797123+0000","last_clean":"2024-09-14T11:56:47.797123+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:56:47.797123+0000","last_undegraded":"2024-09-14T11:56:47.797123+0000","last_fullsized":"2024-09-14T11:56:47.797123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'88","last_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_deep_scrub":"263'88","last_deep_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.797040+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:35.771450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.785169+0000","last_change":"2024-09-14T11:56:53.785169+0000","last_active":"2024-09-14T11:56:53.785169+0000","last_peered":"2024-09-14T11:56:53.785169+0000","last_clean":"2024-09-14T11:56:53.785169+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:56:53.785169+0000","last_undegraded":"2024-09-14T11:56:53.785169+0000","last_fullsized":"2024-09-14T11:56:53.785169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.785079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.176820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'107","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.740750+0000","last_change":"2024-09-14T11:56:57.740750+0000","last_active":"2024-09-14T11:56:57.740750+0000","last_peered":"2024-09-14T11:56:57.740750+0000","last_clean":"2024-09-14T11:56:57.740750+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:56:57.740750+0000","last_undegraded":"2024-09-14T11:56:57.740750+0000","last_fullsized":"2024-09-14T11:56:57.740750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.740665+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:59.815552+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'431","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.546641+0000","last_change":"2024-09-14T11:56:34.546641+0000","last_active":"2024-09-14T11:56:34.546641+0000","last_peered":"2024-09-14T11:56:34.546641+0000","last_clean":"2024-09-14T11:56:34.546641+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:56:34.546641+0000","last_undegraded":"2024-09-14T11:56:34.546641+0000","last_fullsized":"2024-09-14T11:56:34.546641+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.546557+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:09.879015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'407","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.512674+0000","last_change":"2024-09-14T11:56:25.512674+0000","last_active":"2024-09-14T11:56:25.512674+0000","last_peered":"2024-09-14T11:56:25.512674+0000","last_clean":"2024-09-14T11:56:25.512674+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:25.512674+0000","last_undegraded":"2024-09-14T11:56:25.512674+0000","last_fullsized":"2024-09-14T11:56:25.512674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.512545+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:59.346574+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":815,"num_read_kb":18319,"num_write":1414,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.196211+0000","last_change":"2024-09-14T11:56:39.196211+0000","last_active":"2024-09-14T11:56:39.196211+0000","last_peered":"2024-09-14T11:56:39.196211+0000","last_clean":"2024-09-14T11:56:39.196211+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:56:39.196211+0000","last_undegraded":"2024-09-14T11:56:39.196211+0000","last_fullsized":"2024-09-14T11:56:39.196211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.196121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'103","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.869581+0000","last_change":"2024-09-14T11:56:41.869581+0000","last_active":"2024-09-14T11:56:41.869581+0000","last_peered":"2024-09-14T11:56:41.869581+0000","last_clean":"2024-09-14T11:56:41.869581+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:56:41.869581+0000","last_undegraded":"2024-09-14T11:56:41.869581+0000","last_fullsized":"2024-09-14T11:56:41.869581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.869495+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:42.141907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'774","reported_seq":4573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.444378+0000","last_change":"2024-09-14T11:56:52.444378+0000","last_active":"2024-09-14T11:56:52.444378+0000","last_peered":"2024-09-14T11:56:52.444378+0000","last_clean":"2024-09-14T11:56:52.444378+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:52.444378+0000","last_undegraded":"2024-09-14T11:56:52.444378+0000","last_fullsized":"2024-09-14T11:56:52.444378+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.444278+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:28.372005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'216","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.934993+0000","last_change":"2024-09-14T11:56:57.934993+0000","last_active":"2024-09-14T11:56:57.934993+0000","last_peered":"2024-09-14T11:56:57.934993+0000","last_clean":"2024-09-14T11:56:57.934993+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:56:57.934993+0000","last_undegraded":"2024-09-14T11:56:57.934993+0000","last_fullsized":"2024-09-14T11:56:57.934993+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.934887+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:55.562512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'527","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.833061+0000","last_change":"2024-09-14T11:56:26.833061+0000","last_active":"2024-09-14T11:56:26.833061+0000","last_peered":"2024-09-14T11:56:26.833061+0000","last_clean":"2024-09-14T11:56:26.833061+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:56:26.833061+0000","last_undegraded":"2024-09-14T11:56:26.833061+0000","last_fullsized":"2024-09-14T11:56:26.833061+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.832975+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:55.872822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.106600+0000","last_change":"2024-09-14T11:56:24.106600+0000","last_active":"2024-09-14T11:56:24.106600+0000","last_peered":"2024-09-14T11:56:24.106600+0000","last_clean":"2024-09-14T11:56:24.106600+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:24.106600+0000","last_undegraded":"2024-09-14T11:56:24.106600+0000","last_fullsized":"2024-09-14T11:56:24.106600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.106406+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:03.759033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.784450+0000","last_change":"2024-09-14T11:56:46.784450+0000","last_active":"2024-09-14T11:56:46.784450+0000","last_peered":"2024-09-14T11:56:46.784450+0000","last_clean":"2024-09-14T11:56:46.784450+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:56:46.784450+0000","last_undegraded":"2024-09-14T11:56:46.784450+0000","last_fullsized":"2024-09-14T11:56:46.784450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.784356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:25.395721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'255","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.516156+0000","last_change":"2024-09-14T11:56:48.516156+0000","last_active":"2024-09-14T11:56:48.516156+0000","last_peered":"2024-09-14T11:56:48.516156+0000","last_clean":"2024-09-14T11:56:48.516156+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:48.516156+0000","last_undegraded":"2024-09-14T11:56:48.516156+0000","last_fullsized":"2024-09-14T11:56:48.516156+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.516064+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:05.662866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'791","reported_seq":2561,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.153975+0000","last_change":"2024-09-14T11:56:55.153975+0000","last_active":"2024-09-14T11:56:55.153975+0000","last_peered":"2024-09-14T11:56:55.153975+0000","last_clean":"2024-09-14T11:56:55.153975+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:55.153975+0000","last_undegraded":"2024-09-14T11:56:55.153975+0000","last_fullsized":"2024-09-14T11:56:55.153975+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.153895+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:46.428579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1229","reported_seq":2892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.771034+0000","last_change":"2024-09-14T11:56:35.771034+0000","last_active":"2024-09-14T11:56:35.771034+0000","last_peered":"2024-09-14T11:56:35.771034+0000","last_clean":"2024-09-14T11:56:35.771034+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:56:35.771034+0000","last_undegraded":"2024-09-14T11:56:35.771034+0000","last_fullsized":"2024-09-14T11:56:35.771034+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1229","last_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_deep_scrub":"263'1229","last_deep_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.770916+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":1200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:33.485010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'358","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.557591+0000","last_change":"2024-09-14T11:56:28.557531+0000","last_active":"2024-09-14T11:56:28.557591+0000","last_peered":"2024-09-14T11:56:28.557591+0000","last_clean":"2024-09-14T11:56:28.557591+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:28.557591+0000","last_undegraded":"2024-09-14T11:56:28.557591+0000","last_fullsized":"2024-09-14T11:56:28.557591+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.557427+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:28.224602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":41733,"num_write":1105,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.542271+0000","last_change":"2024-09-14T11:56:41.542271+0000","last_active":"2024-09-14T11:56:41.542271+0000","last_peered":"2024-09-14T11:56:41.542271+0000","last_clean":"2024-09-14T11:56:41.542271+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:56:41.542271+0000","last_undegraded":"2024-09-14T11:56:41.542271+0000","last_fullsized":"2024-09-14T11:56:41.542271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.542187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:06.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'364","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.693108+0000","last_change":"2024-09-14T11:56:49.693108+0000","last_active":"2024-09-14T11:56:49.693108+0000","last_peered":"2024-09-14T11:56:49.693108+0000","last_clean":"2024-09-14T11:56:49.693108+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:49.693108+0000","last_undegraded":"2024-09-14T11:56:49.693108+0000","last_fullsized":"2024-09-14T11:56:49.693108+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.693011+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.084690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.855114+0000","last_change":"2024-09-14T11:56:44.855045+0000","last_active":"2024-09-14T11:56:44.855114+0000","last_peered":"2024-09-14T11:56:44.855114+0000","last_clean":"2024-09-14T11:56:44.855114+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:56:44.855114+0000","last_undegraded":"2024-09-14T11:56:44.855114+0000","last_fullsized":"2024-09-14T11:56:44.855114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.854939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:34.855798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.815835+0000","last_change":"2024-09-14T11:56:54.815835+0000","last_active":"2024-09-14T11:56:54.815835+0000","last_peered":"2024-09-14T11:56:54.815835+0000","last_clean":"2024-09-14T11:56:54.815835+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:56:54.815835+0000","last_undegraded":"2024-09-14T11:56:54.815835+0000","last_fullsized":"2024-09-14T11:56:54.815835+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.815746+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:58.396730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'806","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.715525+0000","last_change":"2024-09-14T11:56:27.715525+0000","last_active":"2024-09-14T11:56:27.715525+0000","last_peered":"2024-09-14T11:56:27.715525+0000","last_clean":"2024-09-14T11:56:27.715525+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:56:27.715525+0000","last_undegraded":"2024-09-14T11:56:27.715525+0000","last_fullsized":"2024-09-14T11:56:27.715525+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.715433+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:50.726219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'313","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.855003+0000","last_change":"2024-09-14T11:56:32.855003+0000","last_active":"2024-09-14T11:56:32.855003+0000","last_peered":"2024-09-14T11:56:32.855003+0000","last_clean":"2024-09-14T11:56:32.855003+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:32.855003+0000","last_undegraded":"2024-09-14T11:56:32.855003+0000","last_fullsized":"2024-09-14T11:56:32.855003+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.854894+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:57.072216+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":67475,"num_write":1031,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.846368+0000","last_change":"2024-09-14T11:56:34.846368+0000","last_active":"2024-09-14T11:56:34.846368+0000","last_peered":"2024-09-14T11:56:34.846368+0000","last_clean":"2024-09-14T11:56:34.846368+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:56:34.846368+0000","last_undegraded":"2024-09-14T11:56:34.846368+0000","last_fullsized":"2024-09-14T11:56:34.846368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.846285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:47.433018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'297","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.306830+0000","last_change":"2024-09-14T11:56:46.306762+0000","last_active":"2024-09-14T11:56:46.306830+0000","last_peered":"2024-09-14T11:56:46.306830+0000","last_clean":"2024-09-14T11:56:46.306830+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:56:46.306830+0000","last_undegraded":"2024-09-14T11:56:46.306830+0000","last_fullsized":"2024-09-14T11:56:46.306830+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.306669+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:27.229964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49558,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1126,"num_write":402,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.232554+0000","last_change":"2024-09-14T11:56:53.232554+0000","last_active":"2024-09-14T11:56:53.232554+0000","last_peered":"2024-09-14T11:56:53.232554+0000","last_clean":"2024-09-14T11:56:53.232554+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:56:53.232554+0000","last_undegraded":"2024-09-14T11:56:53.232554+0000","last_fullsized":"2024-09-14T11:56:53.232554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.232457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:43.213959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'121","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.235418+0000","last_change":"2024-09-14T11:56:44.235418+0000","last_active":"2024-09-14T11:56:44.235418+0000","last_peered":"2024-09-14T11:56:44.235418+0000","last_clean":"2024-09-14T11:56:44.235418+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:56:44.235418+0000","last_undegraded":"2024-09-14T11:56:44.235418+0000","last_fullsized":"2024-09-14T11:56:44.235418+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.235335+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:59.340370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1042","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.270323+0000","last_change":"2024-09-14T11:56:30.270323+0000","last_active":"2024-09-14T11:56:30.270323+0000","last_peered":"2024-09-14T11:56:30.270323+0000","last_clean":"2024-09-14T11:56:30.270323+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:56:30.270323+0000","last_undegraded":"2024-09-14T11:56:30.270323+0000","last_fullsized":"2024-09-14T11:56:30.270323+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1042","last_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_deep_scrub":"263'1042","last_deep_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.270230+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.888140+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'294","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.494855+0000","last_change":"2024-09-14T11:56:24.494772+0000","last_active":"2024-09-14T11:56:24.494855+0000","last_peered":"2024-09-14T11:56:24.494855+0000","last_clean":"2024-09-14T11:56:24.494855+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:24.494855+0000","last_undegraded":"2024-09-14T11:56:24.494855+0000","last_fullsized":"2024-09-14T11:56:24.494855+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.494631+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:43.745446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":31073,"num_write":909,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.899812+0000","last_change":"2024-09-14T11:56:36.899748+0000","last_active":"2024-09-14T11:56:36.899812+0000","last_peered":"2024-09-14T11:56:36.899812+0000","last_clean":"2024-09-14T11:56:36.899812+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:56:36.899812+0000","last_undegraded":"2024-09-14T11:56:36.899812+0000","last_fullsized":"2024-09-14T11:56:36.899812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.899653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:58.910589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'308","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.515860+0000","last_change":"2024-09-14T11:56:46.515860+0000","last_active":"2024-09-14T11:56:46.515860+0000","last_peered":"2024-09-14T11:56:46.515860+0000","last_clean":"2024-09-14T11:56:46.515860+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:46.515860+0000","last_undegraded":"2024-09-14T11:56:46.515860+0000","last_fullsized":"2024-09-14T11:56:46.515860+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.515757+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:57.140151+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":4054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.701312+0000","last_change":"2024-09-14T11:56:50.701312+0000","last_active":"2024-09-14T11:56:50.701312+0000","last_peered":"2024-09-14T11:56:50.701312+0000","last_clean":"2024-09-14T11:56:50.701312+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:50.701312+0000","last_undegraded":"2024-09-14T11:56:50.701312+0000","last_fullsized":"2024-09-14T11:56:50.701312+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.701208+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:36.693878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'135","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.773527+0000","last_change":"2024-09-14T11:56:56.773527+0000","last_active":"2024-09-14T11:56:56.773527+0000","last_peered":"2024-09-14T11:56:56.773527+0000","last_clean":"2024-09-14T11:56:56.773527+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:56:56.773527+0000","last_undegraded":"2024-09-14T11:56:56.773527+0000","last_fullsized":"2024-09-14T11:56:56.773527+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.773428+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.358395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'415","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.549305+0000","last_change":"2024-09-14T11:56:31.549234+0000","last_active":"2024-09-14T11:56:31.549305+0000","last_peered":"2024-09-14T11:56:31.549305+0000","last_clean":"2024-09-14T11:56:31.549305+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:56:31.549305+0000","last_undegraded":"2024-09-14T11:56:31.549305+0000","last_fullsized":"2024-09-14T11:56:31.549305+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.549129+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:03.979018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.841395+0000","last_change":"2024-09-14T11:56:26.841315+0000","last_active":"2024-09-14T11:56:26.841395+0000","last_peered":"2024-09-14T11:56:26.841395+0000","last_clean":"2024-09-14T11:56:26.841395+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:26.841395+0000","last_undegraded":"2024-09-14T11:56:26.841395+0000","last_fullsized":"2024-09-14T11:56:26.841395+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.841218+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:23.553496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.881630+0000","last_change":"2024-09-14T11:56:37.881630+0000","last_active":"2024-09-14T11:56:37.881630+0000","last_peered":"2024-09-14T11:56:37.881630+0000","last_clean":"2024-09-14T11:56:37.881630+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:56:37.881630+0000","last_undegraded":"2024-09-14T11:56:37.881630+0000","last_fullsized":"2024-09-14T11:56:37.881630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.881540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:26.348899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'498","reported_seq":1131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.642102+0000","last_change":"2024-09-14T11:56:43.642102+0000","last_active":"2024-09-14T11:56:43.642102+0000","last_peered":"2024-09-14T11:56:43.642102+0000","last_clean":"2024-09-14T11:56:43.642102+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:43.642102+0000","last_undegraded":"2024-09-14T11:56:43.642102+0000","last_fullsized":"2024-09-14T11:56:43.642102+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.642011+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:58.210871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99468,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":885,"num_read_kb":2186,"num_write":738,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.903741+0000","last_change":"2024-09-14T11:56:42.903741+0000","last_active":"2024-09-14T11:56:42.903741+0000","last_peered":"2024-09-14T11:56:42.903741+0000","last_clean":"2024-09-14T11:56:42.903741+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:56:42.903741+0000","last_undegraded":"2024-09-14T11:56:42.903741+0000","last_fullsized":"2024-09-14T11:56:42.903741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.903661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:24.433918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'146","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.916887+0000","last_change":"2024-09-14T11:56:47.916887+0000","last_active":"2024-09-14T11:56:47.916887+0000","last_peered":"2024-09-14T11:56:47.916887+0000","last_clean":"2024-09-14T11:56:47.916887+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:56:47.916887+0000","last_undegraded":"2024-09-14T11:56:47.916887+0000","last_fullsized":"2024-09-14T11:56:47.916887+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.916794+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:10.778249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'847","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.698801+0000","last_change":"2024-09-14T11:56:28.698744+0000","last_active":"2024-09-14T11:56:28.698801+0000","last_peered":"2024-09-14T11:56:28.698801+0000","last_clean":"2024-09-14T11:56:28.698801+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:56:28.698801+0000","last_undegraded":"2024-09-14T11:56:28.698801+0000","last_fullsized":"2024-09-14T11:56:28.698801+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'847","last_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_deep_scrub":"263'847","last_deep_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.698654+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":800,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:40.307674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'386","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.114558+0000","last_change":"2024-09-14T11:56:22.114483+0000","last_active":"2024-09-14T11:56:22.114558+0000","last_peered":"2024-09-14T11:56:22.114558+0000","last_clean":"2024-09-14T11:56:22.114558+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:22.114558+0000","last_undegraded":"2024-09-14T11:56:22.114558+0000","last_fullsized":"2024-09-14T11:56:22.114558+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.114372+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:40.637875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":715,"num_read_kb":16906,"num_write":1227,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.899269+0000","last_change":"2024-09-14T11:56:40.899217+0000","last_active":"2024-09-14T11:56:40.899269+0000","last_peered":"2024-09-14T11:56:40.899269+0000","last_clean":"2024-09-14T11:56:40.899269+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:56:40.899269+0000","last_undegraded":"2024-09-14T11:56:40.899269+0000","last_fullsized":"2024-09-14T11:56:40.899269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.899134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.733282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'304","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.804866+0000","last_change":"2024-09-14T11:56:48.804807+0000","last_active":"2024-09-14T11:56:48.804866+0000","last_peered":"2024-09-14T11:56:48.804866+0000","last_clean":"2024-09-14T11:56:48.804866+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:48.804866+0000","last_undegraded":"2024-09-14T11:56:48.804866+0000","last_fullsized":"2024-09-14T11:56:48.804866+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.804714+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:17.990480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.721287+0000","last_change":"2024-09-14T11:56:49.721287+0000","last_active":"2024-09-14T11:56:49.721287+0000","last_peered":"2024-09-14T11:56:49.721287+0000","last_clean":"2024-09-14T11:56:49.721287+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:56:49.721287+0000","last_undegraded":"2024-09-14T11:56:49.721287+0000","last_fullsized":"2024-09-14T11:56:49.721287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.721199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:44.981198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'121","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.188503+0000","last_change":"2024-09-14T11:56:58.188503+0000","last_active":"2024-09-14T11:56:58.188503+0000","last_peered":"2024-09-14T11:56:58.188503+0000","last_clean":"2024-09-14T11:56:58.188503+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:56:58.188503+0000","last_undegraded":"2024-09-14T11:56:58.188503+0000","last_fullsized":"2024-09-14T11:56:58.188503+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.188428+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.813037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1644","reported_seq":3317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.715896+0000","last_change":"2024-09-14T11:56:29.715837+0000","last_active":"2024-09-14T11:56:29.715896+0000","last_peered":"2024-09-14T11:56:29.715896+0000","last_clean":"2024-09-14T11:56:29.715896+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:56:29.715896+0000","last_undegraded":"2024-09-14T11:56:29.715896+0000","last_fullsized":"2024-09-14T11:56:29.715896+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1644","last_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_deep_scrub":"263'1644","last_deep_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.715743+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:27.695414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.233890+0000","last_change":"2024-09-14T11:56:27.233890+0000","last_active":"2024-09-14T11:56:27.233890+0000","last_peered":"2024-09-14T11:56:27.233890+0000","last_clean":"2024-09-14T11:56:27.233890+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:27.233890+0000","last_undegraded":"2024-09-14T11:56:27.233890+0000","last_fullsized":"2024-09-14T11:56:27.233890+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.233781+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.725234+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.740043+0000","last_change":"2024-09-14T11:56:37.739989+0000","last_active":"2024-09-14T11:56:37.740043+0000","last_peered":"2024-09-14T11:56:37.740043+0000","last_clean":"2024-09-14T11:56:37.740043+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:56:37.740043+0000","last_undegraded":"2024-09-14T11:56:37.740043+0000","last_fullsized":"2024-09-14T11:56:37.740043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.739899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:13.301117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'300","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.857685+0000","last_change":"2024-09-14T11:56:39.857685+0000","last_active":"2024-09-14T11:56:39.857685+0000","last_peered":"2024-09-14T11:56:39.857685+0000","last_clean":"2024-09-14T11:56:39.857685+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:56:39.857685+0000","last_undegraded":"2024-09-14T11:56:39.857685+0000","last_fullsized":"2024-09-14T11:56:39.857685+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.857592+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:20.652302+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69648,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1150,"num_write":402,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'761","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.903028+0000","last_change":"2024-09-14T11:56:43.902970+0000","last_active":"2024-09-14T11:56:43.903028+0000","last_peered":"2024-09-14T11:56:43.903028+0000","last_clean":"2024-09-14T11:56:43.903028+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:43.903028+0000","last_undegraded":"2024-09-14T11:56:43.903028+0000","last_fullsized":"2024-09-14T11:56:43.903028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.902864+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:03.704298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'149","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.887413+0000","last_change":"2024-09-14T11:56:45.887413+0000","last_active":"2024-09-14T11:56:45.887413+0000","last_peered":"2024-09-14T11:56:45.887413+0000","last_clean":"2024-09-14T11:56:45.887413+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:56:45.887413+0000","last_undegraded":"2024-09-14T11:56:45.887413+0000","last_fullsized":"2024-09-14T11:56:45.887413+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.887303+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:14.811741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.721963+0000","last_change":"2024-09-14T11:56:30.721902+0000","last_active":"2024-09-14T11:56:30.721963+0000","last_peered":"2024-09-14T11:56:30.721963+0000","last_clean":"2024-09-14T11:56:30.721963+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:56:30.721963+0000","last_undegraded":"2024-09-14T11:56:30.721963+0000","last_fullsized":"2024-09-14T11:56:30.721963+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.721816+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:19.890041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.691511+0000","last_change":"2024-09-14T11:56:24.691511+0000","last_active":"2024-09-14T11:56:24.691511+0000","last_peered":"2024-09-14T11:56:24.691511+0000","last_clean":"2024-09-14T11:56:24.691511+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:24.691511+0000","last_undegraded":"2024-09-14T11:56:24.691511+0000","last_fullsized":"2024-09-14T11:56:24.691511+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.691405+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:19.223818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.724992+0000","last_change":"2024-09-14T11:56:44.724907+0000","last_active":"2024-09-14T11:56:44.724992+0000","last_peered":"2024-09-14T11:56:44.724992+0000","last_clean":"2024-09-14T11:56:44.724992+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:44.724992+0000","last_undegraded":"2024-09-14T11:56:44.724992+0000","last_fullsized":"2024-09-14T11:56:44.724992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.724814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:32.377727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.309336+0000","last_change":"2024-09-14T11:56:45.309271+0000","last_active":"2024-09-14T11:56:45.309336+0000","last_peered":"2024-09-14T11:56:45.309336+0000","last_clean":"2024-09-14T11:56:45.309336+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:56:45.309336+0000","last_undegraded":"2024-09-14T11:56:45.309336+0000","last_fullsized":"2024-09-14T11:56:45.309336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'84","last_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_deep_scrub":"263'84","last_deep_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.309168+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:20.217748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.230892+0000","last_change":"2024-09-14T11:56:40.230789+0000","last_active":"2024-09-14T11:56:40.230892+0000","last_peered":"2024-09-14T11:56:40.230892+0000","last_clean":"2024-09-14T11:56:40.230892+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:40.230892+0000","last_undegraded":"2024-09-14T11:56:40.230892+0000","last_fullsized":"2024-09-14T11:56:40.230892+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.230641+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:25.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.829596+0000","last_change":"2024-09-14T11:56:54.829596+0000","last_active":"2024-09-14T11:56:54.829596+0000","last_peered":"2024-09-14T11:56:54.829596+0000","last_clean":"2024-09-14T11:56:54.829596+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:56:54.829596+0000","last_undegraded":"2024-09-14T11:56:54.829596+0000","last_fullsized":"2024-09-14T11:56:54.829596+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.829506+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.125183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'513","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.782342+0000","last_change":"2024-09-14T11:56:31.782245+0000","last_active":"2024-09-14T11:56:31.782342+0000","last_peered":"2024-09-14T11:56:31.782342+0000","last_clean":"2024-09-14T11:56:31.782342+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:56:31.782342+0000","last_undegraded":"2024-09-14T11:56:31.782342+0000","last_fullsized":"2024-09-14T11:56:31.782342+0000","mapping_epoch":27,"log_start":"263'501","ondisk_log_start":"263'501","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.782127+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:24.425090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.073606+0000","last_change":"2024-09-14T11:56:23.073606+0000","last_active":"2024-09-14T11:56:23.073606+0000","last_peered":"2024-09-14T11:56:23.073606+0000","last_clean":"2024-09-14T11:56:23.073606+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:23.073606+0000","last_undegraded":"2024-09-14T11:56:23.073606+0000","last_fullsized":"2024-09-14T11:56:23.073606+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.073522+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.269212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":524,"num_write":1137,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.769196+0000","last_change":"2024-09-14T11:56:41.769107+0000","last_active":"2024-09-14T11:56:41.769196+0000","last_peered":"2024-09-14T11:56:41.769196+0000","last_clean":"2024-09-14T11:56:41.769196+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:56:41.769196+0000","last_undegraded":"2024-09-14T11:56:41.769196+0000","last_fullsized":"2024-09-14T11:56:41.769196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.769011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:59.511302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'367","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.736493+0000","last_change":"2024-09-14T11:56:50.736433+0000","last_active":"2024-09-14T11:56:50.736493+0000","last_peered":"2024-09-14T11:56:50.736493+0000","last_clean":"2024-09-14T11:56:50.736493+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:50.736493+0000","last_undegraded":"2024-09-14T11:56:50.736493+0000","last_fullsized":"2024-09-14T11:56:50.736493+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.736341+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.594821+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.232608+0000","last_change":"2024-09-14T11:56:39.232538+0000","last_active":"2024-09-14T11:56:39.232608+0000","last_peered":"2024-09-14T11:56:39.232608+0000","last_clean":"2024-09-14T11:56:39.232608+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:56:39.232608+0000","last_undegraded":"2024-09-14T11:56:39.232608+0000","last_fullsized":"2024-09-14T11:56:39.232608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.232412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:21.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'187","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.935345+0000","last_change":"2024-09-14T11:56:48.935345+0000","last_active":"2024-09-14T11:56:48.935345+0000","last_peered":"2024-09-14T11:56:48.935345+0000","last_clean":"2024-09-14T11:56:48.935345+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:56:48.935345+0000","last_undegraded":"2024-09-14T11:56:48.935345+0000","last_fullsized":"2024-09-14T11:56:48.935345+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.935254+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:03.798486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'466","reported_seq":1965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.229172+0000","last_change":"2024-09-14T11:56:31.229172+0000","last_active":"2024-09-14T11:56:31.229172+0000","last_peered":"2024-09-14T11:56:31.229172+0000","last_clean":"2024-09-14T11:56:31.229172+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:56:31.229172+0000","last_undegraded":"2024-09-14T11:56:31.229172+0000","last_fullsized":"2024-09-14T11:56:31.229172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.229089+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:26.332777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.479532+0000","last_change":"2024-09-14T11:56:23.479532+0000","last_active":"2024-09-14T11:56:23.479532+0000","last_peered":"2024-09-14T11:56:23.479532+0000","last_clean":"2024-09-14T11:56:23.479532+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:56:23.479532+0000","last_undegraded":"2024-09-14T11:56:23.479532+0000","last_fullsized":"2024-09-14T11:56:23.479532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.479446+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.972281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.780627+0000","last_change":"2024-09-14T11:56:23.780627+0000","last_active":"2024-09-14T11:56:23.780627+0000","last_peered":"2024-09-14T11:56:23.780627+0000","last_clean":"2024-09-14T11:56:23.780627+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:56:23.780627+0000","last_undegraded":"2024-09-14T11:56:23.780627+0000","last_fullsized":"2024-09-14T11:56:23.780627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.780539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:19.285862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.893049+0000","last_change":"2024-09-14T11:56:23.893049+0000","last_active":"2024-09-14T11:56:23.893049+0000","last_peered":"2024-09-14T11:56:23.893049+0000","last_clean":"2024-09-14T11:56:23.893049+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:23.893049+0000","last_undegraded":"2024-09-14T11:56:23.893049+0000","last_fullsized":"2024-09-14T11:56:23.893049+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.892977+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:13.522054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":748,"num_read_kb":7472,"num_write":1023,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.580695+0000","last_change":"2024-09-14T11:56:40.580695+0000","last_active":"2024-09-14T11:56:40.580695+0000","last_peered":"2024-09-14T11:56:40.580695+0000","last_clean":"2024-09-14T11:56:40.580695+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:56:40.580695+0000","last_undegraded":"2024-09-14T11:56:40.580695+0000","last_fullsized":"2024-09-14T11:56:40.580695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.580600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:27.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'753","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.718557+0000","last_change":"2024-09-14T11:56:48.718557+0000","last_active":"2024-09-14T11:56:48.718557+0000","last_peered":"2024-09-14T11:56:48.718557+0000","last_clean":"2024-09-14T11:56:48.718557+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:48.718557+0000","last_undegraded":"2024-09-14T11:56:48.718557+0000","last_fullsized":"2024-09-14T11:56:48.718557+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'753","last_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_deep_scrub":"263'753","last_deep_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.718471+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:07.067523+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107204,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.733094+0000","last_change":"2024-09-14T11:56:48.733094+0000","last_active":"2024-09-14T11:56:48.733094+0000","last_peered":"2024-09-14T11:56:48.733094+0000","last_clean":"2024-09-14T11:56:48.733094+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:56:48.733094+0000","last_undegraded":"2024-09-14T11:56:48.733094+0000","last_fullsized":"2024-09-14T11:56:48.733094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.732990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:44.026156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.209235+0000","last_change":"2024-09-14T11:56:46.209235+0000","last_active":"2024-09-14T11:56:46.209235+0000","last_peered":"2024-09-14T11:56:46.209235+0000","last_clean":"2024-09-14T11:56:46.209235+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:56:46.209235+0000","last_undegraded":"2024-09-14T11:56:46.209235+0000","last_fullsized":"2024-09-14T11:56:46.209235+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.209118+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:05.425542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1366","reported_seq":3144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.521567+0000","last_change":"2024-09-14T11:56:30.521567+0000","last_active":"2024-09-14T11:56:30.521567+0000","last_peered":"2024-09-14T11:56:30.521567+0000","last_clean":"2024-09-14T11:56:30.521567+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:56:30.521567+0000","last_undegraded":"2024-09-14T11:56:30.521567+0000","last_fullsized":"2024-09-14T11:56:30.521567+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1366","last_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_deep_scrub":"263'1366","last_deep_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.521471+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:00.605893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.538138+0000","last_change":"2024-09-14T11:56:26.538138+0000","last_active":"2024-09-14T11:56:26.538138+0000","last_peered":"2024-09-14T11:56:26.538138+0000","last_clean":"2024-09-14T11:56:26.538138+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:56:26.538138+0000","last_undegraded":"2024-09-14T11:56:26.538138+0000","last_fullsized":"2024-09-14T11:56:26.538138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.538048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:14.343027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'362","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.498768+0000","last_change":"2024-09-14T11:56:23.498768+0000","last_active":"2024-09-14T11:56:23.498768+0000","last_peered":"2024-09-14T11:56:23.498768+0000","last_clean":"2024-09-14T11:56:23.498768+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:23.498768+0000","last_undegraded":"2024-09-14T11:56:23.498768+0000","last_fullsized":"2024-09-14T11:56:23.498768+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.498682+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:31.939526+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029253,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":615,"num_read_kb":6150,"num_write":1149,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.727701+0000","last_change":"2024-09-14T11:56:42.727701+0000","last_active":"2024-09-14T11:56:42.727701+0000","last_peered":"2024-09-14T11:56:42.727701+0000","last_clean":"2024-09-14T11:56:42.727701+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:56:42.727701+0000","last_undegraded":"2024-09-14T11:56:42.727701+0000","last_fullsized":"2024-09-14T11:56:42.727701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.727605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:20.497909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1264","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.846115+0000","last_change":"2024-09-14T11:56:41.846115+0000","last_active":"2024-09-14T11:56:41.846115+0000","last_peered":"2024-09-14T11:56:41.846115+0000","last_clean":"2024-09-14T11:56:41.846115+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:41.846115+0000","last_undegraded":"2024-09-14T11:56:41.846115+0000","last_fullsized":"2024-09-14T11:56:41.846115+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1264","last_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_deep_scrub":"263'1264","last_deep_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.846014+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:37.873739+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1958,"num_read_kb":3608,"num_write":1054,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.500818+0000","last_change":"2024-09-14T11:56:50.500818+0000","last_active":"2024-09-14T11:56:50.500818+0000","last_peered":"2024-09-14T11:56:50.500818+0000","last_clean":"2024-09-14T11:56:50.500818+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:56:50.500818+0000","last_undegraded":"2024-09-14T11:56:50.500818+0000","last_fullsized":"2024-09-14T11:56:50.500818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.500733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:53.365887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'134","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.959545+0000","last_change":"2024-09-14T11:56:49.959545+0000","last_active":"2024-09-14T11:56:49.959545+0000","last_peered":"2024-09-14T11:56:49.959545+0000","last_clean":"2024-09-14T11:56:49.959545+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:56:49.959545+0000","last_undegraded":"2024-09-14T11:56:49.959545+0000","last_fullsized":"2024-09-14T11:56:49.959545+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.959435+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.018062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'786","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.813513+0000","last_change":"2024-09-14T11:56:30.813513+0000","last_active":"2024-09-14T11:56:30.813513+0000","last_peered":"2024-09-14T11:56:30.813513+0000","last_clean":"2024-09-14T11:56:30.813513+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:56:30.813513+0000","last_undegraded":"2024-09-14T11:56:30.813513+0000","last_fullsized":"2024-09-14T11:56:30.813513+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'786","last_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_deep_scrub":"263'786","last_deep_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.813419+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:18.621682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.949954+0000","last_change":"2024-09-14T11:56:21.949954+0000","last_active":"2024-09-14T11:56:21.949954+0000","last_peered":"2024-09-14T11:56:21.949954+0000","last_clean":"2024-09-14T11:56:21.949954+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:56:21.949954+0000","last_undegraded":"2024-09-14T11:56:21.949954+0000","last_fullsized":"2024-09-14T11:56:21.949954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.949882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:24.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'342","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.834358+0000","last_change":"2024-09-14T11:56:22.834358+0000","last_active":"2024-09-14T11:56:22.834358+0000","last_peered":"2024-09-14T11:56:22.834358+0000","last_clean":"2024-09-14T11:56:22.834358+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:22.834358+0000","last_undegraded":"2024-09-14T11:56:22.834358+0000","last_fullsized":"2024-09-14T11:56:22.834358+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.834283+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":72010,"num_write":1138,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.862175+0000","last_change":"2024-09-14T11:56:35.862175+0000","last_active":"2024-09-14T11:56:35.862175+0000","last_peered":"2024-09-14T11:56:35.862175+0000","last_clean":"2024-09-14T11:56:35.862175+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:56:35.862175+0000","last_undegraded":"2024-09-14T11:56:35.862175+0000","last_fullsized":"2024-09-14T11:56:35.862175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.862069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:42.054433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'260","reported_seq":1302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.536007+0000","last_change":"2024-09-14T11:56:45.536007+0000","last_active":"2024-09-14T11:56:45.536007+0000","last_peered":"2024-09-14T11:56:45.536007+0000","last_clean":"2024-09-14T11:56:45.536007+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:56:45.536007+0000","last_undegraded":"2024-09-14T11:56:45.536007+0000","last_fullsized":"2024-09-14T11:56:45.536007+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.535905+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:52.905109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.695253+0000","last_change":"2024-09-14T11:56:47.695253+0000","last_active":"2024-09-14T11:56:47.695253+0000","last_peered":"2024-09-14T11:56:47.695253+0000","last_clean":"2024-09-14T11:56:47.695253+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:56:47.695253+0000","last_undegraded":"2024-09-14T11:56:47.695253+0000","last_fullsized":"2024-09-14T11:56:47.695253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.695169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:22.244367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'269","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.161409+0000","last_change":"2024-09-14T11:56:56.161351+0000","last_active":"2024-09-14T11:56:56.161409+0000","last_peered":"2024-09-14T11:56:56.161409+0000","last_clean":"2024-09-14T11:56:56.161409+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:56:56.161409+0000","last_undegraded":"2024-09-14T11:56:56.161409+0000","last_fullsized":"2024-09-14T11:56:56.161409+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.161261+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.468810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'432","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.782814+0000","last_change":"2024-09-14T11:56:29.782814+0000","last_active":"2024-09-14T11:56:29.782814+0000","last_peered":"2024-09-14T11:56:29.782814+0000","last_clean":"2024-09-14T11:56:29.782814+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:56:29.782814+0000","last_undegraded":"2024-09-14T11:56:29.782814+0000","last_fullsized":"2024-09-14T11:56:29.782814+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.782725+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:08.803503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.822497+0000","last_change":"2024-09-14T11:56:22.822497+0000","last_active":"2024-09-14T11:56:22.822497+0000","last_peered":"2024-09-14T11:56:22.822497+0000","last_clean":"2024-09-14T11:56:22.822497+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:56:22.822497+0000","last_undegraded":"2024-09-14T11:56:22.822497+0000","last_fullsized":"2024-09-14T11:56:22.822497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.822377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:42.113203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'323","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.913200+0000","last_change":"2024-09-14T11:56:22.913200+0000","last_active":"2024-09-14T11:56:22.913200+0000","last_peered":"2024-09-14T11:56:22.913200+0000","last_clean":"2024-09-14T11:56:22.913200+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:22.913200+0000","last_undegraded":"2024-09-14T11:56:22.913200+0000","last_fullsized":"2024-09-14T11:56:22.913200+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.913114+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:18.574527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1238,"num_read_kb":7389,"num_write":1100,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.683004+0000","last_change":"2024-09-14T11:56:40.683004+0000","last_active":"2024-09-14T11:56:40.683004+0000","last_peered":"2024-09-14T11:56:40.683004+0000","last_clean":"2024-09-14T11:56:40.683004+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:56:40.683004+0000","last_undegraded":"2024-09-14T11:56:40.683004+0000","last_fullsized":"2024-09-14T11:56:40.683004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.682920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:03.268737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'128","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.232307+0000","last_change":"2024-09-14T11:56:40.232307+0000","last_active":"2024-09-14T11:56:40.232307+0000","last_peered":"2024-09-14T11:56:40.232307+0000","last_clean":"2024-09-14T11:56:40.232307+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:56:40.232307+0000","last_undegraded":"2024-09-14T11:56:40.232307+0000","last_fullsized":"2024-09-14T11:56:40.232307+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.232198+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:52.939121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.237710+0000","last_change":"2024-09-14T11:56:38.237710+0000","last_active":"2024-09-14T11:56:38.237710+0000","last_peered":"2024-09-14T11:56:38.237710+0000","last_clean":"2024-09-14T11:56:38.237710+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:56:38.237710+0000","last_undegraded":"2024-09-14T11:56:38.237710+0000","last_fullsized":"2024-09-14T11:56:38.237710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.237609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.821273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.770817+0000","last_change":"2024-09-14T11:56:55.770817+0000","last_active":"2024-09-14T11:56:55.770817+0000","last_peered":"2024-09-14T11:56:55.770817+0000","last_clean":"2024-09-14T11:56:55.770817+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:56:55.770817+0000","last_undegraded":"2024-09-14T11:56:55.770817+0000","last_fullsized":"2024-09-14T11:56:55.770817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'83","last_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_deep_scrub":"263'83","last_deep_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.770737+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:18.262644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'460","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.810118+0000","last_change":"2024-09-14T11:56:28.810118+0000","last_active":"2024-09-14T11:56:28.810118+0000","last_peered":"2024-09-14T11:56:28.810118+0000","last_clean":"2024-09-14T11:56:28.810118+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:56:28.810118+0000","last_undegraded":"2024-09-14T11:56:28.810118+0000","last_fullsized":"2024-09-14T11:56:28.810118+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.810021+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.644059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.828138+0000","last_change":"2024-09-14T11:56:24.828138+0000","last_active":"2024-09-14T11:56:24.828138+0000","last_peered":"2024-09-14T11:56:24.828138+0000","last_clean":"2024-09-14T11:56:24.828138+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:24.828138+0000","last_undegraded":"2024-09-14T11:56:24.828138+0000","last_fullsized":"2024-09-14T11:56:24.828138+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.828029+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:30.652084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.916705+0000","last_change":"2024-09-14T11:56:20.916705+0000","last_active":"2024-09-14T11:56:20.916705+0000","last_peered":"2024-09-14T11:56:20.916705+0000","last_clean":"2024-09-14T11:56:20.916705+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:56:20.916705+0000","last_undegraded":"2024-09-14T11:56:20.916705+0000","last_fullsized":"2024-09-14T11:56:20.916705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.916627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:12.576482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.649519+0000","last_change":"2024-09-14T11:56:39.649519+0000","last_active":"2024-09-14T11:56:39.649519+0000","last_peered":"2024-09-14T11:56:39.649519+0000","last_clean":"2024-09-14T11:56:39.649519+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:56:39.649519+0000","last_undegraded":"2024-09-14T11:56:39.649519+0000","last_fullsized":"2024-09-14T11:56:39.649519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.649433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:03.443069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'547","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.668212+0000","last_change":"2024-09-14T11:56:42.668212+0000","last_active":"2024-09-14T11:56:42.668212+0000","last_peered":"2024-09-14T11:56:42.668212+0000","last_clean":"2024-09-14T11:56:42.668212+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:42.668212+0000","last_undegraded":"2024-09-14T11:56:42.668212+0000","last_fullsized":"2024-09-14T11:56:42.668212+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.668098+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:32.877719+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":943,"num_read_kb":2151,"num_write":772,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.731164+0000","last_change":"2024-09-14T11:56:50.731164+0000","last_active":"2024-09-14T11:56:50.731164+0000","last_peered":"2024-09-14T11:56:50.731164+0000","last_clean":"2024-09-14T11:56:50.731164+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:56:50.731164+0000","last_undegraded":"2024-09-14T11:56:50.731164+0000","last_fullsized":"2024-09-14T11:56:50.731164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.731065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:11.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'166","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.811282+0000","last_change":"2024-09-14T11:56:55.811222+0000","last_active":"2024-09-14T11:56:55.811282+0000","last_peered":"2024-09-14T11:56:55.811282+0000","last_clean":"2024-09-14T11:56:55.811282+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:56:55.811282+0000","last_undegraded":"2024-09-14T11:56:55.811282+0000","last_fullsized":"2024-09-14T11:56:55.811282+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.811129+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.315887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'755","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562539+0000","last_change":"2024-09-14T11:56:32.562539+0000","last_active":"2024-09-14T11:56:32.562539+0000","last_peered":"2024-09-14T11:56:32.562539+0000","last_clean":"2024-09-14T11:56:32.562539+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:56:32.562539+0000","last_undegraded":"2024-09-14T11:56:32.562539+0000","last_fullsized":"2024-09-14T11:56:32.562539+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.562454+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:52.777172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'346","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.813989+0000","last_change":"2024-09-14T11:56:26.813989+0000","last_active":"2024-09-14T11:56:26.813989+0000","last_peered":"2024-09-14T11:56:26.813989+0000","last_clean":"2024-09-14T11:56:26.813989+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:26.813989+0000","last_undegraded":"2024-09-14T11:56:26.813989+0000","last_fullsized":"2024-09-14T11:56:26.813989+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.813888+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:55.071316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":25654,"num_write":1001,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.485112+0000","last_change":"2024-09-14T11:56:34.485112+0000","last_active":"2024-09-14T11:56:34.485112+0000","last_peered":"2024-09-14T11:56:34.485112+0000","last_clean":"2024-09-14T11:56:34.485112+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:56:34.485112+0000","last_undegraded":"2024-09-14T11:56:34.485112+0000","last_fullsized":"2024-09-14T11:56:34.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.485023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.746684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.247905+0000","last_change":"2024-09-14T11:56:35.247905+0000","last_active":"2024-09-14T11:56:35.247905+0000","last_peered":"2024-09-14T11:56:35.247905+0000","last_clean":"2024-09-14T11:56:35.247905+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:56:35.247905+0000","last_undegraded":"2024-09-14T11:56:35.247905+0000","last_fullsized":"2024-09-14T11:56:35.247905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.247811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.168290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'188","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.826318+0000","last_change":"2024-09-14T11:56:40.826318+0000","last_active":"2024-09-14T11:56:40.826318+0000","last_peered":"2024-09-14T11:56:40.826318+0000","last_clean":"2024-09-14T11:56:40.826318+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:56:40.826318+0000","last_undegraded":"2024-09-14T11:56:40.826318+0000","last_fullsized":"2024-09-14T11:56:40.826318+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.826206+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:23.195767+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'811","reported_seq":2686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.732182+0000","last_change":"2024-09-14T11:56:52.732182+0000","last_active":"2024-09-14T11:56:52.732182+0000","last_peered":"2024-09-14T11:56:52.732182+0000","last_clean":"2024-09-14T11:56:52.732182+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:52.732182+0000","last_undegraded":"2024-09-14T11:56:52.732182+0000","last_fullsized":"2024-09-14T11:56:52.732182+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.732066+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:54.882453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'95","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.164874+0000","last_change":"2024-09-14T11:56:57.164874+0000","last_active":"2024-09-14T11:56:57.164874+0000","last_peered":"2024-09-14T11:56:57.164874+0000","last_clean":"2024-09-14T11:56:57.164874+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:56:57.164874+0000","last_undegraded":"2024-09-14T11:56:57.164874+0000","last_fullsized":"2024-09-14T11:56:57.164874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.164782+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:05.807030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'360","reported_seq":1842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.042831+0000","last_change":"2024-09-14T11:56:33.042831+0000","last_active":"2024-09-14T11:56:33.042831+0000","last_peered":"2024-09-14T11:56:33.042831+0000","last_clean":"2024-09-14T11:56:33.042831+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:56:33.042831+0000","last_undegraded":"2024-09-14T11:56:33.042831+0000","last_fullsized":"2024-09-14T11:56:33.042831+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.042715+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:58.519932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'336","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.879898+0000","last_change":"2024-09-14T11:56:24.879898+0000","last_active":"2024-09-14T11:56:24.879898+0000","last_peered":"2024-09-14T11:56:24.879898+0000","last_clean":"2024-09-14T11:56:24.879898+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:24.879898+0000","last_undegraded":"2024-09-14T11:56:24.879898+0000","last_fullsized":"2024-09-14T11:56:24.879898+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.879817+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:17.339902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":1407,"num_write":989,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.878547+0000","last_change":"2024-09-14T11:56:21.878547+0000","last_active":"2024-09-14T11:56:21.878547+0000","last_peered":"2024-09-14T11:56:21.878547+0000","last_clean":"2024-09-14T11:56:21.878547+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:56:21.878547+0000","last_undegraded":"2024-09-14T11:56:21.878547+0000","last_fullsized":"2024-09-14T11:56:21.878547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.878477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:14.405917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.743031+0000","last_change":"2024-09-14T11:56:44.743031+0000","last_active":"2024-09-14T11:56:44.743031+0000","last_peered":"2024-09-14T11:56:44.743031+0000","last_clean":"2024-09-14T11:56:44.743031+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:56:44.743031+0000","last_undegraded":"2024-09-14T11:56:44.743031+0000","last_fullsized":"2024-09-14T11:56:44.743031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.742899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:06.805443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'104","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.821602+0000","last_change":"2024-09-14T11:56:46.821602+0000","last_active":"2024-09-14T11:56:46.821602+0000","last_peered":"2024-09-14T11:56:46.821602+0000","last_clean":"2024-09-14T11:56:46.821602+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:56:46.821602+0000","last_undegraded":"2024-09-14T11:56:46.821602+0000","last_fullsized":"2024-09-14T11:56:46.821602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.821514+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:20.188202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.198992+0000","last_change":"2024-09-14T11:56:52.198992+0000","last_active":"2024-09-14T11:56:52.198992+0000","last_peered":"2024-09-14T11:56:52.198992+0000","last_clean":"2024-09-14T11:56:52.198992+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:52.198992+0000","last_undegraded":"2024-09-14T11:56:52.198992+0000","last_fullsized":"2024-09-14T11:56:52.198992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.198904+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.378166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'332","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.747551+0000","last_change":"2024-09-14T11:56:53.747475+0000","last_active":"2024-09-14T11:56:53.747551+0000","last_peered":"2024-09-14T11:56:53.747551+0000","last_clean":"2024-09-14T11:56:53.747551+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:56:53.747551+0000","last_undegraded":"2024-09-14T11:56:53.747551+0000","last_fullsized":"2024-09-14T11:56:53.747551+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.747387+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.923900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1138","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.720530+0000","last_change":"2024-09-14T11:56:26.720530+0000","last_active":"2024-09-14T11:56:26.720530+0000","last_peered":"2024-09-14T11:56:26.720530+0000","last_clean":"2024-09-14T11:56:26.720530+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:56:26.720530+0000","last_undegraded":"2024-09-14T11:56:26.720530+0000","last_fullsized":"2024-09-14T11:56:26.720530+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.720427+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:26.572105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'384","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.466221+0000","last_change":"2024-09-14T11:56:21.466221+0000","last_active":"2024-09-14T11:56:21.466221+0000","last_peered":"2024-09-14T11:56:21.466221+0000","last_clean":"2024-09-14T11:56:21.466221+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:21.466221+0000","last_undegraded":"2024-09-14T11:56:21.466221+0000","last_fullsized":"2024-09-14T11:56:21.466221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.466142+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:51.285530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":7233,"num_write":1301,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.096139+0000","last_change":"2024-09-14T11:56:23.096139+0000","last_active":"2024-09-14T11:56:23.096139+0000","last_peered":"2024-09-14T11:56:23.096139+0000","last_clean":"2024-09-14T11:56:23.096139+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:56:23.096139+0000","last_undegraded":"2024-09-14T11:56:23.096139+0000","last_fullsized":"2024-09-14T11:56:23.096139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.096056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:44.997173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.171745+0000","last_change":"2024-09-14T11:56:38.171745+0000","last_active":"2024-09-14T11:56:38.171745+0000","last_peered":"2024-09-14T11:56:38.171745+0000","last_clean":"2024-09-14T11:56:38.171745+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:56:38.171745+0000","last_undegraded":"2024-09-14T11:56:38.171745+0000","last_fullsized":"2024-09-14T11:56:38.171745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.171651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'768","reported_seq":1481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.540722+0000","last_change":"2024-09-14T11:56:44.540722+0000","last_active":"2024-09-14T11:56:44.540722+0000","last_peered":"2024-09-14T11:56:44.540722+0000","last_clean":"2024-09-14T11:56:44.540722+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:44.540722+0000","last_undegraded":"2024-09-14T11:56:44.540722+0000","last_fullsized":"2024-09-14T11:56:44.540722+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.540620+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:46.054100+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1362,"num_read_kb":3256,"num_write":1124,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.237722+0000","last_change":"2024-09-14T11:56:51.237722+0000","last_active":"2024-09-14T11:56:51.237722+0000","last_peered":"2024-09-14T11:56:51.237722+0000","last_clean":"2024-09-14T11:56:51.237722+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:56:51.237722+0000","last_undegraded":"2024-09-14T11:56:51.237722+0000","last_fullsized":"2024-09-14T11:56:51.237722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.237634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:59.694149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.795670+0000","last_change":"2024-09-14T11:56:56.795609+0000","last_active":"2024-09-14T11:56:56.795670+0000","last_peered":"2024-09-14T11:56:56.795670+0000","last_clean":"2024-09-14T11:56:56.795670+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:56:56.795670+0000","last_undegraded":"2024-09-14T11:56:56.795670+0000","last_fullsized":"2024-09-14T11:56:56.795670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.795524+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:50.937930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.761145+0000","last_change":"2024-09-14T11:56:59.761145+0000","last_active":"2024-09-14T11:56:59.761145+0000","last_peered":"2024-09-14T11:56:59.761145+0000","last_clean":"2024-09-14T11:56:59.761145+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:56:59.761145+0000","last_undegraded":"2024-09-14T11:56:59.761145+0000","last_fullsized":"2024-09-14T11:56:59.761145+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.761046+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:42.719893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'433","reported_seq":2063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.757762+0000","last_change":"2024-09-14T11:56:31.757762+0000","last_active":"2024-09-14T11:56:31.757762+0000","last_peered":"2024-09-14T11:56:31.757762+0000","last_clean":"2024-09-14T11:56:31.757762+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:56:31.757762+0000","last_undegraded":"2024-09-14T11:56:31.757762+0000","last_fullsized":"2024-09-14T11:56:31.757762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.757652+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:26.947794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.662921+0000","last_change":"2024-09-14T11:56:23.662921+0000","last_active":"2024-09-14T11:56:23.662921+0000","last_peered":"2024-09-14T11:56:23.662921+0000","last_clean":"2024-09-14T11:56:23.662921+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:23.662921+0000","last_undegraded":"2024-09-14T11:56:23.662921+0000","last_fullsized":"2024-09-14T11:56:23.662921+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.662820+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.362361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.764130+0000","last_change":"2024-09-14T11:56:36.764130+0000","last_active":"2024-09-14T11:56:36.764130+0000","last_peered":"2024-09-14T11:56:36.764130+0000","last_clean":"2024-09-14T11:56:36.764130+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:36.764130+0000","last_undegraded":"2024-09-14T11:56:36.764130+0000","last_fullsized":"2024-09-14T11:56:36.764130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.764053+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.131436+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'268","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.282675+0000","last_change":"2024-09-14T11:56:47.282675+0000","last_active":"2024-09-14T11:56:47.282675+0000","last_peered":"2024-09-14T11:56:47.282675+0000","last_clean":"2024-09-14T11:56:47.282675+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:47.282675+0000","last_undegraded":"2024-09-14T11:56:47.282675+0000","last_fullsized":"2024-09-14T11:56:47.282675+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'268","last_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_deep_scrub":"263'268","last_deep_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.282577+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:35.922781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.197057+0000","last_change":"2024-09-14T11:56:54.197057+0000","last_active":"2024-09-14T11:56:54.197057+0000","last_peered":"2024-09-14T11:56:54.197057+0000","last_clean":"2024-09-14T11:56:54.197057+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:56:54.197057+0000","last_undegraded":"2024-09-14T11:56:54.197057+0000","last_fullsized":"2024-09-14T11:56:54.197057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.196971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:14.784761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.111496+0000","last_change":"2024-09-14T11:14:14.154716+0000","last_active":"2024-09-14T11:54:27.111496+0000","last_peered":"2024-09-14T11:54:27.111496+0000","last_clean":"2024-09-14T11:54:27.111496+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:54:27.111496+0000","last_undegraded":"2024-09-14T11:54:27.111496+0000","last_fullsized":"2024-09-14T11:54:27.111496+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:48.691018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'784","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.737175+0000","last_change":"2024-09-14T11:56:32.737175+0000","last_active":"2024-09-14T11:56:32.737175+0000","last_peered":"2024-09-14T11:56:32.737175+0000","last_clean":"2024-09-14T11:56:32.737175+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:56:32.737175+0000","last_undegraded":"2024-09-14T11:56:32.737175+0000","last_fullsized":"2024-09-14T11:56:32.737175+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'784","last_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_deep_scrub":"263'784","last_deep_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.737071+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:46.307192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'373","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.476776+0000","last_change":"2024-09-14T11:56:30.476776+0000","last_active":"2024-09-14T11:56:30.476776+0000","last_peered":"2024-09-14T11:56:30.476776+0000","last_clean":"2024-09-14T11:56:30.476776+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:30.476776+0000","last_undegraded":"2024-09-14T11:56:30.476776+0000","last_fullsized":"2024-09-14T11:56:30.476776+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.476624+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:37.040267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":24187,"num_write":1164,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.301966+0000","last_change":"2024-09-14T11:56:43.301966+0000","last_active":"2024-09-14T11:56:43.301966+0000","last_peered":"2024-09-14T11:56:43.301966+0000","last_clean":"2024-09-14T11:56:43.301966+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:56:43.301966+0000","last_undegraded":"2024-09-14T11:56:43.301966+0000","last_fullsized":"2024-09-14T11:56:43.301966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.301874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:11.795970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'51","reported_seq":556,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.677930+0000","last_change":"2024-09-14T11:56:45.677930+0000","last_active":"2024-09-14T11:56:45.677930+0000","last_peered":"2024-09-14T11:56:45.677930+0000","last_clean":"2024-09-14T11:56:45.677930+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:56:45.677930+0000","last_undegraded":"2024-09-14T11:56:45.677930+0000","last_fullsized":"2024-09-14T11:56:45.677930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.677854+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:59.900722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.451629+0000","last_change":"2024-09-14T11:56:51.451629+0000","last_active":"2024-09-14T11:56:51.451629+0000","last_peered":"2024-09-14T11:56:51.451629+0000","last_clean":"2024-09-14T11:56:51.451629+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:56:51.451629+0000","last_undegraded":"2024-09-14T11:56:51.451629+0000","last_fullsized":"2024-09-14T11:56:51.451629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.451543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.323082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.763278+0000","last_change":"2024-09-14T11:56:58.763278+0000","last_active":"2024-09-14T11:56:58.763278+0000","last_peered":"2024-09-14T11:56:58.763278+0000","last_clean":"2024-09-14T11:56:58.763278+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:56:58.763278+0000","last_undegraded":"2024-09-14T11:56:58.763278+0000","last_fullsized":"2024-09-14T11:56:58.763278+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.763192+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:45.580829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'917","reported_seq":2661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.036282+0000","last_change":"2024-09-14T11:56:29.036282+0000","last_active":"2024-09-14T11:56:29.036282+0000","last_peered":"2024-09-14T11:56:29.036282+0000","last_clean":"2024-09-14T11:56:29.036282+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:56:29.036282+0000","last_undegraded":"2024-09-14T11:56:29.036282+0000","last_fullsized":"2024-09-14T11:56:29.036282+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'917","last_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_deep_scrub":"263'917","last_deep_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.036185+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":900,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.766117+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.816297+0000","last_change":"2024-09-14T11:56:25.816297+0000","last_active":"2024-09-14T11:56:25.816297+0000","last_peered":"2024-09-14T11:56:25.816297+0000","last_clean":"2024-09-14T11:56:25.816297+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:25.816297+0000","last_undegraded":"2024-09-14T11:56:25.816297+0000","last_fullsized":"2024-09-14T11:56:25.816297+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.816150+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:23.901347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.521539+0000","last_change":"2024-09-14T11:56:42.521539+0000","last_active":"2024-09-14T11:56:42.521539+0000","last_peered":"2024-09-14T11:56:42.521539+0000","last_clean":"2024-09-14T11:56:42.521539+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:56:42.521539+0000","last_undegraded":"2024-09-14T11:56:42.521539+0000","last_fullsized":"2024-09-14T11:56:42.521539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.521449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:00.655304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'328","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.269584+0000","last_change":"2024-09-14T11:56:48.269584+0000","last_active":"2024-09-14T11:56:48.269584+0000","last_peered":"2024-09-14T11:56:48.269584+0000","last_clean":"2024-09-14T11:56:48.269584+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:48.269584+0000","last_undegraded":"2024-09-14T11:56:48.269584+0000","last_fullsized":"2024-09-14T11:56:48.269584+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.269489+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:55.281201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.190118+0000","last_change":"2024-09-14T11:56:41.190118+0000","last_active":"2024-09-14T11:56:41.190118+0000","last_peered":"2024-09-14T11:56:41.190118+0000","last_clean":"2024-09-14T11:56:41.190118+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:56:41.190118+0000","last_undegraded":"2024-09-14T11:56:41.190118+0000","last_fullsized":"2024-09-14T11:56:41.190118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.190036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:27.442628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.727430+0000","last_change":"2024-09-14T11:56:58.727430+0000","last_active":"2024-09-14T11:56:58.727430+0000","last_peered":"2024-09-14T11:56:58.727430+0000","last_clean":"2024-09-14T11:56:58.727430+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:56:58.727430+0000","last_undegraded":"2024-09-14T11:56:58.727430+0000","last_fullsized":"2024-09-14T11:56:58.727430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.727339+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:00.229225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'565","reported_seq":2300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.144947+0000","last_change":"2024-09-14T11:56:36.144947+0000","last_active":"2024-09-14T11:56:36.144947+0000","last_peered":"2024-09-14T11:56:36.144947+0000","last_clean":"2024-09-14T11:56:36.144947+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:56:36.144947+0000","last_undegraded":"2024-09-14T11:56:36.144947+0000","last_fullsized":"2024-09-14T11:56:36.144947+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'565","last_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_deep_scrub":"263'565","last_deep_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.144850+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:25.651462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.513418+0000","last_change":"2024-09-14T11:56:22.513418+0000","last_active":"2024-09-14T11:56:22.513418+0000","last_peered":"2024-09-14T11:56:22.513418+0000","last_clean":"2024-09-14T11:56:22.513418+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:22.513418+0000","last_undegraded":"2024-09-14T11:56:22.513418+0000","last_fullsized":"2024-09-14T11:56:22.513418+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.513319+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.055131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":715,"num_read_kb":20814,"num_write":1368,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.285132+0000","last_change":"2024-09-14T11:56:36.285132+0000","last_active":"2024-09-14T11:56:36.285132+0000","last_peered":"2024-09-14T11:56:36.285132+0000","last_clean":"2024-09-14T11:56:36.285132+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:56:36.285132+0000","last_undegraded":"2024-09-14T11:56:36.285132+0000","last_fullsized":"2024-09-14T11:56:36.285132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.285037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.139207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'270","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.491371+0000","last_change":"2024-09-14T11:56:47.491371+0000","last_active":"2024-09-14T11:56:47.491371+0000","last_peered":"2024-09-14T11:56:47.491371+0000","last_clean":"2024-09-14T11:56:47.491371+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:47.491371+0000","last_undegraded":"2024-09-14T11:56:47.491371+0000","last_fullsized":"2024-09-14T11:56:47.491371+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.491269+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:00.619858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.764814+0000","last_change":"2024-09-14T11:56:52.764814+0000","last_active":"2024-09-14T11:56:52.764814+0000","last_peered":"2024-09-14T11:56:52.764814+0000","last_clean":"2024-09-14T11:56:52.764814+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:56:52.764814+0000","last_undegraded":"2024-09-14T11:56:52.764814+0000","last_fullsized":"2024-09-14T11:56:52.764814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.764702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:01.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.194337+0000","last_change":"2024-09-14T11:56:32.194337+0000","last_active":"2024-09-14T11:56:32.194337+0000","last_peered":"2024-09-14T11:56:32.194337+0000","last_clean":"2024-09-14T11:56:32.194337+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:56:32.194337+0000","last_undegraded":"2024-09-14T11:56:32.194337+0000","last_fullsized":"2024-09-14T11:56:32.194337+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.194246+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:46.983995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.027053+0000","last_change":"2024-09-14T11:56:24.027053+0000","last_active":"2024-09-14T11:56:24.027053+0000","last_peered":"2024-09-14T11:56:24.027053+0000","last_clean":"2024-09-14T11:56:24.027053+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:24.027053+0000","last_undegraded":"2024-09-14T11:56:24.027053+0000","last_fullsized":"2024-09-14T11:56:24.027053+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.026967+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:04.386753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":1976,"num_write":1075,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.696720+0000","last_change":"2024-09-14T11:56:41.696720+0000","last_active":"2024-09-14T11:56:41.696720+0000","last_peered":"2024-09-14T11:56:41.696720+0000","last_clean":"2024-09-14T11:56:41.696720+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:56:41.696720+0000","last_undegraded":"2024-09-14T11:56:41.696720+0000","last_fullsized":"2024-09-14T11:56:41.696720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.696635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:41.649777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'497","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.802546+0000","last_change":"2024-09-14T11:56:42.802546+0000","last_active":"2024-09-14T11:56:42.802546+0000","last_peered":"2024-09-14T11:56:42.802546+0000","last_clean":"2024-09-14T11:56:42.802546+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:42.802546+0000","last_undegraded":"2024-09-14T11:56:42.802546+0000","last_fullsized":"2024-09-14T11:56:42.802546+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.802453+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.897670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100440,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2109,"num_write":762,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.765021+0000","last_change":"2024-09-14T11:56:53.765021+0000","last_active":"2024-09-14T11:56:53.765021+0000","last_peered":"2024-09-14T11:56:53.765021+0000","last_clean":"2024-09-14T11:56:53.765021+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:56:53.765021+0000","last_undegraded":"2024-09-14T11:56:53.765021+0000","last_fullsized":"2024-09-14T11:56:53.765021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.764935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:14.345255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'179","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.163408+0000","last_change":"2024-09-14T11:56:59.163408+0000","last_active":"2024-09-14T11:56:59.163408+0000","last_peered":"2024-09-14T11:56:59.163408+0000","last_clean":"2024-09-14T11:56:59.163408+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:56:59.163408+0000","last_undegraded":"2024-09-14T11:56:59.163408+0000","last_fullsized":"2024-09-14T11:56:59.163408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.163317+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:15.030499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'413","reported_seq":1954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.580724+0000","last_change":"2024-09-14T11:56:36.580724+0000","last_active":"2024-09-14T11:56:36.580724+0000","last_peered":"2024-09-14T11:56:36.580724+0000","last_clean":"2024-09-14T11:56:36.580724+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:56:36.580724+0000","last_undegraded":"2024-09-14T11:56:36.580724+0000","last_fullsized":"2024-09-14T11:56:36.580724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.580630+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:57.544918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'351","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.810015+0000","last_change":"2024-09-14T11:56:23.810015+0000","last_active":"2024-09-14T11:56:23.810015+0000","last_peered":"2024-09-14T11:56:23.810015+0000","last_clean":"2024-09-14T11:56:23.810015+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:23.810015+0000","last_undegraded":"2024-09-14T11:56:23.810015+0000","last_fullsized":"2024-09-14T11:56:23.810015+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.809947+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:11.325976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":10770,"num_write":1202,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.246504+0000","last_change":"2024-09-14T11:56:37.246504+0000","last_active":"2024-09-14T11:56:37.246504+0000","last_peered":"2024-09-14T11:56:37.246504+0000","last_clean":"2024-09-14T11:56:37.246504+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:56:37.246504+0000","last_undegraded":"2024-09-14T11:56:37.246504+0000","last_fullsized":"2024-09-14T11:56:37.246504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.246409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:58.990350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'329","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.490988+0000","last_change":"2024-09-14T11:56:49.490988+0000","last_active":"2024-09-14T11:56:49.490988+0000","last_peered":"2024-09-14T11:56:49.490988+0000","last_clean":"2024-09-14T11:56:49.490988+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:49.490988+0000","last_undegraded":"2024-09-14T11:56:49.490988+0000","last_fullsized":"2024-09-14T11:56:49.490988+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.490894+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.716046+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.821686+0000","last_change":"2024-09-14T11:56:43.821583+0000","last_active":"2024-09-14T11:56:43.821686+0000","last_peered":"2024-09-14T11:56:43.821686+0000","last_clean":"2024-09-14T11:56:43.821686+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:56:43.821686+0000","last_undegraded":"2024-09-14T11:56:43.821686+0000","last_fullsized":"2024-09-14T11:56:43.821686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.821463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:44.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'239","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.190251+0000","last_change":"2024-09-14T11:56:45.190251+0000","last_active":"2024-09-14T11:56:45.190251+0000","last_peered":"2024-09-14T11:56:45.190251+0000","last_clean":"2024-09-14T11:56:45.190251+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:56:45.190251+0000","last_undegraded":"2024-09-14T11:56:45.190251+0000","last_fullsized":"2024-09-14T11:56:45.190251+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.190156+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:19.971391+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'497","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.133993+0000","last_change":"2024-09-14T11:56:35.133928+0000","last_active":"2024-09-14T11:56:35.133993+0000","last_peered":"2024-09-14T11:56:35.133993+0000","last_clean":"2024-09-14T11:56:35.133993+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:56:35.133993+0000","last_undegraded":"2024-09-14T11:56:35.133993+0000","last_fullsized":"2024-09-14T11:56:35.133993+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.133843+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:47.774586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.633798+0000","last_change":"2024-09-14T11:56:22.633722+0000","last_active":"2024-09-14T11:56:22.633798+0000","last_peered":"2024-09-14T11:56:22.633798+0000","last_clean":"2024-09-14T11:56:22.633798+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:22.633798+0000","last_undegraded":"2024-09-14T11:56:22.633798+0000","last_fullsized":"2024-09-14T11:56:22.633798+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.633613+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:24.515854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.787436+0000","last_change":"2024-09-14T11:56:45.787436+0000","last_active":"2024-09-14T11:56:45.787436+0000","last_peered":"2024-09-14T11:56:45.787436+0000","last_clean":"2024-09-14T11:56:45.787436+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:56:45.787436+0000","last_undegraded":"2024-09-14T11:56:45.787436+0000","last_fullsized":"2024-09-14T11:56:45.787436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.787349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:30.736106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.282345+0000","last_change":"2024-09-14T11:56:50.282345+0000","last_active":"2024-09-14T11:56:50.282345+0000","last_peered":"2024-09-14T11:56:50.282345+0000","last_clean":"2024-09-14T11:56:50.282345+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:50.282345+0000","last_undegraded":"2024-09-14T11:56:50.282345+0000","last_fullsized":"2024-09-14T11:56:50.282345+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.282250+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.560895+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.917145+0000","last_change":"2024-09-14T11:56:46.917145+0000","last_active":"2024-09-14T11:56:46.917145+0000","last_peered":"2024-09-14T11:56:46.917145+0000","last_clean":"2024-09-14T11:56:46.917145+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:56:46.917145+0000","last_undegraded":"2024-09-14T11:56:46.917145+0000","last_fullsized":"2024-09-14T11:56:46.917145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.917046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:41.568586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'148","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.748983+0000","last_change":"2024-09-14T11:56:57.748983+0000","last_active":"2024-09-14T11:56:57.748983+0000","last_peered":"2024-09-14T11:56:57.748983+0000","last_clean":"2024-09-14T11:56:57.748983+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:56:57.748983+0000","last_undegraded":"2024-09-14T11:56:57.748983+0000","last_fullsized":"2024-09-14T11:56:57.748983+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.748848+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:22.383031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'422","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832552+0000","last_change":"2024-09-14T11:56:27.832498+0000","last_active":"2024-09-14T11:56:27.832552+0000","last_peered":"2024-09-14T11:56:27.832552+0000","last_clean":"2024-09-14T11:56:27.832552+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:56:27.832552+0000","last_undegraded":"2024-09-14T11:56:27.832552+0000","last_fullsized":"2024-09-14T11:56:27.832552+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'422","last_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_deep_scrub":"263'422","last_deep_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832415+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:22.843154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.528483+0000","last_change":"2024-09-14T11:56:24.528420+0000","last_active":"2024-09-14T11:56:24.528483+0000","last_peered":"2024-09-14T11:56:24.528483+0000","last_clean":"2024-09-14T11:56:24.528483+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:24.528483+0000","last_undegraded":"2024-09-14T11:56:24.528483+0000","last_fullsized":"2024-09-14T11:56:24.528483+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.528314+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.890618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":46735,"num_write":1109,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.774071+0000","last_change":"2024-09-14T11:56:39.774007+0000","last_active":"2024-09-14T11:56:39.774071+0000","last_peered":"2024-09-14T11:56:39.774071+0000","last_clean":"2024-09-14T11:56:39.774071+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:56:39.774071+0000","last_undegraded":"2024-09-14T11:56:39.774071+0000","last_fullsized":"2024-09-14T11:56:39.774071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.773918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:01.996446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'87","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.768704+0000","last_change":"2024-09-14T11:56:49.768704+0000","last_active":"2024-09-14T11:56:49.768704+0000","last_peered":"2024-09-14T11:56:49.768704+0000","last_clean":"2024-09-14T11:56:49.768704+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:56:49.768704+0000","last_undegraded":"2024-09-14T11:56:49.768704+0000","last_fullsized":"2024-09-14T11:56:49.768704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.768604+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:52.138898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.229292+0000","last_change":"2024-09-14T11:56:43.229292+0000","last_active":"2024-09-14T11:56:43.229292+0000","last_peered":"2024-09-14T11:56:43.229292+0000","last_clean":"2024-09-14T11:56:43.229292+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:43.229292+0000","last_undegraded":"2024-09-14T11:56:43.229292+0000","last_fullsized":"2024-09-14T11:56:43.229292+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.229209+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:29.015641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.420310+0000","last_change":"2024-09-14T11:56:54.420310+0000","last_active":"2024-09-14T11:56:54.420310+0000","last_peered":"2024-09-14T11:56:54.420310+0000","last_clean":"2024-09-14T11:56:54.420310+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:56:54.420310+0000","last_undegraded":"2024-09-14T11:56:54.420310+0000","last_fullsized":"2024-09-14T11:56:54.420310+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.420225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:23.804109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'915","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.792157+0000","last_change":"2024-09-14T11:56:34.792073+0000","last_active":"2024-09-14T11:56:34.792157+0000","last_peered":"2024-09-14T11:56:34.792157+0000","last_clean":"2024-09-14T11:56:34.792157+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:56:34.792157+0000","last_undegraded":"2024-09-14T11:56:34.792157+0000","last_fullsized":"2024-09-14T11:56:34.792157+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'915","last_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_deep_scrub":"263'915","last_deep_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.791978+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.186719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832779+0000","last_change":"2024-09-14T11:56:27.832718+0000","last_active":"2024-09-14T11:56:27.832779+0000","last_peered":"2024-09-14T11:56:27.832779+0000","last_clean":"2024-09-14T11:56:27.832779+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:27.832779+0000","last_undegraded":"2024-09-14T11:56:27.832779+0000","last_fullsized":"2024-09-14T11:56:27.832779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832588+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:52.609553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.517199+0000","last_change":"2024-09-14T11:56:43.517199+0000","last_active":"2024-09-14T11:56:43.517199+0000","last_peered":"2024-09-14T11:56:43.517199+0000","last_clean":"2024-09-14T11:56:43.517199+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:56:43.517199+0000","last_undegraded":"2024-09-14T11:56:43.517199+0000","last_fullsized":"2024-09-14T11:56:43.517199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.517088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:06.786780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'307","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.686246+0000","last_change":"2024-09-14T11:56:51.686246+0000","last_active":"2024-09-14T11:56:51.686246+0000","last_peered":"2024-09-14T11:56:51.686246+0000","last_clean":"2024-09-14T11:56:51.686246+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:51.686246+0000","last_undegraded":"2024-09-14T11:56:51.686246+0000","last_fullsized":"2024-09-14T11:56:51.686246+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.686158+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:06.242376+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.734741+0000","last_change":"2024-09-14T11:56:51.734741+0000","last_active":"2024-09-14T11:56:51.734741+0000","last_peered":"2024-09-14T11:56:51.734741+0000","last_clean":"2024-09-14T11:56:51.734741+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:56:51.734741+0000","last_undegraded":"2024-09-14T11:56:51.734741+0000","last_fullsized":"2024-09-14T11:56:51.734741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.734652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:22.887452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'122","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.378277+0000","last_change":"2024-09-14T11:56:55.378277+0000","last_active":"2024-09-14T11:56:55.378277+0000","last_peered":"2024-09-14T11:56:55.378277+0000","last_clean":"2024-09-14T11:56:55.378277+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:56:55.378277+0000","last_undegraded":"2024-09-14T11:56:55.378277+0000","last_fullsized":"2024-09-14T11:56:55.378277+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.378185+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:20.899163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.763122+0000","last_change":"2024-09-14T11:56:33.763020+0000","last_active":"2024-09-14T11:56:33.763122+0000","last_peered":"2024-09-14T11:56:33.763122+0000","last_clean":"2024-09-14T11:56:33.763122+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:56:33.763122+0000","last_undegraded":"2024-09-14T11:56:33.763122+0000","last_fullsized":"2024-09-14T11:56:33.763122+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.762877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:10.689175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.799237+0000","last_change":"2024-09-14T11:56:28.799145+0000","last_active":"2024-09-14T11:56:28.799237+0000","last_peered":"2024-09-14T11:56:28.799237+0000","last_clean":"2024-09-14T11:56:28.799237+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:28.799237+0000","last_undegraded":"2024-09-14T11:56:28.799237+0000","last_fullsized":"2024-09-14T11:56:28.799237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.799019+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.449897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.755551+0000","last_change":"2024-09-14T11:56:47.755551+0000","last_active":"2024-09-14T11:56:47.755551+0000","last_peered":"2024-09-14T11:56:47.755551+0000","last_clean":"2024-09-14T11:56:47.755551+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:56:47.755551+0000","last_undegraded":"2024-09-14T11:56:47.755551+0000","last_fullsized":"2024-09-14T11:56:47.755551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.755450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:19.691984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'267","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.650622+0000","last_change":"2024-09-14T11:56:46.650622+0000","last_active":"2024-09-14T11:56:46.650622+0000","last_peered":"2024-09-14T11:56:46.650622+0000","last_clean":"2024-09-14T11:56:46.650622+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:56:46.650622+0000","last_undegraded":"2024-09-14T11:56:46.650622+0000","last_fullsized":"2024-09-14T11:56:46.650622+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.650528+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:11.329743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":976,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.218389+0000","last_change":"2024-09-14T11:56:42.218389+0000","last_active":"2024-09-14T11:56:42.218389+0000","last_peered":"2024-09-14T11:56:42.218389+0000","last_clean":"2024-09-14T11:56:42.218389+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:56:42.218389+0000","last_undegraded":"2024-09-14T11:56:42.218389+0000","last_fullsized":"2024-09-14T11:56:42.218389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.218303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:15.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'145","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:00.568911+0000","last_change":"2024-09-14T11:14:14.154133+0000","last_active":"2024-09-14T11:54:00.568911+0000","last_peered":"2024-09-14T11:54:00.568911+0000","last_clean":"2024-09-14T11:54:00.568911+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:54:00.568911+0000","last_undegraded":"2024-09-14T11:54:00.568911+0000","last_fullsized":"2024-09-14T11:54:00.568911+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:14:13.136528+0000","last_clean_scrub_stamp":"2024-09-14T11:14:13.136528+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:07.280075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'329","reported_seq":1768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.031151+0000","last_change":"2024-09-14T11:56:32.031151+0000","last_active":"2024-09-14T11:56:32.031151+0000","last_peered":"2024-09-14T11:56:32.031151+0000","last_clean":"2024-09-14T11:56:32.031151+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:56:32.031151+0000","last_undegraded":"2024-09-14T11:56:32.031151+0000","last_fullsized":"2024-09-14T11:56:32.031151+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.031055+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:39.902095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'364","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.015176+0000","last_change":"2024-09-14T11:56:28.015176+0000","last_active":"2024-09-14T11:56:28.015176+0000","last_peered":"2024-09-14T11:56:28.015176+0000","last_clean":"2024-09-14T11:56:28.015176+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:28.015176+0000","last_undegraded":"2024-09-14T11:56:28.015176+0000","last_fullsized":"2024-09-14T11:56:28.015176+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.015080+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:02.166337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":1005,"num_write":1035,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.784036+0000","last_change":"2024-09-14T11:56:43.784036+0000","last_active":"2024-09-14T11:56:43.784036+0000","last_peered":"2024-09-14T11:56:43.784036+0000","last_clean":"2024-09-14T11:56:43.784036+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:56:43.784036+0000","last_undegraded":"2024-09-14T11:56:43.784036+0000","last_fullsized":"2024-09-14T11:56:43.784036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.783954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:02.643027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'229","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.289568+0000","last_change":"2024-09-14T11:56:49.289568+0000","last_active":"2024-09-14T11:56:49.289568+0000","last_peered":"2024-09-14T11:56:49.289568+0000","last_clean":"2024-09-14T11:56:49.289568+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:49.289568+0000","last_undegraded":"2024-09-14T11:56:49.289568+0000","last_fullsized":"2024-09-14T11:56:49.289568+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.289489+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:54.229919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.788551+0000","last_change":"2024-09-14T11:56:52.788551+0000","last_active":"2024-09-14T11:56:52.788551+0000","last_peered":"2024-09-14T11:56:52.788551+0000","last_clean":"2024-09-14T11:56:52.788551+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:56:52.788551+0000","last_undegraded":"2024-09-14T11:56:52.788551+0000","last_fullsized":"2024-09-14T11:56:52.788551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.788452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:09.126403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.357385+0000","last_change":"2024-09-14T11:56:56.357385+0000","last_active":"2024-09-14T11:56:56.357385+0000","last_peered":"2024-09-14T11:56:56.357385+0000","last_clean":"2024-09-14T11:56:56.357385+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:56:56.357385+0000","last_undegraded":"2024-09-14T11:56:56.357385+0000","last_fullsized":"2024-09-14T11:56:56.357385+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.357285+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:54.981854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.730074+0000","last_change":"2024-09-14T11:56:32.730074+0000","last_active":"2024-09-14T11:56:32.730074+0000","last_peered":"2024-09-14T11:56:32.730074+0000","last_clean":"2024-09-14T11:56:32.730074+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:56:32.730074+0000","last_undegraded":"2024-09-14T11:56:32.730074+0000","last_fullsized":"2024-09-14T11:56:32.730074+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.729983+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.217638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'335","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.542389+0000","last_change":"2024-09-14T11:56:26.542389+0000","last_active":"2024-09-14T11:56:26.542389+0000","last_peered":"2024-09-14T11:56:26.542389+0000","last_clean":"2024-09-14T11:56:26.542389+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:26.542389+0000","last_undegraded":"2024-09-14T11:56:26.542389+0000","last_fullsized":"2024-09-14T11:56:26.542389+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.542240+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:49.477686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":673,"num_read_kb":5062,"num_write":1074,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.726990+0000","last_change":"2024-09-14T11:56:38.726990+0000","last_active":"2024-09-14T11:56:38.726990+0000","last_peered":"2024-09-14T11:56:38.726990+0000","last_clean":"2024-09-14T11:56:38.726990+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:56:38.726990+0000","last_undegraded":"2024-09-14T11:56:38.726990+0000","last_fullsized":"2024-09-14T11:56:38.726990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.726904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.234751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'320","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.751007+0000","last_change":"2024-09-14T11:56:51.751007+0000","last_active":"2024-09-14T11:56:51.751007+0000","last_peered":"2024-09-14T11:56:51.751007+0000","last_clean":"2024-09-14T11:56:51.751007+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:51.751007+0000","last_undegraded":"2024-09-14T11:56:51.751007+0000","last_fullsized":"2024-09-14T11:56:51.751007+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.750913+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:18.147199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.790033+0000","last_change":"2024-09-14T11:56:54.790033+0000","last_active":"2024-09-14T11:56:54.790033+0000","last_peered":"2024-09-14T11:56:54.790033+0000","last_clean":"2024-09-14T11:56:54.790033+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:56:54.790033+0000","last_undegraded":"2024-09-14T11:56:54.790033+0000","last_fullsized":"2024-09-14T11:56:54.790033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.789942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:54.043254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'116","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.881093+0000","last_change":"2024-09-14T11:56:55.881093+0000","last_active":"2024-09-14T11:56:55.881093+0000","last_peered":"2024-09-14T11:56:55.881093+0000","last_clean":"2024-09-14T11:56:55.881093+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:56:55.881093+0000","last_undegraded":"2024-09-14T11:56:55.881093+0000","last_fullsized":"2024-09-14T11:56:55.881093+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.881013+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.948640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'436","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.789928+0000","last_change":"2024-09-14T11:56:35.789928+0000","last_active":"2024-09-14T11:56:35.789928+0000","last_peered":"2024-09-14T11:56:35.789928+0000","last_clean":"2024-09-14T11:56:35.789928+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:56:35.789928+0000","last_undegraded":"2024-09-14T11:56:35.789928+0000","last_fullsized":"2024-09-14T11:56:35.789928+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.789837+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:13.884434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.147968+0000","last_change":"2024-09-14T11:56:25.147968+0000","last_active":"2024-09-14T11:56:25.147968+0000","last_peered":"2024-09-14T11:56:25.147968+0000","last_clean":"2024-09-14T11:56:25.147968+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:25.147968+0000","last_undegraded":"2024-09-14T11:56:25.147968+0000","last_fullsized":"2024-09-14T11:56:25.147968+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.147865+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:36.906313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'539","reported_seq":2256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.747353+0000","last_change":"2024-09-14T11:56:34.747353+0000","last_active":"2024-09-14T11:56:34.747353+0000","last_peered":"2024-09-14T11:56:34.747353+0000","last_clean":"2024-09-14T11:56:34.747353+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:56:34.747353+0000","last_undegraded":"2024-09-14T11:56:34.747353+0000","last_fullsized":"2024-09-14T11:56:34.747353+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'539","last_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_deep_scrub":"263'539","last_deep_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.747258+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.313926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'380","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.841288+0000","last_change":"2024-09-14T11:56:25.841288+0000","last_active":"2024-09-14T11:56:25.841288+0000","last_peered":"2024-09-14T11:56:25.841288+0000","last_clean":"2024-09-14T11:56:25.841288+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:25.841288+0000","last_undegraded":"2024-09-14T11:56:25.841288+0000","last_fullsized":"2024-09-14T11:56:25.841288+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.841167+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.025310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":5548,"num_write":1128,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1192","reported_seq":2827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.736512+0000","last_change":"2024-09-14T11:56:38.736512+0000","last_active":"2024-09-14T11:56:38.736512+0000","last_peered":"2024-09-14T11:56:38.736512+0000","last_clean":"2024-09-14T11:56:38.736512+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:56:38.736512+0000","last_undegraded":"2024-09-14T11:56:38.736512+0000","last_fullsized":"2024-09-14T11:56:38.736512+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1192","last_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_deep_scrub":"263'1192","last_deep_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.736423+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.672754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.805721+0000","last_change":"2024-09-14T11:56:30.805721+0000","last_active":"2024-09-14T11:56:30.805721+0000","last_peered":"2024-09-14T11:56:30.805721+0000","last_clean":"2024-09-14T11:56:30.805721+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:30.805721+0000","last_undegraded":"2024-09-14T11:56:30.805721+0000","last_fullsized":"2024-09-14T11:56:30.805721+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.805550+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:51.121985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'463","reported_seq":2205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.766924+0000","last_change":"2024-09-14T11:56:33.766924+0000","last_active":"2024-09-14T11:56:33.766924+0000","last_peered":"2024-09-14T11:56:33.766924+0000","last_clean":"2024-09-14T11:56:33.766924+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:56:33.766924+0000","last_undegraded":"2024-09-14T11:56:33.766924+0000","last_fullsized":"2024-09-14T11:56:33.766924+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.766839+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:15.603752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2774,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.568939+0000","last_change":"2024-09-14T11:56:25.568939+0000","last_active":"2024-09-14T11:56:25.568939+0000","last_peered":"2024-09-14T11:56:25.568939+0000","last_clean":"2024-09-14T11:56:25.568939+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:25.568939+0000","last_undegraded":"2024-09-14T11:56:25.568939+0000","last_fullsized":"2024-09-14T11:56:25.568939+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.568822+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.874889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":9527,"num_write":1076,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'418","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.093331+0000","last_change":"2024-09-14T11:56:34.093331+0000","last_active":"2024-09-14T11:56:34.093331+0000","last_peered":"2024-09-14T11:56:34.093331+0000","last_clean":"2024-09-14T11:56:34.093331+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:56:34.093331+0000","last_undegraded":"2024-09-14T11:56:34.093331+0000","last_fullsized":"2024-09-14T11:56:34.093331+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.093235+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:56.415972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'329","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.009840+0000","last_change":"2024-09-14T11:56:25.009840+0000","last_active":"2024-09-14T11:56:25.009840+0000","last_peered":"2024-09-14T11:56:25.009840+0000","last_clean":"2024-09-14T11:56:25.009840+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:25.009840+0000","last_undegraded":"2024-09-14T11:56:25.009840+0000","last_fullsized":"2024-09-14T11:56:25.009840+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.009692+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:51.768321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":10973,"num_write":1149,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'781","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.772231+0000","last_change":"2024-09-14T11:56:35.772231+0000","last_active":"2024-09-14T11:56:35.772231+0000","last_peered":"2024-09-14T11:56:35.772231+0000","last_clean":"2024-09-14T11:56:35.772231+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:56:35.772231+0000","last_undegraded":"2024-09-14T11:56:35.772231+0000","last_fullsized":"2024-09-14T11:56:35.772231+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.772148+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:57.596143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.849765+0000","last_change":"2024-09-14T11:56:24.849765+0000","last_active":"2024-09-14T11:56:24.849765+0000","last_peered":"2024-09-14T11:56:24.849765+0000","last_clean":"2024-09-14T11:56:24.849765+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:24.849765+0000","last_undegraded":"2024-09-14T11:56:24.849765+0000","last_fullsized":"2024-09-14T11:56:24.849765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.849561+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:14.537929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":959,"num_read_kb":11029,"num_write":1184,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'411","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.179313+0000","last_change":"2024-09-14T11:56:37.179313+0000","last_active":"2024-09-14T11:56:37.179313+0000","last_peered":"2024-09-14T11:56:37.179313+0000","last_clean":"2024-09-14T11:56:37.179313+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:56:37.179313+0000","last_undegraded":"2024-09-14T11:56:37.179313+0000","last_fullsized":"2024-09-14T11:56:37.179313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.179225+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:59.876690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'401","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.896659+0000","last_change":"2024-09-14T11:56:33.896659+0000","last_active":"2024-09-14T11:56:33.896659+0000","last_peered":"2024-09-14T11:56:33.896659+0000","last_clean":"2024-09-14T11:56:33.896659+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:33.896659+0000","last_undegraded":"2024-09-14T11:56:33.896659+0000","last_fullsized":"2024-09-14T11:56:33.896659+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.896569+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:18.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":972,"num_read_kb":685,"num_write":1240,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'544","reported_seq":2170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.194969+0000","last_change":"2024-09-14T11:56:33.194969+0000","last_active":"2024-09-14T11:56:33.194969+0000","last_peered":"2024-09-14T11:56:33.194969+0000","last_clean":"2024-09-14T11:56:33.194969+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:56:33.194969+0000","last_undegraded":"2024-09-14T11:56:33.194969+0000","last_fullsized":"2024-09-14T11:56:33.194969+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.194868+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.778340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'301","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.998258+0000","last_change":"2024-09-14T11:56:25.998258+0000","last_active":"2024-09-14T11:56:25.998258+0000","last_peered":"2024-09-14T11:56:25.998258+0000","last_clean":"2024-09-14T11:56:25.998258+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:25.998258+0000","last_undegraded":"2024-09-14T11:56:25.998258+0000","last_fullsized":"2024-09-14T11:56:25.998258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.998152+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:52.475288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":918,"num_read_kb":80980,"num_write":1012,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.541399+0000","last_change":"2024-09-14T11:56:35.541399+0000","last_active":"2024-09-14T11:56:35.541399+0000","last_peered":"2024-09-14T11:56:35.541399+0000","last_clean":"2024-09-14T11:56:35.541399+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:56:35.541399+0000","last_undegraded":"2024-09-14T11:56:35.541399+0000","last_fullsized":"2024-09-14T11:56:35.541399+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.541315+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.815826+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.804378+0000","last_change":"2024-09-14T11:56:29.804378+0000","last_active":"2024-09-14T11:56:29.804378+0000","last_peered":"2024-09-14T11:56:29.804378+0000","last_clean":"2024-09-14T11:56:29.804378+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:29.804378+0000","last_undegraded":"2024-09-14T11:56:29.804378+0000","last_fullsized":"2024-09-14T11:56:29.804378+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.804272+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:56.088992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'423","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.710966+0000","last_change":"2024-09-14T11:56:37.710966+0000","last_active":"2024-09-14T11:56:37.710966+0000","last_peered":"2024-09-14T11:56:37.710966+0000","last_clean":"2024-09-14T11:56:37.710966+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:56:37.710966+0000","last_undegraded":"2024-09-14T11:56:37.710966+0000","last_fullsized":"2024-09-14T11:56:37.710966+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.710871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:32.054722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'365","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.007712+0000","last_change":"2024-09-14T11:56:27.007610+0000","last_active":"2024-09-14T11:56:27.007712+0000","last_peered":"2024-09-14T11:56:27.007712+0000","last_clean":"2024-09-14T11:56:27.007712+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:27.007712+0000","last_undegraded":"2024-09-14T11:56:27.007712+0000","last_fullsized":"2024-09-14T11:56:27.007712+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.007472+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:43.410193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":571,"num_read_kb":30121,"num_write":1035,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'415","reported_seq":1912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.869913+0000","last_change":"2024-09-14T11:56:29.869913+0000","last_active":"2024-09-14T11:56:29.869913+0000","last_peered":"2024-09-14T11:56:29.869913+0000","last_clean":"2024-09-14T11:56:29.869913+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:56:29.869913+0000","last_undegraded":"2024-09-14T11:56:29.869913+0000","last_fullsized":"2024-09-14T11:56:29.869913+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.869818+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:11.490799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.844135+0000","last_change":"2024-09-14T11:56:31.844066+0000","last_active":"2024-09-14T11:56:31.844135+0000","last_peered":"2024-09-14T11:56:31.844135+0000","last_clean":"2024-09-14T11:56:31.844135+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:31.844135+0000","last_undegraded":"2024-09-14T11:56:31.844135+0000","last_fullsized":"2024-09-14T11:56:31.844135+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.843966+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:29.756203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'816","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.728869+0000","last_change":"2024-09-14T11:56:36.728783+0000","last_active":"2024-09-14T11:56:36.728869+0000","last_peered":"2024-09-14T11:56:36.728869+0000","last_clean":"2024-09-14T11:56:36.728869+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:56:36.728869+0000","last_undegraded":"2024-09-14T11:56:36.728869+0000","last_fullsized":"2024-09-14T11:56:36.728869+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'816","last_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_deep_scrub":"263'816","last_deep_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.728665+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:46.867994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'300","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.563332+0000","last_change":"2024-09-14T11:56:27.563220+0000","last_active":"2024-09-14T11:56:27.563332+0000","last_peered":"2024-09-14T11:56:27.563332+0000","last_clean":"2024-09-14T11:56:27.563332+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:27.563332+0000","last_undegraded":"2024-09-14T11:56:27.563332+0000","last_fullsized":"2024-09-14T11:56:27.563332+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.563050+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.198569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":33889,"num_write":889,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'382","reported_seq":1844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.559856+0000","last_change":"2024-09-14T11:56:36.559792+0000","last_active":"2024-09-14T11:56:36.559856+0000","last_peered":"2024-09-14T11:56:36.559856+0000","last_clean":"2024-09-14T11:56:36.559856+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:56:36.559856+0000","last_undegraded":"2024-09-14T11:56:36.559856+0000","last_fullsized":"2024-09-14T11:56:36.559856+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.559698+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:41.726328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.192131+0000","last_change":"2024-09-14T11:56:26.192037+0000","last_active":"2024-09-14T11:56:26.192131+0000","last_peered":"2024-09-14T11:56:26.192131+0000","last_clean":"2024-09-14T11:56:26.192131+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:26.192131+0000","last_undegraded":"2024-09-14T11:56:26.192131+0000","last_fullsized":"2024-09-14T11:56:26.192131+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.191880+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.808289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'501","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513475+0000","last_change":"2024-09-14T11:56:33.513417+0000","last_active":"2024-09-14T11:56:33.513475+0000","last_peered":"2024-09-14T11:56:33.513475+0000","last_clean":"2024-09-14T11:56:33.513475+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:56:33.513475+0000","last_undegraded":"2024-09-14T11:56:33.513475+0000","last_fullsized":"2024-09-14T11:56:33.513475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.513326+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.516314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'488","reported_seq":1225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.533695+0000","last_change":"2024-09-14T11:56:35.533626+0000","last_active":"2024-09-14T11:56:35.533695+0000","last_peered":"2024-09-14T11:56:35.533695+0000","last_clean":"2024-09-14T11:56:35.533695+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:35.533695+0000","last_undegraded":"2024-09-14T11:56:35.533695+0000","last_fullsized":"2024-09-14T11:56:35.533695+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.533523+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.931408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1169,"num_read_kb":1914,"num_write":1411,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.265684+0000","last_change":"2024-09-14T11:56:42.265618+0000","last_active":"2024-09-14T11:56:42.265684+0000","last_peered":"2024-09-14T11:56:42.265684+0000","last_clean":"2024-09-14T11:56:42.265684+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:56:42.265684+0000","last_undegraded":"2024-09-14T11:56:42.265684+0000","last_fullsized":"2024-09-14T11:56:42.265684+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.265519+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.913918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'370","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.845355+0000","last_change":"2024-09-14T11:56:38.845355+0000","last_active":"2024-09-14T11:56:38.845355+0000","last_peered":"2024-09-14T11:56:38.845355+0000","last_clean":"2024-09-14T11:56:38.845355+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:38.845355+0000","last_undegraded":"2024-09-14T11:56:38.845355+0000","last_fullsized":"2024-09-14T11:56:38.845355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.845248+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:52.872233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":47810,"num_write":1093,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'445","reported_seq":1979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.440280+0000","last_change":"2024-09-14T11:56:33.440280+0000","last_active":"2024-09-14T11:56:33.440280+0000","last_peered":"2024-09-14T11:56:33.440280+0000","last_clean":"2024-09-14T11:56:33.440280+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:56:33.440280+0000","last_undegraded":"2024-09-14T11:56:33.440280+0000","last_fullsized":"2024-09-14T11:56:33.440280+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.440166+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:03.203426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.814186+0000","last_change":"2024-09-14T11:56:32.814186+0000","last_active":"2024-09-14T11:56:32.814186+0000","last_peered":"2024-09-14T11:56:32.814186+0000","last_clean":"2024-09-14T11:56:32.814186+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:32.814186+0000","last_undegraded":"2024-09-14T11:56:32.814186+0000","last_fullsized":"2024-09-14T11:56:32.814186+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.814090+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.660032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.824437+0000","last_change":"2024-09-14T11:56:33.824437+0000","last_active":"2024-09-14T11:56:33.824437+0000","last_peered":"2024-09-14T11:56:33.824437+0000","last_clean":"2024-09-14T11:56:33.824437+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:33.824437+0000","last_undegraded":"2024-09-14T11:56:33.824437+0000","last_fullsized":"2024-09-14T11:56:33.824437+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.824296+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:37.946754+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'502","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.620855+0000","last_change":"2024-09-14T11:56:37.620855+0000","last_active":"2024-09-14T11:56:37.620855+0000","last_peered":"2024-09-14T11:56:37.620855+0000","last_clean":"2024-09-14T11:56:37.620855+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:56:37.620855+0000","last_undegraded":"2024-09-14T11:56:37.620855+0000","last_fullsized":"2024-09-14T11:56:37.620855+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.620756+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:34.911258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":928,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'359","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.767279+0000","last_change":"2024-09-14T11:56:27.767279+0000","last_active":"2024-09-14T11:56:27.767279+0000","last_peered":"2024-09-14T11:56:27.767279+0000","last_clean":"2024-09-14T11:56:27.767279+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:27.767279+0000","last_undegraded":"2024-09-14T11:56:27.767279+0000","last_fullsized":"2024-09-14T11:56:27.767279+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.767137+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:02.709261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":694,"num_read_kb":183365,"num_write":1193,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.731802+0000","last_change":"2024-09-14T11:56:41.731802+0000","last_active":"2024-09-14T11:56:41.731802+0000","last_peered":"2024-09-14T11:56:41.731802+0000","last_clean":"2024-09-14T11:56:41.731802+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:56:41.731802+0000","last_undegraded":"2024-09-14T11:56:41.731802+0000","last_fullsized":"2024-09-14T11:56:41.731802+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.731720+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:26.482405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1563,"ondisk_log_size":1563,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":647,"ondisk_log_size":647,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1608537,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17476,"num_read_kb":36987,"num_write":14663,"num_write_kb":11713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701800,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2260,"ondisk_log_size":2260,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3642,"ondisk_log_size":3642,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":41776745,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44044,"num_read_kb":2244679,"num_write":72642,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64241664,"data_stored":64241664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3767,"ondisk_log_size":3767,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174309,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174255,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509964,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271740,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94100100,"statfs":{"total":96636764160,"available":96358502400,"internally_reserved":0,"allocated":10334208,"data_stored":8385962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166396,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205444,"statfs":{"total":96636764160,"available":96466374656,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509963,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110592,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94261248,"statfs":{"total":96636764160,"available":96523517952,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542667,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300316,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94071524,"statfs":{"total":96636764160,"available":96329240576,"internally_reserved":0,"allocated":8335360,"data_stored":6347071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542670,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273604,"kb_used_data":11956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098236,"statfs":{"total":96636764160,"available":96356593664,"internally_reserved":0,"allocated":12242944,"data_stored":10281542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267909575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542668,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98288,"kb_used_data":12960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94273552,"statfs":{"total":96636764160,"available":96536117248,"internally_reserved":0,"allocated":13271040,"data_stored":11361506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542667,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168732,"kb_used_data":11276,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94203108,"statfs":{"total":96636764160,"available":96463982592,"internally_reserved":0,"allocated":11546624,"data_stored":9590010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542666,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279572,"kb_used_data":17924,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94092268,"statfs":{"total":96636764160,"available":96350482432,"internally_reserved":0,"allocated":18354176,"data_stored":16376601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13529088,"data_stored":13529088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7331840,"data_stored":7331840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8024064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:57:04.626 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.626 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.626 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.626 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.626 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.627 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.628 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.629 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.630 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.631 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.632 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.633 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.634 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:29:09.297420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=29, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.635 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.636 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:43.694081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=43, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.636 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.636 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.636 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:46.712917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.638 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.638 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:14:13.136528+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=14, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:04.639 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:57:24.640 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:57:24.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:57:24.986 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:57:24.988 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1566,"stamp":"2024-09-14T11:57:23.944722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43992737,"num_objects":740,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":310307,"num_read_kb":2858305,"num_write":163686,"num_write_kb":2485845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741093,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13177,"ondisk_log_size":13177,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1669240,"kb_used_data":96824,"kb_used_omap":12,"kb_used_meta":1572275,"kb_avail":753305480,"statfs":{"total":773094113280,"available":771384811520,"internally_reserved":0,"allocated":99147776,"data_stored":83483642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1610010160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005394"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.874448+0000","last_change":"2024-09-14T11:57:10.874448+0000","last_active":"2024-09-14T11:57:10.874448+0000","last_peered":"2024-09-14T11:57:10.874448+0000","last_clean":"2024-09-14T11:57:10.874448+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:57:10.874448+0000","last_undegraded":"2024-09-14T11:57:10.874448+0000","last_fullsized":"2024-09-14T11:57:10.874448+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:10.874364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:10.874364+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.874364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:39.697372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.780748+0000","last_change":"2024-09-14T11:57:06.780748+0000","last_active":"2024-09-14T11:57:06.780748+0000","last_peered":"2024-09-14T11:57:06.780748+0000","last_clean":"2024-09-14T11:57:06.780748+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:57:06.780748+0000","last_undegraded":"2024-09-14T11:57:06.780748+0000","last_fullsized":"2024-09-14T11:57:06.780748+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:06.780600+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:06.780600+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.780600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:51.855889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.063650+0000","last_change":"2024-09-14T11:57:12.063650+0000","last_active":"2024-09-14T11:57:12.063650+0000","last_peered":"2024-09-14T11:57:12.063650+0000","last_clean":"2024-09-14T11:57:12.063650+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:57:12.063650+0000","last_undegraded":"2024-09-14T11:57:12.063650+0000","last_fullsized":"2024-09-14T11:57:12.063650+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:12.063558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:12.063558+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.063558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:10.648788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.640970+0000","last_change":"2024-09-14T11:57:04.640970+0000","last_active":"2024-09-14T11:57:04.640970+0000","last_peered":"2024-09-14T11:57:04.640970+0000","last_clean":"2024-09-14T11:57:04.640970+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:57:04.640970+0000","last_undegraded":"2024-09-14T11:57:04.640970+0000","last_fullsized":"2024-09-14T11:57:04.640970+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T11:57:04.640869+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T11:57:04.640869+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.640869+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:28.867490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.930910+0000","last_change":"2024-09-14T11:56:54.930910+0000","last_active":"2024-09-14T11:56:54.930910+0000","last_peered":"2024-09-14T11:56:54.930910+0000","last_clean":"2024-09-14T11:56:54.930910+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:56:54.930910+0000","last_undegraded":"2024-09-14T11:56:54.930910+0000","last_fullsized":"2024-09-14T11:56:54.930910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.930819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:24.220591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.969229+0000","last_change":"2024-09-14T11:57:09.969229+0000","last_active":"2024-09-14T11:57:09.969229+0000","last_peered":"2024-09-14T11:57:09.969229+0000","last_clean":"2024-09-14T11:57:09.969229+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:57:09.969229+0000","last_undegraded":"2024-09-14T11:57:09.969229+0000","last_fullsized":"2024-09-14T11:57:09.969229+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:09.969129+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:09.969129+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.969129+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.586520+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.068350+0000","last_change":"2024-09-14T11:56:56.068350+0000","last_active":"2024-09-14T11:56:56.068350+0000","last_peered":"2024-09-14T11:56:56.068350+0000","last_clean":"2024-09-14T11:56:56.068350+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:56:56.068350+0000","last_undegraded":"2024-09-14T11:56:56.068350+0000","last_fullsized":"2024-09-14T11:56:56.068350+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.068263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:51.903194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.956980+0000","last_change":"2024-09-14T11:56:46.956880+0000","last_active":"2024-09-14T11:56:46.956980+0000","last_peered":"2024-09-14T11:56:46.956980+0000","last_clean":"2024-09-14T11:56:46.956980+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:56:46.956980+0000","last_undegraded":"2024-09-14T11:56:46.956980+0000","last_fullsized":"2024-09-14T11:56:46.956980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.956766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:51.738185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.322815+0000","last_change":"2024-09-14T11:56:59.322815+0000","last_active":"2024-09-14T11:56:59.322815+0000","last_peered":"2024-09-14T11:56:59.322815+0000","last_clean":"2024-09-14T11:56:59.322815+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:56:59.322815+0000","last_undegraded":"2024-09-14T11:56:59.322815+0000","last_fullsized":"2024-09-14T11:56:59.322815+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.322702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:12.249136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.497463+0000","last_change":"2024-09-14T11:57:15.497463+0000","last_active":"2024-09-14T11:57:15.497463+0000","last_peered":"2024-09-14T11:57:15.497463+0000","last_clean":"2024-09-14T11:57:15.497463+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:57:15.497463+0000","last_undegraded":"2024-09-14T11:57:15.497463+0000","last_fullsized":"2024-09-14T11:57:15.497463+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:15.497360+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:15.497360+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.497360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:27.779269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.915023+0000","last_change":"2024-09-14T11:56:49.915023+0000","last_active":"2024-09-14T11:56:49.915023+0000","last_peered":"2024-09-14T11:56:49.915023+0000","last_clean":"2024-09-14T11:56:49.915023+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:56:49.915023+0000","last_undegraded":"2024-09-14T11:56:49.915023+0000","last_fullsized":"2024-09-14T11:56:49.915023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.914938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:12.204381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.621229+0000","last_change":"2024-09-14T11:57:07.621229+0000","last_active":"2024-09-14T11:57:07.621229+0000","last_peered":"2024-09-14T11:57:07.621229+0000","last_clean":"2024-09-14T11:57:07.621229+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:57:07.621229+0000","last_undegraded":"2024-09-14T11:57:07.621229+0000","last_fullsized":"2024-09-14T11:57:07.621229+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-14T11:57:07.621101+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-14T11:57:07.621101+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.621101+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:00.620858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.900067+0000","last_change":"2024-09-14T11:41:15.877117+0000","last_active":"2024-09-14T11:53:24.900067+0000","last_peered":"2024-09-14T11:53:24.900067+0000","last_clean":"2024-09-14T11:53:24.900067+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:53:24.900067+0000","last_undegraded":"2024-09-14T11:53:24.900067+0000","last_fullsized":"2024-09-14T11:53:24.900067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:37.805211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.970113+0000","last_change":"2024-09-14T11:57:17.970113+0000","last_active":"2024-09-14T11:57:17.970113+0000","last_peered":"2024-09-14T11:57:17.970113+0000","last_clean":"2024-09-14T11:57:17.970113+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:57:17.970113+0000","last_undegraded":"2024-09-14T11:57:17.970113+0000","last_fullsized":"2024-09-14T11:57:17.970113+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:57:17.970022+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:57:17.970022+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.970022+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:11.590361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.028896+0000","last_change":"2024-09-14T11:57:05.028896+0000","last_active":"2024-09-14T11:57:05.028896+0000","last_peered":"2024-09-14T11:57:05.028896+0000","last_clean":"2024-09-14T11:57:05.028896+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:57:05.028896+0000","last_undegraded":"2024-09-14T11:57:05.028896+0000","last_fullsized":"2024-09-14T11:57:05.028896+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:05.028795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:05.028795+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.028795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.622172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.128410+0000","last_change":"2024-09-14T11:57:08.128410+0000","last_active":"2024-09-14T11:57:08.128410+0000","last_peered":"2024-09-14T11:57:08.128410+0000","last_clean":"2024-09-14T11:57:08.128410+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:57:08.128410+0000","last_undegraded":"2024-09-14T11:57:08.128410+0000","last_fullsized":"2024-09-14T11:57:08.128410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:57:08.128326+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:57:08.128326+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.128326+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:26.301682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":21,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:19.914868+0000","last_change":"2024-09-14T11:41:15.877065+0000","last_active":"2024-09-14T11:55:19.914868+0000","last_peered":"2024-09-14T11:55:19.914868+0000","last_clean":"2024-09-14T11:55:19.914868+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:55:19.914868+0000","last_undegraded":"2024-09-14T11:55:19.914868+0000","last_fullsized":"2024-09-14T11:55:19.914868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.802906+0000","last_change":"2024-09-14T11:57:07.802906+0000","last_active":"2024-09-14T11:57:07.802906+0000","last_peered":"2024-09-14T11:57:07.802906+0000","last_clean":"2024-09-14T11:57:07.802906+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:57:07.802906+0000","last_undegraded":"2024-09-14T11:57:07.802906+0000","last_fullsized":"2024-09-14T11:57:07.802906+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:07.802804+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:07.802804+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.802804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:40.829736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.550789+0000","last_change":"2024-09-14T11:57:11.550700+0000","last_active":"2024-09-14T11:57:11.550789+0000","last_peered":"2024-09-14T11:57:11.550789+0000","last_clean":"2024-09-14T11:57:11.550789+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:57:11.550789+0000","last_undegraded":"2024-09-14T11:57:11.550789+0000","last_fullsized":"2024-09-14T11:57:11.550789+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:57:11.550582+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:57:11.550582+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.550582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:47.920952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.131668+0000","last_change":"2024-09-14T11:57:06.131668+0000","last_active":"2024-09-14T11:57:06.131668+0000","last_peered":"2024-09-14T11:57:06.131668+0000","last_clean":"2024-09-14T11:57:06.131668+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:57:06.131668+0000","last_undegraded":"2024-09-14T11:57:06.131668+0000","last_fullsized":"2024-09-14T11:57:06.131668+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-14T11:57:06.131560+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-14T11:57:06.131560+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.131560+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:17.950586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.020574+0000","last_change":"2024-09-14T11:57:04.020574+0000","last_active":"2024-09-14T11:57:04.020574+0000","last_peered":"2024-09-14T11:57:04.020574+0000","last_clean":"2024-09-14T11:57:04.020574+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:57:04.020574+0000","last_undegraded":"2024-09-14T11:57:04.020574+0000","last_fullsized":"2024-09-14T11:57:04.020574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.020474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.020474+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.020474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:23.031527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.270094+0000","last_change":"2024-09-14T11:56:56.270094+0000","last_active":"2024-09-14T11:56:56.270094+0000","last_peered":"2024-09-14T11:56:56.270094+0000","last_clean":"2024-09-14T11:56:56.270094+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:56:56.270094+0000","last_undegraded":"2024-09-14T11:56:56.270094+0000","last_fullsized":"2024-09-14T11:56:56.270094+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.270012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:44.058197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.051738+0000","last_change":"2024-09-14T11:57:04.051738+0000","last_active":"2024-09-14T11:57:04.051738+0000","last_peered":"2024-09-14T11:57:04.051738+0000","last_clean":"2024-09-14T11:57:04.051738+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:57:04.051738+0000","last_undegraded":"2024-09-14T11:57:04.051738+0000","last_fullsized":"2024-09-14T11:57:04.051738+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.051640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.051640+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.051640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:11.183614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.175963+0000","last_change":"2024-09-14T11:56:50.175963+0000","last_active":"2024-09-14T11:56:50.175963+0000","last_peered":"2024-09-14T11:56:50.175963+0000","last_clean":"2024-09-14T11:56:50.175963+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:56:50.175963+0000","last_undegraded":"2024-09-14T11:56:50.175963+0000","last_fullsized":"2024-09-14T11:56:50.175963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.175869+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.609485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.505029+0000","last_change":"2024-09-14T11:57:19.505029+0000","last_active":"2024-09-14T11:57:19.505029+0000","last_peered":"2024-09-14T11:57:19.505029+0000","last_clean":"2024-09-14T11:57:19.505029+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:57:19.505029+0000","last_undegraded":"2024-09-14T11:57:19.505029+0000","last_fullsized":"2024-09-14T11:57:19.505029+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:19.504939+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:19.504939+0000","last_clean_scrub_stamp":"2024-09-14T11:57:19.504939+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:15.694865+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.252142+0000","last_change":"2024-09-14T11:56:57.252142+0000","last_active":"2024-09-14T11:56:57.252142+0000","last_peered":"2024-09-14T11:56:57.252142+0000","last_clean":"2024-09-14T11:56:57.252142+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:57.252142+0000","last_undegraded":"2024-09-14T11:56:57.252142+0000","last_fullsized":"2024-09-14T11:56:57.252142+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.252056+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:33.734708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.047074+0000","last_change":"2024-09-14T11:57:03.047074+0000","last_active":"2024-09-14T11:57:03.047074+0000","last_peered":"2024-09-14T11:57:03.047074+0000","last_clean":"2024-09-14T11:57:03.047074+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:57:03.047074+0000","last_undegraded":"2024-09-14T11:57:03.047074+0000","last_fullsized":"2024-09-14T11:57:03.047074+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:03.046986+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:03.046986+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.046986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.408386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.658530+0000","last_change":"2024-09-14T11:57:05.658530+0000","last_active":"2024-09-14T11:57:05.658530+0000","last_peered":"2024-09-14T11:57:05.658530+0000","last_clean":"2024-09-14T11:57:05.658530+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:57:05.658530+0000","last_undegraded":"2024-09-14T11:57:05.658530+0000","last_fullsized":"2024-09-14T11:57:05.658530+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T11:57:05.658462+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T11:57:05.658462+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.658462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:38.731476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.459216+0000","last_change":"2024-09-14T11:57:18.459216+0000","last_active":"2024-09-14T11:57:18.459216+0000","last_peered":"2024-09-14T11:57:18.459216+0000","last_clean":"2024-09-14T11:57:18.459216+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:57:18.459216+0000","last_undegraded":"2024-09-14T11:57:18.459216+0000","last_fullsized":"2024-09-14T11:57:18.459216+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:18.459119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:18.459119+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.459119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:31.698366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.979332+0000","last_change":"2024-09-14T11:57:16.979332+0000","last_active":"2024-09-14T11:57:16.979332+0000","last_peered":"2024-09-14T11:57:16.979332+0000","last_clean":"2024-09-14T11:57:16.979332+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:57:16.979332+0000","last_undegraded":"2024-09-14T11:57:16.979332+0000","last_fullsized":"2024-09-14T11:57:16.979332+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:57:16.979220+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:57:16.979220+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.979220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.912288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17456,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.492188+0000","last_change":"2024-09-14T11:57:14.492188+0000","last_active":"2024-09-14T11:57:14.492188+0000","last_peered":"2024-09-14T11:57:14.492188+0000","last_clean":"2024-09-14T11:57:14.492188+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:57:14.492188+0000","last_undegraded":"2024-09-14T11:57:14.492188+0000","last_fullsized":"2024-09-14T11:57:14.492188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:14.492097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:14.492097+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.492097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:35.249474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.051414+0000","last_change":"2024-09-14T11:56:55.051414+0000","last_active":"2024-09-14T11:56:55.051414+0000","last_peered":"2024-09-14T11:56:55.051414+0000","last_clean":"2024-09-14T11:56:55.051414+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:56:55.051414+0000","last_undegraded":"2024-09-14T11:56:55.051414+0000","last_fullsized":"2024-09-14T11:56:55.051414+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.051327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:05.849317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.013913+0000","last_change":"2024-09-14T11:57:03.013913+0000","last_active":"2024-09-14T11:57:03.013913+0000","last_peered":"2024-09-14T11:57:03.013913+0000","last_clean":"2024-09-14T11:57:03.013913+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:57:03.013913+0000","last_undegraded":"2024-09-14T11:57:03.013913+0000","last_fullsized":"2024-09-14T11:57:03.013913+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:03.013823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:03.013823+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.013823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:59.157431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.981280+0000","last_change":"2024-09-14T11:57:14.981280+0000","last_active":"2024-09-14T11:57:14.981280+0000","last_peered":"2024-09-14T11:57:14.981280+0000","last_clean":"2024-09-14T11:57:14.981280+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:57:14.981280+0000","last_undegraded":"2024-09-14T11:57:14.981280+0000","last_fullsized":"2024-09-14T11:57:14.981280+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:14.981157+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:14.981157+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.981157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:43.335715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.710040+0000","last_change":"2024-09-14T11:57:04.710040+0000","last_active":"2024-09-14T11:57:04.710040+0000","last_peered":"2024-09-14T11:57:04.710040+0000","last_clean":"2024-09-14T11:57:04.710040+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:57:04.710040+0000","last_undegraded":"2024-09-14T11:57:04.710040+0000","last_fullsized":"2024-09-14T11:57:04.710040+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:57:04.709953+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:57:04.709953+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.709953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:20.179480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.687150+0000","last_change":"2024-09-14T11:57:03.687150+0000","last_active":"2024-09-14T11:57:03.687150+0000","last_peered":"2024-09-14T11:57:03.687150+0000","last_clean":"2024-09-14T11:57:03.687150+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:57:03.687150+0000","last_undegraded":"2024-09-14T11:57:03.687150+0000","last_fullsized":"2024-09-14T11:57:03.687150+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:57:03.687070+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:57:03.687070+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.687070+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:49.778239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.914206+0000","last_change":"2024-09-14T11:56:52.914206+0000","last_active":"2024-09-14T11:56:52.914206+0000","last_peered":"2024-09-14T11:56:52.914206+0000","last_clean":"2024-09-14T11:56:52.914206+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:56:52.914206+0000","last_undegraded":"2024-09-14T11:56:52.914206+0000","last_fullsized":"2024-09-14T11:56:52.914206+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.914085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:51.597067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.000039+0000","last_change":"2024-09-14T11:57:14.000039+0000","last_active":"2024-09-14T11:57:14.000039+0000","last_peered":"2024-09-14T11:57:14.000039+0000","last_clean":"2024-09-14T11:57:14.000039+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:57:14.000039+0000","last_undegraded":"2024-09-14T11:57:14.000039+0000","last_fullsized":"2024-09-14T11:57:14.000039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.999948+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:50.336243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.483782+0000","last_change":"2024-09-14T11:57:06.483667+0000","last_active":"2024-09-14T11:57:06.483782+0000","last_peered":"2024-09-14T11:57:06.483782+0000","last_clean":"2024-09-14T11:57:06.483782+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:57:06.483782+0000","last_undegraded":"2024-09-14T11:57:06.483782+0000","last_fullsized":"2024-09-14T11:57:06.483782+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:06.483567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:06.483567+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.483567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:28.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.095046+0000","last_change":"2024-09-14T11:57:05.095046+0000","last_active":"2024-09-14T11:57:05.095046+0000","last_peered":"2024-09-14T11:57:05.095046+0000","last_clean":"2024-09-14T11:57:05.095046+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:57:05.095046+0000","last_undegraded":"2024-09-14T11:57:05.095046+0000","last_fullsized":"2024-09-14T11:57:05.095046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:57:05.094962+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:57:05.094962+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.094962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:08.194097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.453570+0000","last_change":"2024-09-14T11:57:17.453570+0000","last_active":"2024-09-14T11:57:17.453570+0000","last_peered":"2024-09-14T11:57:17.453570+0000","last_clean":"2024-09-14T11:57:17.453570+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:57:17.453570+0000","last_undegraded":"2024-09-14T11:57:17.453570+0000","last_fullsized":"2024-09-14T11:57:17.453570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:17.453471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:17.453471+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.453471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:10.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.947199+0000","last_change":"2024-09-14T11:57:15.947199+0000","last_active":"2024-09-14T11:57:15.947199+0000","last_peered":"2024-09-14T11:57:15.947199+0000","last_clean":"2024-09-14T11:57:15.947199+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:57:15.947199+0000","last_undegraded":"2024-09-14T11:57:15.947199+0000","last_fullsized":"2024-09-14T11:57:15.947199+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:15.947106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:15.947106+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.947106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:40.360937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.869558+0000","last_change":"2024-09-14T11:56:48.869491+0000","last_active":"2024-09-14T11:56:48.869558+0000","last_peered":"2024-09-14T11:56:48.869558+0000","last_clean":"2024-09-14T11:56:48.869558+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:56:48.869558+0000","last_undegraded":"2024-09-14T11:56:48.869558+0000","last_fullsized":"2024-09-14T11:56:48.869558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.869404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:45.392711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.906801+0000","last_change":"2024-09-14T11:56:44.906801+0000","last_active":"2024-09-14T11:56:44.906801+0000","last_peered":"2024-09-14T11:56:44.906801+0000","last_clean":"2024-09-14T11:56:44.906801+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:56:44.906801+0000","last_undegraded":"2024-09-14T11:56:44.906801+0000","last_fullsized":"2024-09-14T11:56:44.906801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.906705+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:43.767361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.861643+0000","last_change":"2024-09-14T11:57:09.861643+0000","last_active":"2024-09-14T11:57:09.861643+0000","last_peered":"2024-09-14T11:57:09.861643+0000","last_clean":"2024-09-14T11:57:09.861643+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:57:09.861643+0000","last_undegraded":"2024-09-14T11:57:09.861643+0000","last_fullsized":"2024-09-14T11:57:09.861643+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.861561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.861561+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.861561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:13.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.018208+0000","last_change":"2024-09-14T11:57:09.018208+0000","last_active":"2024-09-14T11:57:09.018208+0000","last_peered":"2024-09-14T11:57:09.018208+0000","last_clean":"2024-09-14T11:57:09.018208+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:57:09.018208+0000","last_undegraded":"2024-09-14T11:57:09.018208+0000","last_fullsized":"2024-09-14T11:57:09.018208+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.018126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.018126+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.018126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:47.315444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.591938+0000","last_change":"2024-09-14T11:57:08.591832+0000","last_active":"2024-09-14T11:57:08.591938+0000","last_peered":"2024-09-14T11:57:08.591938+0000","last_clean":"2024-09-14T11:57:08.591938+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:57:08.591938+0000","last_undegraded":"2024-09-14T11:57:08.591938+0000","last_fullsized":"2024-09-14T11:57:08.591938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:08.591732+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:08.591732+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.591732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:34.689858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.358514+0000","last_change":"2024-09-14T11:57:00.358443+0000","last_active":"2024-09-14T11:57:00.358514+0000","last_peered":"2024-09-14T11:57:00.358514+0000","last_clean":"2024-09-14T11:57:00.358514+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:57:00.358514+0000","last_undegraded":"2024-09-14T11:57:00.358514+0000","last_fullsized":"2024-09-14T11:57:00.358514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'4","last_scrub_stamp":"2024-09-14T11:57:00.358351+0000","last_deep_scrub":"251'4","last_deep_scrub_stamp":"2024-09-14T11:57:00.358351+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.358351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:59.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.899496+0000","last_change":"2024-09-14T11:41:15.877714+0000","last_active":"2024-09-14T11:53:19.899496+0000","last_peered":"2024-09-14T11:53:19.899496+0000","last_clean":"2024-09-14T11:53:19.899496+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:53:19.899496+0000","last_undegraded":"2024-09-14T11:53:19.899496+0000","last_fullsized":"2024-09-14T11:53:19.899496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.928827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.053836+0000","last_change":"2024-09-14T11:57:01.053836+0000","last_active":"2024-09-14T11:57:01.053836+0000","last_peered":"2024-09-14T11:57:01.053836+0000","last_clean":"2024-09-14T11:57:01.053836+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:57:01.053836+0000","last_undegraded":"2024-09-14T11:57:01.053836+0000","last_fullsized":"2024-09-14T11:57:01.053836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:01.053704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:01.053704+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.053704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:30.489447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.004701+0000","last_change":"2024-09-14T11:57:02.004701+0000","last_active":"2024-09-14T11:57:02.004701+0000","last_peered":"2024-09-14T11:57:02.004701+0000","last_clean":"2024-09-14T11:57:02.004701+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:57:02.004701+0000","last_undegraded":"2024-09-14T11:57:02.004701+0000","last_fullsized":"2024-09-14T11:57:02.004701+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:57:02.004606+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:57:02.004606+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.004606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:10.100431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.395292+0000","last_change":"2024-09-14T11:57:01.395217+0000","last_active":"2024-09-14T11:57:01.395292+0000","last_peered":"2024-09-14T11:57:01.395292+0000","last_clean":"2024-09-14T11:57:01.395292+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:57:01.395292+0000","last_undegraded":"2024-09-14T11:57:01.395292+0000","last_fullsized":"2024-09-14T11:57:01.395292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:01.395134+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:01.395134+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.395134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:28.593249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.485720+0000","last_change":"2024-09-14T11:57:19.485720+0000","last_active":"2024-09-14T11:57:19.485720+0000","last_peered":"2024-09-14T11:57:19.485720+0000","last_clean":"2024-09-14T11:57:19.485720+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:57:19.485720+0000","last_undegraded":"2024-09-14T11:57:19.485720+0000","last_fullsized":"2024-09-14T11:57:19.485720+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:19.485622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:19.485622+0000","last_clean_scrub_stamp":"2024-09-14T11:57:19.485622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.004352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.094951+0000","last_change":"2024-09-14T11:56:58.094951+0000","last_active":"2024-09-14T11:56:58.094951+0000","last_peered":"2024-09-14T11:56:58.094951+0000","last_clean":"2024-09-14T11:56:58.094951+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:56:58.094951+0000","last_undegraded":"2024-09-14T11:56:58.094951+0000","last_fullsized":"2024-09-14T11:56:58.094951+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.094857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:22.727039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.162273+0000","last_change":"2024-09-14T11:57:07.162273+0000","last_active":"2024-09-14T11:57:07.162273+0000","last_peered":"2024-09-14T11:57:07.162273+0000","last_clean":"2024-09-14T11:57:07.162273+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:57:07.162273+0000","last_undegraded":"2024-09-14T11:57:07.162273+0000","last_fullsized":"2024-09-14T11:57:07.162273+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:07.162187+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:07.162187+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.162187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:28.310536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.646330+0000","last_change":"2024-09-14T11:57:02.646236+0000","last_active":"2024-09-14T11:57:02.646330+0000","last_peered":"2024-09-14T11:57:02.646330+0000","last_clean":"2024-09-14T11:57:02.646330+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:57:02.646330+0000","last_undegraded":"2024-09-14T11:57:02.646330+0000","last_fullsized":"2024-09-14T11:57:02.646330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:02.646141+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:02.646141+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.646141+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:33.693607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.897219+0000","last_change":"2024-09-14T11:41:15.867816+0000","last_active":"2024-09-14T11:52:59.897219+0000","last_peered":"2024-09-14T11:52:59.897219+0000","last_clean":"2024-09-14T11:52:59.897219+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:52:59.897219+0000","last_undegraded":"2024-09-14T11:52:59.897219+0000","last_fullsized":"2024-09-14T11:52:59.897219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:38.913430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.070548+0000","last_change":"2024-09-14T11:57:11.070548+0000","last_active":"2024-09-14T11:57:11.070548+0000","last_peered":"2024-09-14T11:57:11.070548+0000","last_clean":"2024-09-14T11:57:11.070548+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:57:11.070548+0000","last_undegraded":"2024-09-14T11:57:11.070548+0000","last_fullsized":"2024-09-14T11:57:11.070548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:11.070461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:11.070461+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.070461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.220080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.263149+0000","last_change":"2024-09-14T11:56:53.263149+0000","last_active":"2024-09-14T11:56:53.263149+0000","last_peered":"2024-09-14T11:56:53.263149+0000","last_clean":"2024-09-14T11:56:53.263149+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:56:53.263149+0000","last_undegraded":"2024-09-14T11:56:53.263149+0000","last_fullsized":"2024-09-14T11:56:53.263149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.263023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.980502+0000","last_change":"2024-09-14T11:56:59.980419+0000","last_active":"2024-09-14T11:56:59.980502+0000","last_peered":"2024-09-14T11:56:59.980502+0000","last_clean":"2024-09-14T11:56:59.980502+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:56:59.980502+0000","last_undegraded":"2024-09-14T11:56:59.980502+0000","last_fullsized":"2024-09-14T11:56:59.980502+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.980335+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:11.344838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.986515+0000","last_change":"2024-09-14T11:57:18.986515+0000","last_active":"2024-09-14T11:57:18.986515+0000","last_peered":"2024-09-14T11:57:18.986515+0000","last_clean":"2024-09-14T11:57:18.986515+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:57:18.986515+0000","last_undegraded":"2024-09-14T11:57:18.986515+0000","last_fullsized":"2024-09-14T11:57:18.986515+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:18.986421+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:18.986421+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.986421+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:27.354616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.283767+0000","last_change":"2024-09-14T11:56:55.283767+0000","last_active":"2024-09-14T11:56:55.283767+0000","last_peered":"2024-09-14T11:56:55.283767+0000","last_clean":"2024-09-14T11:56:55.283767+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:56:55.283767+0000","last_undegraded":"2024-09-14T11:56:55.283767+0000","last_fullsized":"2024-09-14T11:56:55.283767+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.283654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:50.578811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.667212+0000","last_change":"2024-09-14T11:57:03.667212+0000","last_active":"2024-09-14T11:57:03.667212+0000","last_peered":"2024-09-14T11:57:03.667212+0000","last_clean":"2024-09-14T11:57:03.667212+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:57:03.667212+0000","last_undegraded":"2024-09-14T11:57:03.667212+0000","last_fullsized":"2024-09-14T11:57:03.667212+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:03.667127+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:03.667127+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.667127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:10.621565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.038789+0000","last_change":"2024-09-14T11:57:03.038706+0000","last_active":"2024-09-14T11:57:03.038789+0000","last_peered":"2024-09-14T11:57:03.038789+0000","last_clean":"2024-09-14T11:57:03.038789+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:57:03.038789+0000","last_undegraded":"2024-09-14T11:57:03.038789+0000","last_fullsized":"2024-09-14T11:57:03.038789+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:57:03.038596+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:57:03.038596+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.038596+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:21.732593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.944919+0000","last_change":"2024-09-14T11:56:50.944919+0000","last_active":"2024-09-14T11:56:50.944919+0000","last_peered":"2024-09-14T11:56:50.944919+0000","last_clean":"2024-09-14T11:56:50.944919+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:56:50.944919+0000","last_undegraded":"2024-09-14T11:56:50.944919+0000","last_fullsized":"2024-09-14T11:56:50.944919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.944826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.115267+0000","last_change":"2024-09-14T11:57:09.115267+0000","last_active":"2024-09-14T11:57:09.115267+0000","last_peered":"2024-09-14T11:57:09.115267+0000","last_clean":"2024-09-14T11:57:09.115267+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:57:09.115267+0000","last_undegraded":"2024-09-14T11:57:09.115267+0000","last_fullsized":"2024-09-14T11:57:09.115267+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:09.115139+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:09.115139+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.115139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.455712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.504316+0000","last_change":"2024-09-14T11:57:05.504316+0000","last_active":"2024-09-14T11:57:05.504316+0000","last_peered":"2024-09-14T11:57:05.504316+0000","last_clean":"2024-09-14T11:57:05.504316+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:57:05.504316+0000","last_undegraded":"2024-09-14T11:57:05.504316+0000","last_fullsized":"2024-09-14T11:57:05.504316+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:05.504199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:05.504199+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.504199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:54.504015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.053263+0000","last_change":"2024-09-14T11:57:04.053263+0000","last_active":"2024-09-14T11:57:04.053263+0000","last_peered":"2024-09-14T11:57:04.053263+0000","last_clean":"2024-09-14T11:57:04.053263+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:57:04.053263+0000","last_undegraded":"2024-09-14T11:57:04.053263+0000","last_fullsized":"2024-09-14T11:57:04.053263+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:04.053154+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:04.053154+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.053154+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:41.426153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.487277+0000","last_change":"2024-09-14T11:57:14.487277+0000","last_active":"2024-09-14T11:57:14.487277+0000","last_peered":"2024-09-14T11:57:14.487277+0000","last_clean":"2024-09-14T11:57:14.487277+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:57:14.487277+0000","last_undegraded":"2024-09-14T11:57:14.487277+0000","last_fullsized":"2024-09-14T11:57:14.487277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:14.487179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:14.487179+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.487179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.653708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.016403+0000","last_change":"2024-09-14T11:57:13.016403+0000","last_active":"2024-09-14T11:57:13.016403+0000","last_peered":"2024-09-14T11:57:13.016403+0000","last_clean":"2024-09-14T11:57:13.016403+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:57:13.016403+0000","last_undegraded":"2024-09-14T11:57:13.016403+0000","last_fullsized":"2024-09-14T11:57:13.016403+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.016319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.016319+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.016319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.149029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.933625+0000","last_change":"2024-09-14T11:56:51.933625+0000","last_active":"2024-09-14T11:56:51.933625+0000","last_peered":"2024-09-14T11:56:51.933625+0000","last_clean":"2024-09-14T11:56:51.933625+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:56:51.933625+0000","last_undegraded":"2024-09-14T11:56:51.933625+0000","last_fullsized":"2024-09-14T11:56:51.933625+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.933536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:59.991027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.668608+0000","last_change":"2024-09-14T11:57:00.668608+0000","last_active":"2024-09-14T11:57:00.668608+0000","last_peered":"2024-09-14T11:57:00.668608+0000","last_clean":"2024-09-14T11:57:00.668608+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:57:00.668608+0000","last_undegraded":"2024-09-14T11:57:00.668608+0000","last_fullsized":"2024-09-14T11:57:00.668608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.668524+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.185828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.283375+0000","last_change":"2024-09-14T11:56:58.283375+0000","last_active":"2024-09-14T11:56:58.283375+0000","last_peered":"2024-09-14T11:56:58.283375+0000","last_clean":"2024-09-14T11:56:58.283375+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:56:58.283375+0000","last_undegraded":"2024-09-14T11:56:58.283375+0000","last_fullsized":"2024-09-14T11:56:58.283375+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.283290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:10.478240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.090301+0000","last_change":"2024-09-14T11:57:00.090301+0000","last_active":"2024-09-14T11:57:00.090301+0000","last_peered":"2024-09-14T11:57:00.090301+0000","last_clean":"2024-09-14T11:57:00.090301+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:57:00.090301+0000","last_undegraded":"2024-09-14T11:57:00.090301+0000","last_fullsized":"2024-09-14T11:57:00.090301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:00.090217+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:00.090217+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.090217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:11.802130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.582356+0000","last_change":"2024-09-14T11:57:10.582356+0000","last_active":"2024-09-14T11:57:10.582356+0000","last_peered":"2024-09-14T11:57:10.582356+0000","last_clean":"2024-09-14T11:57:10.582356+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:57:10.582356+0000","last_undegraded":"2024-09-14T11:57:10.582356+0000","last_fullsized":"2024-09-14T11:57:10.582356+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:57:10.582255+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:57:10.582255+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.582255+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.270555+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.225945+0000","last_change":"2024-09-14T11:56:51.225945+0000","last_active":"2024-09-14T11:56:51.225945+0000","last_peered":"2024-09-14T11:56:51.225945+0000","last_clean":"2024-09-14T11:56:51.225945+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:56:51.225945+0000","last_undegraded":"2024-09-14T11:56:51.225945+0000","last_fullsized":"2024-09-14T11:56:51.225945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.225829+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:16.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.450114+0000","last_change":"2024-09-14T11:57:13.450114+0000","last_active":"2024-09-14T11:57:13.450114+0000","last_peered":"2024-09-14T11:57:13.450114+0000","last_clean":"2024-09-14T11:57:13.450114+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:57:13.450114+0000","last_undegraded":"2024-09-14T11:57:13.450114+0000","last_fullsized":"2024-09-14T11:57:13.450114+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.450011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.450011+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.450011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:38.282195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.113053+0000","last_change":"2024-09-14T11:57:10.113053+0000","last_active":"2024-09-14T11:57:10.113053+0000","last_peered":"2024-09-14T11:57:10.113053+0000","last_clean":"2024-09-14T11:57:10.113053+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:57:10.113053+0000","last_undegraded":"2024-09-14T11:57:10.113053+0000","last_fullsized":"2024-09-14T11:57:10.113053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:10.112952+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:10.112952+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.112952+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:23.351432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.013241+0000","last_change":"2024-09-14T11:56:53.013241+0000","last_active":"2024-09-14T11:56:53.013241+0000","last_peered":"2024-09-14T11:56:53.013241+0000","last_clean":"2024-09-14T11:56:53.013241+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:56:53.013241+0000","last_undegraded":"2024-09-14T11:56:53.013241+0000","last_fullsized":"2024-09-14T11:56:53.013241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.013141+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.047147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.946131+0000","last_change":"2024-09-14T11:56:45.946131+0000","last_active":"2024-09-14T11:56:45.946131+0000","last_peered":"2024-09-14T11:56:45.946131+0000","last_clean":"2024-09-14T11:56:45.946131+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:56:45.946131+0000","last_undegraded":"2024-09-14T11:56:45.946131+0000","last_fullsized":"2024-09-14T11:56:45.946131+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.946047+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:05.117515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.910049+0000","last_change":"2024-09-14T11:41:15.876434+0000","last_active":"2024-09-14T11:54:44.910049+0000","last_peered":"2024-09-14T11:54:44.910049+0000","last_clean":"2024-09-14T11:54:44.910049+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:54:44.910049+0000","last_undegraded":"2024-09-14T11:54:44.910049+0000","last_fullsized":"2024-09-14T11:54:44.910049+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:41:14.844664+0000","last_clean_scrub_stamp":"2024-09-14T11:41:14.844664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.996131+0000","last_change":"2024-09-14T11:57:06.996131+0000","last_active":"2024-09-14T11:57:06.996131+0000","last_peered":"2024-09-14T11:57:06.996131+0000","last_clean":"2024-09-14T11:57:06.996131+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:57:06.996131+0000","last_undegraded":"2024-09-14T11:57:06.996131+0000","last_fullsized":"2024-09-14T11:57:06.996131+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:57:06.996042+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:57:06.996042+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.996042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:41.361438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.639260+0000","last_change":"2024-09-14T11:57:06.639260+0000","last_active":"2024-09-14T11:57:06.639260+0000","last_peered":"2024-09-14T11:57:06.639260+0000","last_clean":"2024-09-14T11:57:06.639260+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:57:06.639260+0000","last_undegraded":"2024-09-14T11:57:06.639260+0000","last_fullsized":"2024-09-14T11:57:06.639260+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:06.639169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:06.639169+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.639169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:42.256373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.717550+0000","last_change":"2024-09-14T11:57:00.717550+0000","last_active":"2024-09-14T11:57:00.717550+0000","last_peered":"2024-09-14T11:57:00.717550+0000","last_clean":"2024-09-14T11:57:00.717550+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:57:00.717550+0000","last_undegraded":"2024-09-14T11:57:00.717550+0000","last_fullsized":"2024-09-14T11:57:00.717550+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:57:00.717455+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:57:00.717455+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.717455+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:33.056621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.468325+0000","last_change":"2024-09-14T11:57:16.468325+0000","last_active":"2024-09-14T11:57:16.468325+0000","last_peered":"2024-09-14T11:57:16.468325+0000","last_clean":"2024-09-14T11:57:16.468325+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:57:16.468325+0000","last_undegraded":"2024-09-14T11:57:16.468325+0000","last_fullsized":"2024-09-14T11:57:16.468325+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:16.468225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:16.468225+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.468225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:26.508246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.450693+0000","last_change":"2024-09-14T11:57:10.450693+0000","last_active":"2024-09-14T11:57:10.450693+0000","last_peered":"2024-09-14T11:57:10.450693+0000","last_clean":"2024-09-14T11:57:10.450693+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:57:10.450693+0000","last_undegraded":"2024-09-14T11:57:10.450693+0000","last_fullsized":"2024-09-14T11:57:10.450693+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:10.450590+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:10.450590+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.450590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.457760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.045891+0000","last_change":"2024-09-14T11:56:54.045891+0000","last_active":"2024-09-14T11:56:54.045891+0000","last_peered":"2024-09-14T11:56:54.045891+0000","last_clean":"2024-09-14T11:56:54.045891+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:56:54.045891+0000","last_undegraded":"2024-09-14T11:56:54.045891+0000","last_fullsized":"2024-09-14T11:56:54.045891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.045797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:35.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":179,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.374906+0000","last_change":"2024-09-14T11:56:58.374906+0000","last_active":"2024-09-14T11:56:58.374906+0000","last_peered":"2024-09-14T11:56:58.374906+0000","last_clean":"2024-09-14T11:56:58.374906+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:56:58.374906+0000","last_undegraded":"2024-09-14T11:56:58.374906+0000","last_fullsized":"2024-09-14T11:56:58.374906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.374822+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:02.736281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.482616+0000","last_change":"2024-09-14T11:57:15.482616+0000","last_active":"2024-09-14T11:57:15.482616+0000","last_peered":"2024-09-14T11:57:15.482616+0000","last_clean":"2024-09-14T11:57:15.482616+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:57:15.482616+0000","last_undegraded":"2024-09-14T11:57:15.482616+0000","last_fullsized":"2024-09-14T11:57:15.482616+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:15.482528+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:15.482528+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.482528+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:08.023703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.057742+0000","last_change":"2024-09-14T11:56:57.057742+0000","last_active":"2024-09-14T11:56:57.057742+0000","last_peered":"2024-09-14T11:56:57.057742+0000","last_clean":"2024-09-14T11:56:57.057742+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:56:57.057742+0000","last_undegraded":"2024-09-14T11:56:57.057742+0000","last_fullsized":"2024-09-14T11:56:57.057742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.057651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:43.123811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.591935+0000","last_change":"2024-09-14T11:57:09.591935+0000","last_active":"2024-09-14T11:57:09.591935+0000","last_peered":"2024-09-14T11:57:09.591935+0000","last_clean":"2024-09-14T11:57:09.591935+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:57:09.591935+0000","last_undegraded":"2024-09-14T11:57:09.591935+0000","last_fullsized":"2024-09-14T11:57:09.591935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:09.591838+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:09.591838+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.591838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:05.006842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.069124+0000","last_change":"2024-09-14T11:57:02.069065+0000","last_active":"2024-09-14T11:57:02.069124+0000","last_peered":"2024-09-14T11:57:02.069124+0000","last_clean":"2024-09-14T11:57:02.069124+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:57:02.069124+0000","last_undegraded":"2024-09-14T11:57:02.069124+0000","last_fullsized":"2024-09-14T11:57:02.069124+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:57:02.068979+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:57:02.068979+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.068979+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:41.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.480503+0000","last_change":"2024-09-14T11:57:18.480503+0000","last_active":"2024-09-14T11:57:18.480503+0000","last_peered":"2024-09-14T11:57:18.480503+0000","last_clean":"2024-09-14T11:57:18.480503+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:57:18.480503+0000","last_undegraded":"2024-09-14T11:57:18.480503+0000","last_fullsized":"2024-09-14T11:57:18.480503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:18.480414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:18.480414+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.480414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:05.772829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.400944+0000","last_change":"2024-09-14T11:57:09.400944+0000","last_active":"2024-09-14T11:57:09.400944+0000","last_peered":"2024-09-14T11:57:09.400944+0000","last_clean":"2024-09-14T11:57:09.400944+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:57:09.400944+0000","last_undegraded":"2024-09-14T11:57:09.400944+0000","last_fullsized":"2024-09-14T11:57:09.400944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.400856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.400856+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.400856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:16.556288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.966020+0000","last_change":"2024-09-14T11:57:00.966020+0000","last_active":"2024-09-14T11:57:00.966020+0000","last_peered":"2024-09-14T11:57:00.966020+0000","last_clean":"2024-09-14T11:57:00.966020+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:57:00.966020+0000","last_undegraded":"2024-09-14T11:57:00.966020+0000","last_fullsized":"2024-09-14T11:57:00.966020+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:57:00.965937+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:57:00.965937+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.965937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:50.557729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.132995+0000","last_change":"2024-09-14T11:56:49.132901+0000","last_active":"2024-09-14T11:56:49.132995+0000","last_peered":"2024-09-14T11:56:49.132995+0000","last_clean":"2024-09-14T11:56:49.132995+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:56:49.132995+0000","last_undegraded":"2024-09-14T11:56:49.132995+0000","last_fullsized":"2024-09-14T11:56:49.132995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.132808+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:18.076133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.415739+0000","last_change":"2024-09-14T11:57:11.415739+0000","last_active":"2024-09-14T11:57:11.415739+0000","last_peered":"2024-09-14T11:57:11.415739+0000","last_clean":"2024-09-14T11:57:11.415739+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:57:11.415739+0000","last_undegraded":"2024-09-14T11:57:11.415739+0000","last_fullsized":"2024-09-14T11:57:11.415739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:11.415636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:11.415636+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.415636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:15.987476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.508826+0000","last_change":"2024-09-14T11:57:12.508826+0000","last_active":"2024-09-14T11:57:12.508826+0000","last_peered":"2024-09-14T11:57:12.508826+0000","last_clean":"2024-09-14T11:57:12.508826+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:57:12.508826+0000","last_undegraded":"2024-09-14T11:57:12.508826+0000","last_fullsized":"2024-09-14T11:57:12.508826+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:12.508724+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:12.508724+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.508724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:37.452554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.440763+0000","last_change":"2024-09-14T11:57:03.440763+0000","last_active":"2024-09-14T11:57:03.440763+0000","last_peered":"2024-09-14T11:57:03.440763+0000","last_clean":"2024-09-14T11:57:03.440763+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:57:03.440763+0000","last_undegraded":"2024-09-14T11:57:03.440763+0000","last_fullsized":"2024-09-14T11:57:03.440763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:03.440660+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:03.440660+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.440660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.426625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.692157+0000","last_change":"2024-09-14T11:57:01.692086+0000","last_active":"2024-09-14T11:57:01.692157+0000","last_peered":"2024-09-14T11:57:01.692157+0000","last_clean":"2024-09-14T11:57:01.692157+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:57:01.692157+0000","last_undegraded":"2024-09-14T11:57:01.692157+0000","last_fullsized":"2024-09-14T11:57:01.692157+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:57:01.692002+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:57:01.692002+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.692002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:09.233252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.835671+0000","last_change":"2024-09-14T11:57:08.835671+0000","last_active":"2024-09-14T11:57:08.835671+0000","last_peered":"2024-09-14T11:57:08.835671+0000","last_clean":"2024-09-14T11:57:08.835671+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:57:08.835671+0000","last_undegraded":"2024-09-14T11:57:08.835671+0000","last_fullsized":"2024-09-14T11:57:08.835671+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:08.835583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:08.835583+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.835583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:21.433249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.505956+0000","last_change":"2024-09-14T11:57:13.505956+0000","last_active":"2024-09-14T11:57:13.505956+0000","last_peered":"2024-09-14T11:57:13.505956+0000","last_clean":"2024-09-14T11:57:13.505956+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:57:13.505956+0000","last_undegraded":"2024-09-14T11:57:13.505956+0000","last_fullsized":"2024-09-14T11:57:13.505956+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.505842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.505842+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.505842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:08.726873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.913761+0000","last_change":"2024-09-14T11:56:47.913761+0000","last_active":"2024-09-14T11:56:47.913761+0000","last_peered":"2024-09-14T11:56:47.913761+0000","last_clean":"2024-09-14T11:56:47.913761+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:56:47.913761+0000","last_undegraded":"2024-09-14T11:56:47.913761+0000","last_fullsized":"2024-09-14T11:56:47.913761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.913640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:12.325543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.144187+0000","last_change":"2024-09-14T11:56:48.144132+0000","last_active":"2024-09-14T11:56:48.144187+0000","last_peered":"2024-09-14T11:56:48.144187+0000","last_clean":"2024-09-14T11:56:48.144187+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:56:48.144187+0000","last_undegraded":"2024-09-14T11:56:48.144187+0000","last_fullsized":"2024-09-14T11:56:48.144187+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.144046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:55.137350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.041527+0000","last_change":"2024-09-14T11:57:02.041438+0000","last_active":"2024-09-14T11:57:02.041527+0000","last_peered":"2024-09-14T11:57:02.041527+0000","last_clean":"2024-09-14T11:57:02.041527+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:57:02.041527+0000","last_undegraded":"2024-09-14T11:57:02.041527+0000","last_fullsized":"2024-09-14T11:57:02.041527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:02.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:02.041303+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:22.240923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.448566+0000","last_change":"2024-09-14T11:57:08.448566+0000","last_active":"2024-09-14T11:57:08.448566+0000","last_peered":"2024-09-14T11:57:08.448566+0000","last_clean":"2024-09-14T11:57:08.448566+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:57:08.448566+0000","last_undegraded":"2024-09-14T11:57:08.448566+0000","last_fullsized":"2024-09-14T11:57:08.448566+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:08.448470+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:08.448470+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.448470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:35.742467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.663495+0000","last_change":"2024-09-14T11:57:02.663495+0000","last_active":"2024-09-14T11:57:02.663495+0000","last_peered":"2024-09-14T11:57:02.663495+0000","last_clean":"2024-09-14T11:57:02.663495+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:57:02.663495+0000","last_undegraded":"2024-09-14T11:57:02.663495+0000","last_fullsized":"2024-09-14T11:57:02.663495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:57:02.663409+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:57:02.663409+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.663409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:14.457039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.334999+0000","last_change":"2024-09-14T11:56:57.334999+0000","last_active":"2024-09-14T11:56:57.334999+0000","last_peered":"2024-09-14T11:56:57.334999+0000","last_clean":"2024-09-14T11:56:57.334999+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:56:57.334999+0000","last_undegraded":"2024-09-14T11:56:57.334999+0000","last_fullsized":"2024-09-14T11:56:57.334999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.334915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.592191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.937325+0000","last_change":"2024-09-14T11:57:10.937325+0000","last_active":"2024-09-14T11:57:10.937325+0000","last_peered":"2024-09-14T11:57:10.937325+0000","last_clean":"2024-09-14T11:57:10.937325+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:57:10.937325+0000","last_undegraded":"2024-09-14T11:57:10.937325+0000","last_fullsized":"2024-09-14T11:57:10.937325+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:10.937245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:10.937245+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.937245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:36.577749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.980193+0000","last_change":"2024-09-14T11:57:07.980193+0000","last_active":"2024-09-14T11:57:07.980193+0000","last_peered":"2024-09-14T11:57:07.980193+0000","last_clean":"2024-09-14T11:57:07.980193+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:57:07.980193+0000","last_undegraded":"2024-09-14T11:57:07.980193+0000","last_fullsized":"2024-09-14T11:57:07.980193+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:07.980052+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:07.980052+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.980052+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:57.197935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.454366+0000","last_change":"2024-09-14T11:57:04.454366+0000","last_active":"2024-09-14T11:57:04.454366+0000","last_peered":"2024-09-14T11:57:04.454366+0000","last_clean":"2024-09-14T11:57:04.454366+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:57:04.454366+0000","last_undegraded":"2024-09-14T11:57:04.454366+0000","last_fullsized":"2024-09-14T11:57:04.454366+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.454265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.454265+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.454265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.151908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.984107+0000","last_change":"2024-09-14T11:56:50.984107+0000","last_active":"2024-09-14T11:56:50.984107+0000","last_peered":"2024-09-14T11:56:50.984107+0000","last_clean":"2024-09-14T11:56:50.984107+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:56:50.984107+0000","last_undegraded":"2024-09-14T11:56:50.984107+0000","last_fullsized":"2024-09-14T11:56:50.984107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.984030+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:46.373826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.885109+0000","last_change":"2024-09-14T11:56:53.885109+0000","last_active":"2024-09-14T11:56:53.885109+0000","last_peered":"2024-09-14T11:56:53.885109+0000","last_clean":"2024-09-14T11:56:53.885109+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:56:53.885109+0000","last_undegraded":"2024-09-14T11:56:53.885109+0000","last_fullsized":"2024-09-14T11:56:53.885109+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.885011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:38.040674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.112834+0000","last_change":"2024-09-14T11:56:59.112834+0000","last_active":"2024-09-14T11:56:59.112834+0000","last_peered":"2024-09-14T11:56:59.112834+0000","last_clean":"2024-09-14T11:56:59.112834+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:56:59.112834+0000","last_undegraded":"2024-09-14T11:56:59.112834+0000","last_fullsized":"2024-09-14T11:56:59.112834+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.112741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:05.850721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.457354+0000","last_change":"2024-09-14T11:57:07.457354+0000","last_active":"2024-09-14T11:57:07.457354+0000","last_peered":"2024-09-14T11:57:07.457354+0000","last_clean":"2024-09-14T11:57:07.457354+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:57:07.457354+0000","last_undegraded":"2024-09-14T11:57:07.457354+0000","last_fullsized":"2024-09-14T11:57:07.457354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:07.457262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:07.457262+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.457262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.652237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.671280+0000","last_change":"2024-09-14T11:57:01.671280+0000","last_active":"2024-09-14T11:57:01.671280+0000","last_peered":"2024-09-14T11:57:01.671280+0000","last_clean":"2024-09-14T11:57:01.671280+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:57:01.671280+0000","last_undegraded":"2024-09-14T11:57:01.671280+0000","last_fullsized":"2024-09-14T11:57:01.671280+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:57:01.671202+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:57:01.671202+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.671202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:56.164844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.479092+0000","last_change":"2024-09-14T11:57:17.479092+0000","last_active":"2024-09-14T11:57:17.479092+0000","last_peered":"2024-09-14T11:57:17.479092+0000","last_clean":"2024-09-14T11:57:17.479092+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:57:17.479092+0000","last_undegraded":"2024-09-14T11:57:17.479092+0000","last_fullsized":"2024-09-14T11:57:17.479092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:17.479000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:17.479000+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.479000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:27.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.750401+0000","last_change":"2024-09-14T11:57:05.750401+0000","last_active":"2024-09-14T11:57:05.750401+0000","last_peered":"2024-09-14T11:57:05.750401+0000","last_clean":"2024-09-14T11:57:05.750401+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:57:05.750401+0000","last_undegraded":"2024-09-14T11:57:05.750401+0000","last_fullsized":"2024-09-14T11:57:05.750401+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:05.750321+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:05.750321+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.750321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:01.997392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.414830+0000","last_change":"2024-09-14T11:57:02.414830+0000","last_active":"2024-09-14T11:57:02.414830+0000","last_peered":"2024-09-14T11:57:02.414830+0000","last_clean":"2024-09-14T11:57:02.414830+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:57:02.414830+0000","last_undegraded":"2024-09-14T11:57:02.414830+0000","last_fullsized":"2024-09-14T11:57:02.414830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:02.414741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:02.414741+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.414741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.691386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.967461+0000","last_change":"2024-09-14T11:56:58.967461+0000","last_active":"2024-09-14T11:56:58.967461+0000","last_peered":"2024-09-14T11:56:58.967461+0000","last_clean":"2024-09-14T11:56:58.967461+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:56:58.967461+0000","last_undegraded":"2024-09-14T11:56:58.967461+0000","last_fullsized":"2024-09-14T11:56:58.967461+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.967365+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:06.574227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.486318+0000","last_change":"2024-09-14T11:57:16.486318+0000","last_active":"2024-09-14T11:57:16.486318+0000","last_peered":"2024-09-14T11:57:16.486318+0000","last_clean":"2024-09-14T11:57:16.486318+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:57:16.486318+0000","last_undegraded":"2024-09-14T11:57:16.486318+0000","last_fullsized":"2024-09-14T11:57:16.486318+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:16.486225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:16.486225+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.486225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:52.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.275179+0000","last_change":"2024-09-14T11:56:54.275179+0000","last_active":"2024-09-14T11:56:54.275179+0000","last_peered":"2024-09-14T11:56:54.275179+0000","last_clean":"2024-09-14T11:56:54.275179+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:56:54.275179+0000","last_undegraded":"2024-09-14T11:56:54.275179+0000","last_fullsized":"2024-09-14T11:56:54.275179+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.275052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:27.168851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'11","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.995693+0000","last_change":"2024-09-14T11:56:51.995693+0000","last_active":"2024-09-14T11:56:51.995693+0000","last_peered":"2024-09-14T11:56:51.995693+0000","last_clean":"2024-09-14T11:56:51.995693+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:56:51.995693+0000","last_undegraded":"2024-09-14T11:56:51.995693+0000","last_fullsized":"2024-09-14T11:56:51.995693+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.995590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:12.438738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.189319+0000","last_change":"2024-09-14T11:56:47.189319+0000","last_active":"2024-09-14T11:56:47.189319+0000","last_peered":"2024-09-14T11:56:47.189319+0000","last_clean":"2024-09-14T11:56:47.189319+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:56:47.189319+0000","last_undegraded":"2024-09-14T11:56:47.189319+0000","last_fullsized":"2024-09-14T11:56:47.189319+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.189227+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:38.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.449013+0000","last_change":"2024-09-14T11:57:12.449013+0000","last_active":"2024-09-14T11:57:12.449013+0000","last_peered":"2024-09-14T11:57:12.449013+0000","last_clean":"2024-09-14T11:57:12.449013+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:57:12.449013+0000","last_undegraded":"2024-09-14T11:57:12.449013+0000","last_fullsized":"2024-09-14T11:57:12.449013+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:12.448918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:12.448918+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.448918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:24.545838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.040203+0000","last_change":"2024-09-14T11:57:06.040203+0000","last_active":"2024-09-14T11:57:06.040203+0000","last_peered":"2024-09-14T11:57:06.040203+0000","last_clean":"2024-09-14T11:57:06.040203+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:57:06.040203+0000","last_undegraded":"2024-09-14T11:57:06.040203+0000","last_fullsized":"2024-09-14T11:57:06.040203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:06.040103+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:06.040103+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.040103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:00.771691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.249115+0000","last_change":"2024-09-14T11:56:52.249115+0000","last_active":"2024-09-14T11:56:52.249115+0000","last_peered":"2024-09-14T11:56:52.249115+0000","last_clean":"2024-09-14T11:56:52.249115+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:56:52.249115+0000","last_undegraded":"2024-09-14T11:56:52.249115+0000","last_fullsized":"2024-09-14T11:56:52.249115+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.249025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:41.425368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.353189+0000","last_change":"2024-09-14T11:56:59.353130+0000","last_active":"2024-09-14T11:56:59.353189+0000","last_peered":"2024-09-14T11:56:59.353189+0000","last_clean":"2024-09-14T11:56:59.353189+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:56:59.353189+0000","last_undegraded":"2024-09-14T11:56:59.353189+0000","last_fullsized":"2024-09-14T11:56:59.353189+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.353042+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.218284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'328","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.457995+0000","last_change":"2024-09-14T11:56:32.457995+0000","last_active":"2024-09-14T11:56:32.457995+0000","last_peered":"2024-09-14T11:56:32.457995+0000","last_clean":"2024-09-14T11:56:32.457995+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:32.457995+0000","last_undegraded":"2024-09-14T11:56:32.457995+0000","last_fullsized":"2024-09-14T11:56:32.457995+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.457886+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:42.457035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":2359,"num_write":1145,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1593","reported_seq":3387,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.733167+0000","last_change":"2024-09-14T11:56:40.733167+0000","last_active":"2024-09-14T11:56:40.733167+0000","last_peered":"2024-09-14T11:56:40.733167+0000","last_clean":"2024-09-14T11:56:40.733167+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:56:40.733167+0000","last_undegraded":"2024-09-14T11:56:40.733167+0000","last_fullsized":"2024-09-14T11:56:40.733167+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1593","last_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_deep_scrub":"263'1593","last_deep_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.733084+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.184612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'344","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.843948+0000","last_change":"2024-09-14T11:56:25.843948+0000","last_active":"2024-09-14T11:56:25.843948+0000","last_peered":"2024-09-14T11:56:25.843948+0000","last_clean":"2024-09-14T11:56:25.843948+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:25.843948+0000","last_undegraded":"2024-09-14T11:56:25.843948+0000","last_fullsized":"2024-09-14T11:56:25.843948+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.843781+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:39.876965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":643,"num_read_kb":6703,"num_write":1183,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'563","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.583527+0000","last_change":"2024-09-14T11:56:39.583472+0000","last_active":"2024-09-14T11:56:39.583527+0000","last_peered":"2024-09-14T11:56:39.583527+0000","last_clean":"2024-09-14T11:56:39.583527+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:56:39.583527+0000","last_undegraded":"2024-09-14T11:56:39.583527+0000","last_fullsized":"2024-09-14T11:56:39.583527+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'563","last_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_deep_scrub":"263'563","last_deep_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.583358+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.041135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'350","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.490371+0000","last_change":"2024-09-14T11:56:29.490371+0000","last_active":"2024-09-14T11:56:29.490371+0000","last_peered":"2024-09-14T11:56:29.490371+0000","last_clean":"2024-09-14T11:56:29.490371+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:29.490371+0000","last_undegraded":"2024-09-14T11:56:29.490371+0000","last_fullsized":"2024-09-14T11:56:29.490371+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.490240+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:19.905307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":11794,"num_write":1143,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'481","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.761132+0000","last_change":"2024-09-14T11:56:40.761132+0000","last_active":"2024-09-14T11:56:40.761132+0000","last_peered":"2024-09-14T11:56:40.761132+0000","last_clean":"2024-09-14T11:56:40.761132+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:56:40.761132+0000","last_undegraded":"2024-09-14T11:56:40.761132+0000","last_fullsized":"2024-09-14T11:56:40.761132+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.761000+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:10.670888+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.751856+0000","last_change":"2024-09-14T11:56:37.751856+0000","last_active":"2024-09-14T11:56:37.751856+0000","last_peered":"2024-09-14T11:56:37.751856+0000","last_clean":"2024-09-14T11:56:37.751856+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:37.751856+0000","last_undegraded":"2024-09-14T11:56:37.751856+0000","last_fullsized":"2024-09-14T11:56:37.751856+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.751721+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:52.423497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1061","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.655563+0000","last_change":"2024-09-14T11:56:38.655504+0000","last_active":"2024-09-14T11:56:38.655563+0000","last_peered":"2024-09-14T11:56:38.655563+0000","last_clean":"2024-09-14T11:56:38.655563+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:56:38.655563+0000","last_undegraded":"2024-09-14T11:56:38.655563+0000","last_fullsized":"2024-09-14T11:56:38.655563+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1061","last_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_deep_scrub":"263'1061","last_deep_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.655414+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:06.267363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'351","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.566767+0000","last_change":"2024-09-14T11:56:37.566767+0000","last_active":"2024-09-14T11:56:37.566767+0000","last_peered":"2024-09-14T11:56:37.566767+0000","last_clean":"2024-09-14T11:56:37.566767+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:37.566767+0000","last_undegraded":"2024-09-14T11:56:37.566767+0000","last_fullsized":"2024-09-14T11:56:37.566767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.566631+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:27.502397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":626,"num_read_kb":64951,"num_write":1173,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'466","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.235997+0000","last_change":"2024-09-14T11:56:34.235997+0000","last_active":"2024-09-14T11:56:34.235997+0000","last_peered":"2024-09-14T11:56:34.235997+0000","last_clean":"2024-09-14T11:56:34.235997+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:56:34.235997+0000","last_undegraded":"2024-09-14T11:56:34.235997+0000","last_fullsized":"2024-09-14T11:56:34.235997+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.235902+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:32.784865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.776617+0000","last_change":"2024-09-14T11:56:34.776532+0000","last_active":"2024-09-14T11:56:34.776617+0000","last_peered":"2024-09-14T11:56:34.776617+0000","last_clean":"2024-09-14T11:56:34.776617+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:34.776617+0000","last_undegraded":"2024-09-14T11:56:34.776617+0000","last_fullsized":"2024-09-14T11:56:34.776617+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.776385+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.314618+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'803","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.817046+0000","last_change":"2024-09-14T11:56:42.817046+0000","last_active":"2024-09-14T11:56:42.817046+0000","last_peered":"2024-09-14T11:56:42.817046+0000","last_clean":"2024-09-14T11:56:42.817046+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:56:42.817046+0000","last_undegraded":"2024-09-14T11:56:42.817046+0000","last_fullsized":"2024-09-14T11:56:42.817046+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.816954+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:54.466437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'298","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.494965+0000","last_change":"2024-09-14T11:56:31.494896+0000","last_active":"2024-09-14T11:56:31.494965+0000","last_peered":"2024-09-14T11:56:31.494965+0000","last_clean":"2024-09-14T11:56:31.494965+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:31.494965+0000","last_undegraded":"2024-09-14T11:56:31.494965+0000","last_fullsized":"2024-09-14T11:56:31.494965+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.494814+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:22.737796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":10089,"num_write":838,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'972","reported_seq":2716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.682691+0000","last_change":"2024-09-14T11:56:43.682691+0000","last_active":"2024-09-14T11:56:43.682691+0000","last_peered":"2024-09-14T11:56:43.682691+0000","last_clean":"2024-09-14T11:56:43.682691+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:56:43.682691+0000","last_undegraded":"2024-09-14T11:56:43.682691+0000","last_fullsized":"2024-09-14T11:56:43.682691+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.682597+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:06.195336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3830,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'304","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.076723+0000","last_change":"2024-09-14T11:56:31.076616+0000","last_active":"2024-09-14T11:56:31.076723+0000","last_peered":"2024-09-14T11:56:31.076723+0000","last_clean":"2024-09-14T11:56:31.076723+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:31.076723+0000","last_undegraded":"2024-09-14T11:56:31.076723+0000","last_fullsized":"2024-09-14T11:56:31.076723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.076451+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:08.379985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":712,"num_read_kb":31980,"num_write":1004,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'457","reported_seq":1989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.852513+0000","last_change":"2024-09-14T11:56:30.852513+0000","last_active":"2024-09-14T11:56:30.852513+0000","last_peered":"2024-09-14T11:56:30.852513+0000","last_clean":"2024-09-14T11:56:30.852513+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:56:30.852513+0000","last_undegraded":"2024-09-14T11:56:30.852513+0000","last_fullsized":"2024-09-14T11:56:30.852513+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.852429+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:32.993438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'844","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.751896+0000","last_change":"2024-09-14T11:56:38.751896+0000","last_active":"2024-09-14T11:56:38.751896+0000","last_peered":"2024-09-14T11:56:38.751896+0000","last_clean":"2024-09-14T11:56:38.751896+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:56:38.751896+0000","last_undegraded":"2024-09-14T11:56:38.751896+0000","last_fullsized":"2024-09-14T11:56:38.751896+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'844","last_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_deep_scrub":"263'844","last_deep_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.751800+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:31.522430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.518468+0000","last_change":"2024-09-14T11:56:29.518468+0000","last_active":"2024-09-14T11:56:29.518468+0000","last_peered":"2024-09-14T11:56:29.518468+0000","last_clean":"2024-09-14T11:56:29.518468+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:29.518468+0000","last_undegraded":"2024-09-14T11:56:29.518468+0000","last_fullsized":"2024-09-14T11:56:29.518468+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.518308+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:50.599905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":694,"num_read_kb":5626,"num_write":1163,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1035","reported_seq":2968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.559633+0000","last_change":"2024-09-14T11:56:38.559633+0000","last_active":"2024-09-14T11:56:38.559633+0000","last_peered":"2024-09-14T11:56:38.559633+0000","last_clean":"2024-09-14T11:56:38.559633+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:56:38.559633+0000","last_undegraded":"2024-09-14T11:56:38.559633+0000","last_fullsized":"2024-09-14T11:56:38.559633+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1035","last_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_deep_scrub":"263'1035","last_deep_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.559545+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:59.274734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.210958+0000","last_change":"2024-09-14T11:56:28.210958+0000","last_active":"2024-09-14T11:56:28.210958+0000","last_peered":"2024-09-14T11:56:28.210958+0000","last_clean":"2024-09-14T11:56:28.210958+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:28.210958+0000","last_undegraded":"2024-09-14T11:56:28.210958+0000","last_fullsized":"2024-09-14T11:56:28.210958+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.210845+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:07.178497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.732926+0000","last_change":"2024-09-14T11:56:39.732926+0000","last_active":"2024-09-14T11:56:39.732926+0000","last_peered":"2024-09-14T11:56:39.732926+0000","last_clean":"2024-09-14T11:56:39.732926+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:56:39.732926+0000","last_undegraded":"2024-09-14T11:56:39.732926+0000","last_fullsized":"2024-09-14T11:56:39.732926+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.732833+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:56.461549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.221091+0000","last_change":"2024-09-14T11:56:29.221091+0000","last_active":"2024-09-14T11:56:29.221091+0000","last_peered":"2024-09-14T11:56:29.221091+0000","last_clean":"2024-09-14T11:56:29.221091+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:29.221091+0000","last_undegraded":"2024-09-14T11:56:29.221091+0000","last_fullsized":"2024-09-14T11:56:29.221091+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.220978+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.320306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'801","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.875354+0000","last_change":"2024-09-14T11:56:28.875354+0000","last_active":"2024-09-14T11:56:28.875354+0000","last_peered":"2024-09-14T11:56:28.875354+0000","last_clean":"2024-09-14T11:56:28.875354+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:56:28.875354+0000","last_undegraded":"2024-09-14T11:56:28.875354+0000","last_fullsized":"2024-09-14T11:56:28.875354+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'801","last_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_deep_scrub":"263'801","last_deep_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.875262+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:43.441720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.735385+0000","last_change":"2024-09-14T11:56:25.735385+0000","last_active":"2024-09-14T11:56:25.735385+0000","last_peered":"2024-09-14T11:56:25.735385+0000","last_clean":"2024-09-14T11:56:25.735385+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:25.735385+0000","last_undegraded":"2024-09-14T11:56:25.735385+0000","last_fullsized":"2024-09-14T11:56:25.735385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.735245+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:43.758913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'455","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.828599+0000","last_change":"2024-09-14T11:56:31.828599+0000","last_active":"2024-09-14T11:56:31.828599+0000","last_peered":"2024-09-14T11:56:31.828599+0000","last_clean":"2024-09-14T11:56:31.828599+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:56:31.828599+0000","last_undegraded":"2024-09-14T11:56:31.828599+0000","last_fullsized":"2024-09-14T11:56:31.828599+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'455","last_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_deep_scrub":"263'455","last_deep_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.828518+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:25.639201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":693,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'426","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.027590+0000","last_change":"2024-09-14T11:56:30.027590+0000","last_active":"2024-09-14T11:56:30.027590+0000","last_peered":"2024-09-14T11:56:30.027590+0000","last_clean":"2024-09-14T11:56:30.027590+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:30.027590+0000","last_undegraded":"2024-09-14T11:56:30.027590+0000","last_fullsized":"2024-09-14T11:56:30.027590+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.027445+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.053487+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1042,"num_read_kb":31602,"num_write":1294,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'450","reported_seq":1961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.793178+0000","last_change":"2024-09-14T11:56:39.793178+0000","last_active":"2024-09-14T11:56:39.793178+0000","last_peered":"2024-09-14T11:56:39.793178+0000","last_clean":"2024-09-14T11:56:39.793178+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:56:39.793178+0000","last_undegraded":"2024-09-14T11:56:39.793178+0000","last_fullsized":"2024-09-14T11:56:39.793178+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.793094+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.783508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'326","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.526665+0000","last_change":"2024-09-14T11:56:28.526665+0000","last_active":"2024-09-14T11:56:28.526665+0000","last_peered":"2024-09-14T11:56:28.526665+0000","last_clean":"2024-09-14T11:56:28.526665+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:28.526665+0000","last_undegraded":"2024-09-14T11:56:28.526665+0000","last_fullsized":"2024-09-14T11:56:28.526665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.526538+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:23.545261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048824,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":49467,"num_write":1023,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'152","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.923340+0000","last_change":"2024-09-14T11:56:56.923340+0000","last_active":"2024-09-14T11:56:56.923340+0000","last_peered":"2024-09-14T11:56:56.923340+0000","last_clean":"2024-09-14T11:56:56.923340+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:56:56.923340+0000","last_undegraded":"2024-09-14T11:56:56.923340+0000","last_fullsized":"2024-09-14T11:56:56.923340+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'152","last_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_deep_scrub":"263'152","last_deep_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.923215+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:16.289153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'476","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.251948+0000","last_change":"2024-09-14T11:56:41.251948+0000","last_active":"2024-09-14T11:56:41.251948+0000","last_peered":"2024-09-14T11:56:41.251948+0000","last_clean":"2024-09-14T11:56:41.251948+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:56:41.251948+0000","last_undegraded":"2024-09-14T11:56:41.251948+0000","last_fullsized":"2024-09-14T11:56:41.251948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.251856+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:21.434224+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'350","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.558262+0000","last_change":"2024-09-14T11:56:27.558262+0000","last_active":"2024-09-14T11:56:27.558262+0000","last_peered":"2024-09-14T11:56:27.558262+0000","last_clean":"2024-09-14T11:56:27.558262+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:27.558262+0000","last_undegraded":"2024-09-14T11:56:27.558262+0000","last_fullsized":"2024-09-14T11:56:27.558262+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.558151+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:00.824858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":64658,"num_write":1071,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.763098+0000","last_change":"2024-09-14T11:56:45.763098+0000","last_active":"2024-09-14T11:56:45.763098+0000","last_peered":"2024-09-14T11:56:45.763098+0000","last_clean":"2024-09-14T11:56:45.763098+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:56:45.763098+0000","last_undegraded":"2024-09-14T11:56:45.763098+0000","last_fullsized":"2024-09-14T11:56:45.763098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.763005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:53.301799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'330","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.685731+0000","last_change":"2024-09-14T11:56:44.685731+0000","last_active":"2024-09-14T11:56:44.685731+0000","last_peered":"2024-09-14T11:56:44.685731+0000","last_clean":"2024-09-14T11:56:44.685731+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:44.685731+0000","last_undegraded":"2024-09-14T11:56:44.685731+0000","last_fullsized":"2024-09-14T11:56:44.685731+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.685661+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:21.057194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.423979+0000","last_change":"2024-09-14T11:56:53.423979+0000","last_active":"2024-09-14T11:56:53.423979+0000","last_peered":"2024-09-14T11:56:53.423979+0000","last_clean":"2024-09-14T11:56:53.423979+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:56:53.423979+0000","last_undegraded":"2024-09-14T11:56:53.423979+0000","last_fullsized":"2024-09-14T11:56:53.423979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.423888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:07.799827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2528","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.687669+0000","last_change":"2024-09-14T11:56:59.687669+0000","last_active":"2024-09-14T11:56:59.687669+0000","last_peered":"2024-09-14T11:56:59.687669+0000","last_clean":"2024-09-14T11:56:59.687669+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:56:59.687669+0000","last_undegraded":"2024-09-14T11:56:59.687669+0000","last_fullsized":"2024-09-14T11:56:59.687669+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.687562+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:31.039855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.790192+0000","last_change":"2024-09-14T11:56:36.790192+0000","last_active":"2024-09-14T11:56:36.790192+0000","last_peered":"2024-09-14T11:56:36.790192+0000","last_clean":"2024-09-14T11:56:36.790192+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:56:36.790192+0000","last_undegraded":"2024-09-14T11:56:36.790192+0000","last_fullsized":"2024-09-14T11:56:36.790192+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.790080+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:27.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'386","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.505419+0000","last_change":"2024-09-14T11:56:20.505419+0000","last_active":"2024-09-14T11:56:20.505419+0000","last_peered":"2024-09-14T11:56:20.505419+0000","last_clean":"2024-09-14T11:56:20.505419+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:20.505419+0000","last_undegraded":"2024-09-14T11:56:20.505419+0000","last_fullsized":"2024-09-14T11:56:20.505419+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.505297+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:34.623393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":676,"num_read_kb":35601,"num_write":1215,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"263'4","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.329564+0000","last_change":"2024-09-14T11:56:44.329564+0000","last_active":"2024-09-14T11:56:44.329564+0000","last_peered":"2024-09-14T11:56:44.329564+0000","last_clean":"2024-09-14T11:56:44.329564+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:44.329564+0000","last_undegraded":"2024-09-14T11:56:44.329564+0000","last_fullsized":"2024-09-14T11:56:44.329564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.329492+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:26.816036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'88","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.797123+0000","last_change":"2024-09-14T11:56:47.797123+0000","last_active":"2024-09-14T11:56:47.797123+0000","last_peered":"2024-09-14T11:56:47.797123+0000","last_clean":"2024-09-14T11:56:47.797123+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:56:47.797123+0000","last_undegraded":"2024-09-14T11:56:47.797123+0000","last_fullsized":"2024-09-14T11:56:47.797123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'88","last_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_deep_scrub":"263'88","last_deep_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.797040+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:35.771450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.785169+0000","last_change":"2024-09-14T11:56:53.785169+0000","last_active":"2024-09-14T11:56:53.785169+0000","last_peered":"2024-09-14T11:56:53.785169+0000","last_clean":"2024-09-14T11:56:53.785169+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:56:53.785169+0000","last_undegraded":"2024-09-14T11:56:53.785169+0000","last_fullsized":"2024-09-14T11:56:53.785169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.785079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.176820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'107","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.740750+0000","last_change":"2024-09-14T11:56:57.740750+0000","last_active":"2024-09-14T11:56:57.740750+0000","last_peered":"2024-09-14T11:56:57.740750+0000","last_clean":"2024-09-14T11:56:57.740750+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:56:57.740750+0000","last_undegraded":"2024-09-14T11:56:57.740750+0000","last_fullsized":"2024-09-14T11:56:57.740750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.740665+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:59.815552+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'431","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.546641+0000","last_change":"2024-09-14T11:56:34.546641+0000","last_active":"2024-09-14T11:56:34.546641+0000","last_peered":"2024-09-14T11:56:34.546641+0000","last_clean":"2024-09-14T11:56:34.546641+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:56:34.546641+0000","last_undegraded":"2024-09-14T11:56:34.546641+0000","last_fullsized":"2024-09-14T11:56:34.546641+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.546557+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:09.879015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'407","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.512674+0000","last_change":"2024-09-14T11:56:25.512674+0000","last_active":"2024-09-14T11:56:25.512674+0000","last_peered":"2024-09-14T11:56:25.512674+0000","last_clean":"2024-09-14T11:56:25.512674+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:25.512674+0000","last_undegraded":"2024-09-14T11:56:25.512674+0000","last_fullsized":"2024-09-14T11:56:25.512674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.512545+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:59.346574+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":815,"num_read_kb":18319,"num_write":1414,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.196211+0000","last_change":"2024-09-14T11:56:39.196211+0000","last_active":"2024-09-14T11:56:39.196211+0000","last_peered":"2024-09-14T11:56:39.196211+0000","last_clean":"2024-09-14T11:56:39.196211+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:56:39.196211+0000","last_undegraded":"2024-09-14T11:56:39.196211+0000","last_fullsized":"2024-09-14T11:56:39.196211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.196121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'103","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.869581+0000","last_change":"2024-09-14T11:56:41.869581+0000","last_active":"2024-09-14T11:56:41.869581+0000","last_peered":"2024-09-14T11:56:41.869581+0000","last_clean":"2024-09-14T11:56:41.869581+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:56:41.869581+0000","last_undegraded":"2024-09-14T11:56:41.869581+0000","last_fullsized":"2024-09-14T11:56:41.869581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.869495+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:42.141907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'774","reported_seq":4573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.444378+0000","last_change":"2024-09-14T11:56:52.444378+0000","last_active":"2024-09-14T11:56:52.444378+0000","last_peered":"2024-09-14T11:56:52.444378+0000","last_clean":"2024-09-14T11:56:52.444378+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:52.444378+0000","last_undegraded":"2024-09-14T11:56:52.444378+0000","last_fullsized":"2024-09-14T11:56:52.444378+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.444278+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:28.372005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'216","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.934993+0000","last_change":"2024-09-14T11:56:57.934993+0000","last_active":"2024-09-14T11:56:57.934993+0000","last_peered":"2024-09-14T11:56:57.934993+0000","last_clean":"2024-09-14T11:56:57.934993+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:56:57.934993+0000","last_undegraded":"2024-09-14T11:56:57.934993+0000","last_fullsized":"2024-09-14T11:56:57.934993+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.934887+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:55.562512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'527","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.833061+0000","last_change":"2024-09-14T11:56:26.833061+0000","last_active":"2024-09-14T11:56:26.833061+0000","last_peered":"2024-09-14T11:56:26.833061+0000","last_clean":"2024-09-14T11:56:26.833061+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:56:26.833061+0000","last_undegraded":"2024-09-14T11:56:26.833061+0000","last_fullsized":"2024-09-14T11:56:26.833061+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.832975+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:55.872822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.106600+0000","last_change":"2024-09-14T11:56:24.106600+0000","last_active":"2024-09-14T11:56:24.106600+0000","last_peered":"2024-09-14T11:56:24.106600+0000","last_clean":"2024-09-14T11:56:24.106600+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:24.106600+0000","last_undegraded":"2024-09-14T11:56:24.106600+0000","last_fullsized":"2024-09-14T11:56:24.106600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.106406+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:03.759033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.784450+0000","last_change":"2024-09-14T11:56:46.784450+0000","last_active":"2024-09-14T11:56:46.784450+0000","last_peered":"2024-09-14T11:56:46.784450+0000","last_clean":"2024-09-14T11:56:46.784450+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:56:46.784450+0000","last_undegraded":"2024-09-14T11:56:46.784450+0000","last_fullsized":"2024-09-14T11:56:46.784450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.784356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:25.395721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'255","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.516156+0000","last_change":"2024-09-14T11:56:48.516156+0000","last_active":"2024-09-14T11:56:48.516156+0000","last_peered":"2024-09-14T11:56:48.516156+0000","last_clean":"2024-09-14T11:56:48.516156+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:48.516156+0000","last_undegraded":"2024-09-14T11:56:48.516156+0000","last_fullsized":"2024-09-14T11:56:48.516156+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.516064+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:05.662866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'791","reported_seq":2561,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.153975+0000","last_change":"2024-09-14T11:56:55.153975+0000","last_active":"2024-09-14T11:56:55.153975+0000","last_peered":"2024-09-14T11:56:55.153975+0000","last_clean":"2024-09-14T11:56:55.153975+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:55.153975+0000","last_undegraded":"2024-09-14T11:56:55.153975+0000","last_fullsized":"2024-09-14T11:56:55.153975+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.153895+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:46.428579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1229","reported_seq":2892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.771034+0000","last_change":"2024-09-14T11:56:35.771034+0000","last_active":"2024-09-14T11:56:35.771034+0000","last_peered":"2024-09-14T11:56:35.771034+0000","last_clean":"2024-09-14T11:56:35.771034+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:56:35.771034+0000","last_undegraded":"2024-09-14T11:56:35.771034+0000","last_fullsized":"2024-09-14T11:56:35.771034+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1229","last_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_deep_scrub":"263'1229","last_deep_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.770916+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":1200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:33.485010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'358","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.557591+0000","last_change":"2024-09-14T11:56:28.557531+0000","last_active":"2024-09-14T11:56:28.557591+0000","last_peered":"2024-09-14T11:56:28.557591+0000","last_clean":"2024-09-14T11:56:28.557591+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:28.557591+0000","last_undegraded":"2024-09-14T11:56:28.557591+0000","last_fullsized":"2024-09-14T11:56:28.557591+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.557427+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:28.224602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":41733,"num_write":1105,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.542271+0000","last_change":"2024-09-14T11:56:41.542271+0000","last_active":"2024-09-14T11:56:41.542271+0000","last_peered":"2024-09-14T11:56:41.542271+0000","last_clean":"2024-09-14T11:56:41.542271+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:56:41.542271+0000","last_undegraded":"2024-09-14T11:56:41.542271+0000","last_fullsized":"2024-09-14T11:56:41.542271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.542187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:06.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'364","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.693108+0000","last_change":"2024-09-14T11:56:49.693108+0000","last_active":"2024-09-14T11:56:49.693108+0000","last_peered":"2024-09-14T11:56:49.693108+0000","last_clean":"2024-09-14T11:56:49.693108+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:49.693108+0000","last_undegraded":"2024-09-14T11:56:49.693108+0000","last_fullsized":"2024-09-14T11:56:49.693108+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.693011+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.084690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.855114+0000","last_change":"2024-09-14T11:56:44.855045+0000","last_active":"2024-09-14T11:56:44.855114+0000","last_peered":"2024-09-14T11:56:44.855114+0000","last_clean":"2024-09-14T11:56:44.855114+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:56:44.855114+0000","last_undegraded":"2024-09-14T11:56:44.855114+0000","last_fullsized":"2024-09-14T11:56:44.855114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.854939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:34.855798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.815835+0000","last_change":"2024-09-14T11:56:54.815835+0000","last_active":"2024-09-14T11:56:54.815835+0000","last_peered":"2024-09-14T11:56:54.815835+0000","last_clean":"2024-09-14T11:56:54.815835+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:56:54.815835+0000","last_undegraded":"2024-09-14T11:56:54.815835+0000","last_fullsized":"2024-09-14T11:56:54.815835+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.815746+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:58.396730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'806","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.715525+0000","last_change":"2024-09-14T11:56:27.715525+0000","last_active":"2024-09-14T11:56:27.715525+0000","last_peered":"2024-09-14T11:56:27.715525+0000","last_clean":"2024-09-14T11:56:27.715525+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:56:27.715525+0000","last_undegraded":"2024-09-14T11:56:27.715525+0000","last_fullsized":"2024-09-14T11:56:27.715525+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.715433+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:50.726219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'313","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.855003+0000","last_change":"2024-09-14T11:56:32.855003+0000","last_active":"2024-09-14T11:56:32.855003+0000","last_peered":"2024-09-14T11:56:32.855003+0000","last_clean":"2024-09-14T11:56:32.855003+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:32.855003+0000","last_undegraded":"2024-09-14T11:56:32.855003+0000","last_fullsized":"2024-09-14T11:56:32.855003+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.854894+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:57.072216+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":67475,"num_write":1031,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.846368+0000","last_change":"2024-09-14T11:56:34.846368+0000","last_active":"2024-09-14T11:56:34.846368+0000","last_peered":"2024-09-14T11:56:34.846368+0000","last_clean":"2024-09-14T11:56:34.846368+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:56:34.846368+0000","last_undegraded":"2024-09-14T11:56:34.846368+0000","last_fullsized":"2024-09-14T11:56:34.846368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.846285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:47.433018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'297","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.306830+0000","last_change":"2024-09-14T11:56:46.306762+0000","last_active":"2024-09-14T11:56:46.306830+0000","last_peered":"2024-09-14T11:56:46.306830+0000","last_clean":"2024-09-14T11:56:46.306830+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:56:46.306830+0000","last_undegraded":"2024-09-14T11:56:46.306830+0000","last_fullsized":"2024-09-14T11:56:46.306830+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.306669+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:27.229964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49558,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1126,"num_write":402,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.232554+0000","last_change":"2024-09-14T11:56:53.232554+0000","last_active":"2024-09-14T11:56:53.232554+0000","last_peered":"2024-09-14T11:56:53.232554+0000","last_clean":"2024-09-14T11:56:53.232554+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:56:53.232554+0000","last_undegraded":"2024-09-14T11:56:53.232554+0000","last_fullsized":"2024-09-14T11:56:53.232554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.232457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:43.213959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'121","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.235418+0000","last_change":"2024-09-14T11:56:44.235418+0000","last_active":"2024-09-14T11:56:44.235418+0000","last_peered":"2024-09-14T11:56:44.235418+0000","last_clean":"2024-09-14T11:56:44.235418+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:56:44.235418+0000","last_undegraded":"2024-09-14T11:56:44.235418+0000","last_fullsized":"2024-09-14T11:56:44.235418+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.235335+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:59.340370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1042","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.270323+0000","last_change":"2024-09-14T11:56:30.270323+0000","last_active":"2024-09-14T11:56:30.270323+0000","last_peered":"2024-09-14T11:56:30.270323+0000","last_clean":"2024-09-14T11:56:30.270323+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:56:30.270323+0000","last_undegraded":"2024-09-14T11:56:30.270323+0000","last_fullsized":"2024-09-14T11:56:30.270323+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1042","last_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_deep_scrub":"263'1042","last_deep_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.270230+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.888140+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'294","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.494855+0000","last_change":"2024-09-14T11:56:24.494772+0000","last_active":"2024-09-14T11:56:24.494855+0000","last_peered":"2024-09-14T11:56:24.494855+0000","last_clean":"2024-09-14T11:56:24.494855+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:24.494855+0000","last_undegraded":"2024-09-14T11:56:24.494855+0000","last_fullsized":"2024-09-14T11:56:24.494855+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.494631+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:43.745446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":31073,"num_write":909,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.899812+0000","last_change":"2024-09-14T11:56:36.899748+0000","last_active":"2024-09-14T11:56:36.899812+0000","last_peered":"2024-09-14T11:56:36.899812+0000","last_clean":"2024-09-14T11:56:36.899812+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:56:36.899812+0000","last_undegraded":"2024-09-14T11:56:36.899812+0000","last_fullsized":"2024-09-14T11:56:36.899812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.899653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:58.910589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'308","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.515860+0000","last_change":"2024-09-14T11:56:46.515860+0000","last_active":"2024-09-14T11:56:46.515860+0000","last_peered":"2024-09-14T11:56:46.515860+0000","last_clean":"2024-09-14T11:56:46.515860+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:46.515860+0000","last_undegraded":"2024-09-14T11:56:46.515860+0000","last_fullsized":"2024-09-14T11:56:46.515860+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.515757+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:57.140151+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":4054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.701312+0000","last_change":"2024-09-14T11:56:50.701312+0000","last_active":"2024-09-14T11:56:50.701312+0000","last_peered":"2024-09-14T11:56:50.701312+0000","last_clean":"2024-09-14T11:56:50.701312+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:50.701312+0000","last_undegraded":"2024-09-14T11:56:50.701312+0000","last_fullsized":"2024-09-14T11:56:50.701312+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.701208+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:36.693878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'135","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.773527+0000","last_change":"2024-09-14T11:56:56.773527+0000","last_active":"2024-09-14T11:56:56.773527+0000","last_peered":"2024-09-14T11:56:56.773527+0000","last_clean":"2024-09-14T11:56:56.773527+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:56:56.773527+0000","last_undegraded":"2024-09-14T11:56:56.773527+0000","last_fullsized":"2024-09-14T11:56:56.773527+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.773428+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.358395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'415","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.549305+0000","last_change":"2024-09-14T11:56:31.549234+0000","last_active":"2024-09-14T11:56:31.549305+0000","last_peered":"2024-09-14T11:56:31.549305+0000","last_clean":"2024-09-14T11:56:31.549305+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:56:31.549305+0000","last_undegraded":"2024-09-14T11:56:31.549305+0000","last_fullsized":"2024-09-14T11:56:31.549305+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.549129+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:03.979018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.841395+0000","last_change":"2024-09-14T11:56:26.841315+0000","last_active":"2024-09-14T11:56:26.841395+0000","last_peered":"2024-09-14T11:56:26.841395+0000","last_clean":"2024-09-14T11:56:26.841395+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:26.841395+0000","last_undegraded":"2024-09-14T11:56:26.841395+0000","last_fullsized":"2024-09-14T11:56:26.841395+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.841218+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:23.553496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.881630+0000","last_change":"2024-09-14T11:56:37.881630+0000","last_active":"2024-09-14T11:56:37.881630+0000","last_peered":"2024-09-14T11:56:37.881630+0000","last_clean":"2024-09-14T11:56:37.881630+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:56:37.881630+0000","last_undegraded":"2024-09-14T11:56:37.881630+0000","last_fullsized":"2024-09-14T11:56:37.881630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.881540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:26.348899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'498","reported_seq":1131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.642102+0000","last_change":"2024-09-14T11:56:43.642102+0000","last_active":"2024-09-14T11:56:43.642102+0000","last_peered":"2024-09-14T11:56:43.642102+0000","last_clean":"2024-09-14T11:56:43.642102+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:43.642102+0000","last_undegraded":"2024-09-14T11:56:43.642102+0000","last_fullsized":"2024-09-14T11:56:43.642102+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.642011+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:58.210871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99468,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":885,"num_read_kb":2186,"num_write":738,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.903741+0000","last_change":"2024-09-14T11:56:42.903741+0000","last_active":"2024-09-14T11:56:42.903741+0000","last_peered":"2024-09-14T11:56:42.903741+0000","last_clean":"2024-09-14T11:56:42.903741+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:56:42.903741+0000","last_undegraded":"2024-09-14T11:56:42.903741+0000","last_fullsized":"2024-09-14T11:56:42.903741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.903661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:24.433918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'146","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.916887+0000","last_change":"2024-09-14T11:56:47.916887+0000","last_active":"2024-09-14T11:56:47.916887+0000","last_peered":"2024-09-14T11:56:47.916887+0000","last_clean":"2024-09-14T11:56:47.916887+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:56:47.916887+0000","last_undegraded":"2024-09-14T11:56:47.916887+0000","last_fullsized":"2024-09-14T11:56:47.916887+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.916794+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:10.778249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'847","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.698801+0000","last_change":"2024-09-14T11:56:28.698744+0000","last_active":"2024-09-14T11:56:28.698801+0000","last_peered":"2024-09-14T11:56:28.698801+0000","last_clean":"2024-09-14T11:56:28.698801+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:56:28.698801+0000","last_undegraded":"2024-09-14T11:56:28.698801+0000","last_fullsized":"2024-09-14T11:56:28.698801+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'847","last_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_deep_scrub":"263'847","last_deep_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.698654+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":800,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:40.307674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'386","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.114558+0000","last_change":"2024-09-14T11:56:22.114483+0000","last_active":"2024-09-14T11:56:22.114558+0000","last_peered":"2024-09-14T11:56:22.114558+0000","last_clean":"2024-09-14T11:56:22.114558+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:22.114558+0000","last_undegraded":"2024-09-14T11:56:22.114558+0000","last_fullsized":"2024-09-14T11:56:22.114558+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.114372+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:40.637875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":715,"num_read_kb":16906,"num_write":1227,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.899269+0000","last_change":"2024-09-14T11:56:40.899217+0000","last_active":"2024-09-14T11:56:40.899269+0000","last_peered":"2024-09-14T11:56:40.899269+0000","last_clean":"2024-09-14T11:56:40.899269+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:56:40.899269+0000","last_undegraded":"2024-09-14T11:56:40.899269+0000","last_fullsized":"2024-09-14T11:56:40.899269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.899134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.733282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'304","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.804866+0000","last_change":"2024-09-14T11:56:48.804807+0000","last_active":"2024-09-14T11:56:48.804866+0000","last_peered":"2024-09-14T11:56:48.804866+0000","last_clean":"2024-09-14T11:56:48.804866+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:48.804866+0000","last_undegraded":"2024-09-14T11:56:48.804866+0000","last_fullsized":"2024-09-14T11:56:48.804866+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.804714+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:17.990480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.721340+0000","last_change":"2024-09-14T11:56:49.721287+0000","last_active":"2024-09-14T11:56:49.721340+0000","last_peered":"2024-09-14T11:56:49.721340+0000","last_clean":"2024-09-14T11:56:49.721340+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:56:49.721340+0000","last_undegraded":"2024-09-14T11:56:49.721340+0000","last_fullsized":"2024-09-14T11:56:49.721340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.721199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:44.981198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'121","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.188503+0000","last_change":"2024-09-14T11:56:58.188503+0000","last_active":"2024-09-14T11:56:58.188503+0000","last_peered":"2024-09-14T11:56:58.188503+0000","last_clean":"2024-09-14T11:56:58.188503+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:56:58.188503+0000","last_undegraded":"2024-09-14T11:56:58.188503+0000","last_fullsized":"2024-09-14T11:56:58.188503+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.188428+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.813037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1644","reported_seq":3317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.715896+0000","last_change":"2024-09-14T11:56:29.715837+0000","last_active":"2024-09-14T11:56:29.715896+0000","last_peered":"2024-09-14T11:56:29.715896+0000","last_clean":"2024-09-14T11:56:29.715896+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:56:29.715896+0000","last_undegraded":"2024-09-14T11:56:29.715896+0000","last_fullsized":"2024-09-14T11:56:29.715896+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1644","last_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_deep_scrub":"263'1644","last_deep_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.715743+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:27.695414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.233890+0000","last_change":"2024-09-14T11:56:27.233890+0000","last_active":"2024-09-14T11:56:27.233890+0000","last_peered":"2024-09-14T11:56:27.233890+0000","last_clean":"2024-09-14T11:56:27.233890+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:27.233890+0000","last_undegraded":"2024-09-14T11:56:27.233890+0000","last_fullsized":"2024-09-14T11:56:27.233890+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.233781+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.725234+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.740043+0000","last_change":"2024-09-14T11:56:37.739989+0000","last_active":"2024-09-14T11:56:37.740043+0000","last_peered":"2024-09-14T11:56:37.740043+0000","last_clean":"2024-09-14T11:56:37.740043+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:56:37.740043+0000","last_undegraded":"2024-09-14T11:56:37.740043+0000","last_fullsized":"2024-09-14T11:56:37.740043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.739899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:13.301117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'300","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.857750+0000","last_change":"2024-09-14T11:56:39.857685+0000","last_active":"2024-09-14T11:56:39.857750+0000","last_peered":"2024-09-14T11:56:39.857750+0000","last_clean":"2024-09-14T11:56:39.857750+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:56:39.857750+0000","last_undegraded":"2024-09-14T11:56:39.857750+0000","last_fullsized":"2024-09-14T11:56:39.857750+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.857592+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:20.652302+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69648,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1150,"num_write":402,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'761","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.903028+0000","last_change":"2024-09-14T11:56:43.902970+0000","last_active":"2024-09-14T11:56:43.903028+0000","last_peered":"2024-09-14T11:56:43.903028+0000","last_clean":"2024-09-14T11:56:43.903028+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:43.903028+0000","last_undegraded":"2024-09-14T11:56:43.903028+0000","last_fullsized":"2024-09-14T11:56:43.903028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.902864+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:03.704298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'149","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.887413+0000","last_change":"2024-09-14T11:56:45.887413+0000","last_active":"2024-09-14T11:56:45.887413+0000","last_peered":"2024-09-14T11:56:45.887413+0000","last_clean":"2024-09-14T11:56:45.887413+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:56:45.887413+0000","last_undegraded":"2024-09-14T11:56:45.887413+0000","last_fullsized":"2024-09-14T11:56:45.887413+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.887303+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:14.811741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.721963+0000","last_change":"2024-09-14T11:56:30.721902+0000","last_active":"2024-09-14T11:56:30.721963+0000","last_peered":"2024-09-14T11:56:30.721963+0000","last_clean":"2024-09-14T11:56:30.721963+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:56:30.721963+0000","last_undegraded":"2024-09-14T11:56:30.721963+0000","last_fullsized":"2024-09-14T11:56:30.721963+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.721816+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:19.890041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.691511+0000","last_change":"2024-09-14T11:56:24.691511+0000","last_active":"2024-09-14T11:56:24.691511+0000","last_peered":"2024-09-14T11:56:24.691511+0000","last_clean":"2024-09-14T11:56:24.691511+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:24.691511+0000","last_undegraded":"2024-09-14T11:56:24.691511+0000","last_fullsized":"2024-09-14T11:56:24.691511+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.691405+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:19.223818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.724992+0000","last_change":"2024-09-14T11:56:44.724907+0000","last_active":"2024-09-14T11:56:44.724992+0000","last_peered":"2024-09-14T11:56:44.724992+0000","last_clean":"2024-09-14T11:56:44.724992+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:44.724992+0000","last_undegraded":"2024-09-14T11:56:44.724992+0000","last_fullsized":"2024-09-14T11:56:44.724992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.724814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:32.377727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.309336+0000","last_change":"2024-09-14T11:56:45.309271+0000","last_active":"2024-09-14T11:56:45.309336+0000","last_peered":"2024-09-14T11:56:45.309336+0000","last_clean":"2024-09-14T11:56:45.309336+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:56:45.309336+0000","last_undegraded":"2024-09-14T11:56:45.309336+0000","last_fullsized":"2024-09-14T11:56:45.309336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'84","last_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_deep_scrub":"263'84","last_deep_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.309168+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:20.217748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.230892+0000","last_change":"2024-09-14T11:56:40.230789+0000","last_active":"2024-09-14T11:56:40.230892+0000","last_peered":"2024-09-14T11:56:40.230892+0000","last_clean":"2024-09-14T11:56:40.230892+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:40.230892+0000","last_undegraded":"2024-09-14T11:56:40.230892+0000","last_fullsized":"2024-09-14T11:56:40.230892+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.230641+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:25.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.829596+0000","last_change":"2024-09-14T11:56:54.829596+0000","last_active":"2024-09-14T11:56:54.829596+0000","last_peered":"2024-09-14T11:56:54.829596+0000","last_clean":"2024-09-14T11:56:54.829596+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:56:54.829596+0000","last_undegraded":"2024-09-14T11:56:54.829596+0000","last_fullsized":"2024-09-14T11:56:54.829596+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.829506+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.125183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'513","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.782342+0000","last_change":"2024-09-14T11:56:31.782245+0000","last_active":"2024-09-14T11:56:31.782342+0000","last_peered":"2024-09-14T11:56:31.782342+0000","last_clean":"2024-09-14T11:56:31.782342+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:56:31.782342+0000","last_undegraded":"2024-09-14T11:56:31.782342+0000","last_fullsized":"2024-09-14T11:56:31.782342+0000","mapping_epoch":27,"log_start":"263'501","ondisk_log_start":"263'501","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.782127+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:24.425090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.073606+0000","last_change":"2024-09-14T11:56:23.073606+0000","last_active":"2024-09-14T11:56:23.073606+0000","last_peered":"2024-09-14T11:56:23.073606+0000","last_clean":"2024-09-14T11:56:23.073606+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:23.073606+0000","last_undegraded":"2024-09-14T11:56:23.073606+0000","last_fullsized":"2024-09-14T11:56:23.073606+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.073522+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.269212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":524,"num_write":1137,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.769196+0000","last_change":"2024-09-14T11:56:41.769107+0000","last_active":"2024-09-14T11:56:41.769196+0000","last_peered":"2024-09-14T11:56:41.769196+0000","last_clean":"2024-09-14T11:56:41.769196+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:56:41.769196+0000","last_undegraded":"2024-09-14T11:56:41.769196+0000","last_fullsized":"2024-09-14T11:56:41.769196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.769011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:59.511302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'367","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.736493+0000","last_change":"2024-09-14T11:56:50.736433+0000","last_active":"2024-09-14T11:56:50.736493+0000","last_peered":"2024-09-14T11:56:50.736493+0000","last_clean":"2024-09-14T11:56:50.736493+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:50.736493+0000","last_undegraded":"2024-09-14T11:56:50.736493+0000","last_fullsized":"2024-09-14T11:56:50.736493+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.736341+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.594821+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.232608+0000","last_change":"2024-09-14T11:56:39.232538+0000","last_active":"2024-09-14T11:56:39.232608+0000","last_peered":"2024-09-14T11:56:39.232608+0000","last_clean":"2024-09-14T11:56:39.232608+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:56:39.232608+0000","last_undegraded":"2024-09-14T11:56:39.232608+0000","last_fullsized":"2024-09-14T11:56:39.232608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.232412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:21.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'187","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.935345+0000","last_change":"2024-09-14T11:56:48.935345+0000","last_active":"2024-09-14T11:56:48.935345+0000","last_peered":"2024-09-14T11:56:48.935345+0000","last_clean":"2024-09-14T11:56:48.935345+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:56:48.935345+0000","last_undegraded":"2024-09-14T11:56:48.935345+0000","last_fullsized":"2024-09-14T11:56:48.935345+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.935254+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:03.798486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'466","reported_seq":1965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.229172+0000","last_change":"2024-09-14T11:56:31.229172+0000","last_active":"2024-09-14T11:56:31.229172+0000","last_peered":"2024-09-14T11:56:31.229172+0000","last_clean":"2024-09-14T11:56:31.229172+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:56:31.229172+0000","last_undegraded":"2024-09-14T11:56:31.229172+0000","last_fullsized":"2024-09-14T11:56:31.229172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.229089+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:26.332777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.479532+0000","last_change":"2024-09-14T11:56:23.479532+0000","last_active":"2024-09-14T11:56:23.479532+0000","last_peered":"2024-09-14T11:56:23.479532+0000","last_clean":"2024-09-14T11:56:23.479532+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:56:23.479532+0000","last_undegraded":"2024-09-14T11:56:23.479532+0000","last_fullsized":"2024-09-14T11:56:23.479532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.479446+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.972281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.780627+0000","last_change":"2024-09-14T11:56:23.780627+0000","last_active":"2024-09-14T11:56:23.780627+0000","last_peered":"2024-09-14T11:56:23.780627+0000","last_clean":"2024-09-14T11:56:23.780627+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:56:23.780627+0000","last_undegraded":"2024-09-14T11:56:23.780627+0000","last_fullsized":"2024-09-14T11:56:23.780627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.780539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:19.285862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.893049+0000","last_change":"2024-09-14T11:56:23.893049+0000","last_active":"2024-09-14T11:56:23.893049+0000","last_peered":"2024-09-14T11:56:23.893049+0000","last_clean":"2024-09-14T11:56:23.893049+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:23.893049+0000","last_undegraded":"2024-09-14T11:56:23.893049+0000","last_fullsized":"2024-09-14T11:56:23.893049+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.892977+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:13.522054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":748,"num_read_kb":7472,"num_write":1023,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.580695+0000","last_change":"2024-09-14T11:56:40.580695+0000","last_active":"2024-09-14T11:56:40.580695+0000","last_peered":"2024-09-14T11:56:40.580695+0000","last_clean":"2024-09-14T11:56:40.580695+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:56:40.580695+0000","last_undegraded":"2024-09-14T11:56:40.580695+0000","last_fullsized":"2024-09-14T11:56:40.580695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.580600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:27.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'753","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.718557+0000","last_change":"2024-09-14T11:56:48.718557+0000","last_active":"2024-09-14T11:56:48.718557+0000","last_peered":"2024-09-14T11:56:48.718557+0000","last_clean":"2024-09-14T11:56:48.718557+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:48.718557+0000","last_undegraded":"2024-09-14T11:56:48.718557+0000","last_fullsized":"2024-09-14T11:56:48.718557+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'753","last_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_deep_scrub":"263'753","last_deep_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.718471+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:07.067523+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107204,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.733094+0000","last_change":"2024-09-14T11:56:48.733094+0000","last_active":"2024-09-14T11:56:48.733094+0000","last_peered":"2024-09-14T11:56:48.733094+0000","last_clean":"2024-09-14T11:56:48.733094+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:56:48.733094+0000","last_undegraded":"2024-09-14T11:56:48.733094+0000","last_fullsized":"2024-09-14T11:56:48.733094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.732990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:44.026156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.209235+0000","last_change":"2024-09-14T11:56:46.209235+0000","last_active":"2024-09-14T11:56:46.209235+0000","last_peered":"2024-09-14T11:56:46.209235+0000","last_clean":"2024-09-14T11:56:46.209235+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:56:46.209235+0000","last_undegraded":"2024-09-14T11:56:46.209235+0000","last_fullsized":"2024-09-14T11:56:46.209235+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.209118+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:05.425542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1366","reported_seq":3144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.521567+0000","last_change":"2024-09-14T11:56:30.521567+0000","last_active":"2024-09-14T11:56:30.521567+0000","last_peered":"2024-09-14T11:56:30.521567+0000","last_clean":"2024-09-14T11:56:30.521567+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:56:30.521567+0000","last_undegraded":"2024-09-14T11:56:30.521567+0000","last_fullsized":"2024-09-14T11:56:30.521567+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1366","last_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_deep_scrub":"263'1366","last_deep_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.521471+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:00.605893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.538138+0000","last_change":"2024-09-14T11:56:26.538138+0000","last_active":"2024-09-14T11:56:26.538138+0000","last_peered":"2024-09-14T11:56:26.538138+0000","last_clean":"2024-09-14T11:56:26.538138+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:56:26.538138+0000","last_undegraded":"2024-09-14T11:56:26.538138+0000","last_fullsized":"2024-09-14T11:56:26.538138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.538048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:14.343027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'362","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.498768+0000","last_change":"2024-09-14T11:56:23.498768+0000","last_active":"2024-09-14T11:56:23.498768+0000","last_peered":"2024-09-14T11:56:23.498768+0000","last_clean":"2024-09-14T11:56:23.498768+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:23.498768+0000","last_undegraded":"2024-09-14T11:56:23.498768+0000","last_fullsized":"2024-09-14T11:56:23.498768+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.498682+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:31.939526+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029253,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":615,"num_read_kb":6150,"num_write":1149,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.727701+0000","last_change":"2024-09-14T11:56:42.727701+0000","last_active":"2024-09-14T11:56:42.727701+0000","last_peered":"2024-09-14T11:56:42.727701+0000","last_clean":"2024-09-14T11:56:42.727701+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:56:42.727701+0000","last_undegraded":"2024-09-14T11:56:42.727701+0000","last_fullsized":"2024-09-14T11:56:42.727701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.727605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:20.497909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1264","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.846115+0000","last_change":"2024-09-14T11:56:41.846115+0000","last_active":"2024-09-14T11:56:41.846115+0000","last_peered":"2024-09-14T11:56:41.846115+0000","last_clean":"2024-09-14T11:56:41.846115+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:41.846115+0000","last_undegraded":"2024-09-14T11:56:41.846115+0000","last_fullsized":"2024-09-14T11:56:41.846115+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1264","last_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_deep_scrub":"263'1264","last_deep_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.846014+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:37.873739+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1958,"num_read_kb":3608,"num_write":1054,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.500818+0000","last_change":"2024-09-14T11:56:50.500818+0000","last_active":"2024-09-14T11:56:50.500818+0000","last_peered":"2024-09-14T11:56:50.500818+0000","last_clean":"2024-09-14T11:56:50.500818+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:56:50.500818+0000","last_undegraded":"2024-09-14T11:56:50.500818+0000","last_fullsized":"2024-09-14T11:56:50.500818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.500733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:53.365887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'134","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.959545+0000","last_change":"2024-09-14T11:56:49.959545+0000","last_active":"2024-09-14T11:56:49.959545+0000","last_peered":"2024-09-14T11:56:49.959545+0000","last_clean":"2024-09-14T11:56:49.959545+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:56:49.959545+0000","last_undegraded":"2024-09-14T11:56:49.959545+0000","last_fullsized":"2024-09-14T11:56:49.959545+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.959435+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.018062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'786","reported_seq":2315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.813513+0000","last_change":"2024-09-14T11:56:30.813513+0000","last_active":"2024-09-14T11:56:30.813513+0000","last_peered":"2024-09-14T11:56:30.813513+0000","last_clean":"2024-09-14T11:56:30.813513+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:56:30.813513+0000","last_undegraded":"2024-09-14T11:56:30.813513+0000","last_fullsized":"2024-09-14T11:56:30.813513+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'786","last_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_deep_scrub":"263'786","last_deep_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.813419+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:18.621682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.949954+0000","last_change":"2024-09-14T11:56:21.949954+0000","last_active":"2024-09-14T11:56:21.949954+0000","last_peered":"2024-09-14T11:56:21.949954+0000","last_clean":"2024-09-14T11:56:21.949954+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:56:21.949954+0000","last_undegraded":"2024-09-14T11:56:21.949954+0000","last_fullsized":"2024-09-14T11:56:21.949954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.949882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:24.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'342","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.834358+0000","last_change":"2024-09-14T11:56:22.834358+0000","last_active":"2024-09-14T11:56:22.834358+0000","last_peered":"2024-09-14T11:56:22.834358+0000","last_clean":"2024-09-14T11:56:22.834358+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:22.834358+0000","last_undegraded":"2024-09-14T11:56:22.834358+0000","last_fullsized":"2024-09-14T11:56:22.834358+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.834283+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":72010,"num_write":1138,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.862175+0000","last_change":"2024-09-14T11:56:35.862175+0000","last_active":"2024-09-14T11:56:35.862175+0000","last_peered":"2024-09-14T11:56:35.862175+0000","last_clean":"2024-09-14T11:56:35.862175+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:56:35.862175+0000","last_undegraded":"2024-09-14T11:56:35.862175+0000","last_fullsized":"2024-09-14T11:56:35.862175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.862069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:42.054433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'260","reported_seq":1302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.536007+0000","last_change":"2024-09-14T11:56:45.536007+0000","last_active":"2024-09-14T11:56:45.536007+0000","last_peered":"2024-09-14T11:56:45.536007+0000","last_clean":"2024-09-14T11:56:45.536007+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:56:45.536007+0000","last_undegraded":"2024-09-14T11:56:45.536007+0000","last_fullsized":"2024-09-14T11:56:45.536007+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.535905+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:52.905109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.695253+0000","last_change":"2024-09-14T11:56:47.695253+0000","last_active":"2024-09-14T11:56:47.695253+0000","last_peered":"2024-09-14T11:56:47.695253+0000","last_clean":"2024-09-14T11:56:47.695253+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:56:47.695253+0000","last_undegraded":"2024-09-14T11:56:47.695253+0000","last_fullsized":"2024-09-14T11:56:47.695253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.695169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:22.244367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'269","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.161409+0000","last_change":"2024-09-14T11:56:56.161351+0000","last_active":"2024-09-14T11:56:56.161409+0000","last_peered":"2024-09-14T11:56:56.161409+0000","last_clean":"2024-09-14T11:56:56.161409+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:56:56.161409+0000","last_undegraded":"2024-09-14T11:56:56.161409+0000","last_fullsized":"2024-09-14T11:56:56.161409+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.161261+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.468810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'432","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.782814+0000","last_change":"2024-09-14T11:56:29.782814+0000","last_active":"2024-09-14T11:56:29.782814+0000","last_peered":"2024-09-14T11:56:29.782814+0000","last_clean":"2024-09-14T11:56:29.782814+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:56:29.782814+0000","last_undegraded":"2024-09-14T11:56:29.782814+0000","last_fullsized":"2024-09-14T11:56:29.782814+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.782725+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:08.803503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.822497+0000","last_change":"2024-09-14T11:56:22.822497+0000","last_active":"2024-09-14T11:56:22.822497+0000","last_peered":"2024-09-14T11:56:22.822497+0000","last_clean":"2024-09-14T11:56:22.822497+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:56:22.822497+0000","last_undegraded":"2024-09-14T11:56:22.822497+0000","last_fullsized":"2024-09-14T11:56:22.822497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.822377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:42.113203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'323","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.913200+0000","last_change":"2024-09-14T11:56:22.913200+0000","last_active":"2024-09-14T11:56:22.913200+0000","last_peered":"2024-09-14T11:56:22.913200+0000","last_clean":"2024-09-14T11:56:22.913200+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:22.913200+0000","last_undegraded":"2024-09-14T11:56:22.913200+0000","last_fullsized":"2024-09-14T11:56:22.913200+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.913114+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:18.574527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1238,"num_read_kb":7389,"num_write":1100,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.683004+0000","last_change":"2024-09-14T11:56:40.683004+0000","last_active":"2024-09-14T11:56:40.683004+0000","last_peered":"2024-09-14T11:56:40.683004+0000","last_clean":"2024-09-14T11:56:40.683004+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:56:40.683004+0000","last_undegraded":"2024-09-14T11:56:40.683004+0000","last_fullsized":"2024-09-14T11:56:40.683004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.682920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:03.268737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'128","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.232307+0000","last_change":"2024-09-14T11:56:40.232307+0000","last_active":"2024-09-14T11:56:40.232307+0000","last_peered":"2024-09-14T11:56:40.232307+0000","last_clean":"2024-09-14T11:56:40.232307+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:56:40.232307+0000","last_undegraded":"2024-09-14T11:56:40.232307+0000","last_fullsized":"2024-09-14T11:56:40.232307+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.232198+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:52.939121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.237710+0000","last_change":"2024-09-14T11:56:38.237710+0000","last_active":"2024-09-14T11:56:38.237710+0000","last_peered":"2024-09-14T11:56:38.237710+0000","last_clean":"2024-09-14T11:56:38.237710+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:56:38.237710+0000","last_undegraded":"2024-09-14T11:56:38.237710+0000","last_fullsized":"2024-09-14T11:56:38.237710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.237609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.821273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.770817+0000","last_change":"2024-09-14T11:56:55.770817+0000","last_active":"2024-09-14T11:56:55.770817+0000","last_peered":"2024-09-14T11:56:55.770817+0000","last_clean":"2024-09-14T11:56:55.770817+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:56:55.770817+0000","last_undegraded":"2024-09-14T11:56:55.770817+0000","last_fullsized":"2024-09-14T11:56:55.770817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'83","last_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_deep_scrub":"263'83","last_deep_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.770737+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:18.262644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'460","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.810118+0000","last_change":"2024-09-14T11:56:28.810118+0000","last_active":"2024-09-14T11:56:28.810118+0000","last_peered":"2024-09-14T11:56:28.810118+0000","last_clean":"2024-09-14T11:56:28.810118+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:56:28.810118+0000","last_undegraded":"2024-09-14T11:56:28.810118+0000","last_fullsized":"2024-09-14T11:56:28.810118+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.810021+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.644059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.828138+0000","last_change":"2024-09-14T11:56:24.828138+0000","last_active":"2024-09-14T11:56:24.828138+0000","last_peered":"2024-09-14T11:56:24.828138+0000","last_clean":"2024-09-14T11:56:24.828138+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:24.828138+0000","last_undegraded":"2024-09-14T11:56:24.828138+0000","last_fullsized":"2024-09-14T11:56:24.828138+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.828029+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:30.652084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.916705+0000","last_change":"2024-09-14T11:56:20.916705+0000","last_active":"2024-09-14T11:56:20.916705+0000","last_peered":"2024-09-14T11:56:20.916705+0000","last_clean":"2024-09-14T11:56:20.916705+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:56:20.916705+0000","last_undegraded":"2024-09-14T11:56:20.916705+0000","last_fullsized":"2024-09-14T11:56:20.916705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.916627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:12.576482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.649519+0000","last_change":"2024-09-14T11:56:39.649519+0000","last_active":"2024-09-14T11:56:39.649519+0000","last_peered":"2024-09-14T11:56:39.649519+0000","last_clean":"2024-09-14T11:56:39.649519+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:56:39.649519+0000","last_undegraded":"2024-09-14T11:56:39.649519+0000","last_fullsized":"2024-09-14T11:56:39.649519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.649433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:03.443069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'547","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.668212+0000","last_change":"2024-09-14T11:56:42.668212+0000","last_active":"2024-09-14T11:56:42.668212+0000","last_peered":"2024-09-14T11:56:42.668212+0000","last_clean":"2024-09-14T11:56:42.668212+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:42.668212+0000","last_undegraded":"2024-09-14T11:56:42.668212+0000","last_fullsized":"2024-09-14T11:56:42.668212+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.668098+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:32.877719+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":943,"num_read_kb":2151,"num_write":772,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.731164+0000","last_change":"2024-09-14T11:56:50.731164+0000","last_active":"2024-09-14T11:56:50.731164+0000","last_peered":"2024-09-14T11:56:50.731164+0000","last_clean":"2024-09-14T11:56:50.731164+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:56:50.731164+0000","last_undegraded":"2024-09-14T11:56:50.731164+0000","last_fullsized":"2024-09-14T11:56:50.731164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.731065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:11.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'166","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.811282+0000","last_change":"2024-09-14T11:56:55.811222+0000","last_active":"2024-09-14T11:56:55.811282+0000","last_peered":"2024-09-14T11:56:55.811282+0000","last_clean":"2024-09-14T11:56:55.811282+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:56:55.811282+0000","last_undegraded":"2024-09-14T11:56:55.811282+0000","last_fullsized":"2024-09-14T11:56:55.811282+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.811129+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.315887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'755","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562539+0000","last_change":"2024-09-14T11:56:32.562539+0000","last_active":"2024-09-14T11:56:32.562539+0000","last_peered":"2024-09-14T11:56:32.562539+0000","last_clean":"2024-09-14T11:56:32.562539+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:56:32.562539+0000","last_undegraded":"2024-09-14T11:56:32.562539+0000","last_fullsized":"2024-09-14T11:56:32.562539+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.562454+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:52.777172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'346","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.813989+0000","last_change":"2024-09-14T11:56:26.813989+0000","last_active":"2024-09-14T11:56:26.813989+0000","last_peered":"2024-09-14T11:56:26.813989+0000","last_clean":"2024-09-14T11:56:26.813989+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:26.813989+0000","last_undegraded":"2024-09-14T11:56:26.813989+0000","last_fullsized":"2024-09-14T11:56:26.813989+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.813888+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:55.071316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":25654,"num_write":1001,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.485112+0000","last_change":"2024-09-14T11:56:34.485112+0000","last_active":"2024-09-14T11:56:34.485112+0000","last_peered":"2024-09-14T11:56:34.485112+0000","last_clean":"2024-09-14T11:56:34.485112+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:56:34.485112+0000","last_undegraded":"2024-09-14T11:56:34.485112+0000","last_fullsized":"2024-09-14T11:56:34.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.485023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.746684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.247905+0000","last_change":"2024-09-14T11:56:35.247905+0000","last_active":"2024-09-14T11:56:35.247905+0000","last_peered":"2024-09-14T11:56:35.247905+0000","last_clean":"2024-09-14T11:56:35.247905+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:56:35.247905+0000","last_undegraded":"2024-09-14T11:56:35.247905+0000","last_fullsized":"2024-09-14T11:56:35.247905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.247811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.168290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'188","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.826318+0000","last_change":"2024-09-14T11:56:40.826318+0000","last_active":"2024-09-14T11:56:40.826318+0000","last_peered":"2024-09-14T11:56:40.826318+0000","last_clean":"2024-09-14T11:56:40.826318+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:56:40.826318+0000","last_undegraded":"2024-09-14T11:56:40.826318+0000","last_fullsized":"2024-09-14T11:56:40.826318+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.826206+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:23.195767+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'811","reported_seq":2686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.732182+0000","last_change":"2024-09-14T11:56:52.732182+0000","last_active":"2024-09-14T11:56:52.732182+0000","last_peered":"2024-09-14T11:56:52.732182+0000","last_clean":"2024-09-14T11:56:52.732182+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:52.732182+0000","last_undegraded":"2024-09-14T11:56:52.732182+0000","last_fullsized":"2024-09-14T11:56:52.732182+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.732066+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:54.882453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'95","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.164929+0000","last_change":"2024-09-14T11:56:57.164874+0000","last_active":"2024-09-14T11:56:57.164929+0000","last_peered":"2024-09-14T11:56:57.164929+0000","last_clean":"2024-09-14T11:56:57.164929+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:56:57.164929+0000","last_undegraded":"2024-09-14T11:56:57.164929+0000","last_fullsized":"2024-09-14T11:56:57.164929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.164782+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:05.807030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'360","reported_seq":1842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.042831+0000","last_change":"2024-09-14T11:56:33.042831+0000","last_active":"2024-09-14T11:56:33.042831+0000","last_peered":"2024-09-14T11:56:33.042831+0000","last_clean":"2024-09-14T11:56:33.042831+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:56:33.042831+0000","last_undegraded":"2024-09-14T11:56:33.042831+0000","last_fullsized":"2024-09-14T11:56:33.042831+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.042715+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:58.519932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'336","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.879898+0000","last_change":"2024-09-14T11:56:24.879898+0000","last_active":"2024-09-14T11:56:24.879898+0000","last_peered":"2024-09-14T11:56:24.879898+0000","last_clean":"2024-09-14T11:56:24.879898+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:24.879898+0000","last_undegraded":"2024-09-14T11:56:24.879898+0000","last_fullsized":"2024-09-14T11:56:24.879898+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.879817+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:17.339902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":1407,"num_write":989,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.878597+0000","last_change":"2024-09-14T11:56:21.878547+0000","last_active":"2024-09-14T11:56:21.878597+0000","last_peered":"2024-09-14T11:56:21.878597+0000","last_clean":"2024-09-14T11:56:21.878597+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:56:21.878597+0000","last_undegraded":"2024-09-14T11:56:21.878597+0000","last_fullsized":"2024-09-14T11:56:21.878597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.878477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:14.405917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.743031+0000","last_change":"2024-09-14T11:56:44.743031+0000","last_active":"2024-09-14T11:56:44.743031+0000","last_peered":"2024-09-14T11:56:44.743031+0000","last_clean":"2024-09-14T11:56:44.743031+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:56:44.743031+0000","last_undegraded":"2024-09-14T11:56:44.743031+0000","last_fullsized":"2024-09-14T11:56:44.743031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.742899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:06.805443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'104","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.821602+0000","last_change":"2024-09-14T11:56:46.821602+0000","last_active":"2024-09-14T11:56:46.821602+0000","last_peered":"2024-09-14T11:56:46.821602+0000","last_clean":"2024-09-14T11:56:46.821602+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:56:46.821602+0000","last_undegraded":"2024-09-14T11:56:46.821602+0000","last_fullsized":"2024-09-14T11:56:46.821602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.821514+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:20.188202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.198992+0000","last_change":"2024-09-14T11:56:52.198992+0000","last_active":"2024-09-14T11:56:52.198992+0000","last_peered":"2024-09-14T11:56:52.198992+0000","last_clean":"2024-09-14T11:56:52.198992+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:52.198992+0000","last_undegraded":"2024-09-14T11:56:52.198992+0000","last_fullsized":"2024-09-14T11:56:52.198992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.198904+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.378166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'332","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.747551+0000","last_change":"2024-09-14T11:56:53.747475+0000","last_active":"2024-09-14T11:56:53.747551+0000","last_peered":"2024-09-14T11:56:53.747551+0000","last_clean":"2024-09-14T11:56:53.747551+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:56:53.747551+0000","last_undegraded":"2024-09-14T11:56:53.747551+0000","last_fullsized":"2024-09-14T11:56:53.747551+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.747387+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.923900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1138","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.720530+0000","last_change":"2024-09-14T11:56:26.720530+0000","last_active":"2024-09-14T11:56:26.720530+0000","last_peered":"2024-09-14T11:56:26.720530+0000","last_clean":"2024-09-14T11:56:26.720530+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:56:26.720530+0000","last_undegraded":"2024-09-14T11:56:26.720530+0000","last_fullsized":"2024-09-14T11:56:26.720530+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.720427+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:26.572105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'384","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.466221+0000","last_change":"2024-09-14T11:56:21.466221+0000","last_active":"2024-09-14T11:56:21.466221+0000","last_peered":"2024-09-14T11:56:21.466221+0000","last_clean":"2024-09-14T11:56:21.466221+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:21.466221+0000","last_undegraded":"2024-09-14T11:56:21.466221+0000","last_fullsized":"2024-09-14T11:56:21.466221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.466142+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:51.285530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":7233,"num_write":1301,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.096204+0000","last_change":"2024-09-14T11:56:23.096139+0000","last_active":"2024-09-14T11:56:23.096204+0000","last_peered":"2024-09-14T11:56:23.096204+0000","last_clean":"2024-09-14T11:56:23.096204+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:56:23.096204+0000","last_undegraded":"2024-09-14T11:56:23.096204+0000","last_fullsized":"2024-09-14T11:56:23.096204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.096056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:44.997173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.171745+0000","last_change":"2024-09-14T11:56:38.171745+0000","last_active":"2024-09-14T11:56:38.171745+0000","last_peered":"2024-09-14T11:56:38.171745+0000","last_clean":"2024-09-14T11:56:38.171745+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:56:38.171745+0000","last_undegraded":"2024-09-14T11:56:38.171745+0000","last_fullsized":"2024-09-14T11:56:38.171745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.171651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'768","reported_seq":1481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.540722+0000","last_change":"2024-09-14T11:56:44.540722+0000","last_active":"2024-09-14T11:56:44.540722+0000","last_peered":"2024-09-14T11:56:44.540722+0000","last_clean":"2024-09-14T11:56:44.540722+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:44.540722+0000","last_undegraded":"2024-09-14T11:56:44.540722+0000","last_fullsized":"2024-09-14T11:56:44.540722+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.540620+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:46.054100+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1362,"num_read_kb":3256,"num_write":1124,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.237722+0000","last_change":"2024-09-14T11:56:51.237722+0000","last_active":"2024-09-14T11:56:51.237722+0000","last_peered":"2024-09-14T11:56:51.237722+0000","last_clean":"2024-09-14T11:56:51.237722+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:56:51.237722+0000","last_undegraded":"2024-09-14T11:56:51.237722+0000","last_fullsized":"2024-09-14T11:56:51.237722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.237634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:59.694149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.795670+0000","last_change":"2024-09-14T11:56:56.795609+0000","last_active":"2024-09-14T11:56:56.795670+0000","last_peered":"2024-09-14T11:56:56.795670+0000","last_clean":"2024-09-14T11:56:56.795670+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:56:56.795670+0000","last_undegraded":"2024-09-14T11:56:56.795670+0000","last_fullsized":"2024-09-14T11:56:56.795670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.795524+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:50.937930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.761145+0000","last_change":"2024-09-14T11:56:59.761145+0000","last_active":"2024-09-14T11:56:59.761145+0000","last_peered":"2024-09-14T11:56:59.761145+0000","last_clean":"2024-09-14T11:56:59.761145+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:56:59.761145+0000","last_undegraded":"2024-09-14T11:56:59.761145+0000","last_fullsized":"2024-09-14T11:56:59.761145+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.761046+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:42.719893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'433","reported_seq":2063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.757762+0000","last_change":"2024-09-14T11:56:31.757762+0000","last_active":"2024-09-14T11:56:31.757762+0000","last_peered":"2024-09-14T11:56:31.757762+0000","last_clean":"2024-09-14T11:56:31.757762+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:56:31.757762+0000","last_undegraded":"2024-09-14T11:56:31.757762+0000","last_fullsized":"2024-09-14T11:56:31.757762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.757652+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:26.947794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.662921+0000","last_change":"2024-09-14T11:56:23.662921+0000","last_active":"2024-09-14T11:56:23.662921+0000","last_peered":"2024-09-14T11:56:23.662921+0000","last_clean":"2024-09-14T11:56:23.662921+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:23.662921+0000","last_undegraded":"2024-09-14T11:56:23.662921+0000","last_fullsized":"2024-09-14T11:56:23.662921+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.662820+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.362361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.764130+0000","last_change":"2024-09-14T11:56:36.764130+0000","last_active":"2024-09-14T11:56:36.764130+0000","last_peered":"2024-09-14T11:56:36.764130+0000","last_clean":"2024-09-14T11:56:36.764130+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:36.764130+0000","last_undegraded":"2024-09-14T11:56:36.764130+0000","last_fullsized":"2024-09-14T11:56:36.764130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.764053+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.131436+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'268","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.282675+0000","last_change":"2024-09-14T11:56:47.282675+0000","last_active":"2024-09-14T11:56:47.282675+0000","last_peered":"2024-09-14T11:56:47.282675+0000","last_clean":"2024-09-14T11:56:47.282675+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:47.282675+0000","last_undegraded":"2024-09-14T11:56:47.282675+0000","last_fullsized":"2024-09-14T11:56:47.282675+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'268","last_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_deep_scrub":"263'268","last_deep_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.282577+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:35.922781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.197057+0000","last_change":"2024-09-14T11:56:54.197057+0000","last_active":"2024-09-14T11:56:54.197057+0000","last_peered":"2024-09-14T11:56:54.197057+0000","last_clean":"2024-09-14T11:56:54.197057+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:56:54.197057+0000","last_undegraded":"2024-09-14T11:56:54.197057+0000","last_fullsized":"2024-09-14T11:56:54.197057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.196971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:14.784761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.091259+0000","last_change":"2024-09-14T11:57:01.091259+0000","last_active":"2024-09-14T11:57:01.091259+0000","last_peered":"2024-09-14T11:57:01.091259+0000","last_clean":"2024-09-14T11:57:01.091259+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:57:01.091259+0000","last_undegraded":"2024-09-14T11:57:01.091259+0000","last_fullsized":"2024-09-14T11:57:01.091259+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T11:57:01.091173+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T11:57:01.091173+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.091173+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.186184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'784","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.737175+0000","last_change":"2024-09-14T11:56:32.737175+0000","last_active":"2024-09-14T11:56:32.737175+0000","last_peered":"2024-09-14T11:56:32.737175+0000","last_clean":"2024-09-14T11:56:32.737175+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:56:32.737175+0000","last_undegraded":"2024-09-14T11:56:32.737175+0000","last_fullsized":"2024-09-14T11:56:32.737175+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'784","last_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_deep_scrub":"263'784","last_deep_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.737071+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:46.307192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'373","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.476776+0000","last_change":"2024-09-14T11:56:30.476776+0000","last_active":"2024-09-14T11:56:30.476776+0000","last_peered":"2024-09-14T11:56:30.476776+0000","last_clean":"2024-09-14T11:56:30.476776+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:30.476776+0000","last_undegraded":"2024-09-14T11:56:30.476776+0000","last_fullsized":"2024-09-14T11:56:30.476776+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.476624+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:37.040267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":24187,"num_write":1164,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.301966+0000","last_change":"2024-09-14T11:56:43.301966+0000","last_active":"2024-09-14T11:56:43.301966+0000","last_peered":"2024-09-14T11:56:43.301966+0000","last_clean":"2024-09-14T11:56:43.301966+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:56:43.301966+0000","last_undegraded":"2024-09-14T11:56:43.301966+0000","last_fullsized":"2024-09-14T11:56:43.301966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.301874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:11.795970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'51","reported_seq":556,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.677930+0000","last_change":"2024-09-14T11:56:45.677930+0000","last_active":"2024-09-14T11:56:45.677930+0000","last_peered":"2024-09-14T11:56:45.677930+0000","last_clean":"2024-09-14T11:56:45.677930+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:56:45.677930+0000","last_undegraded":"2024-09-14T11:56:45.677930+0000","last_fullsized":"2024-09-14T11:56:45.677930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.677854+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:59.900722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.451629+0000","last_change":"2024-09-14T11:56:51.451629+0000","last_active":"2024-09-14T11:56:51.451629+0000","last_peered":"2024-09-14T11:56:51.451629+0000","last_clean":"2024-09-14T11:56:51.451629+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:56:51.451629+0000","last_undegraded":"2024-09-14T11:56:51.451629+0000","last_fullsized":"2024-09-14T11:56:51.451629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.451543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.323082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.763278+0000","last_change":"2024-09-14T11:56:58.763278+0000","last_active":"2024-09-14T11:56:58.763278+0000","last_peered":"2024-09-14T11:56:58.763278+0000","last_clean":"2024-09-14T11:56:58.763278+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:56:58.763278+0000","last_undegraded":"2024-09-14T11:56:58.763278+0000","last_fullsized":"2024-09-14T11:56:58.763278+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.763192+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:45.580829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'917","reported_seq":2661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.036282+0000","last_change":"2024-09-14T11:56:29.036282+0000","last_active":"2024-09-14T11:56:29.036282+0000","last_peered":"2024-09-14T11:56:29.036282+0000","last_clean":"2024-09-14T11:56:29.036282+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:56:29.036282+0000","last_undegraded":"2024-09-14T11:56:29.036282+0000","last_fullsized":"2024-09-14T11:56:29.036282+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'917","last_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_deep_scrub":"263'917","last_deep_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.036185+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":900,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.766117+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.816297+0000","last_change":"2024-09-14T11:56:25.816297+0000","last_active":"2024-09-14T11:56:25.816297+0000","last_peered":"2024-09-14T11:56:25.816297+0000","last_clean":"2024-09-14T11:56:25.816297+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:25.816297+0000","last_undegraded":"2024-09-14T11:56:25.816297+0000","last_fullsized":"2024-09-14T11:56:25.816297+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.816150+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:23.901347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.521539+0000","last_change":"2024-09-14T11:56:42.521539+0000","last_active":"2024-09-14T11:56:42.521539+0000","last_peered":"2024-09-14T11:56:42.521539+0000","last_clean":"2024-09-14T11:56:42.521539+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:56:42.521539+0000","last_undegraded":"2024-09-14T11:56:42.521539+0000","last_fullsized":"2024-09-14T11:56:42.521539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.521449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:00.655304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'328","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.269584+0000","last_change":"2024-09-14T11:56:48.269584+0000","last_active":"2024-09-14T11:56:48.269584+0000","last_peered":"2024-09-14T11:56:48.269584+0000","last_clean":"2024-09-14T11:56:48.269584+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:48.269584+0000","last_undegraded":"2024-09-14T11:56:48.269584+0000","last_fullsized":"2024-09-14T11:56:48.269584+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.269489+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:55.281201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.190118+0000","last_change":"2024-09-14T11:56:41.190118+0000","last_active":"2024-09-14T11:56:41.190118+0000","last_peered":"2024-09-14T11:56:41.190118+0000","last_clean":"2024-09-14T11:56:41.190118+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:56:41.190118+0000","last_undegraded":"2024-09-14T11:56:41.190118+0000","last_fullsized":"2024-09-14T11:56:41.190118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.190036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:27.442628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.727430+0000","last_change":"2024-09-14T11:56:58.727430+0000","last_active":"2024-09-14T11:56:58.727430+0000","last_peered":"2024-09-14T11:56:58.727430+0000","last_clean":"2024-09-14T11:56:58.727430+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:56:58.727430+0000","last_undegraded":"2024-09-14T11:56:58.727430+0000","last_fullsized":"2024-09-14T11:56:58.727430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.727339+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:00.229225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'565","reported_seq":2300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.144947+0000","last_change":"2024-09-14T11:56:36.144947+0000","last_active":"2024-09-14T11:56:36.144947+0000","last_peered":"2024-09-14T11:56:36.144947+0000","last_clean":"2024-09-14T11:56:36.144947+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:56:36.144947+0000","last_undegraded":"2024-09-14T11:56:36.144947+0000","last_fullsized":"2024-09-14T11:56:36.144947+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'565","last_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_deep_scrub":"263'565","last_deep_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.144850+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:25.651462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.513418+0000","last_change":"2024-09-14T11:56:22.513418+0000","last_active":"2024-09-14T11:56:22.513418+0000","last_peered":"2024-09-14T11:56:22.513418+0000","last_clean":"2024-09-14T11:56:22.513418+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:22.513418+0000","last_undegraded":"2024-09-14T11:56:22.513418+0000","last_fullsized":"2024-09-14T11:56:22.513418+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.513319+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.055131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":715,"num_read_kb":20814,"num_write":1368,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.285132+0000","last_change":"2024-09-14T11:56:36.285132+0000","last_active":"2024-09-14T11:56:36.285132+0000","last_peered":"2024-09-14T11:56:36.285132+0000","last_clean":"2024-09-14T11:56:36.285132+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:56:36.285132+0000","last_undegraded":"2024-09-14T11:56:36.285132+0000","last_fullsized":"2024-09-14T11:56:36.285132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.285037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.139207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'270","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.491371+0000","last_change":"2024-09-14T11:56:47.491371+0000","last_active":"2024-09-14T11:56:47.491371+0000","last_peered":"2024-09-14T11:56:47.491371+0000","last_clean":"2024-09-14T11:56:47.491371+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:47.491371+0000","last_undegraded":"2024-09-14T11:56:47.491371+0000","last_fullsized":"2024-09-14T11:56:47.491371+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.491269+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:00.619858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.764814+0000","last_change":"2024-09-14T11:56:52.764814+0000","last_active":"2024-09-14T11:56:52.764814+0000","last_peered":"2024-09-14T11:56:52.764814+0000","last_clean":"2024-09-14T11:56:52.764814+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:56:52.764814+0000","last_undegraded":"2024-09-14T11:56:52.764814+0000","last_fullsized":"2024-09-14T11:56:52.764814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.764702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:01.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.194337+0000","last_change":"2024-09-14T11:56:32.194337+0000","last_active":"2024-09-14T11:56:32.194337+0000","last_peered":"2024-09-14T11:56:32.194337+0000","last_clean":"2024-09-14T11:56:32.194337+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:56:32.194337+0000","last_undegraded":"2024-09-14T11:56:32.194337+0000","last_fullsized":"2024-09-14T11:56:32.194337+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.194246+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:46.983995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.027053+0000","last_change":"2024-09-14T11:56:24.027053+0000","last_active":"2024-09-14T11:56:24.027053+0000","last_peered":"2024-09-14T11:56:24.027053+0000","last_clean":"2024-09-14T11:56:24.027053+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:24.027053+0000","last_undegraded":"2024-09-14T11:56:24.027053+0000","last_fullsized":"2024-09-14T11:56:24.027053+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.026967+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:04.386753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":1976,"num_write":1075,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.696720+0000","last_change":"2024-09-14T11:56:41.696720+0000","last_active":"2024-09-14T11:56:41.696720+0000","last_peered":"2024-09-14T11:56:41.696720+0000","last_clean":"2024-09-14T11:56:41.696720+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:56:41.696720+0000","last_undegraded":"2024-09-14T11:56:41.696720+0000","last_fullsized":"2024-09-14T11:56:41.696720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.696635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:41.649777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'497","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.802546+0000","last_change":"2024-09-14T11:56:42.802546+0000","last_active":"2024-09-14T11:56:42.802546+0000","last_peered":"2024-09-14T11:56:42.802546+0000","last_clean":"2024-09-14T11:56:42.802546+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:42.802546+0000","last_undegraded":"2024-09-14T11:56:42.802546+0000","last_fullsized":"2024-09-14T11:56:42.802546+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.802453+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.897670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100440,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2109,"num_write":762,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.765021+0000","last_change":"2024-09-14T11:56:53.765021+0000","last_active":"2024-09-14T11:56:53.765021+0000","last_peered":"2024-09-14T11:56:53.765021+0000","last_clean":"2024-09-14T11:56:53.765021+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:56:53.765021+0000","last_undegraded":"2024-09-14T11:56:53.765021+0000","last_fullsized":"2024-09-14T11:56:53.765021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.764935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:14.345255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'179","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.163408+0000","last_change":"2024-09-14T11:56:59.163408+0000","last_active":"2024-09-14T11:56:59.163408+0000","last_peered":"2024-09-14T11:56:59.163408+0000","last_clean":"2024-09-14T11:56:59.163408+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:56:59.163408+0000","last_undegraded":"2024-09-14T11:56:59.163408+0000","last_fullsized":"2024-09-14T11:56:59.163408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.163317+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:15.030499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'413","reported_seq":1954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.580724+0000","last_change":"2024-09-14T11:56:36.580724+0000","last_active":"2024-09-14T11:56:36.580724+0000","last_peered":"2024-09-14T11:56:36.580724+0000","last_clean":"2024-09-14T11:56:36.580724+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:56:36.580724+0000","last_undegraded":"2024-09-14T11:56:36.580724+0000","last_fullsized":"2024-09-14T11:56:36.580724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.580630+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:57.544918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'351","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.810015+0000","last_change":"2024-09-14T11:56:23.810015+0000","last_active":"2024-09-14T11:56:23.810015+0000","last_peered":"2024-09-14T11:56:23.810015+0000","last_clean":"2024-09-14T11:56:23.810015+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:23.810015+0000","last_undegraded":"2024-09-14T11:56:23.810015+0000","last_fullsized":"2024-09-14T11:56:23.810015+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.809947+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:11.325976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":10770,"num_write":1202,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.246504+0000","last_change":"2024-09-14T11:56:37.246504+0000","last_active":"2024-09-14T11:56:37.246504+0000","last_peered":"2024-09-14T11:56:37.246504+0000","last_clean":"2024-09-14T11:56:37.246504+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:56:37.246504+0000","last_undegraded":"2024-09-14T11:56:37.246504+0000","last_fullsized":"2024-09-14T11:56:37.246504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.246409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:58.990350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'329","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.490988+0000","last_change":"2024-09-14T11:56:49.490988+0000","last_active":"2024-09-14T11:56:49.490988+0000","last_peered":"2024-09-14T11:56:49.490988+0000","last_clean":"2024-09-14T11:56:49.490988+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:49.490988+0000","last_undegraded":"2024-09-14T11:56:49.490988+0000","last_fullsized":"2024-09-14T11:56:49.490988+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.490894+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.716046+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.821686+0000","last_change":"2024-09-14T11:56:43.821583+0000","last_active":"2024-09-14T11:56:43.821686+0000","last_peered":"2024-09-14T11:56:43.821686+0000","last_clean":"2024-09-14T11:56:43.821686+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:56:43.821686+0000","last_undegraded":"2024-09-14T11:56:43.821686+0000","last_fullsized":"2024-09-14T11:56:43.821686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.821463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:44.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'239","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.190251+0000","last_change":"2024-09-14T11:56:45.190251+0000","last_active":"2024-09-14T11:56:45.190251+0000","last_peered":"2024-09-14T11:56:45.190251+0000","last_clean":"2024-09-14T11:56:45.190251+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:56:45.190251+0000","last_undegraded":"2024-09-14T11:56:45.190251+0000","last_fullsized":"2024-09-14T11:56:45.190251+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.190156+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:19.971391+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'497","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.133993+0000","last_change":"2024-09-14T11:56:35.133928+0000","last_active":"2024-09-14T11:56:35.133993+0000","last_peered":"2024-09-14T11:56:35.133993+0000","last_clean":"2024-09-14T11:56:35.133993+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:56:35.133993+0000","last_undegraded":"2024-09-14T11:56:35.133993+0000","last_fullsized":"2024-09-14T11:56:35.133993+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.133843+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:47.774586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.633798+0000","last_change":"2024-09-14T11:56:22.633722+0000","last_active":"2024-09-14T11:56:22.633798+0000","last_peered":"2024-09-14T11:56:22.633798+0000","last_clean":"2024-09-14T11:56:22.633798+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:22.633798+0000","last_undegraded":"2024-09-14T11:56:22.633798+0000","last_fullsized":"2024-09-14T11:56:22.633798+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.633613+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:24.515854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.787436+0000","last_change":"2024-09-14T11:56:45.787436+0000","last_active":"2024-09-14T11:56:45.787436+0000","last_peered":"2024-09-14T11:56:45.787436+0000","last_clean":"2024-09-14T11:56:45.787436+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:56:45.787436+0000","last_undegraded":"2024-09-14T11:56:45.787436+0000","last_fullsized":"2024-09-14T11:56:45.787436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.787349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:30.736106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.282345+0000","last_change":"2024-09-14T11:56:50.282345+0000","last_active":"2024-09-14T11:56:50.282345+0000","last_peered":"2024-09-14T11:56:50.282345+0000","last_clean":"2024-09-14T11:56:50.282345+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:50.282345+0000","last_undegraded":"2024-09-14T11:56:50.282345+0000","last_fullsized":"2024-09-14T11:56:50.282345+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.282250+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.560895+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.917145+0000","last_change":"2024-09-14T11:56:46.917145+0000","last_active":"2024-09-14T11:56:46.917145+0000","last_peered":"2024-09-14T11:56:46.917145+0000","last_clean":"2024-09-14T11:56:46.917145+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:56:46.917145+0000","last_undegraded":"2024-09-14T11:56:46.917145+0000","last_fullsized":"2024-09-14T11:56:46.917145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.917046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:41.568586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'148","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.748983+0000","last_change":"2024-09-14T11:56:57.748983+0000","last_active":"2024-09-14T11:56:57.748983+0000","last_peered":"2024-09-14T11:56:57.748983+0000","last_clean":"2024-09-14T11:56:57.748983+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:56:57.748983+0000","last_undegraded":"2024-09-14T11:56:57.748983+0000","last_fullsized":"2024-09-14T11:56:57.748983+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.748848+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:22.383031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'422","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832552+0000","last_change":"2024-09-14T11:56:27.832498+0000","last_active":"2024-09-14T11:56:27.832552+0000","last_peered":"2024-09-14T11:56:27.832552+0000","last_clean":"2024-09-14T11:56:27.832552+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:56:27.832552+0000","last_undegraded":"2024-09-14T11:56:27.832552+0000","last_fullsized":"2024-09-14T11:56:27.832552+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'422","last_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_deep_scrub":"263'422","last_deep_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832415+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:22.843154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.528483+0000","last_change":"2024-09-14T11:56:24.528420+0000","last_active":"2024-09-14T11:56:24.528483+0000","last_peered":"2024-09-14T11:56:24.528483+0000","last_clean":"2024-09-14T11:56:24.528483+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:24.528483+0000","last_undegraded":"2024-09-14T11:56:24.528483+0000","last_fullsized":"2024-09-14T11:56:24.528483+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.528314+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.890618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":46735,"num_write":1109,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.774071+0000","last_change":"2024-09-14T11:56:39.774007+0000","last_active":"2024-09-14T11:56:39.774071+0000","last_peered":"2024-09-14T11:56:39.774071+0000","last_clean":"2024-09-14T11:56:39.774071+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:56:39.774071+0000","last_undegraded":"2024-09-14T11:56:39.774071+0000","last_fullsized":"2024-09-14T11:56:39.774071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.773918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:01.996446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'87","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.768704+0000","last_change":"2024-09-14T11:56:49.768704+0000","last_active":"2024-09-14T11:56:49.768704+0000","last_peered":"2024-09-14T11:56:49.768704+0000","last_clean":"2024-09-14T11:56:49.768704+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:56:49.768704+0000","last_undegraded":"2024-09-14T11:56:49.768704+0000","last_fullsized":"2024-09-14T11:56:49.768704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.768604+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:52.138898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.229292+0000","last_change":"2024-09-14T11:56:43.229292+0000","last_active":"2024-09-14T11:56:43.229292+0000","last_peered":"2024-09-14T11:56:43.229292+0000","last_clean":"2024-09-14T11:56:43.229292+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:43.229292+0000","last_undegraded":"2024-09-14T11:56:43.229292+0000","last_fullsized":"2024-09-14T11:56:43.229292+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.229209+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:29.015641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.420310+0000","last_change":"2024-09-14T11:56:54.420310+0000","last_active":"2024-09-14T11:56:54.420310+0000","last_peered":"2024-09-14T11:56:54.420310+0000","last_clean":"2024-09-14T11:56:54.420310+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:56:54.420310+0000","last_undegraded":"2024-09-14T11:56:54.420310+0000","last_fullsized":"2024-09-14T11:56:54.420310+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.420225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:23.804109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'915","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.792157+0000","last_change":"2024-09-14T11:56:34.792073+0000","last_active":"2024-09-14T11:56:34.792157+0000","last_peered":"2024-09-14T11:56:34.792157+0000","last_clean":"2024-09-14T11:56:34.792157+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:56:34.792157+0000","last_undegraded":"2024-09-14T11:56:34.792157+0000","last_fullsized":"2024-09-14T11:56:34.792157+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'915","last_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_deep_scrub":"263'915","last_deep_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.791978+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.186719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832779+0000","last_change":"2024-09-14T11:56:27.832718+0000","last_active":"2024-09-14T11:56:27.832779+0000","last_peered":"2024-09-14T11:56:27.832779+0000","last_clean":"2024-09-14T11:56:27.832779+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:27.832779+0000","last_undegraded":"2024-09-14T11:56:27.832779+0000","last_fullsized":"2024-09-14T11:56:27.832779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832588+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:52.609553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.517199+0000","last_change":"2024-09-14T11:56:43.517199+0000","last_active":"2024-09-14T11:56:43.517199+0000","last_peered":"2024-09-14T11:56:43.517199+0000","last_clean":"2024-09-14T11:56:43.517199+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:56:43.517199+0000","last_undegraded":"2024-09-14T11:56:43.517199+0000","last_fullsized":"2024-09-14T11:56:43.517199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.517088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:06.786780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'307","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.686246+0000","last_change":"2024-09-14T11:56:51.686246+0000","last_active":"2024-09-14T11:56:51.686246+0000","last_peered":"2024-09-14T11:56:51.686246+0000","last_clean":"2024-09-14T11:56:51.686246+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:51.686246+0000","last_undegraded":"2024-09-14T11:56:51.686246+0000","last_fullsized":"2024-09-14T11:56:51.686246+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.686158+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:06.242376+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.734741+0000","last_change":"2024-09-14T11:56:51.734741+0000","last_active":"2024-09-14T11:56:51.734741+0000","last_peered":"2024-09-14T11:56:51.734741+0000","last_clean":"2024-09-14T11:56:51.734741+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:56:51.734741+0000","last_undegraded":"2024-09-14T11:56:51.734741+0000","last_fullsized":"2024-09-14T11:56:51.734741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.734652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:22.887452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'122","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.378277+0000","last_change":"2024-09-14T11:56:55.378277+0000","last_active":"2024-09-14T11:56:55.378277+0000","last_peered":"2024-09-14T11:56:55.378277+0000","last_clean":"2024-09-14T11:56:55.378277+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:56:55.378277+0000","last_undegraded":"2024-09-14T11:56:55.378277+0000","last_fullsized":"2024-09-14T11:56:55.378277+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.378185+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:20.899163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.763122+0000","last_change":"2024-09-14T11:56:33.763020+0000","last_active":"2024-09-14T11:56:33.763122+0000","last_peered":"2024-09-14T11:56:33.763122+0000","last_clean":"2024-09-14T11:56:33.763122+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:56:33.763122+0000","last_undegraded":"2024-09-14T11:56:33.763122+0000","last_fullsized":"2024-09-14T11:56:33.763122+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.762877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:10.689175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.799237+0000","last_change":"2024-09-14T11:56:28.799145+0000","last_active":"2024-09-14T11:56:28.799237+0000","last_peered":"2024-09-14T11:56:28.799237+0000","last_clean":"2024-09-14T11:56:28.799237+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:28.799237+0000","last_undegraded":"2024-09-14T11:56:28.799237+0000","last_fullsized":"2024-09-14T11:56:28.799237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.799019+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.449897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.755551+0000","last_change":"2024-09-14T11:56:47.755551+0000","last_active":"2024-09-14T11:56:47.755551+0000","last_peered":"2024-09-14T11:56:47.755551+0000","last_clean":"2024-09-14T11:56:47.755551+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:56:47.755551+0000","last_undegraded":"2024-09-14T11:56:47.755551+0000","last_fullsized":"2024-09-14T11:56:47.755551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.755450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:19.691984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'267","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.650622+0000","last_change":"2024-09-14T11:56:46.650622+0000","last_active":"2024-09-14T11:56:46.650622+0000","last_peered":"2024-09-14T11:56:46.650622+0000","last_clean":"2024-09-14T11:56:46.650622+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:56:46.650622+0000","last_undegraded":"2024-09-14T11:56:46.650622+0000","last_fullsized":"2024-09-14T11:56:46.650622+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.650528+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:11.329743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":976,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.218389+0000","last_change":"2024-09-14T11:56:42.218389+0000","last_active":"2024-09-14T11:56:42.218389+0000","last_peered":"2024-09-14T11:56:42.218389+0000","last_clean":"2024-09-14T11:56:42.218389+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:56:42.218389+0000","last_undegraded":"2024-09-14T11:56:42.218389+0000","last_fullsized":"2024-09-14T11:56:42.218389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.218303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:15.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'146","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.141951+0000","last_change":"2024-09-14T11:57:00.141951+0000","last_active":"2024-09-14T11:57:00.141951+0000","last_peered":"2024-09-14T11:57:00.141951+0000","last_clean":"2024-09-14T11:57:00.141951+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:57:00.141951+0000","last_undegraded":"2024-09-14T11:57:00.141951+0000","last_fullsized":"2024-09-14T11:57:00.141951+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:57:00.141868+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:57:00.141868+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.141868+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:43.617119+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'329","reported_seq":1768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.031151+0000","last_change":"2024-09-14T11:56:32.031151+0000","last_active":"2024-09-14T11:56:32.031151+0000","last_peered":"2024-09-14T11:56:32.031151+0000","last_clean":"2024-09-14T11:56:32.031151+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:56:32.031151+0000","last_undegraded":"2024-09-14T11:56:32.031151+0000","last_fullsized":"2024-09-14T11:56:32.031151+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.031055+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:39.902095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'364","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.015176+0000","last_change":"2024-09-14T11:56:28.015176+0000","last_active":"2024-09-14T11:56:28.015176+0000","last_peered":"2024-09-14T11:56:28.015176+0000","last_clean":"2024-09-14T11:56:28.015176+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:28.015176+0000","last_undegraded":"2024-09-14T11:56:28.015176+0000","last_fullsized":"2024-09-14T11:56:28.015176+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.015080+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:02.166337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":1005,"num_write":1035,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.784036+0000","last_change":"2024-09-14T11:56:43.784036+0000","last_active":"2024-09-14T11:56:43.784036+0000","last_peered":"2024-09-14T11:56:43.784036+0000","last_clean":"2024-09-14T11:56:43.784036+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:56:43.784036+0000","last_undegraded":"2024-09-14T11:56:43.784036+0000","last_fullsized":"2024-09-14T11:56:43.784036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.783954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:02.643027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'229","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.289568+0000","last_change":"2024-09-14T11:56:49.289568+0000","last_active":"2024-09-14T11:56:49.289568+0000","last_peered":"2024-09-14T11:56:49.289568+0000","last_clean":"2024-09-14T11:56:49.289568+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:49.289568+0000","last_undegraded":"2024-09-14T11:56:49.289568+0000","last_fullsized":"2024-09-14T11:56:49.289568+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.289489+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:54.229919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.788551+0000","last_change":"2024-09-14T11:56:52.788551+0000","last_active":"2024-09-14T11:56:52.788551+0000","last_peered":"2024-09-14T11:56:52.788551+0000","last_clean":"2024-09-14T11:56:52.788551+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:56:52.788551+0000","last_undegraded":"2024-09-14T11:56:52.788551+0000","last_fullsized":"2024-09-14T11:56:52.788551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.788452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:09.126403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.357385+0000","last_change":"2024-09-14T11:56:56.357385+0000","last_active":"2024-09-14T11:56:56.357385+0000","last_peered":"2024-09-14T11:56:56.357385+0000","last_clean":"2024-09-14T11:56:56.357385+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:56:56.357385+0000","last_undegraded":"2024-09-14T11:56:56.357385+0000","last_fullsized":"2024-09-14T11:56:56.357385+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.357285+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:54.981854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.730074+0000","last_change":"2024-09-14T11:56:32.730074+0000","last_active":"2024-09-14T11:56:32.730074+0000","last_peered":"2024-09-14T11:56:32.730074+0000","last_clean":"2024-09-14T11:56:32.730074+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:56:32.730074+0000","last_undegraded":"2024-09-14T11:56:32.730074+0000","last_fullsized":"2024-09-14T11:56:32.730074+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.729983+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.217638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'335","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.542389+0000","last_change":"2024-09-14T11:56:26.542389+0000","last_active":"2024-09-14T11:56:26.542389+0000","last_peered":"2024-09-14T11:56:26.542389+0000","last_clean":"2024-09-14T11:56:26.542389+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:26.542389+0000","last_undegraded":"2024-09-14T11:56:26.542389+0000","last_fullsized":"2024-09-14T11:56:26.542389+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.542240+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:49.477686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":673,"num_read_kb":5062,"num_write":1074,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.726990+0000","last_change":"2024-09-14T11:56:38.726990+0000","last_active":"2024-09-14T11:56:38.726990+0000","last_peered":"2024-09-14T11:56:38.726990+0000","last_clean":"2024-09-14T11:56:38.726990+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:56:38.726990+0000","last_undegraded":"2024-09-14T11:56:38.726990+0000","last_fullsized":"2024-09-14T11:56:38.726990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.726904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.234751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'320","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.751007+0000","last_change":"2024-09-14T11:56:51.751007+0000","last_active":"2024-09-14T11:56:51.751007+0000","last_peered":"2024-09-14T11:56:51.751007+0000","last_clean":"2024-09-14T11:56:51.751007+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:51.751007+0000","last_undegraded":"2024-09-14T11:56:51.751007+0000","last_fullsized":"2024-09-14T11:56:51.751007+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.750913+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:18.147199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.790033+0000","last_change":"2024-09-14T11:56:54.790033+0000","last_active":"2024-09-14T11:56:54.790033+0000","last_peered":"2024-09-14T11:56:54.790033+0000","last_clean":"2024-09-14T11:56:54.790033+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:56:54.790033+0000","last_undegraded":"2024-09-14T11:56:54.790033+0000","last_fullsized":"2024-09-14T11:56:54.790033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.789942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:54.043254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'116","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.881093+0000","last_change":"2024-09-14T11:56:55.881093+0000","last_active":"2024-09-14T11:56:55.881093+0000","last_peered":"2024-09-14T11:56:55.881093+0000","last_clean":"2024-09-14T11:56:55.881093+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:56:55.881093+0000","last_undegraded":"2024-09-14T11:56:55.881093+0000","last_fullsized":"2024-09-14T11:56:55.881093+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.881013+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.948640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'436","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.789928+0000","last_change":"2024-09-14T11:56:35.789928+0000","last_active":"2024-09-14T11:56:35.789928+0000","last_peered":"2024-09-14T11:56:35.789928+0000","last_clean":"2024-09-14T11:56:35.789928+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:56:35.789928+0000","last_undegraded":"2024-09-14T11:56:35.789928+0000","last_fullsized":"2024-09-14T11:56:35.789928+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.789837+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:13.884434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.147968+0000","last_change":"2024-09-14T11:56:25.147968+0000","last_active":"2024-09-14T11:56:25.147968+0000","last_peered":"2024-09-14T11:56:25.147968+0000","last_clean":"2024-09-14T11:56:25.147968+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:25.147968+0000","last_undegraded":"2024-09-14T11:56:25.147968+0000","last_fullsized":"2024-09-14T11:56:25.147968+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.147865+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:36.906313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'539","reported_seq":2256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.747353+0000","last_change":"2024-09-14T11:56:34.747353+0000","last_active":"2024-09-14T11:56:34.747353+0000","last_peered":"2024-09-14T11:56:34.747353+0000","last_clean":"2024-09-14T11:56:34.747353+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:56:34.747353+0000","last_undegraded":"2024-09-14T11:56:34.747353+0000","last_fullsized":"2024-09-14T11:56:34.747353+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'539","last_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_deep_scrub":"263'539","last_deep_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.747258+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.313926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'380","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.841288+0000","last_change":"2024-09-14T11:56:25.841288+0000","last_active":"2024-09-14T11:56:25.841288+0000","last_peered":"2024-09-14T11:56:25.841288+0000","last_clean":"2024-09-14T11:56:25.841288+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:25.841288+0000","last_undegraded":"2024-09-14T11:56:25.841288+0000","last_fullsized":"2024-09-14T11:56:25.841288+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.841167+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.025310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":5548,"num_write":1128,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1192","reported_seq":2827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.736512+0000","last_change":"2024-09-14T11:56:38.736512+0000","last_active":"2024-09-14T11:56:38.736512+0000","last_peered":"2024-09-14T11:56:38.736512+0000","last_clean":"2024-09-14T11:56:38.736512+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:56:38.736512+0000","last_undegraded":"2024-09-14T11:56:38.736512+0000","last_fullsized":"2024-09-14T11:56:38.736512+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1192","last_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_deep_scrub":"263'1192","last_deep_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.736423+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.672754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.805721+0000","last_change":"2024-09-14T11:56:30.805721+0000","last_active":"2024-09-14T11:56:30.805721+0000","last_peered":"2024-09-14T11:56:30.805721+0000","last_clean":"2024-09-14T11:56:30.805721+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:30.805721+0000","last_undegraded":"2024-09-14T11:56:30.805721+0000","last_fullsized":"2024-09-14T11:56:30.805721+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.805550+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:51.121985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'463","reported_seq":2205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.766924+0000","last_change":"2024-09-14T11:56:33.766924+0000","last_active":"2024-09-14T11:56:33.766924+0000","last_peered":"2024-09-14T11:56:33.766924+0000","last_clean":"2024-09-14T11:56:33.766924+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:56:33.766924+0000","last_undegraded":"2024-09-14T11:56:33.766924+0000","last_fullsized":"2024-09-14T11:56:33.766924+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.766839+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:15.603752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2774,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.568939+0000","last_change":"2024-09-14T11:56:25.568939+0000","last_active":"2024-09-14T11:56:25.568939+0000","last_peered":"2024-09-14T11:56:25.568939+0000","last_clean":"2024-09-14T11:56:25.568939+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:25.568939+0000","last_undegraded":"2024-09-14T11:56:25.568939+0000","last_fullsized":"2024-09-14T11:56:25.568939+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.568822+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.874889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":9527,"num_write":1076,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'418","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.093331+0000","last_change":"2024-09-14T11:56:34.093331+0000","last_active":"2024-09-14T11:56:34.093331+0000","last_peered":"2024-09-14T11:56:34.093331+0000","last_clean":"2024-09-14T11:56:34.093331+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:56:34.093331+0000","last_undegraded":"2024-09-14T11:56:34.093331+0000","last_fullsized":"2024-09-14T11:56:34.093331+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.093235+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:56.415972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'329","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.009840+0000","last_change":"2024-09-14T11:56:25.009840+0000","last_active":"2024-09-14T11:56:25.009840+0000","last_peered":"2024-09-14T11:56:25.009840+0000","last_clean":"2024-09-14T11:56:25.009840+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:25.009840+0000","last_undegraded":"2024-09-14T11:56:25.009840+0000","last_fullsized":"2024-09-14T11:56:25.009840+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.009692+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:51.768321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":10973,"num_write":1149,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'781","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.772231+0000","last_change":"2024-09-14T11:56:35.772231+0000","last_active":"2024-09-14T11:56:35.772231+0000","last_peered":"2024-09-14T11:56:35.772231+0000","last_clean":"2024-09-14T11:56:35.772231+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:56:35.772231+0000","last_undegraded":"2024-09-14T11:56:35.772231+0000","last_fullsized":"2024-09-14T11:56:35.772231+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.772148+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:57.596143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'404","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.849765+0000","last_change":"2024-09-14T11:56:24.849765+0000","last_active":"2024-09-14T11:56:24.849765+0000","last_peered":"2024-09-14T11:56:24.849765+0000","last_clean":"2024-09-14T11:56:24.849765+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:24.849765+0000","last_undegraded":"2024-09-14T11:56:24.849765+0000","last_fullsized":"2024-09-14T11:56:24.849765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.849561+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:14.537929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":959,"num_read_kb":11029,"num_write":1184,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'411","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.179313+0000","last_change":"2024-09-14T11:56:37.179313+0000","last_active":"2024-09-14T11:56:37.179313+0000","last_peered":"2024-09-14T11:56:37.179313+0000","last_clean":"2024-09-14T11:56:37.179313+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:56:37.179313+0000","last_undegraded":"2024-09-14T11:56:37.179313+0000","last_fullsized":"2024-09-14T11:56:37.179313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.179225+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:59.876690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'401","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.896659+0000","last_change":"2024-09-14T11:56:33.896659+0000","last_active":"2024-09-14T11:56:33.896659+0000","last_peered":"2024-09-14T11:56:33.896659+0000","last_clean":"2024-09-14T11:56:33.896659+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:33.896659+0000","last_undegraded":"2024-09-14T11:56:33.896659+0000","last_fullsized":"2024-09-14T11:56:33.896659+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.896569+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:18.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":972,"num_read_kb":685,"num_write":1240,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'544","reported_seq":2170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.194969+0000","last_change":"2024-09-14T11:56:33.194969+0000","last_active":"2024-09-14T11:56:33.194969+0000","last_peered":"2024-09-14T11:56:33.194969+0000","last_clean":"2024-09-14T11:56:33.194969+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:56:33.194969+0000","last_undegraded":"2024-09-14T11:56:33.194969+0000","last_fullsized":"2024-09-14T11:56:33.194969+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.194868+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.778340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'301","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.998258+0000","last_change":"2024-09-14T11:56:25.998258+0000","last_active":"2024-09-14T11:56:25.998258+0000","last_peered":"2024-09-14T11:56:25.998258+0000","last_clean":"2024-09-14T11:56:25.998258+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:25.998258+0000","last_undegraded":"2024-09-14T11:56:25.998258+0000","last_fullsized":"2024-09-14T11:56:25.998258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.998152+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:52.475288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":918,"num_read_kb":80980,"num_write":1012,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.541399+0000","last_change":"2024-09-14T11:56:35.541399+0000","last_active":"2024-09-14T11:56:35.541399+0000","last_peered":"2024-09-14T11:56:35.541399+0000","last_clean":"2024-09-14T11:56:35.541399+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:56:35.541399+0000","last_undegraded":"2024-09-14T11:56:35.541399+0000","last_fullsized":"2024-09-14T11:56:35.541399+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.541315+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.815826+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.804378+0000","last_change":"2024-09-14T11:56:29.804378+0000","last_active":"2024-09-14T11:56:29.804378+0000","last_peered":"2024-09-14T11:56:29.804378+0000","last_clean":"2024-09-14T11:56:29.804378+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:29.804378+0000","last_undegraded":"2024-09-14T11:56:29.804378+0000","last_fullsized":"2024-09-14T11:56:29.804378+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.804272+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:56.088992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'423","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.710966+0000","last_change":"2024-09-14T11:56:37.710966+0000","last_active":"2024-09-14T11:56:37.710966+0000","last_peered":"2024-09-14T11:56:37.710966+0000","last_clean":"2024-09-14T11:56:37.710966+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:56:37.710966+0000","last_undegraded":"2024-09-14T11:56:37.710966+0000","last_fullsized":"2024-09-14T11:56:37.710966+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.710871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:32.054722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'365","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.007712+0000","last_change":"2024-09-14T11:56:27.007610+0000","last_active":"2024-09-14T11:56:27.007712+0000","last_peered":"2024-09-14T11:56:27.007712+0000","last_clean":"2024-09-14T11:56:27.007712+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:27.007712+0000","last_undegraded":"2024-09-14T11:56:27.007712+0000","last_fullsized":"2024-09-14T11:56:27.007712+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.007472+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:43.410193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":571,"num_read_kb":30121,"num_write":1035,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'415","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.869970+0000","last_change":"2024-09-14T11:56:29.869913+0000","last_active":"2024-09-14T11:56:29.869970+0000","last_peered":"2024-09-14T11:56:29.869970+0000","last_clean":"2024-09-14T11:56:29.869970+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:56:29.869970+0000","last_undegraded":"2024-09-14T11:56:29.869970+0000","last_fullsized":"2024-09-14T11:56:29.869970+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.869818+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:11.490799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.844135+0000","last_change":"2024-09-14T11:56:31.844066+0000","last_active":"2024-09-14T11:56:31.844135+0000","last_peered":"2024-09-14T11:56:31.844135+0000","last_clean":"2024-09-14T11:56:31.844135+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:31.844135+0000","last_undegraded":"2024-09-14T11:56:31.844135+0000","last_fullsized":"2024-09-14T11:56:31.844135+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.843966+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:29.756203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'816","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.728869+0000","last_change":"2024-09-14T11:56:36.728783+0000","last_active":"2024-09-14T11:56:36.728869+0000","last_peered":"2024-09-14T11:56:36.728869+0000","last_clean":"2024-09-14T11:56:36.728869+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:56:36.728869+0000","last_undegraded":"2024-09-14T11:56:36.728869+0000","last_fullsized":"2024-09-14T11:56:36.728869+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'816","last_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_deep_scrub":"263'816","last_deep_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.728665+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:46.867994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'300","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.563332+0000","last_change":"2024-09-14T11:56:27.563220+0000","last_active":"2024-09-14T11:56:27.563332+0000","last_peered":"2024-09-14T11:56:27.563332+0000","last_clean":"2024-09-14T11:56:27.563332+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:27.563332+0000","last_undegraded":"2024-09-14T11:56:27.563332+0000","last_fullsized":"2024-09-14T11:56:27.563332+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.563050+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.198569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":33889,"num_write":889,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'382","reported_seq":1844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.559856+0000","last_change":"2024-09-14T11:56:36.559792+0000","last_active":"2024-09-14T11:56:36.559856+0000","last_peered":"2024-09-14T11:56:36.559856+0000","last_clean":"2024-09-14T11:56:36.559856+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:56:36.559856+0000","last_undegraded":"2024-09-14T11:56:36.559856+0000","last_fullsized":"2024-09-14T11:56:36.559856+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.559698+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:41.726328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.192131+0000","last_change":"2024-09-14T11:56:26.192037+0000","last_active":"2024-09-14T11:56:26.192131+0000","last_peered":"2024-09-14T11:56:26.192131+0000","last_clean":"2024-09-14T11:56:26.192131+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:26.192131+0000","last_undegraded":"2024-09-14T11:56:26.192131+0000","last_fullsized":"2024-09-14T11:56:26.192131+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.191880+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.808289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'501","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513475+0000","last_change":"2024-09-14T11:56:33.513417+0000","last_active":"2024-09-14T11:56:33.513475+0000","last_peered":"2024-09-14T11:56:33.513475+0000","last_clean":"2024-09-14T11:56:33.513475+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:56:33.513475+0000","last_undegraded":"2024-09-14T11:56:33.513475+0000","last_fullsized":"2024-09-14T11:56:33.513475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.513326+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.516314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'488","reported_seq":1225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.533695+0000","last_change":"2024-09-14T11:56:35.533626+0000","last_active":"2024-09-14T11:56:35.533695+0000","last_peered":"2024-09-14T11:56:35.533695+0000","last_clean":"2024-09-14T11:56:35.533695+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:35.533695+0000","last_undegraded":"2024-09-14T11:56:35.533695+0000","last_fullsized":"2024-09-14T11:56:35.533695+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.533523+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.931408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1169,"num_read_kb":1914,"num_write":1411,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.265684+0000","last_change":"2024-09-14T11:56:42.265618+0000","last_active":"2024-09-14T11:56:42.265684+0000","last_peered":"2024-09-14T11:56:42.265684+0000","last_clean":"2024-09-14T11:56:42.265684+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:56:42.265684+0000","last_undegraded":"2024-09-14T11:56:42.265684+0000","last_fullsized":"2024-09-14T11:56:42.265684+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.265519+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.913918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'370","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.845355+0000","last_change":"2024-09-14T11:56:38.845355+0000","last_active":"2024-09-14T11:56:38.845355+0000","last_peered":"2024-09-14T11:56:38.845355+0000","last_clean":"2024-09-14T11:56:38.845355+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:38.845355+0000","last_undegraded":"2024-09-14T11:56:38.845355+0000","last_fullsized":"2024-09-14T11:56:38.845355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.845248+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:52.872233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":47810,"num_write":1093,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'445","reported_seq":1979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.440280+0000","last_change":"2024-09-14T11:56:33.440280+0000","last_active":"2024-09-14T11:56:33.440280+0000","last_peered":"2024-09-14T11:56:33.440280+0000","last_clean":"2024-09-14T11:56:33.440280+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:56:33.440280+0000","last_undegraded":"2024-09-14T11:56:33.440280+0000","last_fullsized":"2024-09-14T11:56:33.440280+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.440166+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:03.203426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.814186+0000","last_change":"2024-09-14T11:56:32.814186+0000","last_active":"2024-09-14T11:56:32.814186+0000","last_peered":"2024-09-14T11:56:32.814186+0000","last_clean":"2024-09-14T11:56:32.814186+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:32.814186+0000","last_undegraded":"2024-09-14T11:56:32.814186+0000","last_fullsized":"2024-09-14T11:56:32.814186+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.814090+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.660032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.824437+0000","last_change":"2024-09-14T11:56:33.824437+0000","last_active":"2024-09-14T11:56:33.824437+0000","last_peered":"2024-09-14T11:56:33.824437+0000","last_clean":"2024-09-14T11:56:33.824437+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:33.824437+0000","last_undegraded":"2024-09-14T11:56:33.824437+0000","last_fullsized":"2024-09-14T11:56:33.824437+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.824296+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:37.946754+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'502","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.620855+0000","last_change":"2024-09-14T11:56:37.620855+0000","last_active":"2024-09-14T11:56:37.620855+0000","last_peered":"2024-09-14T11:56:37.620855+0000","last_clean":"2024-09-14T11:56:37.620855+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:56:37.620855+0000","last_undegraded":"2024-09-14T11:56:37.620855+0000","last_fullsized":"2024-09-14T11:56:37.620855+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.620756+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:34.911258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":928,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'359","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.767279+0000","last_change":"2024-09-14T11:56:27.767279+0000","last_active":"2024-09-14T11:56:27.767279+0000","last_peered":"2024-09-14T11:56:27.767279+0000","last_clean":"2024-09-14T11:56:27.767279+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:27.767279+0000","last_undegraded":"2024-09-14T11:56:27.767279+0000","last_fullsized":"2024-09-14T11:56:27.767279+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.767137+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:02.709261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":694,"num_read_kb":183365,"num_write":1193,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.731802+0000","last_change":"2024-09-14T11:56:41.731802+0000","last_active":"2024-09-14T11:56:41.731802+0000","last_peered":"2024-09-14T11:56:41.731802+0000","last_clean":"2024-09-14T11:56:41.731802+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:56:41.731802+0000","last_undegraded":"2024-09-14T11:56:41.731802+0000","last_fullsized":"2024-09-14T11:56:41.731802+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.731720+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:26.482405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1564,"ondisk_log_size":1564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":647,"ondisk_log_size":647,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1608537,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17476,"num_read_kb":36987,"num_write":14663,"num_write_kb":11713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701800,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2260,"ondisk_log_size":2260,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3642,"ondisk_log_size":3642,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":41776745,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44044,"num_read_kb":2244679,"num_write":72642,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64241664,"data_stored":64241664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3767,"ondisk_log_size":3767,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174309,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174255,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509968,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271740,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94100100,"statfs":{"total":96636764160,"available":96358502400,"internally_reserved":0,"allocated":10334208,"data_stored":8385962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509969,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166396,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205444,"statfs":{"total":96636764160,"available":96466374656,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509967,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110592,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94261248,"statfs":{"total":96636764160,"available":96523517952,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542671,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300316,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94071524,"statfs":{"total":96636764160,"available":96329240576,"internally_reserved":0,"allocated":8335360,"data_stored":6347071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542674,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273604,"kb_used_data":11956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098236,"statfs":{"total":96636764160,"available":96356593664,"internally_reserved":0,"allocated":12242944,"data_stored":10281542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267909575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542672,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98288,"kb_used_data":12960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94273552,"statfs":{"total":96636764160,"available":96536117248,"internally_reserved":0,"allocated":13271040,"data_stored":11361506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542671,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168732,"kb_used_data":11276,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94203108,"statfs":{"total":96636764160,"available":96463982592,"internally_reserved":0,"allocated":11546624,"data_stored":9590010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542670,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279572,"kb_used_data":17924,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94092268,"statfs":{"total":96636764160,"available":96350482432,"internally_reserved":0,"allocated":18354176,"data_stored":16376601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13529088,"data_stored":13529088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7331840,"data_stored":7331840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8024064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:57:25.002 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:25.002 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:25.003 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:25.003 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:25.003 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:41:14.844664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=41, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=56, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:57:25.006 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:57:45.008 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:57:45.338 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-14T11:57:45.350 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-14T11:57:45.351 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1576,"stamp":"2024-09-14T11:57:43.953405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43992737,"num_objects":740,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":310307,"num_read_kb":2858305,"num_write":163686,"num_write_kb":2485845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741281,"num_omap_keys":1788,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13178,"ondisk_log_size":13178,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1669240,"kb_used_data":96824,"kb_used_omap":12,"kb_used_meta":1572275,"kb_avail":753305480,"statfs":{"total":773094113280,"available":771384811520,"internally_reserved":0,"allocated":99147776,"data_stored":83483642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1610010160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005369"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.874448+0000","last_change":"2024-09-14T11:57:10.874448+0000","last_active":"2024-09-14T11:57:10.874448+0000","last_peered":"2024-09-14T11:57:10.874448+0000","last_clean":"2024-09-14T11:57:10.874448+0000","last_became_active":"2024-09-14T11:41:15.870304+0000","last_became_peered":"2024-09-14T11:41:15.870304+0000","last_unstale":"2024-09-14T11:57:10.874448+0000","last_undegraded":"2024-09-14T11:57:10.874448+0000","last_fullsized":"2024-09-14T11:57:10.874448+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:10.874364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:10.874364+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.874364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:39.697372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.780748+0000","last_change":"2024-09-14T11:57:06.780748+0000","last_active":"2024-09-14T11:57:06.780748+0000","last_peered":"2024-09-14T11:57:06.780748+0000","last_clean":"2024-09-14T11:57:06.780748+0000","last_became_active":"2024-09-14T11:30:47.736552+0000","last_became_peered":"2024-09-14T11:30:47.736552+0000","last_unstale":"2024-09-14T11:57:06.780748+0000","last_undegraded":"2024-09-14T11:57:06.780748+0000","last_fullsized":"2024-09-14T11:57:06.780748+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:06.780600+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:06.780600+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.780600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:51.855889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.063650+0000","last_change":"2024-09-14T11:57:12.063650+0000","last_active":"2024-09-14T11:57:12.063650+0000","last_peered":"2024-09-14T11:57:12.063650+0000","last_clean":"2024-09-14T11:57:12.063650+0000","last_became_active":"2024-09-14T11:30:44.716115+0000","last_became_peered":"2024-09-14T11:30:44.716115+0000","last_unstale":"2024-09-14T11:57:12.063650+0000","last_undegraded":"2024-09-14T11:57:12.063650+0000","last_fullsized":"2024-09-14T11:57:12.063650+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:12.063558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:12.063558+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.063558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:10.648788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'13","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.640970+0000","last_change":"2024-09-14T11:57:04.640970+0000","last_active":"2024-09-14T11:57:04.640970+0000","last_peered":"2024-09-14T11:57:04.640970+0000","last_clean":"2024-09-14T11:57:04.640970+0000","last_became_active":"2024-09-14T11:29:10.317849+0000","last_became_peered":"2024-09-14T11:29:10.317849+0000","last_unstale":"2024-09-14T11:57:04.640970+0000","last_undegraded":"2024-09-14T11:57:04.640970+0000","last_fullsized":"2024-09-14T11:57:04.640970+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T11:57:04.640869+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T11:57:04.640869+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.640869+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:28.867490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.930910+0000","last_change":"2024-09-14T11:56:54.930910+0000","last_active":"2024-09-14T11:56:54.930910+0000","last_peered":"2024-09-14T11:56:54.930910+0000","last_clean":"2024-09-14T11:56:54.930910+0000","last_became_active":"2024-09-14T11:41:15.877529+0000","last_became_peered":"2024-09-14T11:41:15.877529+0000","last_unstale":"2024-09-14T11:56:54.930910+0000","last_undegraded":"2024-09-14T11:56:54.930910+0000","last_fullsized":"2024-09-14T11:56:54.930910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.930819+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.930819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:24.220591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.969229+0000","last_change":"2024-09-14T11:57:09.969229+0000","last_active":"2024-09-14T11:57:09.969229+0000","last_peered":"2024-09-14T11:57:09.969229+0000","last_clean":"2024-09-14T11:57:09.969229+0000","last_became_active":"2024-09-14T11:30:47.732794+0000","last_became_peered":"2024-09-14T11:30:47.732794+0000","last_unstale":"2024-09-14T11:57:09.969229+0000","last_undegraded":"2024-09-14T11:57:09.969229+0000","last_fullsized":"2024-09-14T11:57:09.969229+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:09.969129+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:09.969129+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.969129+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.586520+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.068350+0000","last_change":"2024-09-14T11:56:56.068350+0000","last_active":"2024-09-14T11:56:56.068350+0000","last_peered":"2024-09-14T11:56:56.068350+0000","last_clean":"2024-09-14T11:56:56.068350+0000","last_became_active":"2024-09-14T11:30:44.720661+0000","last_became_peered":"2024-09-14T11:30:44.720661+0000","last_unstale":"2024-09-14T11:56:56.068350+0000","last_undegraded":"2024-09-14T11:56:56.068350+0000","last_fullsized":"2024-09-14T11:56:56.068350+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:56.068263+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.068263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:51.903194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'18","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.956980+0000","last_change":"2024-09-14T11:56:46.956880+0000","last_active":"2024-09-14T11:56:46.956980+0000","last_peered":"2024-09-14T11:56:46.956980+0000","last_clean":"2024-09-14T11:56:46.956980+0000","last_became_active":"2024-09-14T11:29:10.325282+0000","last_became_peered":"2024-09-14T11:29:10.325282+0000","last_unstale":"2024-09-14T11:56:46.956980+0000","last_undegraded":"2024-09-14T11:56:46.956980+0000","last_fullsized":"2024-09-14T11:56:46.956980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:56:46.956766+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.956766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:51.738185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":94,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.322815+0000","last_change":"2024-09-14T11:56:59.322815+0000","last_active":"2024-09-14T11:56:59.322815+0000","last_peered":"2024-09-14T11:56:59.322815+0000","last_clean":"2024-09-14T11:56:59.322815+0000","last_became_active":"2024-09-14T11:41:15.869848+0000","last_became_peered":"2024-09-14T11:41:15.869848+0000","last_unstale":"2024-09-14T11:56:59.322815+0000","last_undegraded":"2024-09-14T11:56:59.322815+0000","last_fullsized":"2024-09-14T11:56:59.322815+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:59.322702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.322702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:12.249136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.497463+0000","last_change":"2024-09-14T11:57:15.497463+0000","last_active":"2024-09-14T11:57:15.497463+0000","last_peered":"2024-09-14T11:57:15.497463+0000","last_clean":"2024-09-14T11:57:15.497463+0000","last_became_active":"2024-09-14T11:30:47.897745+0000","last_became_peered":"2024-09-14T11:30:47.897745+0000","last_unstale":"2024-09-14T11:57:15.497463+0000","last_undegraded":"2024-09-14T11:57:15.497463+0000","last_fullsized":"2024-09-14T11:57:15.497463+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:15.497360+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:15.497360+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.497360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:27.779269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.915023+0000","last_change":"2024-09-14T11:56:49.915023+0000","last_active":"2024-09-14T11:56:49.915023+0000","last_peered":"2024-09-14T11:56:49.915023+0000","last_clean":"2024-09-14T11:56:49.915023+0000","last_became_active":"2024-09-14T11:30:44.718118+0000","last_became_peered":"2024-09-14T11:30:44.718118+0000","last_unstale":"2024-09-14T11:56:49.915023+0000","last_undegraded":"2024-09-14T11:56:49.915023+0000","last_fullsized":"2024-09-14T11:56:49.915023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:49.914938+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.914938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:12.204381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'19","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.621229+0000","last_change":"2024-09-14T11:57:07.621229+0000","last_active":"2024-09-14T11:57:07.621229+0000","last_peered":"2024-09-14T11:57:07.621229+0000","last_clean":"2024-09-14T11:57:07.621229+0000","last_became_active":"2024-09-14T11:29:10.312789+0000","last_became_peered":"2024-09-14T11:29:10.312789+0000","last_unstale":"2024-09-14T11:57:07.621229+0000","last_undegraded":"2024-09-14T11:57:07.621229+0000","last_fullsized":"2024-09-14T11:57:07.621229+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-14T11:57:07.621101+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-14T11:57:07.621101+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.621101+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:00.620858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:20.004785+0000","last_change":"2024-09-14T11:57:20.004785+0000","last_active":"2024-09-14T11:57:20.004785+0000","last_peered":"2024-09-14T11:57:20.004785+0000","last_clean":"2024-09-14T11:57:20.004785+0000","last_became_active":"2024-09-14T11:41:15.876810+0000","last_became_peered":"2024-09-14T11:41:15.876810+0000","last_unstale":"2024-09-14T11:57:20.004785+0000","last_undegraded":"2024-09-14T11:57:20.004785+0000","last_fullsized":"2024-09-14T11:57:20.004785+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:20.004699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:20.004699+0000","last_clean_scrub_stamp":"2024-09-14T11:57:20.004699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:47.883556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.970113+0000","last_change":"2024-09-14T11:57:17.970113+0000","last_active":"2024-09-14T11:57:17.970113+0000","last_peered":"2024-09-14T11:57:17.970113+0000","last_clean":"2024-09-14T11:57:17.970113+0000","last_became_active":"2024-09-14T11:30:47.897362+0000","last_became_peered":"2024-09-14T11:30:47.897362+0000","last_unstale":"2024-09-14T11:57:17.970113+0000","last_undegraded":"2024-09-14T11:57:17.970113+0000","last_fullsized":"2024-09-14T11:57:17.970113+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:57:17.970022+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:57:17.970022+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.970022+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:11.590361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20484,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.028896+0000","last_change":"2024-09-14T11:57:05.028896+0000","last_active":"2024-09-14T11:57:05.028896+0000","last_peered":"2024-09-14T11:57:05.028896+0000","last_clean":"2024-09-14T11:57:05.028896+0000","last_became_active":"2024-09-14T11:30:44.706719+0000","last_became_peered":"2024-09-14T11:30:44.706719+0000","last_unstale":"2024-09-14T11:57:05.028896+0000","last_undegraded":"2024-09-14T11:57:05.028896+0000","last_fullsized":"2024-09-14T11:57:05.028896+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:05.028795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:05.028795+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.028795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:54.622172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.128410+0000","last_change":"2024-09-14T11:57:08.128410+0000","last_active":"2024-09-14T11:57:08.128410+0000","last_peered":"2024-09-14T11:57:08.128410+0000","last_clean":"2024-09-14T11:57:08.128410+0000","last_became_active":"2024-09-14T11:29:10.320072+0000","last_became_peered":"2024-09-14T11:29:10.320072+0000","last_unstale":"2024-09-14T11:57:08.128410+0000","last_undegraded":"2024-09-14T11:57:08.128410+0000","last_fullsized":"2024-09-14T11:57:08.128410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:57:08.128326+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:57:08.128326+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.128326+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:26.301682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":136,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.065131+0000","last_change":"2024-09-14T11:57:23.065131+0000","last_active":"2024-09-14T11:57:23.065131+0000","last_peered":"2024-09-14T11:57:23.065131+0000","last_clean":"2024-09-14T11:57:23.065131+0000","last_became_active":"2024-09-14T11:41:15.876786+0000","last_became_peered":"2024-09-14T11:41:15.876786+0000","last_unstale":"2024-09-14T11:57:23.065131+0000","last_undegraded":"2024-09-14T11:57:23.065131+0000","last_fullsized":"2024-09-14T11:57:23.065131+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:23.065030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:23.065030+0000","last_clean_scrub_stamp":"2024-09-14T11:57:23.065030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.668223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.802967+0000","last_change":"2024-09-14T11:57:07.802906+0000","last_active":"2024-09-14T11:57:07.802967+0000","last_peered":"2024-09-14T11:57:07.802967+0000","last_clean":"2024-09-14T11:57:07.802967+0000","last_became_active":"2024-09-14T11:31:38.870858+0000","last_became_peered":"2024-09-14T11:31:38.870858+0000","last_unstale":"2024-09-14T11:57:07.802967+0000","last_undegraded":"2024-09-14T11:57:07.802967+0000","last_fullsized":"2024-09-14T11:57:07.802967+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:07.802804+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:07.802804+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.802804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:40.829736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.550789+0000","last_change":"2024-09-14T11:57:11.550700+0000","last_active":"2024-09-14T11:57:11.550789+0000","last_peered":"2024-09-14T11:57:11.550789+0000","last_clean":"2024-09-14T11:57:11.550789+0000","last_became_active":"2024-09-14T11:30:44.719100+0000","last_became_peered":"2024-09-14T11:30:44.719100+0000","last_unstale":"2024-09-14T11:57:11.550789+0000","last_undegraded":"2024-09-14T11:57:11.550789+0000","last_fullsized":"2024-09-14T11:57:11.550789+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:57:11.550582+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:57:11.550582+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.550582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:47.920952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'99","reported_seq":324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.131668+0000","last_change":"2024-09-14T11:57:06.131668+0000","last_active":"2024-09-14T11:57:06.131668+0000","last_peered":"2024-09-14T11:57:06.131668+0000","last_clean":"2024-09-14T11:57:06.131668+0000","last_became_active":"2024-09-14T11:29:10.325337+0000","last_became_peered":"2024-09-14T11:29:10.325337+0000","last_unstale":"2024-09-14T11:57:06.131668+0000","last_undegraded":"2024-09-14T11:57:06.131668+0000","last_fullsized":"2024-09-14T11:57:06.131668+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-14T11:57:06.131560+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-14T11:57:06.131560+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.131560+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:17.950586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":541,"num_write":255,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.020574+0000","last_change":"2024-09-14T11:57:04.020574+0000","last_active":"2024-09-14T11:57:04.020574+0000","last_peered":"2024-09-14T11:57:04.020574+0000","last_clean":"2024-09-14T11:57:04.020574+0000","last_became_active":"2024-09-14T11:41:15.866027+0000","last_became_peered":"2024-09-14T11:41:15.866027+0000","last_unstale":"2024-09-14T11:57:04.020574+0000","last_undegraded":"2024-09-14T11:57:04.020574+0000","last_fullsized":"2024-09-14T11:57:04.020574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.020474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.020474+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.020474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:23.031527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.270147+0000","last_change":"2024-09-14T11:56:56.270094+0000","last_active":"2024-09-14T11:56:56.270147+0000","last_peered":"2024-09-14T11:56:56.270147+0000","last_clean":"2024-09-14T11:56:56.270147+0000","last_became_active":"2024-09-14T11:30:47.741903+0000","last_became_peered":"2024-09-14T11:30:47.741903+0000","last_unstale":"2024-09-14T11:56:56.270147+0000","last_undegraded":"2024-09-14T11:56:56.270147+0000","last_fullsized":"2024-09-14T11:56:56.270147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:56.270012+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.270012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:44.058197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.051801+0000","last_change":"2024-09-14T11:57:04.051738+0000","last_active":"2024-09-14T11:57:04.051801+0000","last_peered":"2024-09-14T11:57:04.051801+0000","last_clean":"2024-09-14T11:57:04.051801+0000","last_became_active":"2024-09-14T11:30:44.712907+0000","last_became_peered":"2024-09-14T11:30:44.712907+0000","last_unstale":"2024-09-14T11:57:04.051801+0000","last_undegraded":"2024-09-14T11:57:04.051801+0000","last_fullsized":"2024-09-14T11:57:04.051801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.051640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.051640+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.051640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:11.183614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'44","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.175963+0000","last_change":"2024-09-14T11:56:50.175963+0000","last_active":"2024-09-14T11:56:50.175963+0000","last_peered":"2024-09-14T11:56:50.175963+0000","last_clean":"2024-09-14T11:56:50.175963+0000","last_became_active":"2024-09-14T11:29:10.322405+0000","last_became_peered":"2024-09-14T11:29:10.322405+0000","last_unstale":"2024-09-14T11:56:50.175963+0000","last_undegraded":"2024-09-14T11:56:50.175963+0000","last_fullsized":"2024-09-14T11:56:50.175963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:50.175869+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.175869+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.609485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":227,"num_write":111,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.505029+0000","last_change":"2024-09-14T11:57:19.505029+0000","last_active":"2024-09-14T11:57:19.505029+0000","last_peered":"2024-09-14T11:57:19.505029+0000","last_clean":"2024-09-14T11:57:19.505029+0000","last_became_active":"2024-09-14T11:41:15.874772+0000","last_became_peered":"2024-09-14T11:41:15.874772+0000","last_unstale":"2024-09-14T11:57:19.505029+0000","last_undegraded":"2024-09-14T11:57:19.505029+0000","last_fullsized":"2024-09-14T11:57:19.505029+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:19.504939+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:19.504939+0000","last_clean_scrub_stamp":"2024-09-14T11:57:19.504939+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:15.694865+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.252142+0000","last_change":"2024-09-14T11:56:57.252142+0000","last_active":"2024-09-14T11:56:57.252142+0000","last_peered":"2024-09-14T11:56:57.252142+0000","last_clean":"2024-09-14T11:56:57.252142+0000","last_became_active":"2024-09-14T11:30:47.735470+0000","last_became_peered":"2024-09-14T11:30:47.735470+0000","last_unstale":"2024-09-14T11:56:57.252142+0000","last_undegraded":"2024-09-14T11:56:57.252142+0000","last_fullsized":"2024-09-14T11:56:57.252142+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:56:57.252056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.252056+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:33.734708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":14436,"num_write":12,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.047074+0000","last_change":"2024-09-14T11:57:03.047074+0000","last_active":"2024-09-14T11:57:03.047074+0000","last_peered":"2024-09-14T11:57:03.047074+0000","last_clean":"2024-09-14T11:57:03.047074+0000","last_became_active":"2024-09-14T11:30:44.717836+0000","last_became_peered":"2024-09-14T11:30:44.717836+0000","last_unstale":"2024-09-14T11:57:03.047074+0000","last_undegraded":"2024-09-14T11:57:03.047074+0000","last_fullsized":"2024-09-14T11:57:03.047074+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:03.046986+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:03.046986+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.046986+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.408386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.658530+0000","last_change":"2024-09-14T11:57:05.658530+0000","last_active":"2024-09-14T11:57:05.658530+0000","last_peered":"2024-09-14T11:57:05.658530+0000","last_clean":"2024-09-14T11:57:05.658530+0000","last_became_active":"2024-09-14T11:29:10.322936+0000","last_became_peered":"2024-09-14T11:29:10.322936+0000","last_unstale":"2024-09-14T11:57:05.658530+0000","last_undegraded":"2024-09-14T11:57:05.658530+0000","last_fullsized":"2024-09-14T11:57:05.658530+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T11:57:05.658462+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T11:57:05.658462+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.658462+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:38.731476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":163,"num_write":87,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.459216+0000","last_change":"2024-09-14T11:57:18.459216+0000","last_active":"2024-09-14T11:57:18.459216+0000","last_peered":"2024-09-14T11:57:18.459216+0000","last_clean":"2024-09-14T11:57:18.459216+0000","last_became_active":"2024-09-14T11:41:15.871896+0000","last_became_peered":"2024-09-14T11:41:15.871896+0000","last_unstale":"2024-09-14T11:57:18.459216+0000","last_undegraded":"2024-09-14T11:57:18.459216+0000","last_fullsized":"2024-09-14T11:57:18.459216+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:18.459119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:18.459119+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.459119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:31.698366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.979332+0000","last_change":"2024-09-14T11:57:16.979332+0000","last_active":"2024-09-14T11:57:16.979332+0000","last_peered":"2024-09-14T11:57:16.979332+0000","last_clean":"2024-09-14T11:57:16.979332+0000","last_became_active":"2024-09-14T11:30:47.739336+0000","last_became_peered":"2024-09-14T11:30:47.739336+0000","last_unstale":"2024-09-14T11:57:16.979332+0000","last_undegraded":"2024-09-14T11:57:16.979332+0000","last_fullsized":"2024-09-14T11:57:16.979332+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:57:16.979220+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:57:16.979220+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.979220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.912288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17456,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.492188+0000","last_change":"2024-09-14T11:57:14.492188+0000","last_active":"2024-09-14T11:57:14.492188+0000","last_peered":"2024-09-14T11:57:14.492188+0000","last_clean":"2024-09-14T11:57:14.492188+0000","last_became_active":"2024-09-14T11:30:44.721028+0000","last_became_peered":"2024-09-14T11:30:44.721028+0000","last_unstale":"2024-09-14T11:57:14.492188+0000","last_undegraded":"2024-09-14T11:57:14.492188+0000","last_fullsized":"2024-09-14T11:57:14.492188+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:14.492097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:14.492097+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.492097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:35.249474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'12","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.051414+0000","last_change":"2024-09-14T11:56:55.051414+0000","last_active":"2024-09-14T11:56:55.051414+0000","last_peered":"2024-09-14T11:56:55.051414+0000","last_clean":"2024-09-14T11:56:55.051414+0000","last_became_active":"2024-09-14T11:29:10.322439+0000","last_became_peered":"2024-09-14T11:29:10.322439+0000","last_unstale":"2024-09-14T11:56:55.051414+0000","last_undegraded":"2024-09-14T11:56:55.051414+0000","last_fullsized":"2024-09-14T11:56:55.051414+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:56:55.051327+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.051327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:05.849317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.013978+0000","last_change":"2024-09-14T11:57:03.013913+0000","last_active":"2024-09-14T11:57:03.013978+0000","last_peered":"2024-09-14T11:57:03.013978+0000","last_clean":"2024-09-14T11:57:03.013978+0000","last_became_active":"2024-09-14T11:41:15.860274+0000","last_became_peered":"2024-09-14T11:41:15.860274+0000","last_unstale":"2024-09-14T11:57:03.013978+0000","last_undegraded":"2024-09-14T11:57:03.013978+0000","last_fullsized":"2024-09-14T11:57:03.013978+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:03.013823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:03.013823+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.013823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:59.157431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.981369+0000","last_change":"2024-09-14T11:57:14.981280+0000","last_active":"2024-09-14T11:57:14.981369+0000","last_peered":"2024-09-14T11:57:14.981369+0000","last_clean":"2024-09-14T11:57:14.981369+0000","last_became_active":"2024-09-14T11:30:47.895637+0000","last_became_peered":"2024-09-14T11:30:47.895637+0000","last_unstale":"2024-09-14T11:57:14.981369+0000","last_undegraded":"2024-09-14T11:57:14.981369+0000","last_fullsized":"2024-09-14T11:57:14.981369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:14.981157+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:14.981157+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.981157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:43.335715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.710040+0000","last_change":"2024-09-14T11:57:04.710040+0000","last_active":"2024-09-14T11:57:04.710040+0000","last_peered":"2024-09-14T11:57:04.710040+0000","last_clean":"2024-09-14T11:57:04.710040+0000","last_became_active":"2024-09-14T11:30:44.719076+0000","last_became_peered":"2024-09-14T11:30:44.719076+0000","last_unstale":"2024-09-14T11:57:04.710040+0000","last_undegraded":"2024-09-14T11:57:04.710040+0000","last_fullsized":"2024-09-14T11:57:04.710040+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:57:04.709953+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:57:04.709953+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.709953+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:20.179480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'47","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.687150+0000","last_change":"2024-09-14T11:57:03.687150+0000","last_active":"2024-09-14T11:57:03.687150+0000","last_peered":"2024-09-14T11:57:03.687150+0000","last_clean":"2024-09-14T11:57:03.687150+0000","last_became_active":"2024-09-14T11:29:10.322046+0000","last_became_peered":"2024-09-14T11:29:10.322046+0000","last_unstale":"2024-09-14T11:57:03.687150+0000","last_undegraded":"2024-09-14T11:57:03.687150+0000","last_fullsized":"2024-09-14T11:57:03.687150+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:57:03.687070+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:57:03.687070+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.687070+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:49.778239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":358,"num_read_kb":249,"num_write":114,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.914300+0000","last_change":"2024-09-14T11:56:52.914206+0000","last_active":"2024-09-14T11:56:52.914300+0000","last_peered":"2024-09-14T11:56:52.914300+0000","last_clean":"2024-09-14T11:56:52.914300+0000","last_became_active":"2024-09-14T11:41:15.870878+0000","last_became_peered":"2024-09-14T11:41:15.870878+0000","last_unstale":"2024-09-14T11:56:52.914300+0000","last_undegraded":"2024-09-14T11:56:52.914300+0000","last_fullsized":"2024-09-14T11:56:52.914300+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:52.914085+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.914085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:51.597067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.000039+0000","last_change":"2024-09-14T11:57:14.000039+0000","last_active":"2024-09-14T11:57:14.000039+0000","last_peered":"2024-09-14T11:57:14.000039+0000","last_clean":"2024-09-14T11:57:14.000039+0000","last_became_active":"2024-09-14T11:30:47.898230+0000","last_became_peered":"2024-09-14T11:30:47.898230+0000","last_unstale":"2024-09-14T11:57:14.000039+0000","last_undegraded":"2024-09-14T11:57:14.000039+0000","last_fullsized":"2024-09-14T11:57:14.000039+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.999948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.999948+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.999948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:50.336243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.483782+0000","last_change":"2024-09-14T11:57:06.483667+0000","last_active":"2024-09-14T11:57:06.483782+0000","last_peered":"2024-09-14T11:57:06.483782+0000","last_clean":"2024-09-14T11:57:06.483782+0000","last_became_active":"2024-09-14T11:30:44.721823+0000","last_became_peered":"2024-09-14T11:30:44.721823+0000","last_unstale":"2024-09-14T11:57:06.483782+0000","last_undegraded":"2024-09-14T11:57:06.483782+0000","last_fullsized":"2024-09-14T11:57:06.483782+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:06.483567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:06.483567+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.483567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:28.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'9","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.095046+0000","last_change":"2024-09-14T11:57:05.095046+0000","last_active":"2024-09-14T11:57:05.095046+0000","last_peered":"2024-09-14T11:57:05.095046+0000","last_clean":"2024-09-14T11:57:05.095046+0000","last_became_active":"2024-09-14T11:29:10.322273+0000","last_became_peered":"2024-09-14T11:29:10.322273+0000","last_unstale":"2024-09-14T11:57:05.095046+0000","last_undegraded":"2024-09-14T11:57:05.095046+0000","last_fullsized":"2024-09-14T11:57:05.095046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:57:05.094962+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:57:05.094962+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.094962+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:08.194097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":36,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.453723+0000","last_change":"2024-09-14T11:57:17.453570+0000","last_active":"2024-09-14T11:57:17.453723+0000","last_peered":"2024-09-14T11:57:17.453723+0000","last_clean":"2024-09-14T11:57:17.453723+0000","last_became_active":"2024-09-14T11:41:15.873378+0000","last_became_peered":"2024-09-14T11:41:15.873378+0000","last_unstale":"2024-09-14T11:57:17.453723+0000","last_undegraded":"2024-09-14T11:57:17.453723+0000","last_fullsized":"2024-09-14T11:57:17.453723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:17.453471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:17.453471+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.453471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:10.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.947255+0000","last_change":"2024-09-14T11:57:15.947199+0000","last_active":"2024-09-14T11:57:15.947255+0000","last_peered":"2024-09-14T11:57:15.947255+0000","last_clean":"2024-09-14T11:57:15.947255+0000","last_became_active":"2024-09-14T11:30:47.897893+0000","last_became_peered":"2024-09-14T11:30:47.897893+0000","last_unstale":"2024-09-14T11:57:15.947255+0000","last_undegraded":"2024-09-14T11:57:15.947255+0000","last_fullsized":"2024-09-14T11:57:15.947255+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:15.947106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:15.947106+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.947106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:40.360937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.869558+0000","last_change":"2024-09-14T11:56:48.869491+0000","last_active":"2024-09-14T11:56:48.869558+0000","last_peered":"2024-09-14T11:56:48.869558+0000","last_clean":"2024-09-14T11:56:48.869558+0000","last_became_active":"2024-09-14T11:30:44.714962+0000","last_became_peered":"2024-09-14T11:30:44.714962+0000","last_unstale":"2024-09-14T11:56:48.869558+0000","last_undegraded":"2024-09-14T11:56:48.869558+0000","last_fullsized":"2024-09-14T11:56:48.869558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:48.869404+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.869404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:45.392711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":17408,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.906801+0000","last_change":"2024-09-14T11:56:44.906801+0000","last_active":"2024-09-14T11:56:44.906801+0000","last_peered":"2024-09-14T11:56:44.906801+0000","last_clean":"2024-09-14T11:56:44.906801+0000","last_became_active":"2024-09-14T11:29:10.320946+0000","last_became_peered":"2024-09-14T11:29:10.320946+0000","last_unstale":"2024-09-14T11:56:44.906801+0000","last_undegraded":"2024-09-14T11:56:44.906801+0000","last_fullsized":"2024-09-14T11:56:44.906801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T11:56:44.906705+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.906705+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:43.767361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":270,"num_read_kb":176,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.861709+0000","last_change":"2024-09-14T11:57:09.861643+0000","last_active":"2024-09-14T11:57:09.861709+0000","last_peered":"2024-09-14T11:57:09.861709+0000","last_clean":"2024-09-14T11:57:09.861709+0000","last_became_active":"2024-09-14T11:41:15.871477+0000","last_became_peered":"2024-09-14T11:41:15.871477+0000","last_unstale":"2024-09-14T11:57:09.861709+0000","last_undegraded":"2024-09-14T11:57:09.861709+0000","last_fullsized":"2024-09-14T11:57:09.861709+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.861561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.861561+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.861561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:13.509770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.018265+0000","last_change":"2024-09-14T11:57:09.018208+0000","last_active":"2024-09-14T11:57:09.018265+0000","last_peered":"2024-09-14T11:57:09.018265+0000","last_clean":"2024-09-14T11:57:09.018265+0000","last_became_active":"2024-09-14T11:30:47.741836+0000","last_became_peered":"2024-09-14T11:30:47.741836+0000","last_unstale":"2024-09-14T11:57:09.018265+0000","last_undegraded":"2024-09-14T11:57:09.018265+0000","last_fullsized":"2024-09-14T11:57:09.018265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.018126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.018126+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.018126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:47.315444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.591938+0000","last_change":"2024-09-14T11:57:08.591832+0000","last_active":"2024-09-14T11:57:08.591938+0000","last_peered":"2024-09-14T11:57:08.591938+0000","last_clean":"2024-09-14T11:57:08.591938+0000","last_became_active":"2024-09-14T11:30:44.720964+0000","last_became_peered":"2024-09-14T11:30:44.720964+0000","last_unstale":"2024-09-14T11:57:08.591938+0000","last_undegraded":"2024-09-14T11:57:08.591938+0000","last_fullsized":"2024-09-14T11:57:08.591938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:08.591732+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:08.591732+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.591732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:34.689858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"251'4","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.358514+0000","last_change":"2024-09-14T11:57:00.358443+0000","last_active":"2024-09-14T11:57:00.358514+0000","last_peered":"2024-09-14T11:57:00.358514+0000","last_clean":"2024-09-14T11:57:00.358514+0000","last_became_active":"2024-09-14T11:29:10.325489+0000","last_became_peered":"2024-09-14T11:29:10.325489+0000","last_unstale":"2024-09-14T11:57:00.358514+0000","last_undegraded":"2024-09-14T11:57:00.358514+0000","last_fullsized":"2024-09-14T11:57:00.358514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'4","last_scrub_stamp":"2024-09-14T11:57:00.358351+0000","last_deep_scrub":"251'4","last_deep_scrub_stamp":"2024-09-14T11:57:00.358351+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.358351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:59.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.083758+0000","last_change":"2024-09-14T11:57:22.083758+0000","last_active":"2024-09-14T11:57:22.083758+0000","last_peered":"2024-09-14T11:57:22.083758+0000","last_clean":"2024-09-14T11:57:22.083758+0000","last_became_active":"2024-09-14T11:41:15.877411+0000","last_became_peered":"2024-09-14T11:41:15.877411+0000","last_unstale":"2024-09-14T11:57:22.083758+0000","last_undegraded":"2024-09-14T11:57:22.083758+0000","last_fullsized":"2024-09-14T11:57:22.083758+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:22.083669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:22.083669+0000","last_clean_scrub_stamp":"2024-09-14T11:57:22.083669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:59.256191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.053836+0000","last_change":"2024-09-14T11:57:01.053836+0000","last_active":"2024-09-14T11:57:01.053836+0000","last_peered":"2024-09-14T11:57:01.053836+0000","last_clean":"2024-09-14T11:57:01.053836+0000","last_became_active":"2024-09-14T11:30:47.737470+0000","last_became_peered":"2024-09-14T11:30:47.737470+0000","last_unstale":"2024-09-14T11:57:01.053836+0000","last_undegraded":"2024-09-14T11:57:01.053836+0000","last_fullsized":"2024-09-14T11:57:01.053836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:01.053704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:01.053704+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.053704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:30.489447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.004701+0000","last_change":"2024-09-14T11:57:02.004701+0000","last_active":"2024-09-14T11:57:02.004701+0000","last_peered":"2024-09-14T11:57:02.004701+0000","last_clean":"2024-09-14T11:57:02.004701+0000","last_became_active":"2024-09-14T11:30:44.716739+0000","last_became_peered":"2024-09-14T11:30:44.716739+0000","last_unstale":"2024-09-14T11:57:02.004701+0000","last_undegraded":"2024-09-14T11:57:02.004701+0000","last_fullsized":"2024-09-14T11:57:02.004701+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:57:02.004606+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:57:02.004606+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.004606+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:10.100431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'32","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.395292+0000","last_change":"2024-09-14T11:57:01.395217+0000","last_active":"2024-09-14T11:57:01.395292+0000","last_peered":"2024-09-14T11:57:01.395292+0000","last_clean":"2024-09-14T11:57:01.395292+0000","last_became_active":"2024-09-14T11:29:10.325535+0000","last_became_peered":"2024-09-14T11:29:10.325535+0000","last_unstale":"2024-09-14T11:57:01.395292+0000","last_undegraded":"2024-09-14T11:57:01.395292+0000","last_fullsized":"2024-09-14T11:57:01.395292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:01.395134+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:01.395134+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.395134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:28.593249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":149,"num_write":84,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.485720+0000","last_change":"2024-09-14T11:57:19.485720+0000","last_active":"2024-09-14T11:57:19.485720+0000","last_peered":"2024-09-14T11:57:19.485720+0000","last_clean":"2024-09-14T11:57:19.485720+0000","last_became_active":"2024-09-14T11:41:15.870611+0000","last_became_peered":"2024-09-14T11:41:15.870611+0000","last_unstale":"2024-09-14T11:57:19.485720+0000","last_undegraded":"2024-09-14T11:57:19.485720+0000","last_fullsized":"2024-09-14T11:57:19.485720+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:19.485622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:19.485622+0000","last_clean_scrub_stamp":"2024-09-14T11:57:19.485622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:50.004352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.094951+0000","last_change":"2024-09-14T11:56:58.094951+0000","last_active":"2024-09-14T11:56:58.094951+0000","last_peered":"2024-09-14T11:56:58.094951+0000","last_clean":"2024-09-14T11:56:58.094951+0000","last_became_active":"2024-09-14T11:30:47.734741+0000","last_became_peered":"2024-09-14T11:30:47.734741+0000","last_unstale":"2024-09-14T11:56:58.094951+0000","last_undegraded":"2024-09-14T11:56:58.094951+0000","last_fullsized":"2024-09-14T11:56:58.094951+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.094857+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.094857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:22.727039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.162273+0000","last_change":"2024-09-14T11:57:07.162273+0000","last_active":"2024-09-14T11:57:07.162273+0000","last_peered":"2024-09-14T11:57:07.162273+0000","last_clean":"2024-09-14T11:57:07.162273+0000","last_became_active":"2024-09-14T11:30:44.713845+0000","last_became_peered":"2024-09-14T11:30:44.713845+0000","last_unstale":"2024-09-14T11:57:07.162273+0000","last_undegraded":"2024-09-14T11:57:07.162273+0000","last_fullsized":"2024-09-14T11:57:07.162273+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:07.162187+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:07.162187+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.162187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:28.310536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":50,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'32","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.646330+0000","last_change":"2024-09-14T11:57:02.646236+0000","last_active":"2024-09-14T11:57:02.646330+0000","last_peered":"2024-09-14T11:57:02.646330+0000","last_clean":"2024-09-14T11:57:02.646330+0000","last_became_active":"2024-09-14T11:29:10.316136+0000","last_became_peered":"2024-09-14T11:29:10.316136+0000","last_unstale":"2024-09-14T11:57:02.646330+0000","last_undegraded":"2024-09-14T11:57:02.646330+0000","last_fullsized":"2024-09-14T11:57:02.646330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:02.646141+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:02.646141+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.646141+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:33.693607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":147,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:20.535157+0000","last_change":"2024-09-14T11:57:20.535095+0000","last_active":"2024-09-14T11:57:20.535157+0000","last_peered":"2024-09-14T11:57:20.535157+0000","last_clean":"2024-09-14T11:57:20.535157+0000","last_became_active":"2024-09-14T11:41:15.867519+0000","last_became_peered":"2024-09-14T11:41:15.867519+0000","last_unstale":"2024-09-14T11:57:20.535157+0000","last_undegraded":"2024-09-14T11:57:20.535157+0000","last_fullsized":"2024-09-14T11:57:20.535157+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:20.535010+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:20.535010+0000","last_clean_scrub_stamp":"2024-09-14T11:57:20.535010+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:12.344371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.070548+0000","last_change":"2024-09-14T11:57:11.070548+0000","last_active":"2024-09-14T11:57:11.070548+0000","last_peered":"2024-09-14T11:57:11.070548+0000","last_clean":"2024-09-14T11:57:11.070548+0000","last_became_active":"2024-09-14T11:30:47.739379+0000","last_became_peered":"2024-09-14T11:30:47.739379+0000","last_unstale":"2024-09-14T11:57:11.070548+0000","last_undegraded":"2024-09-14T11:57:11.070548+0000","last_fullsized":"2024-09-14T11:57:11.070548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:11.070461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:11.070461+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.070461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.220080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.263149+0000","last_change":"2024-09-14T11:56:53.263149+0000","last_active":"2024-09-14T11:56:53.263149+0000","last_peered":"2024-09-14T11:56:53.263149+0000","last_clean":"2024-09-14T11:56:53.263149+0000","last_became_active":"2024-09-14T11:30:44.718076+0000","last_became_peered":"2024-09-14T11:30:44.718076+0000","last_unstale":"2024-09-14T11:56:53.263149+0000","last_undegraded":"2024-09-14T11:56:53.263149+0000","last_fullsized":"2024-09-14T11:56:53.263149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.263023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.263023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'44","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.980502+0000","last_change":"2024-09-14T11:56:59.980419+0000","last_active":"2024-09-14T11:56:59.980502+0000","last_peered":"2024-09-14T11:56:59.980502+0000","last_clean":"2024-09-14T11:56:59.980502+0000","last_became_active":"2024-09-14T11:29:10.311181+0000","last_became_peered":"2024-09-14T11:29:10.311181+0000","last_unstale":"2024-09-14T11:56:59.980502+0000","last_undegraded":"2024-09-14T11:56:59.980502+0000","last_fullsized":"2024-09-14T11:56:59.980502+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:59.980335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.980335+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:11.344838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":226,"num_write":118,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.986515+0000","last_change":"2024-09-14T11:57:18.986515+0000","last_active":"2024-09-14T11:57:18.986515+0000","last_peered":"2024-09-14T11:57:18.986515+0000","last_clean":"2024-09-14T11:57:18.986515+0000","last_became_active":"2024-09-14T11:41:15.877160+0000","last_became_peered":"2024-09-14T11:41:15.877160+0000","last_unstale":"2024-09-14T11:57:18.986515+0000","last_undegraded":"2024-09-14T11:57:18.986515+0000","last_fullsized":"2024-09-14T11:57:18.986515+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:18.986421+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:18.986421+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.986421+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:27.354616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.283767+0000","last_change":"2024-09-14T11:56:55.283767+0000","last_active":"2024-09-14T11:56:55.283767+0000","last_peered":"2024-09-14T11:56:55.283767+0000","last_clean":"2024-09-14T11:56:55.283767+0000","last_became_active":"2024-09-14T11:30:47.737970+0000","last_became_peered":"2024-09-14T11:30:47.737970+0000","last_unstale":"2024-09-14T11:56:55.283767+0000","last_undegraded":"2024-09-14T11:56:55.283767+0000","last_fullsized":"2024-09-14T11:56:55.283767+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:55.283654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.283654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:50.578811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.667212+0000","last_change":"2024-09-14T11:57:03.667212+0000","last_active":"2024-09-14T11:57:03.667212+0000","last_peered":"2024-09-14T11:57:03.667212+0000","last_clean":"2024-09-14T11:57:03.667212+0000","last_became_active":"2024-09-14T11:30:44.717881+0000","last_became_peered":"2024-09-14T11:30:44.717881+0000","last_unstale":"2024-09-14T11:57:03.667212+0000","last_undegraded":"2024-09-14T11:57:03.667212+0000","last_fullsized":"2024-09-14T11:57:03.667212+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:03.667127+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:03.667127+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.667127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:10.621565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'12","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.038789+0000","last_change":"2024-09-14T11:57:03.038706+0000","last_active":"2024-09-14T11:57:03.038789+0000","last_peered":"2024-09-14T11:57:03.038789+0000","last_clean":"2024-09-14T11:57:03.038789+0000","last_became_active":"2024-09-14T11:29:10.315220+0000","last_became_peered":"2024-09-14T11:29:10.315220+0000","last_unstale":"2024-09-14T11:57:03.038789+0000","last_undegraded":"2024-09-14T11:57:03.038789+0000","last_fullsized":"2024-09-14T11:57:03.038789+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:57:03.038596+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:57:03.038596+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.038596+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:21.732593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.944919+0000","last_change":"2024-09-14T11:56:50.944919+0000","last_active":"2024-09-14T11:56:50.944919+0000","last_peered":"2024-09-14T11:56:50.944919+0000","last_clean":"2024-09-14T11:56:50.944919+0000","last_became_active":"2024-09-14T11:41:15.868028+0000","last_became_peered":"2024-09-14T11:41:15.868028+0000","last_unstale":"2024-09-14T11:56:50.944919+0000","last_undegraded":"2024-09-14T11:56:50.944919+0000","last_fullsized":"2024-09-14T11:56:50.944919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.944826+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.944826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:13.529979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.115267+0000","last_change":"2024-09-14T11:57:09.115267+0000","last_active":"2024-09-14T11:57:09.115267+0000","last_peered":"2024-09-14T11:57:09.115267+0000","last_clean":"2024-09-14T11:57:09.115267+0000","last_became_active":"2024-09-14T11:30:47.737666+0000","last_became_peered":"2024-09-14T11:30:47.737666+0000","last_unstale":"2024-09-14T11:57:09.115267+0000","last_undegraded":"2024-09-14T11:57:09.115267+0000","last_fullsized":"2024-09-14T11:57:09.115267+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:09.115139+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:09.115139+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.115139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:51.455712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.504316+0000","last_change":"2024-09-14T11:57:05.504316+0000","last_active":"2024-09-14T11:57:05.504316+0000","last_peered":"2024-09-14T11:57:05.504316+0000","last_clean":"2024-09-14T11:57:05.504316+0000","last_became_active":"2024-09-14T11:30:44.719864+0000","last_became_peered":"2024-09-14T11:30:44.719864+0000","last_unstale":"2024-09-14T11:57:05.504316+0000","last_undegraded":"2024-09-14T11:57:05.504316+0000","last_fullsized":"2024-09-14T11:57:05.504316+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:05.504199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:05.504199+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.504199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:54.504015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'32","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.053263+0000","last_change":"2024-09-14T11:57:04.053263+0000","last_active":"2024-09-14T11:57:04.053263+0000","last_peered":"2024-09-14T11:57:04.053263+0000","last_clean":"2024-09-14T11:57:04.053263+0000","last_became_active":"2024-09-14T11:29:10.318051+0000","last_became_peered":"2024-09-14T11:29:10.318051+0000","last_unstale":"2024-09-14T11:57:04.053263+0000","last_undegraded":"2024-09-14T11:57:04.053263+0000","last_fullsized":"2024-09-14T11:57:04.053263+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T11:57:04.053154+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T11:57:04.053154+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.053154+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:41.426153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:14.487277+0000","last_change":"2024-09-14T11:57:14.487277+0000","last_active":"2024-09-14T11:57:14.487277+0000","last_peered":"2024-09-14T11:57:14.487277+0000","last_clean":"2024-09-14T11:57:14.487277+0000","last_became_active":"2024-09-14T11:41:15.872206+0000","last_became_peered":"2024-09-14T11:41:15.872206+0000","last_unstale":"2024-09-14T11:57:14.487277+0000","last_undegraded":"2024-09-14T11:57:14.487277+0000","last_fullsized":"2024-09-14T11:57:14.487277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:14.487179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:14.487179+0000","last_clean_scrub_stamp":"2024-09-14T11:57:14.487179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.653708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.016403+0000","last_change":"2024-09-14T11:57:13.016403+0000","last_active":"2024-09-14T11:57:13.016403+0000","last_peered":"2024-09-14T11:57:13.016403+0000","last_clean":"2024-09-14T11:57:13.016403+0000","last_became_active":"2024-09-14T11:30:47.740274+0000","last_became_peered":"2024-09-14T11:30:47.740274+0000","last_unstale":"2024-09-14T11:57:13.016403+0000","last_undegraded":"2024-09-14T11:57:13.016403+0000","last_fullsized":"2024-09-14T11:57:13.016403+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.016319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.016319+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.016319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.149029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.933625+0000","last_change":"2024-09-14T11:56:51.933625+0000","last_active":"2024-09-14T11:56:51.933625+0000","last_peered":"2024-09-14T11:56:51.933625+0000","last_clean":"2024-09-14T11:56:51.933625+0000","last_became_active":"2024-09-14T11:30:44.719467+0000","last_became_peered":"2024-09-14T11:30:44.719467+0000","last_unstale":"2024-09-14T11:56:51.933625+0000","last_undegraded":"2024-09-14T11:56:51.933625+0000","last_fullsized":"2024-09-14T11:56:51.933625+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.933536+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.933536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:59.991027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.668608+0000","last_change":"2024-09-14T11:57:00.668608+0000","last_active":"2024-09-14T11:57:00.668608+0000","last_peered":"2024-09-14T11:57:00.668608+0000","last_clean":"2024-09-14T11:57:00.668608+0000","last_became_active":"2024-09-14T11:29:10.324334+0000","last_became_peered":"2024-09-14T11:29:10.324334+0000","last_unstale":"2024-09-14T11:57:00.668608+0000","last_undegraded":"2024-09-14T11:57:00.668608+0000","last_fullsized":"2024-09-14T11:57:00.668608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:57:00.668524+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.668524+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.185828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":101,"num_write":61,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.283375+0000","last_change":"2024-09-14T11:56:58.283375+0000","last_active":"2024-09-14T11:56:58.283375+0000","last_peered":"2024-09-14T11:56:58.283375+0000","last_clean":"2024-09-14T11:56:58.283375+0000","last_became_active":"2024-09-14T11:41:15.865429+0000","last_became_peered":"2024-09-14T11:41:15.865429+0000","last_unstale":"2024-09-14T11:56:58.283375+0000","last_undegraded":"2024-09-14T11:56:58.283375+0000","last_fullsized":"2024-09-14T11:56:58.283375+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:58.283290+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.283290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:10.478240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.090301+0000","last_change":"2024-09-14T11:57:00.090301+0000","last_active":"2024-09-14T11:57:00.090301+0000","last_peered":"2024-09-14T11:57:00.090301+0000","last_clean":"2024-09-14T11:57:00.090301+0000","last_became_active":"2024-09-14T11:30:47.897414+0000","last_became_peered":"2024-09-14T11:30:47.897414+0000","last_unstale":"2024-09-14T11:57:00.090301+0000","last_undegraded":"2024-09-14T11:57:00.090301+0000","last_fullsized":"2024-09-14T11:57:00.090301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:00.090217+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:00.090217+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.090217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:11.802130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"260'7","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.582356+0000","last_change":"2024-09-14T11:57:10.582356+0000","last_active":"2024-09-14T11:57:10.582356+0000","last_peered":"2024-09-14T11:57:10.582356+0000","last_clean":"2024-09-14T11:57:10.582356+0000","last_became_active":"2024-09-14T11:30:44.722825+0000","last_became_peered":"2024-09-14T11:30:44.722825+0000","last_unstale":"2024-09-14T11:57:10.582356+0000","last_undegraded":"2024-09-14T11:57:10.582356+0000","last_fullsized":"2024-09-14T11:57:10.582356+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:57:10.582255+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:57:10.582255+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.582255+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.270555+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'24","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.225945+0000","last_change":"2024-09-14T11:56:51.225945+0000","last_active":"2024-09-14T11:56:51.225945+0000","last_peered":"2024-09-14T11:56:51.225945+0000","last_clean":"2024-09-14T11:56:51.225945+0000","last_became_active":"2024-09-14T11:29:10.324939+0000","last_became_peered":"2024-09-14T11:29:10.324939+0000","last_unstale":"2024-09-14T11:56:51.225945+0000","last_undegraded":"2024-09-14T11:56:51.225945+0000","last_fullsized":"2024-09-14T11:56:51.225945+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-14T11:56:51.225829+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.225829+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:16.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":127,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.450114+0000","last_change":"2024-09-14T11:57:13.450114+0000","last_active":"2024-09-14T11:57:13.450114+0000","last_peered":"2024-09-14T11:57:13.450114+0000","last_clean":"2024-09-14T11:57:13.450114+0000","last_became_active":"2024-09-14T11:41:15.875629+0000","last_became_peered":"2024-09-14T11:41:15.875629+0000","last_unstale":"2024-09-14T11:57:13.450114+0000","last_undegraded":"2024-09-14T11:57:13.450114+0000","last_fullsized":"2024-09-14T11:57:13.450114+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.450011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.450011+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.450011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:38.282195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.113053+0000","last_change":"2024-09-14T11:57:10.113053+0000","last_active":"2024-09-14T11:57:10.113053+0000","last_peered":"2024-09-14T11:57:10.113053+0000","last_clean":"2024-09-14T11:57:10.113053+0000","last_became_active":"2024-09-14T11:30:47.741912+0000","last_became_peered":"2024-09-14T11:30:47.741912+0000","last_unstale":"2024-09-14T11:57:10.113053+0000","last_undegraded":"2024-09-14T11:57:10.113053+0000","last_fullsized":"2024-09-14T11:57:10.113053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:10.112952+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:10.112952+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.112952+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:23.351432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5143,"num_write":5,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.013241+0000","last_change":"2024-09-14T11:56:53.013241+0000","last_active":"2024-09-14T11:56:53.013241+0000","last_peered":"2024-09-14T11:56:53.013241+0000","last_clean":"2024-09-14T11:56:53.013241+0000","last_became_active":"2024-09-14T11:30:44.716899+0000","last_became_peered":"2024-09-14T11:30:44.716899+0000","last_unstale":"2024-09-14T11:56:53.013241+0000","last_undegraded":"2024-09-14T11:56:53.013241+0000","last_fullsized":"2024-09-14T11:56:53.013241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:56:53.013141+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.013141+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.047147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'259","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.946131+0000","last_change":"2024-09-14T11:56:45.946131+0000","last_active":"2024-09-14T11:56:45.946131+0000","last_peered":"2024-09-14T11:56:45.946131+0000","last_clean":"2024-09-14T11:56:45.946131+0000","last_became_active":"2024-09-14T11:29:10.320362+0000","last_became_peered":"2024-09-14T11:29:10.320362+0000","last_unstale":"2024-09-14T11:56:45.946131+0000","last_undegraded":"2024-09-14T11:56:45.946131+0000","last_fullsized":"2024-09-14T11:56:45.946131+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-14T11:56:45.946047+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.946047+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:05.117515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2463,"num_read_kb":3230,"num_write":502,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:21.046917+0000","last_change":"2024-09-14T11:57:21.046917+0000","last_active":"2024-09-14T11:57:21.046917+0000","last_peered":"2024-09-14T11:57:21.046917+0000","last_clean":"2024-09-14T11:57:21.046917+0000","last_became_active":"2024-09-14T11:41:15.874853+0000","last_became_peered":"2024-09-14T11:41:15.874853+0000","last_unstale":"2024-09-14T11:57:21.046917+0000","last_undegraded":"2024-09-14T11:57:21.046917+0000","last_fullsized":"2024-09-14T11:57:21.046917+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:21.046830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:21.046830+0000","last_clean_scrub_stamp":"2024-09-14T11:57:21.046830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:54.337242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.996131+0000","last_change":"2024-09-14T11:57:06.996131+0000","last_active":"2024-09-14T11:57:06.996131+0000","last_peered":"2024-09-14T11:57:06.996131+0000","last_clean":"2024-09-14T11:57:06.996131+0000","last_became_active":"2024-09-14T11:30:47.738874+0000","last_became_peered":"2024-09-14T11:30:47.738874+0000","last_unstale":"2024-09-14T11:57:06.996131+0000","last_undegraded":"2024-09-14T11:57:06.996131+0000","last_fullsized":"2024-09-14T11:57:06.996131+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:57:06.996042+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:57:06.996042+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.996042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:41.361438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.639260+0000","last_change":"2024-09-14T11:57:06.639260+0000","last_active":"2024-09-14T11:57:06.639260+0000","last_peered":"2024-09-14T11:57:06.639260+0000","last_clean":"2024-09-14T11:57:06.639260+0000","last_became_active":"2024-09-14T11:30:44.722310+0000","last_became_peered":"2024-09-14T11:30:44.722310+0000","last_unstale":"2024-09-14T11:57:06.639260+0000","last_undegraded":"2024-09-14T11:57:06.639260+0000","last_fullsized":"2024-09-14T11:57:06.639260+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:06.639169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:06.639169+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.639169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:42.256373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'15","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.717550+0000","last_change":"2024-09-14T11:57:00.717550+0000","last_active":"2024-09-14T11:57:00.717550+0000","last_peered":"2024-09-14T11:57:00.717550+0000","last_clean":"2024-09-14T11:57:00.717550+0000","last_became_active":"2024-09-14T11:29:10.318749+0000","last_became_peered":"2024-09-14T11:29:10.318749+0000","last_unstale":"2024-09-14T11:57:00.717550+0000","last_undegraded":"2024-09-14T11:57:00.717550+0000","last_fullsized":"2024-09-14T11:57:00.717550+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:57:00.717455+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:57:00.717455+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.717455+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:33.056621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.468325+0000","last_change":"2024-09-14T11:57:16.468325+0000","last_active":"2024-09-14T11:57:16.468325+0000","last_peered":"2024-09-14T11:57:16.468325+0000","last_clean":"2024-09-14T11:57:16.468325+0000","last_became_active":"2024-09-14T11:41:15.875623+0000","last_became_peered":"2024-09-14T11:41:15.875623+0000","last_unstale":"2024-09-14T11:57:16.468325+0000","last_undegraded":"2024-09-14T11:57:16.468325+0000","last_fullsized":"2024-09-14T11:57:16.468325+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:16.468225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:16.468225+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.468225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:26.508246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.450693+0000","last_change":"2024-09-14T11:57:10.450693+0000","last_active":"2024-09-14T11:57:10.450693+0000","last_peered":"2024-09-14T11:57:10.450693+0000","last_clean":"2024-09-14T11:57:10.450693+0000","last_became_active":"2024-09-14T11:30:47.895872+0000","last_became_peered":"2024-09-14T11:30:47.895872+0000","last_unstale":"2024-09-14T11:57:10.450693+0000","last_undegraded":"2024-09-14T11:57:10.450693+0000","last_fullsized":"2024-09-14T11:57:10.450693+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:57:10.450590+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:57:10.450590+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.450590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.457760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.045891+0000","last_change":"2024-09-14T11:56:54.045891+0000","last_active":"2024-09-14T11:56:54.045891+0000","last_peered":"2024-09-14T11:56:54.045891+0000","last_clean":"2024-09-14T11:56:54.045891+0000","last_became_active":"2024-09-14T11:30:44.713412+0000","last_became_peered":"2024-09-14T11:30:44.713412+0000","last_unstale":"2024-09-14T11:56:54.045891+0000","last_undegraded":"2024-09-14T11:56:54.045891+0000","last_fullsized":"2024-09-14T11:56:54.045891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.045797+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.045797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:35.928451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'44","reported_seq":180,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.374994+0000","last_change":"2024-09-14T11:56:58.374906+0000","last_active":"2024-09-14T11:56:58.374994+0000","last_peered":"2024-09-14T11:56:58.374994+0000","last_clean":"2024-09-14T11:56:58.374994+0000","last_became_active":"2024-09-14T11:29:10.321020+0000","last_became_peered":"2024-09-14T11:29:10.321020+0000","last_unstale":"2024-09-14T11:56:58.374994+0000","last_undegraded":"2024-09-14T11:56:58.374994+0000","last_fullsized":"2024-09-14T11:56:58.374994+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:56:58.374822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.374822+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:02.736281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":270,"num_write":106,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:15.482616+0000","last_change":"2024-09-14T11:57:15.482616+0000","last_active":"2024-09-14T11:57:15.482616+0000","last_peered":"2024-09-14T11:57:15.482616+0000","last_clean":"2024-09-14T11:57:15.482616+0000","last_became_active":"2024-09-14T11:41:15.874461+0000","last_became_peered":"2024-09-14T11:41:15.874461+0000","last_unstale":"2024-09-14T11:57:15.482616+0000","last_undegraded":"2024-09-14T11:57:15.482616+0000","last_fullsized":"2024-09-14T11:57:15.482616+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:15.482528+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:15.482528+0000","last_clean_scrub_stamp":"2024-09-14T11:57:15.482528+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:08.023703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.057742+0000","last_change":"2024-09-14T11:56:57.057742+0000","last_active":"2024-09-14T11:56:57.057742+0000","last_peered":"2024-09-14T11:56:57.057742+0000","last_clean":"2024-09-14T11:56:57.057742+0000","last_became_active":"2024-09-14T11:30:47.736689+0000","last_became_peered":"2024-09-14T11:30:47.736689+0000","last_unstale":"2024-09-14T11:56:57.057742+0000","last_undegraded":"2024-09-14T11:56:57.057742+0000","last_fullsized":"2024-09-14T11:56:57.057742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:57.057651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.057651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:43.123811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.591935+0000","last_change":"2024-09-14T11:57:09.591935+0000","last_active":"2024-09-14T11:57:09.591935+0000","last_peered":"2024-09-14T11:57:09.591935+0000","last_clean":"2024-09-14T11:57:09.591935+0000","last_became_active":"2024-09-14T11:30:44.720303+0000","last_became_peered":"2024-09-14T11:30:44.720303+0000","last_unstale":"2024-09-14T11:57:09.591935+0000","last_undegraded":"2024-09-14T11:57:09.591935+0000","last_fullsized":"2024-09-14T11:57:09.591935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:09.591838+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:09.591838+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.591838+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:05.006842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'47","reported_seq":183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.069124+0000","last_change":"2024-09-14T11:57:02.069065+0000","last_active":"2024-09-14T11:57:02.069124+0000","last_peered":"2024-09-14T11:57:02.069124+0000","last_clean":"2024-09-14T11:57:02.069124+0000","last_became_active":"2024-09-14T11:29:10.322015+0000","last_became_peered":"2024-09-14T11:29:10.322015+0000","last_unstale":"2024-09-14T11:57:02.069124+0000","last_undegraded":"2024-09-14T11:57:02.069124+0000","last_fullsized":"2024-09-14T11:57:02.069124+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:57:02.068979+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:57:02.068979+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.068979+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:41.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":378,"num_read_kb":275,"num_write":117,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.480503+0000","last_change":"2024-09-14T11:57:18.480503+0000","last_active":"2024-09-14T11:57:18.480503+0000","last_peered":"2024-09-14T11:57:18.480503+0000","last_clean":"2024-09-14T11:57:18.480503+0000","last_became_active":"2024-09-14T11:41:15.867508+0000","last_became_peered":"2024-09-14T11:41:15.867508+0000","last_unstale":"2024-09-14T11:57:18.480503+0000","last_undegraded":"2024-09-14T11:57:18.480503+0000","last_fullsized":"2024-09-14T11:57:18.480503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:18.480414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:18.480414+0000","last_clean_scrub_stamp":"2024-09-14T11:57:18.480414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:05.772829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:09.400944+0000","last_change":"2024-09-14T11:57:09.400944+0000","last_active":"2024-09-14T11:57:09.400944+0000","last_peered":"2024-09-14T11:57:09.400944+0000","last_clean":"2024-09-14T11:57:09.400944+0000","last_became_active":"2024-09-14T11:30:47.739075+0000","last_became_peered":"2024-09-14T11:30:47.739075+0000","last_unstale":"2024-09-14T11:57:09.400944+0000","last_undegraded":"2024-09-14T11:57:09.400944+0000","last_fullsized":"2024-09-14T11:57:09.400944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:09.400856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:09.400856+0000","last_clean_scrub_stamp":"2024-09-14T11:57:09.400856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:16.556288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'8","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.966020+0000","last_change":"2024-09-14T11:57:00.966020+0000","last_active":"2024-09-14T11:57:00.966020+0000","last_peered":"2024-09-14T11:57:00.966020+0000","last_clean":"2024-09-14T11:57:00.966020+0000","last_became_active":"2024-09-14T11:30:44.717825+0000","last_became_peered":"2024-09-14T11:30:44.717825+0000","last_unstale":"2024-09-14T11:57:00.966020+0000","last_undegraded":"2024-09-14T11:57:00.966020+0000","last_fullsized":"2024-09-14T11:57:00.966020+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:57:00.965937+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:57:00.965937+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.965937+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:50.557729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12290,"num_write":8,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'38","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.132995+0000","last_change":"2024-09-14T11:56:49.132901+0000","last_active":"2024-09-14T11:56:49.132995+0000","last_peered":"2024-09-14T11:56:49.132995+0000","last_clean":"2024-09-14T11:56:49.132995+0000","last_became_active":"2024-09-14T11:29:10.321851+0000","last_became_peered":"2024-09-14T11:29:10.321851+0000","last_unstale":"2024-09-14T11:56:49.132995+0000","last_undegraded":"2024-09-14T11:56:49.132995+0000","last_fullsized":"2024-09-14T11:56:49.132995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T11:56:49.132808+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.132808+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:18.076133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":188,"num_write":101,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:11.415739+0000","last_change":"2024-09-14T11:57:11.415739+0000","last_active":"2024-09-14T11:57:11.415739+0000","last_peered":"2024-09-14T11:57:11.415739+0000","last_clean":"2024-09-14T11:57:11.415739+0000","last_became_active":"2024-09-14T11:41:15.875283+0000","last_became_peered":"2024-09-14T11:41:15.875283+0000","last_unstale":"2024-09-14T11:57:11.415739+0000","last_undegraded":"2024-09-14T11:57:11.415739+0000","last_fullsized":"2024-09-14T11:57:11.415739+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:11.415636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:11.415636+0000","last_clean_scrub_stamp":"2024-09-14T11:57:11.415636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:15.987476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.508826+0000","last_change":"2024-09-14T11:57:12.508826+0000","last_active":"2024-09-14T11:57:12.508826+0000","last_peered":"2024-09-14T11:57:12.508826+0000","last_clean":"2024-09-14T11:57:12.508826+0000","last_became_active":"2024-09-14T11:30:47.734939+0000","last_became_peered":"2024-09-14T11:30:47.734939+0000","last_unstale":"2024-09-14T11:57:12.508826+0000","last_undegraded":"2024-09-14T11:57:12.508826+0000","last_fullsized":"2024-09-14T11:57:12.508826+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:57:12.508724+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:57:12.508724+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.508724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:37.452554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.440763+0000","last_change":"2024-09-14T11:57:03.440763+0000","last_active":"2024-09-14T11:57:03.440763+0000","last_peered":"2024-09-14T11:57:03.440763+0000","last_clean":"2024-09-14T11:57:03.440763+0000","last_became_active":"2024-09-14T11:30:44.721871+0000","last_became_peered":"2024-09-14T11:30:44.721871+0000","last_unstale":"2024-09-14T11:57:03.440763+0000","last_undegraded":"2024-09-14T11:57:03.440763+0000","last_fullsized":"2024-09-14T11:57:03.440763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:03.440660+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:03.440660+0000","last_clean_scrub_stamp":"2024-09-14T11:57:03.440660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.426625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.692157+0000","last_change":"2024-09-14T11:57:01.692086+0000","last_active":"2024-09-14T11:57:01.692157+0000","last_peered":"2024-09-14T11:57:01.692157+0000","last_clean":"2024-09-14T11:57:01.692157+0000","last_became_active":"2024-09-14T11:29:10.320900+0000","last_became_peered":"2024-09-14T11:29:10.320900+0000","last_unstale":"2024-09-14T11:57:01.692157+0000","last_undegraded":"2024-09-14T11:57:01.692157+0000","last_fullsized":"2024-09-14T11:57:01.692157+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-14T11:57:01.692002+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-14T11:57:01.692002+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.692002+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:09.233252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":224,"num_write":123,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.835671+0000","last_change":"2024-09-14T11:57:08.835671+0000","last_active":"2024-09-14T11:57:08.835671+0000","last_peered":"2024-09-14T11:57:08.835671+0000","last_clean":"2024-09-14T11:57:08.835671+0000","last_became_active":"2024-09-14T11:41:15.872268+0000","last_became_peered":"2024-09-14T11:41:15.872268+0000","last_unstale":"2024-09-14T11:57:08.835671+0000","last_undegraded":"2024-09-14T11:57:08.835671+0000","last_fullsized":"2024-09-14T11:57:08.835671+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:08.835583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:08.835583+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.835583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:21.433249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.505956+0000","last_change":"2024-09-14T11:57:13.505956+0000","last_active":"2024-09-14T11:57:13.505956+0000","last_peered":"2024-09-14T11:57:13.505956+0000","last_clean":"2024-09-14T11:57:13.505956+0000","last_became_active":"2024-09-14T11:30:47.897163+0000","last_became_peered":"2024-09-14T11:30:47.897163+0000","last_unstale":"2024-09-14T11:57:13.505956+0000","last_undegraded":"2024-09-14T11:57:13.505956+0000","last_fullsized":"2024-09-14T11:57:13.505956+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:13.505842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:13.505842+0000","last_clean_scrub_stamp":"2024-09-14T11:57:13.505842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:08.726873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.913761+0000","last_change":"2024-09-14T11:56:47.913761+0000","last_active":"2024-09-14T11:56:47.913761+0000","last_peered":"2024-09-14T11:56:47.913761+0000","last_clean":"2024-09-14T11:56:47.913761+0000","last_became_active":"2024-09-14T11:30:44.720258+0000","last_became_peered":"2024-09-14T11:30:44.720258+0000","last_unstale":"2024-09-14T11:56:47.913761+0000","last_undegraded":"2024-09-14T11:56:47.913761+0000","last_fullsized":"2024-09-14T11:56:47.913761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:47.913640+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.913640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:12.325543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'14","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.144187+0000","last_change":"2024-09-14T11:56:48.144132+0000","last_active":"2024-09-14T11:56:48.144187+0000","last_peered":"2024-09-14T11:56:48.144187+0000","last_clean":"2024-09-14T11:56:48.144187+0000","last_became_active":"2024-09-14T11:29:10.322148+0000","last_became_peered":"2024-09-14T11:29:10.322148+0000","last_unstale":"2024-09-14T11:56:48.144187+0000","last_undegraded":"2024-09-14T11:56:48.144187+0000","last_fullsized":"2024-09-14T11:56:48.144187+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:56:48.144046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.144046+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:55.137350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":53,"num_write":35,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.041527+0000","last_change":"2024-09-14T11:57:02.041438+0000","last_active":"2024-09-14T11:57:02.041527+0000","last_peered":"2024-09-14T11:57:02.041527+0000","last_clean":"2024-09-14T11:57:02.041527+0000","last_became_active":"2024-09-14T11:41:15.864921+0000","last_became_peered":"2024-09-14T11:41:15.864921+0000","last_unstale":"2024-09-14T11:57:02.041527+0000","last_undegraded":"2024-09-14T11:57:02.041527+0000","last_fullsized":"2024-09-14T11:57:02.041527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:02.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:02.041303+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:22.240923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.448566+0000","last_change":"2024-09-14T11:57:08.448566+0000","last_active":"2024-09-14T11:57:08.448566+0000","last_peered":"2024-09-14T11:57:08.448566+0000","last_clean":"2024-09-14T11:57:08.448566+0000","last_became_active":"2024-09-14T11:30:47.895922+0000","last_became_peered":"2024-09-14T11:30:47.895922+0000","last_unstale":"2024-09-14T11:57:08.448566+0000","last_undegraded":"2024-09-14T11:57:08.448566+0000","last_fullsized":"2024-09-14T11:57:08.448566+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:08.448470+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:08.448470+0000","last_clean_scrub_stamp":"2024-09-14T11:57:08.448470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:35.742467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.663495+0000","last_change":"2024-09-14T11:57:02.663495+0000","last_active":"2024-09-14T11:57:02.663495+0000","last_peered":"2024-09-14T11:57:02.663495+0000","last_clean":"2024-09-14T11:57:02.663495+0000","last_became_active":"2024-09-14T11:30:44.718988+0000","last_became_peered":"2024-09-14T11:30:44.718988+0000","last_unstale":"2024-09-14T11:57:02.663495+0000","last_undegraded":"2024-09-14T11:57:02.663495+0000","last_fullsized":"2024-09-14T11:57:02.663495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:57:02.663409+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:57:02.663409+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.663409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:14.457039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.334999+0000","last_change":"2024-09-14T11:56:57.334999+0000","last_active":"2024-09-14T11:56:57.334999+0000","last_peered":"2024-09-14T11:56:57.334999+0000","last_clean":"2024-09-14T11:56:57.334999+0000","last_became_active":"2024-09-14T11:29:10.322928+0000","last_became_peered":"2024-09-14T11:29:10.322928+0000","last_unstale":"2024-09-14T11:56:57.334999+0000","last_undegraded":"2024-09-14T11:56:57.334999+0000","last_fullsized":"2024-09-14T11:56:57.334999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-14T11:56:57.334915+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.334915+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.592191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":259,"num_write":115,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:10.937325+0000","last_change":"2024-09-14T11:57:10.937325+0000","last_active":"2024-09-14T11:57:10.937325+0000","last_peered":"2024-09-14T11:57:10.937325+0000","last_clean":"2024-09-14T11:57:10.937325+0000","last_became_active":"2024-09-14T11:41:15.866718+0000","last_became_peered":"2024-09-14T11:41:15.866718+0000","last_unstale":"2024-09-14T11:57:10.937325+0000","last_undegraded":"2024-09-14T11:57:10.937325+0000","last_fullsized":"2024-09-14T11:57:10.937325+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:10.937245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:10.937245+0000","last_clean_scrub_stamp":"2024-09-14T11:57:10.937245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:36.577749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.980193+0000","last_change":"2024-09-14T11:57:07.980193+0000","last_active":"2024-09-14T11:57:07.980193+0000","last_peered":"2024-09-14T11:57:07.980193+0000","last_clean":"2024-09-14T11:57:07.980193+0000","last_became_active":"2024-09-14T11:30:47.739786+0000","last_became_peered":"2024-09-14T11:30:47.739786+0000","last_unstale":"2024-09-14T11:57:07.980193+0000","last_undegraded":"2024-09-14T11:57:07.980193+0000","last_fullsized":"2024-09-14T11:57:07.980193+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:57:07.980052+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:57:07.980052+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.980052+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:57.197935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:04.454366+0000","last_change":"2024-09-14T11:57:04.454366+0000","last_active":"2024-09-14T11:57:04.454366+0000","last_peered":"2024-09-14T11:57:04.454366+0000","last_clean":"2024-09-14T11:57:04.454366+0000","last_became_active":"2024-09-14T11:30:44.721009+0000","last_became_peered":"2024-09-14T11:30:44.721009+0000","last_unstale":"2024-09-14T11:57:04.454366+0000","last_undegraded":"2024-09-14T11:57:04.454366+0000","last_fullsized":"2024-09-14T11:57:04.454366+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:04.454265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:04.454265+0000","last_clean_scrub_stamp":"2024-09-14T11:57:04.454265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:11.151908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'23","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.984107+0000","last_change":"2024-09-14T11:56:50.984107+0000","last_active":"2024-09-14T11:56:50.984107+0000","last_peered":"2024-09-14T11:56:50.984107+0000","last_clean":"2024-09-14T11:56:50.984107+0000","last_became_active":"2024-09-14T11:29:10.321197+0000","last_became_peered":"2024-09-14T11:29:10.321197+0000","last_unstale":"2024-09-14T11:56:50.984107+0000","last_undegraded":"2024-09-14T11:56:50.984107+0000","last_fullsized":"2024-09-14T11:56:50.984107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:56:50.984030+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.984030+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:46.373826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":119,"num_write":58,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.885109+0000","last_change":"2024-09-14T11:56:53.885109+0000","last_active":"2024-09-14T11:56:53.885109+0000","last_peered":"2024-09-14T11:56:53.885109+0000","last_clean":"2024-09-14T11:56:53.885109+0000","last_became_active":"2024-09-14T11:41:15.869018+0000","last_became_peered":"2024-09-14T11:41:15.869018+0000","last_unstale":"2024-09-14T11:56:53.885109+0000","last_undegraded":"2024-09-14T11:56:53.885109+0000","last_fullsized":"2024-09-14T11:56:53.885109+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:53.885011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.885011+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:38.040674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.112834+0000","last_change":"2024-09-14T11:56:59.112834+0000","last_active":"2024-09-14T11:56:59.112834+0000","last_peered":"2024-09-14T11:56:59.112834+0000","last_clean":"2024-09-14T11:56:59.112834+0000","last_became_active":"2024-09-14T11:30:47.733713+0000","last_became_peered":"2024-09-14T11:30:47.733713+0000","last_unstale":"2024-09-14T11:56:59.112834+0000","last_undegraded":"2024-09-14T11:56:59.112834+0000","last_fullsized":"2024-09-14T11:56:59.112834+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:56:59.112741+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.112741+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:05.850721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.457354+0000","last_change":"2024-09-14T11:57:07.457354+0000","last_active":"2024-09-14T11:57:07.457354+0000","last_peered":"2024-09-14T11:57:07.457354+0000","last_clean":"2024-09-14T11:57:07.457354+0000","last_became_active":"2024-09-14T11:30:44.720563+0000","last_became_peered":"2024-09-14T11:30:44.720563+0000","last_unstale":"2024-09-14T11:57:07.457354+0000","last_undegraded":"2024-09-14T11:57:07.457354+0000","last_fullsized":"2024-09-14T11:57:07.457354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:07.457262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:07.457262+0000","last_clean_scrub_stamp":"2024-09-14T11:57:07.457262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.652237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.671280+0000","last_change":"2024-09-14T11:57:01.671280+0000","last_active":"2024-09-14T11:57:01.671280+0000","last_peered":"2024-09-14T11:57:01.671280+0000","last_clean":"2024-09-14T11:57:01.671280+0000","last_became_active":"2024-09-14T11:29:10.322566+0000","last_became_peered":"2024-09-14T11:29:10.322566+0000","last_unstale":"2024-09-14T11:57:01.671280+0000","last_undegraded":"2024-09-14T11:57:01.671280+0000","last_fullsized":"2024-09-14T11:57:01.671280+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:57:01.671202+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:57:01.671202+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.671202+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:56.164844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":135,"num_write":74,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.479092+0000","last_change":"2024-09-14T11:57:17.479092+0000","last_active":"2024-09-14T11:57:17.479092+0000","last_peered":"2024-09-14T11:57:17.479092+0000","last_clean":"2024-09-14T11:57:17.479092+0000","last_became_active":"2024-09-14T11:41:15.873123+0000","last_became_peered":"2024-09-14T11:41:15.873123+0000","last_unstale":"2024-09-14T11:57:17.479092+0000","last_undegraded":"2024-09-14T11:57:17.479092+0000","last_fullsized":"2024-09-14T11:57:17.479092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:17.479000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:17.479000+0000","last_clean_scrub_stamp":"2024-09-14T11:57:17.479000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:27.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:05.750401+0000","last_change":"2024-09-14T11:57:05.750401+0000","last_active":"2024-09-14T11:57:05.750401+0000","last_peered":"2024-09-14T11:57:05.750401+0000","last_clean":"2024-09-14T11:57:05.750401+0000","last_became_active":"2024-09-14T11:30:47.738769+0000","last_became_peered":"2024-09-14T11:30:47.738769+0000","last_unstale":"2024-09-14T11:57:05.750401+0000","last_undegraded":"2024-09-14T11:57:05.750401+0000","last_fullsized":"2024-09-14T11:57:05.750401+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:57:05.750321+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:57:05.750321+0000","last_clean_scrub_stamp":"2024-09-14T11:57:05.750321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:01.997392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.414830+0000","last_change":"2024-09-14T11:57:02.414830+0000","last_active":"2024-09-14T11:57:02.414830+0000","last_peered":"2024-09-14T11:57:02.414830+0000","last_clean":"2024-09-14T11:57:02.414830+0000","last_became_active":"2024-09-14T11:30:44.720520+0000","last_became_peered":"2024-09-14T11:30:44.720520+0000","last_unstale":"2024-09-14T11:57:02.414830+0000","last_undegraded":"2024-09-14T11:57:02.414830+0000","last_fullsized":"2024-09-14T11:57:02.414830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:02.414741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:02.414741+0000","last_clean_scrub_stamp":"2024-09-14T11:57:02.414741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.691386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'17","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.967461+0000","last_change":"2024-09-14T11:56:58.967461+0000","last_active":"2024-09-14T11:56:58.967461+0000","last_peered":"2024-09-14T11:56:58.967461+0000","last_clean":"2024-09-14T11:56:58.967461+0000","last_became_active":"2024-09-14T11:29:10.318897+0000","last_became_peered":"2024-09-14T11:29:10.318897+0000","last_unstale":"2024-09-14T11:56:58.967461+0000","last_undegraded":"2024-09-14T11:56:58.967461+0000","last_fullsized":"2024-09-14T11:56:58.967461+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:56:58.967365+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.967365+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:06.574227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:16.486318+0000","last_change":"2024-09-14T11:57:16.486318+0000","last_active":"2024-09-14T11:57:16.486318+0000","last_peered":"2024-09-14T11:57:16.486318+0000","last_clean":"2024-09-14T11:57:16.486318+0000","last_became_active":"2024-09-14T11:41:15.869669+0000","last_became_peered":"2024-09-14T11:41:15.869669+0000","last_unstale":"2024-09-14T11:57:16.486318+0000","last_undegraded":"2024-09-14T11:57:16.486318+0000","last_fullsized":"2024-09-14T11:57:16.486318+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:16.486225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:16.486225+0000","last_clean_scrub_stamp":"2024-09-14T11:57:16.486225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:52.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.275179+0000","last_change":"2024-09-14T11:56:54.275179+0000","last_active":"2024-09-14T11:56:54.275179+0000","last_peered":"2024-09-14T11:56:54.275179+0000","last_clean":"2024-09-14T11:56:54.275179+0000","last_became_active":"2024-09-14T11:30:47.741913+0000","last_became_peered":"2024-09-14T11:30:47.741913+0000","last_unstale":"2024-09-14T11:56:54.275179+0000","last_undegraded":"2024-09-14T11:56:54.275179+0000","last_fullsized":"2024-09-14T11:56:54.275179+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.275052+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.275052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:27.168851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'11","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.995693+0000","last_change":"2024-09-14T11:56:51.995693+0000","last_active":"2024-09-14T11:56:51.995693+0000","last_peered":"2024-09-14T11:56:51.995693+0000","last_clean":"2024-09-14T11:56:51.995693+0000","last_became_active":"2024-09-14T11:30:44.712789+0000","last_became_peered":"2024-09-14T11:30:44.712789+0000","last_unstale":"2024-09-14T11:56:51.995693+0000","last_undegraded":"2024-09-14T11:56:51.995693+0000","last_fullsized":"2024-09-14T11:56:51.995693+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:56:51.995590+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.995590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:12.438738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'143","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.189319+0000","last_change":"2024-09-14T11:56:47.189319+0000","last_active":"2024-09-14T11:56:47.189319+0000","last_peered":"2024-09-14T11:56:47.189319+0000","last_clean":"2024-09-14T11:56:47.189319+0000","last_became_active":"2024-09-14T11:29:10.321005+0000","last_became_peered":"2024-09-14T11:29:10.321005+0000","last_unstale":"2024-09-14T11:56:47.189319+0000","last_undegraded":"2024-09-14T11:56:47.189319+0000","last_fullsized":"2024-09-14T11:56:47.189319+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:56:47.189227+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.189227+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:38.048555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1354,"num_read_kb":1047,"num_write":310,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.449013+0000","last_change":"2024-09-14T11:57:12.449013+0000","last_active":"2024-09-14T11:57:12.449013+0000","last_peered":"2024-09-14T11:57:12.449013+0000","last_clean":"2024-09-14T11:57:12.449013+0000","last_became_active":"2024-09-14T11:41:15.878085+0000","last_became_peered":"2024-09-14T11:41:15.878085+0000","last_unstale":"2024-09-14T11:57:12.449013+0000","last_undegraded":"2024-09-14T11:57:12.449013+0000","last_fullsized":"2024-09-14T11:57:12.449013+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:57:12.448918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:57:12.448918+0000","last_clean_scrub_stamp":"2024-09-14T11:57:12.448918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:24.545838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:06.040203+0000","last_change":"2024-09-14T11:57:06.040203+0000","last_active":"2024-09-14T11:57:06.040203+0000","last_peered":"2024-09-14T11:57:06.040203+0000","last_clean":"2024-09-14T11:57:06.040203+0000","last_became_active":"2024-09-14T11:30:47.739615+0000","last_became_peered":"2024-09-14T11:30:47.739615+0000","last_unstale":"2024-09-14T11:57:06.040203+0000","last_undegraded":"2024-09-14T11:57:06.040203+0000","last_fullsized":"2024-09-14T11:57:06.040203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:57:06.040103+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:57:06.040103+0000","last_clean_scrub_stamp":"2024-09-14T11:57:06.040103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:00.771691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.249115+0000","last_change":"2024-09-14T11:56:52.249115+0000","last_active":"2024-09-14T11:56:52.249115+0000","last_peered":"2024-09-14T11:56:52.249115+0000","last_clean":"2024-09-14T11:56:52.249115+0000","last_became_active":"2024-09-14T11:30:44.720871+0000","last_became_peered":"2024-09-14T11:30:44.720871+0000","last_unstale":"2024-09-14T11:56:52.249115+0000","last_undegraded":"2024-09-14T11:56:52.249115+0000","last_fullsized":"2024-09-14T11:56:52.249115+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:56:52.249025+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.249025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:41.425368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'26","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.353189+0000","last_change":"2024-09-14T11:56:59.353130+0000","last_active":"2024-09-14T11:56:59.353189+0000","last_peered":"2024-09-14T11:56:59.353189+0000","last_clean":"2024-09-14T11:56:59.353189+0000","last_became_active":"2024-09-14T11:29:10.323655+0000","last_became_peered":"2024-09-14T11:29:10.323655+0000","last_unstale":"2024-09-14T11:56:59.353189+0000","last_undegraded":"2024-09-14T11:56:59.353189+0000","last_fullsized":"2024-09-14T11:56:59.353189+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:56:59.353042+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.353042+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.218284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":141,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'328","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.457995+0000","last_change":"2024-09-14T11:56:32.457995+0000","last_active":"2024-09-14T11:56:32.457995+0000","last_peered":"2024-09-14T11:56:32.457995+0000","last_clean":"2024-09-14T11:56:32.457995+0000","last_became_active":"2024-09-14T11:14:04.130244+0000","last_became_peered":"2024-09-14T11:14:04.130244+0000","last_unstale":"2024-09-14T11:56:32.457995+0000","last_undegraded":"2024-09-14T11:56:32.457995+0000","last_fullsized":"2024-09-14T11:56:32.457995+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:32.457886+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.457886+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:42.457035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":2359,"num_write":1145,"num_write_kb":27815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1593","reported_seq":3387,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.733167+0000","last_change":"2024-09-14T11:56:40.733167+0000","last_active":"2024-09-14T11:56:40.733167+0000","last_peered":"2024-09-14T11:56:40.733167+0000","last_clean":"2024-09-14T11:56:40.733167+0000","last_became_active":"2024-09-14T11:14:06.121624+0000","last_became_peered":"2024-09-14T11:14:06.121624+0000","last_unstale":"2024-09-14T11:56:40.733167+0000","last_undegraded":"2024-09-14T11:56:40.733167+0000","last_fullsized":"2024-09-14T11:56:40.733167+0000","mapping_epoch":27,"log_start":"263'1500","ondisk_log_start":"263'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1593","last_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_deep_scrub":"263'1593","last_deep_scrub_stamp":"2024-09-14T11:56:40.733084+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.733084+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.184612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7391,"num_read_kb":6399,"num_write":2360,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'344","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.843948+0000","last_change":"2024-09-14T11:56:25.843948+0000","last_active":"2024-09-14T11:56:25.843948+0000","last_peered":"2024-09-14T11:56:25.843948+0000","last_clean":"2024-09-14T11:56:25.843948+0000","last_became_active":"2024-09-14T11:14:04.126212+0000","last_became_peered":"2024-09-14T11:14:04.126212+0000","last_unstale":"2024-09-14T11:56:25.843948+0000","last_undegraded":"2024-09-14T11:56:25.843948+0000","last_fullsized":"2024-09-14T11:56:25.843948+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:56:25.843781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.843781+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:39.876965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":643,"num_read_kb":6703,"num_write":1183,"num_write_kb":40513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'563","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.583527+0000","last_change":"2024-09-14T11:56:39.583472+0000","last_active":"2024-09-14T11:56:39.583527+0000","last_peered":"2024-09-14T11:56:39.583527+0000","last_clean":"2024-09-14T11:56:39.583527+0000","last_became_active":"2024-09-14T11:14:06.122893+0000","last_became_peered":"2024-09-14T11:14:06.122893+0000","last_unstale":"2024-09-14T11:56:39.583527+0000","last_undegraded":"2024-09-14T11:56:39.583527+0000","last_fullsized":"2024-09-14T11:56:39.583527+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'563","last_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_deep_scrub":"263'563","last_deep_scrub_stamp":"2024-09-14T11:56:39.583358+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.583358+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.041135+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3026,"num_read_kb":2817,"num_write":710,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'350","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.490371+0000","last_change":"2024-09-14T11:56:29.490371+0000","last_active":"2024-09-14T11:56:29.490371+0000","last_peered":"2024-09-14T11:56:29.490371+0000","last_clean":"2024-09-14T11:56:29.490371+0000","last_became_active":"2024-09-14T11:14:04.122331+0000","last_became_peered":"2024-09-14T11:14:04.122331+0000","last_unstale":"2024-09-14T11:56:29.490371+0000","last_undegraded":"2024-09-14T11:56:29.490371+0000","last_fullsized":"2024-09-14T11:56:29.490371+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:29.490240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.490240+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:19.905307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":11794,"num_write":1143,"num_write_kb":27571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'481","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.761132+0000","last_change":"2024-09-14T11:56:40.761132+0000","last_active":"2024-09-14T11:56:40.761132+0000","last_peered":"2024-09-14T11:56:40.761132+0000","last_clean":"2024-09-14T11:56:40.761132+0000","last_became_active":"2024-09-14T11:14:06.124242+0000","last_became_peered":"2024-09-14T11:14:06.124242+0000","last_unstale":"2024-09-14T11:56:40.761132+0000","last_undegraded":"2024-09-14T11:56:40.761132+0000","last_fullsized":"2024-09-14T11:56:40.761132+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T11:56:40.761000+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.761000+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:10.670888+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2772,"num_read_kb":2640,"num_write":538,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'314","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.751856+0000","last_change":"2024-09-14T11:56:37.751856+0000","last_active":"2024-09-14T11:56:37.751856+0000","last_peered":"2024-09-14T11:56:37.751856+0000","last_clean":"2024-09-14T11:56:37.751856+0000","last_became_active":"2024-09-14T11:14:04.127770+0000","last_became_peered":"2024-09-14T11:14:04.127770+0000","last_unstale":"2024-09-14T11:56:37.751856+0000","last_undegraded":"2024-09-14T11:56:37.751856+0000","last_fullsized":"2024-09-14T11:56:37.751856+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-14T11:56:37.751721+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.751721+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:52.423497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":13079,"num_write":972,"num_write_kb":33086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1061","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.655563+0000","last_change":"2024-09-14T11:56:38.655504+0000","last_active":"2024-09-14T11:56:38.655563+0000","last_peered":"2024-09-14T11:56:38.655563+0000","last_clean":"2024-09-14T11:56:38.655563+0000","last_became_active":"2024-09-14T11:14:06.134571+0000","last_became_peered":"2024-09-14T11:14:06.134571+0000","last_unstale":"2024-09-14T11:56:38.655563+0000","last_undegraded":"2024-09-14T11:56:38.655563+0000","last_fullsized":"2024-09-14T11:56:38.655563+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1061","last_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_deep_scrub":"263'1061","last_deep_scrub_stamp":"2024-09-14T11:56:38.655414+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.655414+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:06.267363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5203,"num_read_kb":4578,"num_write":1529,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'351","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.566767+0000","last_change":"2024-09-14T11:56:37.566767+0000","last_active":"2024-09-14T11:56:37.566767+0000","last_peered":"2024-09-14T11:56:37.566767+0000","last_clean":"2024-09-14T11:56:37.566767+0000","last_became_active":"2024-09-14T11:14:04.121579+0000","last_became_peered":"2024-09-14T11:14:04.121579+0000","last_unstale":"2024-09-14T11:56:37.566767+0000","last_undegraded":"2024-09-14T11:56:37.566767+0000","last_fullsized":"2024-09-14T11:56:37.566767+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:37.566631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.566631+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:27.502397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":626,"num_read_kb":64951,"num_write":1173,"num_write_kb":36557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'466","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.235997+0000","last_change":"2024-09-14T11:56:34.235997+0000","last_active":"2024-09-14T11:56:34.235997+0000","last_peered":"2024-09-14T11:56:34.235997+0000","last_clean":"2024-09-14T11:56:34.235997+0000","last_became_active":"2024-09-14T11:14:06.130758+0000","last_became_peered":"2024-09-14T11:14:06.130758+0000","last_unstale":"2024-09-14T11:56:34.235997+0000","last_undegraded":"2024-09-14T11:56:34.235997+0000","last_fullsized":"2024-09-14T11:56:34.235997+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:34.235902+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.235902+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:32.784865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2691,"num_read_kb":2531,"num_write":591,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'363","reported_seq":1107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.776617+0000","last_change":"2024-09-14T11:56:34.776532+0000","last_active":"2024-09-14T11:56:34.776617+0000","last_peered":"2024-09-14T11:56:34.776617+0000","last_clean":"2024-09-14T11:56:34.776617+0000","last_became_active":"2024-09-14T11:14:04.132525+0000","last_became_peered":"2024-09-14T11:14:04.132525+0000","last_unstale":"2024-09-14T11:56:34.776617+0000","last_undegraded":"2024-09-14T11:56:34.776617+0000","last_fullsized":"2024-09-14T11:56:34.776617+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:56:34.776385+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.776385+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.314618+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1045,"num_read_kb":31256,"num_write":1134,"num_write_kb":36210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'803","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.817046+0000","last_change":"2024-09-14T11:56:42.817046+0000","last_active":"2024-09-14T11:56:42.817046+0000","last_peered":"2024-09-14T11:56:42.817046+0000","last_clean":"2024-09-14T11:56:42.817046+0000","last_became_active":"2024-09-14T11:14:06.122957+0000","last_became_peered":"2024-09-14T11:14:06.122957+0000","last_unstale":"2024-09-14T11:56:42.817046+0000","last_undegraded":"2024-09-14T11:56:42.817046+0000","last_fullsized":"2024-09-14T11:56:42.817046+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:42.816954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.816954+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:54.466437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3907,"num_read_kb":3545,"num_write":1043,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'298","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.494965+0000","last_change":"2024-09-14T11:56:31.494896+0000","last_active":"2024-09-14T11:56:31.494965+0000","last_peered":"2024-09-14T11:56:31.494965+0000","last_clean":"2024-09-14T11:56:31.494965+0000","last_became_active":"2024-09-14T11:14:04.123185+0000","last_became_peered":"2024-09-14T11:14:04.123185+0000","last_unstale":"2024-09-14T11:56:31.494965+0000","last_undegraded":"2024-09-14T11:56:31.494965+0000","last_fullsized":"2024-09-14T11:56:31.494965+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-14T11:56:31.494814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.494814+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:22.737796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":433,"num_read_kb":10089,"num_write":838,"num_write_kb":36971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'972","reported_seq":2716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.682691+0000","last_change":"2024-09-14T11:56:43.682691+0000","last_active":"2024-09-14T11:56:43.682691+0000","last_peered":"2024-09-14T11:56:43.682691+0000","last_clean":"2024-09-14T11:56:43.682691+0000","last_became_active":"2024-09-14T11:14:38.192247+0000","last_became_peered":"2024-09-14T11:14:38.192247+0000","last_unstale":"2024-09-14T11:56:43.682691+0000","last_undegraded":"2024-09-14T11:56:43.682691+0000","last_fullsized":"2024-09-14T11:56:43.682691+0000","mapping_epoch":38,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'972","last_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_deep_scrub":"263'972","last_deep_scrub_stamp":"2024-09-14T11:56:43.682597+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.682597+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":900,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:06.195336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4944,"num_read_kb":4536,"num_write":1391,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3830,"num_omap_keys":15,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'304","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.076723+0000","last_change":"2024-09-14T11:56:31.076616+0000","last_active":"2024-09-14T11:56:31.076723+0000","last_peered":"2024-09-14T11:56:31.076723+0000","last_clean":"2024-09-14T11:56:31.076723+0000","last_became_active":"2024-09-14T11:14:04.133306+0000","last_became_peered":"2024-09-14T11:14:04.133306+0000","last_unstale":"2024-09-14T11:56:31.076723+0000","last_undegraded":"2024-09-14T11:56:31.076723+0000","last_fullsized":"2024-09-14T11:56:31.076723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:31.076451+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.076451+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:08.379985+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":712,"num_read_kb":31980,"num_write":1004,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'457","reported_seq":1989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.852513+0000","last_change":"2024-09-14T11:56:30.852513+0000","last_active":"2024-09-14T11:56:30.852513+0000","last_peered":"2024-09-14T11:56:30.852513+0000","last_clean":"2024-09-14T11:56:30.852513+0000","last_became_active":"2024-09-14T11:14:06.120560+0000","last_became_peered":"2024-09-14T11:14:06.120560+0000","last_unstale":"2024-09-14T11:56:30.852513+0000","last_undegraded":"2024-09-14T11:56:30.852513+0000","last_fullsized":"2024-09-14T11:56:30.852513+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:56:30.852429+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.852429+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:32.993438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2385,"num_read_kb":2235,"num_write":527,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'844","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.751896+0000","last_change":"2024-09-14T11:56:38.751896+0000","last_active":"2024-09-14T11:56:38.751896+0000","last_peered":"2024-09-14T11:56:38.751896+0000","last_clean":"2024-09-14T11:56:38.751896+0000","last_became_active":"2024-09-14T11:14:06.124265+0000","last_became_peered":"2024-09-14T11:14:06.124265+0000","last_unstale":"2024-09-14T11:56:38.751896+0000","last_undegraded":"2024-09-14T11:56:38.751896+0000","last_fullsized":"2024-09-14T11:56:38.751896+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'844","last_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_deep_scrub":"263'844","last_deep_scrub_stamp":"2024-09-14T11:56:38.751800+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.751800+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:31.522430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4063,"num_read_kb":3676,"num_write":1096,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'389","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.518468+0000","last_change":"2024-09-14T11:56:29.518468+0000","last_active":"2024-09-14T11:56:29.518468+0000","last_peered":"2024-09-14T11:56:29.518468+0000","last_clean":"2024-09-14T11:56:29.518468+0000","last_became_active":"2024-09-14T11:14:38.194361+0000","last_became_peered":"2024-09-14T11:14:38.194361+0000","last_unstale":"2024-09-14T11:56:29.518468+0000","last_undegraded":"2024-09-14T11:56:29.518468+0000","last_fullsized":"2024-09-14T11:56:29.518468+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:29.518308+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.518308+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:50.599905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":694,"num_read_kb":5626,"num_write":1163,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'1035","reported_seq":2968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.559633+0000","last_change":"2024-09-14T11:56:38.559633+0000","last_active":"2024-09-14T11:56:38.559633+0000","last_peered":"2024-09-14T11:56:38.559633+0000","last_clean":"2024-09-14T11:56:38.559633+0000","last_became_active":"2024-09-14T11:14:06.123201+0000","last_became_peered":"2024-09-14T11:14:06.123201+0000","last_unstale":"2024-09-14T11:56:38.559633+0000","last_undegraded":"2024-09-14T11:56:38.559633+0000","last_fullsized":"2024-09-14T11:56:38.559633+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1035","last_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_deep_scrub":"263'1035","last_deep_scrub_stamp":"2024-09-14T11:56:38.559545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.559545+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:59.274734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5243,"num_read_kb":4704,"num_write":1402,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'350","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.211028+0000","last_change":"2024-09-14T11:56:28.210958+0000","last_active":"2024-09-14T11:56:28.211028+0000","last_peered":"2024-09-14T11:56:28.211028+0000","last_clean":"2024-09-14T11:56:28.211028+0000","last_became_active":"2024-09-14T11:14:04.126957+0000","last_became_peered":"2024-09-14T11:14:04.126957+0000","last_unstale":"2024-09-14T11:56:28.211028+0000","last_undegraded":"2024-09-14T11:56:28.211028+0000","last_fullsized":"2024-09-14T11:56:28.211028+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:28.210845+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.210845+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:07.178497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":714,"num_read_kb":58578,"num_write":1224,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'803","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.732926+0000","last_change":"2024-09-14T11:56:39.732926+0000","last_active":"2024-09-14T11:56:39.732926+0000","last_peered":"2024-09-14T11:56:39.732926+0000","last_clean":"2024-09-14T11:56:39.732926+0000","last_became_active":"2024-09-14T11:14:06.126636+0000","last_became_peered":"2024-09-14T11:14:06.126636+0000","last_unstale":"2024-09-14T11:56:39.732926+0000","last_undegraded":"2024-09-14T11:56:39.732926+0000","last_fullsized":"2024-09-14T11:56:39.732926+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'803","last_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_deep_scrub":"263'803","last_deep_scrub_stamp":"2024-09-14T11:56:39.732833+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.732833+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:56.461549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3821,"num_read_kb":3425,"num_write":1067,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'330","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.221162+0000","last_change":"2024-09-14T11:56:29.221091+0000","last_active":"2024-09-14T11:56:29.221162+0000","last_peered":"2024-09-14T11:56:29.221162+0000","last_clean":"2024-09-14T11:56:29.221162+0000","last_became_active":"2024-09-14T11:14:04.123704+0000","last_became_peered":"2024-09-14T11:14:04.123704+0000","last_unstale":"2024-09-14T11:56:29.221162+0000","last_undegraded":"2024-09-14T11:56:29.221162+0000","last_fullsized":"2024-09-14T11:56:29.221162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:29.220978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.220978+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.320306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":711,"num_read_kb":35951,"num_write":1039,"num_write_kb":28351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'801","reported_seq":2354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.875425+0000","last_change":"2024-09-14T11:56:28.875354+0000","last_active":"2024-09-14T11:56:28.875425+0000","last_peered":"2024-09-14T11:56:28.875425+0000","last_clean":"2024-09-14T11:56:28.875425+0000","last_became_active":"2024-09-14T11:14:06.121633+0000","last_became_peered":"2024-09-14T11:14:06.121633+0000","last_unstale":"2024-09-14T11:56:28.875425+0000","last_undegraded":"2024-09-14T11:56:28.875425+0000","last_fullsized":"2024-09-14T11:56:28.875425+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'801","last_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_deep_scrub":"263'801","last_deep_scrub_stamp":"2024-09-14T11:56:28.875262+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.875262+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:43.441720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3751,"num_read_kb":3390,"num_write":1058,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'389","reported_seq":1087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.735488+0000","last_change":"2024-09-14T11:56:25.735385+0000","last_active":"2024-09-14T11:56:25.735488+0000","last_peered":"2024-09-14T11:56:25.735488+0000","last_clean":"2024-09-14T11:56:25.735488+0000","last_became_active":"2024-09-14T11:14:04.133660+0000","last_became_peered":"2024-09-14T11:14:04.133660+0000","last_unstale":"2024-09-14T11:56:25.735488+0000","last_undegraded":"2024-09-14T11:56:25.735488+0000","last_fullsized":"2024-09-14T11:56:25.735488+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:25.735245+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.735245+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:43.758913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288872,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":26852,"num_write":1508,"num_write_kb":37279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'455","reported_seq":2089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.828654+0000","last_change":"2024-09-14T11:56:31.828599+0000","last_active":"2024-09-14T11:56:31.828654+0000","last_peered":"2024-09-14T11:56:31.828654+0000","last_clean":"2024-09-14T11:56:31.828654+0000","last_became_active":"2024-09-14T11:14:06.126411+0000","last_became_peered":"2024-09-14T11:14:06.126411+0000","last_unstale":"2024-09-14T11:56:31.828654+0000","last_undegraded":"2024-09-14T11:56:31.828654+0000","last_fullsized":"2024-09-14T11:56:31.828654+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'455","last_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_deep_scrub":"263'455","last_deep_scrub_stamp":"2024-09-14T11:56:31.828518+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.828518+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:25.639201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2414,"num_read_kb":2293,"num_write":494,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":693,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'426","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.027691+0000","last_change":"2024-09-14T11:56:30.027590+0000","last_active":"2024-09-14T11:56:30.027691+0000","last_peered":"2024-09-14T11:56:30.027691+0000","last_clean":"2024-09-14T11:56:30.027691+0000","last_became_active":"2024-09-14T11:14:04.124085+0000","last_became_peered":"2024-09-14T11:14:04.124085+0000","last_unstale":"2024-09-14T11:56:30.027691+0000","last_undegraded":"2024-09-14T11:56:30.027691+0000","last_fullsized":"2024-09-14T11:56:30.027691+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:56:30.027445+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.027445+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.053487+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1042,"num_read_kb":31602,"num_write":1294,"num_write_kb":12802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'450","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.793251+0000","last_change":"2024-09-14T11:56:39.793178+0000","last_active":"2024-09-14T11:56:39.793251+0000","last_peered":"2024-09-14T11:56:39.793251+0000","last_clean":"2024-09-14T11:56:39.793251+0000","last_became_active":"2024-09-14T11:14:06.120433+0000","last_became_peered":"2024-09-14T11:14:06.120433+0000","last_unstale":"2024-09-14T11:56:39.793251+0000","last_undegraded":"2024-09-14T11:56:39.793251+0000","last_fullsized":"2024-09-14T11:56:39.793251+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:56:39.793094+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.793094+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.783508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2498,"num_read_kb":2338,"num_write":519,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'326","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.526665+0000","last_change":"2024-09-14T11:56:28.526665+0000","last_active":"2024-09-14T11:56:28.526665+0000","last_peered":"2024-09-14T11:56:28.526665+0000","last_clean":"2024-09-14T11:56:28.526665+0000","last_became_active":"2024-09-14T11:14:04.131615+0000","last_became_peered":"2024-09-14T11:14:04.131615+0000","last_unstale":"2024-09-14T11:56:28.526665+0000","last_undegraded":"2024-09-14T11:56:28.526665+0000","last_fullsized":"2024-09-14T11:56:28.526665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-14T11:56:28.526538+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.526538+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:23.545261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048824,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":49467,"num_write":1023,"num_write_kb":49207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'152","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.923340+0000","last_change":"2024-09-14T11:56:56.923340+0000","last_active":"2024-09-14T11:56:56.923340+0000","last_peered":"2024-09-14T11:56:56.923340+0000","last_clean":"2024-09-14T11:56:56.923340+0000","last_became_active":"2024-09-14T11:14:14.156830+0000","last_became_peered":"2024-09-14T11:14:14.156830+0000","last_unstale":"2024-09-14T11:56:56.923340+0000","last_undegraded":"2024-09-14T11:56:56.923340+0000","last_fullsized":"2024-09-14T11:56:56.923340+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'152","last_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_deep_scrub":"263'152","last_deep_scrub_stamp":"2024-09-14T11:56:56.923215+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.923215+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:16.289153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":143,"num_write":341,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'476","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.251948+0000","last_change":"2024-09-14T11:56:41.251948+0000","last_active":"2024-09-14T11:56:41.251948+0000","last_peered":"2024-09-14T11:56:41.251948+0000","last_clean":"2024-09-14T11:56:41.251948+0000","last_became_active":"2024-09-14T11:14:06.114044+0000","last_became_peered":"2024-09-14T11:14:06.114044+0000","last_unstale":"2024-09-14T11:56:41.251948+0000","last_undegraded":"2024-09-14T11:56:41.251948+0000","last_fullsized":"2024-09-14T11:56:41.251948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:56:41.251856+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.251856+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:21.434224+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2496,"num_read_kb":2332,"num_write":571,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'350","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.558262+0000","last_change":"2024-09-14T11:56:27.558262+0000","last_active":"2024-09-14T11:56:27.558262+0000","last_peered":"2024-09-14T11:56:27.558262+0000","last_clean":"2024-09-14T11:56:27.558262+0000","last_became_active":"2024-09-14T11:14:04.129968+0000","last_became_peered":"2024-09-14T11:14:04.129968+0000","last_unstale":"2024-09-14T11:56:27.558262+0000","last_undegraded":"2024-09-14T11:56:27.558262+0000","last_fullsized":"2024-09-14T11:56:27.558262+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-14T11:56:27.558151+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.558151+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:00.824858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":64658,"num_write":1071,"num_write_kb":46902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.763218+0000","last_change":"2024-09-14T11:56:45.763098+0000","last_active":"2024-09-14T11:56:45.763218+0000","last_peered":"2024-09-14T11:56:45.763218+0000","last_clean":"2024-09-14T11:56:45.763218+0000","last_became_active":"2024-09-14T11:14:08.132010+0000","last_became_peered":"2024-09-14T11:14:08.132010+0000","last_unstale":"2024-09-14T11:56:45.763218+0000","last_undegraded":"2024-09-14T11:56:45.763218+0000","last_fullsized":"2024-09-14T11:56:45.763218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.763005+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.763005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:53.301799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'330","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.685785+0000","last_change":"2024-09-14T11:56:44.685731+0000","last_active":"2024-09-14T11:56:44.685785+0000","last_peered":"2024-09-14T11:56:44.685785+0000","last_clean":"2024-09-14T11:56:44.685785+0000","last_became_active":"2024-09-14T11:14:10.153320+0000","last_became_peered":"2024-09-14T11:14:10.153320+0000","last_unstale":"2024-09-14T11:56:44.685785+0000","last_undegraded":"2024-09-14T11:56:44.685785+0000","last_fullsized":"2024-09-14T11:56:44.685785+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:44.685661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.685661+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:21.057194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47936,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":535,"num_read_kb":1119,"num_write":426,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.423979+0000","last_change":"2024-09-14T11:56:53.423979+0000","last_active":"2024-09-14T11:56:53.423979+0000","last_peered":"2024-09-14T11:56:53.423979+0000","last_clean":"2024-09-14T11:56:53.423979+0000","last_became_active":"2024-09-14T11:14:12.145813+0000","last_became_peered":"2024-09-14T11:14:12.145813+0000","last_unstale":"2024-09-14T11:56:53.423979+0000","last_undegraded":"2024-09-14T11:56:53.423979+0000","last_fullsized":"2024-09-14T11:56:53.423979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.423888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.423888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:07.799827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2528","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.687669+0000","last_change":"2024-09-14T11:56:59.687669+0000","last_active":"2024-09-14T11:56:59.687669+0000","last_peered":"2024-09-14T11:56:59.687669+0000","last_clean":"2024-09-14T11:56:59.687669+0000","last_became_active":"2024-09-14T11:14:14.162157+0000","last_became_peered":"2024-09-14T11:14:14.162157+0000","last_unstale":"2024-09-14T11:56:59.687669+0000","last_undegraded":"2024-09-14T11:56:59.687669+0000","last_fullsized":"2024-09-14T11:56:59.687669+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T11:56:59.687562+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.687562+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:31.039855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6245,"num_read_kb":6237,"num_write":5123,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'375","reported_seq":1869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.790264+0000","last_change":"2024-09-14T11:56:36.790192+0000","last_active":"2024-09-14T11:56:36.790264+0000","last_peered":"2024-09-14T11:56:36.790264+0000","last_clean":"2024-09-14T11:56:36.790264+0000","last_became_active":"2024-09-14T11:14:06.123549+0000","last_became_peered":"2024-09-14T11:14:06.123549+0000","last_unstale":"2024-09-14T11:56:36.790264+0000","last_undegraded":"2024-09-14T11:56:36.790264+0000","last_fullsized":"2024-09-14T11:56:36.790264+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T11:56:36.790080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.790080+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:27.578518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2058,"num_read_kb":1970,"num_write":414,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'386","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.505419+0000","last_change":"2024-09-14T11:56:20.505419+0000","last_active":"2024-09-14T11:56:20.505419+0000","last_peered":"2024-09-14T11:56:20.505419+0000","last_clean":"2024-09-14T11:56:20.505419+0000","last_became_active":"2024-09-14T11:14:04.117415+0000","last_became_peered":"2024-09-14T11:14:04.117415+0000","last_unstale":"2024-09-14T11:56:20.505419+0000","last_undegraded":"2024-09-14T11:56:20.505419+0000","last_fullsized":"2024-09-14T11:56:20.505419+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:20.505297+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.505297+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:34.623393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":676,"num_read_kb":35601,"num_write":1215,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"263'4","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.329564+0000","last_change":"2024-09-14T11:56:44.329564+0000","last_active":"2024-09-14T11:56:44.329564+0000","last_peered":"2024-09-14T11:56:44.329564+0000","last_clean":"2024-09-14T11:56:44.329564+0000","last_became_active":"2024-09-14T11:14:08.135534+0000","last_became_peered":"2024-09-14T11:14:08.135534+0000","last_unstale":"2024-09-14T11:56:44.329564+0000","last_undegraded":"2024-09-14T11:56:44.329564+0000","last_fullsized":"2024-09-14T11:56:44.329564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.329492+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.329492+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:26.816036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'88","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.797177+0000","last_change":"2024-09-14T11:56:47.797123+0000","last_active":"2024-09-14T11:56:47.797177+0000","last_peered":"2024-09-14T11:56:47.797177+0000","last_clean":"2024-09-14T11:56:47.797177+0000","last_became_active":"2024-09-14T11:14:10.147900+0000","last_became_peered":"2024-09-14T11:14:10.147900+0000","last_unstale":"2024-09-14T11:56:47.797177+0000","last_undegraded":"2024-09-14T11:56:47.797177+0000","last_fullsized":"2024-09-14T11:56:47.797177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'88","last_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_deep_scrub":"263'88","last_deep_scrub_stamp":"2024-09-14T11:56:47.797040+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.797040+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:35.771450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.785169+0000","last_change":"2024-09-14T11:56:53.785169+0000","last_active":"2024-09-14T11:56:53.785169+0000","last_peered":"2024-09-14T11:56:53.785169+0000","last_clean":"2024-09-14T11:56:53.785169+0000","last_became_active":"2024-09-14T11:14:12.155431+0000","last_became_peered":"2024-09-14T11:14:12.155431+0000","last_unstale":"2024-09-14T11:56:53.785169+0000","last_undegraded":"2024-09-14T11:56:53.785169+0000","last_fullsized":"2024-09-14T11:56:53.785169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.785079+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.785079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.176820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'107","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.740750+0000","last_change":"2024-09-14T11:56:57.740750+0000","last_active":"2024-09-14T11:56:57.740750+0000","last_peered":"2024-09-14T11:56:57.740750+0000","last_clean":"2024-09-14T11:56:57.740750+0000","last_became_active":"2024-09-14T11:14:14.154630+0000","last_became_peered":"2024-09-14T11:14:14.154630+0000","last_unstale":"2024-09-14T11:56:57.740750+0000","last_undegraded":"2024-09-14T11:56:57.740750+0000","last_fullsized":"2024-09-14T11:56:57.740750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'107","last_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_deep_scrub":"263'107","last_deep_scrub_stamp":"2024-09-14T11:56:57.740665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.740665+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:59.815552+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":246,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'431","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.546705+0000","last_change":"2024-09-14T11:56:34.546641+0000","last_active":"2024-09-14T11:56:34.546705+0000","last_peered":"2024-09-14T11:56:34.546705+0000","last_clean":"2024-09-14T11:56:34.546705+0000","last_became_active":"2024-09-14T11:14:06.133751+0000","last_became_peered":"2024-09-14T11:14:06.133751+0000","last_unstale":"2024-09-14T11:56:34.546705+0000","last_undegraded":"2024-09-14T11:56:34.546705+0000","last_fullsized":"2024-09-14T11:56:34.546705+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:56:34.546557+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.546557+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:09.879015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2302,"num_read_kb":2169,"num_write":506,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'407","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.512674+0000","last_change":"2024-09-14T11:56:25.512674+0000","last_active":"2024-09-14T11:56:25.512674+0000","last_peered":"2024-09-14T11:56:25.512674+0000","last_clean":"2024-09-14T11:56:25.512674+0000","last_became_active":"2024-09-14T11:14:04.130937+0000","last_became_peered":"2024-09-14T11:14:04.130937+0000","last_unstale":"2024-09-14T11:56:25.512674+0000","last_undegraded":"2024-09-14T11:56:25.512674+0000","last_fullsized":"2024-09-14T11:56:25.512674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:56:25.512545+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.512545+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:59.346574+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":815,"num_read_kb":18319,"num_write":1414,"num_write_kb":33258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.196270+0000","last_change":"2024-09-14T11:56:39.196211+0000","last_active":"2024-09-14T11:56:39.196270+0000","last_peered":"2024-09-14T11:56:39.196270+0000","last_clean":"2024-09-14T11:56:39.196270+0000","last_became_active":"2024-09-14T11:14:08.133491+0000","last_became_peered":"2024-09-14T11:14:08.133491+0000","last_unstale":"2024-09-14T11:56:39.196270+0000","last_undegraded":"2024-09-14T11:56:39.196270+0000","last_fullsized":"2024-09-14T11:56:39.196270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.196121+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.196121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'103","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.869581+0000","last_change":"2024-09-14T11:56:41.869581+0000","last_active":"2024-09-14T11:56:41.869581+0000","last_peered":"2024-09-14T11:56:41.869581+0000","last_clean":"2024-09-14T11:56:41.869581+0000","last_became_active":"2024-09-14T11:14:10.152094+0000","last_became_peered":"2024-09-14T11:14:10.152094+0000","last_unstale":"2024-09-14T11:56:41.869581+0000","last_undegraded":"2024-09-14T11:56:41.869581+0000","last_fullsized":"2024-09-14T11:56:41.869581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T11:56:41.869495+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.869495+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:42.141907+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'774","reported_seq":4573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.444378+0000","last_change":"2024-09-14T11:56:52.444378+0000","last_active":"2024-09-14T11:56:52.444378+0000","last_peered":"2024-09-14T11:56:52.444378+0000","last_clean":"2024-09-14T11:56:52.444378+0000","last_became_active":"2024-09-14T11:14:12.146322+0000","last_became_peered":"2024-09-14T11:14:12.146322+0000","last_unstale":"2024-09-14T11:56:52.444378+0000","last_undegraded":"2024-09-14T11:56:52.444378+0000","last_fullsized":"2024-09-14T11:56:52.444378+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'774","last_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_deep_scrub":"263'774","last_deep_scrub_stamp":"2024-09-14T11:56:52.444278+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.444278+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:28.372005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'216","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.934993+0000","last_change":"2024-09-14T11:56:57.934993+0000","last_active":"2024-09-14T11:56:57.934993+0000","last_peered":"2024-09-14T11:56:57.934993+0000","last_clean":"2024-09-14T11:56:57.934993+0000","last_became_active":"2024-09-14T11:14:14.156845+0000","last_became_peered":"2024-09-14T11:14:14.156845+0000","last_unstale":"2024-09-14T11:56:57.934993+0000","last_undegraded":"2024-09-14T11:56:57.934993+0000","last_fullsized":"2024-09-14T11:56:57.934993+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:56:57.934887+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.934887+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:55.562512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":586,"num_write":463,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'527","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.833061+0000","last_change":"2024-09-14T11:56:26.833061+0000","last_active":"2024-09-14T11:56:26.833061+0000","last_peered":"2024-09-14T11:56:26.833061+0000","last_clean":"2024-09-14T11:56:26.833061+0000","last_became_active":"2024-09-14T11:14:38.193897+0000","last_became_peered":"2024-09-14T11:14:38.193897+0000","last_unstale":"2024-09-14T11:56:26.833061+0000","last_undegraded":"2024-09-14T11:56:26.833061+0000","last_fullsized":"2024-09-14T11:56:26.833061+0000","mapping_epoch":38,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:56:26.832975+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.832975+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:55.872822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2790,"num_read_kb":2603,"num_write":650,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"263'331","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.106600+0000","last_change":"2024-09-14T11:56:24.106600+0000","last_active":"2024-09-14T11:56:24.106600+0000","last_peered":"2024-09-14T11:56:24.106600+0000","last_clean":"2024-09-14T11:56:24.106600+0000","last_became_active":"2024-09-14T11:14:04.128352+0000","last_became_peered":"2024-09-14T11:14:04.128352+0000","last_unstale":"2024-09-14T11:56:24.106600+0000","last_undegraded":"2024-09-14T11:56:24.106600+0000","last_fullsized":"2024-09-14T11:56:24.106600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:24.106406+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.106406+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:03.759033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":5428,"num_write":990,"num_write_kb":18080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.784570+0000","last_change":"2024-09-14T11:56:46.784450+0000","last_active":"2024-09-14T11:56:46.784570+0000","last_peered":"2024-09-14T11:56:46.784570+0000","last_clean":"2024-09-14T11:56:46.784570+0000","last_became_active":"2024-09-14T11:14:08.132442+0000","last_became_peered":"2024-09-14T11:14:08.132442+0000","last_unstale":"2024-09-14T11:56:46.784570+0000","last_undegraded":"2024-09-14T11:56:46.784570+0000","last_fullsized":"2024-09-14T11:56:46.784570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.784356+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.784356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:25.395721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'255","reported_seq":818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.516212+0000","last_change":"2024-09-14T11:56:48.516156+0000","last_active":"2024-09-14T11:56:48.516212+0000","last_peered":"2024-09-14T11:56:48.516212+0000","last_clean":"2024-09-14T11:56:48.516212+0000","last_became_active":"2024-09-14T11:14:10.150823+0000","last_became_peered":"2024-09-14T11:14:10.150823+0000","last_unstale":"2024-09-14T11:56:48.516212+0000","last_undegraded":"2024-09-14T11:56:48.516212+0000","last_fullsized":"2024-09-14T11:56:48.516212+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-14T11:56:48.516064+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.516064+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:05.662866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":404,"num_read_kb":901,"num_write":326,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'791","reported_seq":2561,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.153975+0000","last_change":"2024-09-14T11:56:55.153975+0000","last_active":"2024-09-14T11:56:55.153975+0000","last_peered":"2024-09-14T11:56:55.153975+0000","last_clean":"2024-09-14T11:56:55.153975+0000","last_became_active":"2024-09-14T11:14:12.152159+0000","last_became_peered":"2024-09-14T11:14:12.152159+0000","last_unstale":"2024-09-14T11:56:55.153975+0000","last_undegraded":"2024-09-14T11:56:55.153975+0000","last_fullsized":"2024-09-14T11:56:55.153975+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:55.153895+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.153895+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:46.428579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'1229","reported_seq":2893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.771121+0000","last_change":"2024-09-14T11:56:35.771034+0000","last_active":"2024-09-14T11:56:35.771121+0000","last_peered":"2024-09-14T11:56:35.771121+0000","last_clean":"2024-09-14T11:56:35.771121+0000","last_became_active":"2024-09-14T11:14:06.125414+0000","last_became_peered":"2024-09-14T11:14:06.125414+0000","last_unstale":"2024-09-14T11:56:35.771121+0000","last_undegraded":"2024-09-14T11:56:35.771121+0000","last_fullsized":"2024-09-14T11:56:35.771121+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1229","last_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_deep_scrub":"263'1229","last_deep_scrub_stamp":"2024-09-14T11:56:35.770916+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.770916+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":1200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:33.485010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5651,"num_read_kb":4977,"num_write":1711,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'358","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.557591+0000","last_change":"2024-09-14T11:56:28.557531+0000","last_active":"2024-09-14T11:56:28.557591+0000","last_peered":"2024-09-14T11:56:28.557591+0000","last_clean":"2024-09-14T11:56:28.557591+0000","last_became_active":"2024-09-14T11:14:04.129677+0000","last_became_peered":"2024-09-14T11:14:04.129677+0000","last_unstale":"2024-09-14T11:56:28.557591+0000","last_undegraded":"2024-09-14T11:56:28.557591+0000","last_fullsized":"2024-09-14T11:56:28.557591+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:56:28.557427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.557427+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:28.224602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":41733,"num_write":1105,"num_write_kb":38687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.542322+0000","last_change":"2024-09-14T11:56:41.542271+0000","last_active":"2024-09-14T11:56:41.542322+0000","last_peered":"2024-09-14T11:56:41.542322+0000","last_clean":"2024-09-14T11:56:41.542322+0000","last_became_active":"2024-09-14T11:14:08.133564+0000","last_became_peered":"2024-09-14T11:14:08.133564+0000","last_unstale":"2024-09-14T11:56:41.542322+0000","last_undegraded":"2024-09-14T11:56:41.542322+0000","last_fullsized":"2024-09-14T11:56:41.542322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.542187+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.542187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:06.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'364","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.693176+0000","last_change":"2024-09-14T11:56:49.693108+0000","last_active":"2024-09-14T11:56:49.693176+0000","last_peered":"2024-09-14T11:56:49.693176+0000","last_clean":"2024-09-14T11:56:49.693176+0000","last_became_active":"2024-09-14T11:14:10.147904+0000","last_became_peered":"2024-09-14T11:14:10.147904+0000","last_unstale":"2024-09-14T11:56:49.693176+0000","last_undegraded":"2024-09-14T11:56:49.693176+0000","last_fullsized":"2024-09-14T11:56:49.693176+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:49.693011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.693011+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.084690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47812,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":1253,"num_write":470,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.855114+0000","last_change":"2024-09-14T11:56:44.855045+0000","last_active":"2024-09-14T11:56:44.855114+0000","last_peered":"2024-09-14T11:56:44.855114+0000","last_clean":"2024-09-14T11:56:44.855114+0000","last_became_active":"2024-09-14T11:14:12.145855+0000","last_became_peered":"2024-09-14T11:14:12.145855+0000","last_unstale":"2024-09-14T11:56:44.855114+0000","last_undegraded":"2024-09-14T11:56:44.855114+0000","last_fullsized":"2024-09-14T11:56:44.855114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.854939+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.854939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:34.855798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.815835+0000","last_change":"2024-09-14T11:56:54.815835+0000","last_active":"2024-09-14T11:56:54.815835+0000","last_peered":"2024-09-14T11:56:54.815835+0000","last_clean":"2024-09-14T11:56:54.815835+0000","last_became_active":"2024-09-14T11:14:14.162413+0000","last_became_peered":"2024-09-14T11:14:14.162413+0000","last_unstale":"2024-09-14T11:56:54.815835+0000","last_undegraded":"2024-09-14T11:56:54.815835+0000","last_fullsized":"2024-09-14T11:56:54.815835+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'555","last_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_deep_scrub":"263'555","last_deep_scrub_stamp":"2024-09-14T11:56:54.815746+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.815746+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:58.396730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1270,"num_read_kb":1268,"num_write":1143,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'806","reported_seq":2449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.715588+0000","last_change":"2024-09-14T11:56:27.715525+0000","last_active":"2024-09-14T11:56:27.715588+0000","last_peered":"2024-09-14T11:56:27.715588+0000","last_clean":"2024-09-14T11:56:27.715588+0000","last_became_active":"2024-09-14T11:14:06.121444+0000","last_became_peered":"2024-09-14T11:14:06.121444+0000","last_unstale":"2024-09-14T11:56:27.715588+0000","last_undegraded":"2024-09-14T11:56:27.715588+0000","last_fullsized":"2024-09-14T11:56:27.715588+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-14T11:56:27.715433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.715433+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:50.726219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3964,"num_read_kb":3598,"num_write":1078,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'313","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.855062+0000","last_change":"2024-09-14T11:56:32.855003+0000","last_active":"2024-09-14T11:56:32.855062+0000","last_peered":"2024-09-14T11:56:32.855062+0000","last_clean":"2024-09-14T11:56:32.855062+0000","last_became_active":"2024-09-14T11:14:38.341443+0000","last_became_peered":"2024-09-14T11:14:38.341443+0000","last_unstale":"2024-09-14T11:56:32.855062+0000","last_undegraded":"2024-09-14T11:56:32.855062+0000","last_fullsized":"2024-09-14T11:56:32.855062+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:56:32.854894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.854894+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:57.072216+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655847,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":67475,"num_write":1031,"num_write_kb":37342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.846435+0000","last_change":"2024-09-14T11:56:34.846368+0000","last_active":"2024-09-14T11:56:34.846435+0000","last_peered":"2024-09-14T11:56:34.846435+0000","last_clean":"2024-09-14T11:56:34.846435+0000","last_became_active":"2024-09-14T11:14:08.127742+0000","last_became_peered":"2024-09-14T11:14:08.127742+0000","last_unstale":"2024-09-14T11:56:34.846435+0000","last_undegraded":"2024-09-14T11:56:34.846435+0000","last_fullsized":"2024-09-14T11:56:34.846435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.846285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.846285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:47.433018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'297","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.306830+0000","last_change":"2024-09-14T11:56:46.306762+0000","last_active":"2024-09-14T11:56:46.306830+0000","last_peered":"2024-09-14T11:56:46.306830+0000","last_clean":"2024-09-14T11:56:46.306830+0000","last_became_active":"2024-09-14T11:14:10.153965+0000","last_became_peered":"2024-09-14T11:14:10.153965+0000","last_unstale":"2024-09-14T11:56:46.306830+0000","last_undegraded":"2024-09-14T11:56:46.306830+0000","last_fullsized":"2024-09-14T11:56:46.306830+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:46.306669+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.306669+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:27.229964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49558,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1126,"num_write":402,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.232667+0000","last_change":"2024-09-14T11:56:53.232554+0000","last_active":"2024-09-14T11:56:53.232667+0000","last_peered":"2024-09-14T11:56:53.232667+0000","last_clean":"2024-09-14T11:56:53.232667+0000","last_became_active":"2024-09-14T11:14:12.150649+0000","last_became_peered":"2024-09-14T11:14:12.150649+0000","last_unstale":"2024-09-14T11:56:53.232667+0000","last_undegraded":"2024-09-14T11:56:53.232667+0000","last_fullsized":"2024-09-14T11:56:53.232667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.232457+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.232457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:43.213959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'121","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.235418+0000","last_change":"2024-09-14T11:56:44.235418+0000","last_active":"2024-09-14T11:56:44.235418+0000","last_peered":"2024-09-14T11:56:44.235418+0000","last_clean":"2024-09-14T11:56:44.235418+0000","last_became_active":"2024-09-14T11:14:14.157163+0000","last_became_peered":"2024-09-14T11:14:14.157163+0000","last_unstale":"2024-09-14T11:56:44.235418+0000","last_undegraded":"2024-09-14T11:56:44.235418+0000","last_fullsized":"2024-09-14T11:56:44.235418+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:44.235335+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.235335+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:59.340370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":289,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1042","reported_seq":2750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.270381+0000","last_change":"2024-09-14T11:56:30.270323+0000","last_active":"2024-09-14T11:56:30.270381+0000","last_peered":"2024-09-14T11:56:30.270381+0000","last_clean":"2024-09-14T11:56:30.270381+0000","last_became_active":"2024-09-14T11:14:06.128447+0000","last_became_peered":"2024-09-14T11:14:06.128447+0000","last_unstale":"2024-09-14T11:56:30.270381+0000","last_undegraded":"2024-09-14T11:56:30.270381+0000","last_fullsized":"2024-09-14T11:56:30.270381+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1042","last_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_deep_scrub":"263'1042","last_deep_scrub_stamp":"2024-09-14T11:56:30.270230+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.270230+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:41.888140+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7424,"num_read_kb":6872,"num_write":1618,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'294","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.494855+0000","last_change":"2024-09-14T11:56:24.494772+0000","last_active":"2024-09-14T11:56:24.494855+0000","last_peered":"2024-09-14T11:56:24.494855+0000","last_clean":"2024-09-14T11:56:24.494855+0000","last_became_active":"2024-09-14T11:14:04.125979+0000","last_became_peered":"2024-09-14T11:14:04.125979+0000","last_unstale":"2024-09-14T11:56:24.494855+0000","last_undegraded":"2024-09-14T11:56:24.494855+0000","last_fullsized":"2024-09-14T11:56:24.494855+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:56:24.494631+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.494631+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:43.745446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":31073,"num_write":909,"num_write_kb":33132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.899812+0000","last_change":"2024-09-14T11:56:36.899748+0000","last_active":"2024-09-14T11:56:36.899812+0000","last_peered":"2024-09-14T11:56:36.899812+0000","last_clean":"2024-09-14T11:56:36.899812+0000","last_became_active":"2024-09-14T11:14:08.126672+0000","last_became_peered":"2024-09-14T11:14:08.126672+0000","last_unstale":"2024-09-14T11:56:36.899812+0000","last_undegraded":"2024-09-14T11:56:36.899812+0000","last_fullsized":"2024-09-14T11:56:36.899812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.899653+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.899653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:58.910589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'308","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.515923+0000","last_change":"2024-09-14T11:56:46.515860+0000","last_active":"2024-09-14T11:56:46.515923+0000","last_peered":"2024-09-14T11:56:46.515923+0000","last_clean":"2024-09-14T11:56:46.515923+0000","last_became_active":"2024-09-14T11:14:10.151926+0000","last_became_peered":"2024-09-14T11:14:10.151926+0000","last_unstale":"2024-09-14T11:56:46.515923+0000","last_undegraded":"2024-09-14T11:56:46.515923+0000","last_fullsized":"2024-09-14T11:56:46.515923+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T11:56:46.515757+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.515757+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:57.140151+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47510,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":1028,"num_write":376,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":4055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.701410+0000","last_change":"2024-09-14T11:56:50.701312+0000","last_active":"2024-09-14T11:56:50.701410+0000","last_peered":"2024-09-14T11:56:50.701410+0000","last_clean":"2024-09-14T11:56:50.701410+0000","last_became_active":"2024-09-14T11:14:12.146859+0000","last_became_peered":"2024-09-14T11:14:12.146859+0000","last_unstale":"2024-09-14T11:56:50.701410+0000","last_undegraded":"2024-09-14T11:56:50.701410+0000","last_fullsized":"2024-09-14T11:56:50.701410+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'793","last_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_deep_scrub":"263'793","last_deep_scrub_stamp":"2024-09-14T11:56:50.701208+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.701208+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:36.693878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'135","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.773582+0000","last_change":"2024-09-14T11:56:56.773527+0000","last_active":"2024-09-14T11:56:56.773582+0000","last_peered":"2024-09-14T11:56:56.773582+0000","last_clean":"2024-09-14T11:56:56.773582+0000","last_became_active":"2024-09-14T11:14:14.159228+0000","last_became_peered":"2024-09-14T11:14:14.159228+0000","last_unstale":"2024-09-14T11:56:56.773582+0000","last_undegraded":"2024-09-14T11:56:56.773582+0000","last_fullsized":"2024-09-14T11:56:56.773582+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-14T11:56:56.773428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.773428+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:47.358395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'415","reported_seq":1910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.549305+0000","last_change":"2024-09-14T11:56:31.549234+0000","last_active":"2024-09-14T11:56:31.549305+0000","last_peered":"2024-09-14T11:56:31.549305+0000","last_clean":"2024-09-14T11:56:31.549305+0000","last_became_active":"2024-09-14T11:14:06.131478+0000","last_became_peered":"2024-09-14T11:14:06.131478+0000","last_unstale":"2024-09-14T11:56:31.549305+0000","last_undegraded":"2024-09-14T11:56:31.549305+0000","last_fullsized":"2024-09-14T11:56:31.549305+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:31.549129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.549129+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:03.979018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2226,"num_read_kb":2103,"num_write":482,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'400","reported_seq":1100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.841395+0000","last_change":"2024-09-14T11:56:26.841315+0000","last_active":"2024-09-14T11:56:26.841395+0000","last_peered":"2024-09-14T11:56:26.841395+0000","last_clean":"2024-09-14T11:56:26.841395+0000","last_became_active":"2024-09-14T11:14:04.128586+0000","last_became_peered":"2024-09-14T11:14:04.128586+0000","last_unstale":"2024-09-14T11:56:26.841395+0000","last_undegraded":"2024-09-14T11:56:26.841395+0000","last_fullsized":"2024-09-14T11:56:26.841395+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:56:26.841218+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.841218+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:23.553496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":813,"num_read_kb":46336,"num_write":1141,"num_write_kb":39888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.881686+0000","last_change":"2024-09-14T11:56:37.881630+0000","last_active":"2024-09-14T11:56:37.881686+0000","last_peered":"2024-09-14T11:56:37.881686+0000","last_clean":"2024-09-14T11:56:37.881686+0000","last_became_active":"2024-09-14T11:14:08.137826+0000","last_became_peered":"2024-09-14T11:14:08.137826+0000","last_unstale":"2024-09-14T11:56:37.881686+0000","last_undegraded":"2024-09-14T11:56:37.881686+0000","last_fullsized":"2024-09-14T11:56:37.881686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.881540+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.881540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:26.348899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'498","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.642164+0000","last_change":"2024-09-14T11:56:43.642102+0000","last_active":"2024-09-14T11:56:43.642164+0000","last_peered":"2024-09-14T11:56:43.642164+0000","last_clean":"2024-09-14T11:56:43.642164+0000","last_became_active":"2024-09-14T11:14:10.153755+0000","last_became_peered":"2024-09-14T11:14:10.153755+0000","last_unstale":"2024-09-14T11:56:43.642164+0000","last_undegraded":"2024-09-14T11:56:43.642164+0000","last_fullsized":"2024-09-14T11:56:43.642164+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:56:43.642011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.642011+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:58.210871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99468,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":885,"num_read_kb":2186,"num_write":738,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.903823+0000","last_change":"2024-09-14T11:56:42.903741+0000","last_active":"2024-09-14T11:56:42.903823+0000","last_peered":"2024-09-14T11:56:42.903823+0000","last_clean":"2024-09-14T11:56:42.903823+0000","last_became_active":"2024-09-14T11:14:12.150146+0000","last_became_peered":"2024-09-14T11:14:12.150146+0000","last_unstale":"2024-09-14T11:56:42.903823+0000","last_undegraded":"2024-09-14T11:56:42.903823+0000","last_fullsized":"2024-09-14T11:56:42.903823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.903661+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.903661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:24.433918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'146","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.916950+0000","last_change":"2024-09-14T11:56:47.916887+0000","last_active":"2024-09-14T11:56:47.916950+0000","last_peered":"2024-09-14T11:56:47.916950+0000","last_clean":"2024-09-14T11:56:47.916950+0000","last_became_active":"2024-09-14T11:14:14.158634+0000","last_became_peered":"2024-09-14T11:14:14.158634+0000","last_unstale":"2024-09-14T11:56:47.916950+0000","last_undegraded":"2024-09-14T11:56:47.916950+0000","last_fullsized":"2024-09-14T11:56:47.916950+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:56:47.916794+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.916794+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:10.778249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":326,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'847","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.698801+0000","last_change":"2024-09-14T11:56:28.698744+0000","last_active":"2024-09-14T11:56:28.698801+0000","last_peered":"2024-09-14T11:56:28.698801+0000","last_clean":"2024-09-14T11:56:28.698801+0000","last_became_active":"2024-09-14T11:14:06.120148+0000","last_became_peered":"2024-09-14T11:14:06.120148+0000","last_unstale":"2024-09-14T11:56:28.698801+0000","last_undegraded":"2024-09-14T11:56:28.698801+0000","last_fullsized":"2024-09-14T11:56:28.698801+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'847","last_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_deep_scrub":"263'847","last_deep_scrub_stamp":"2024-09-14T11:56:28.698654+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.698654+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":800,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:40.307674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3990,"num_read_kb":3618,"num_write":1084,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'386","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.114558+0000","last_change":"2024-09-14T11:56:22.114483+0000","last_active":"2024-09-14T11:56:22.114558+0000","last_peered":"2024-09-14T11:56:22.114558+0000","last_clean":"2024-09-14T11:56:22.114558+0000","last_became_active":"2024-09-14T11:14:04.123358+0000","last_became_peered":"2024-09-14T11:14:04.123358+0000","last_unstale":"2024-09-14T11:56:22.114558+0000","last_undegraded":"2024-09-14T11:56:22.114558+0000","last_fullsized":"2024-09-14T11:56:22.114558+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'386","last_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_deep_scrub":"263'386","last_deep_scrub_stamp":"2024-09-14T11:56:22.114372+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.114372+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:40.637875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":715,"num_read_kb":16906,"num_write":1227,"num_write_kb":62333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.899269+0000","last_change":"2024-09-14T11:56:40.899217+0000","last_active":"2024-09-14T11:56:40.899269+0000","last_peered":"2024-09-14T11:56:40.899269+0000","last_clean":"2024-09-14T11:56:40.899269+0000","last_became_active":"2024-09-14T11:14:08.130675+0000","last_became_peered":"2024-09-14T11:14:08.130675+0000","last_unstale":"2024-09-14T11:56:40.899269+0000","last_undegraded":"2024-09-14T11:56:40.899269+0000","last_fullsized":"2024-09-14T11:56:40.899269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.899134+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.899134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.733282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'304","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.804866+0000","last_change":"2024-09-14T11:56:48.804807+0000","last_active":"2024-09-14T11:56:48.804866+0000","last_peered":"2024-09-14T11:56:48.804866+0000","last_clean":"2024-09-14T11:56:48.804866+0000","last_became_active":"2024-09-14T11:14:10.151958+0000","last_became_peered":"2024-09-14T11:14:10.151958+0000","last_unstale":"2024-09-14T11:56:48.804866+0000","last_undegraded":"2024-09-14T11:56:48.804866+0000","last_fullsized":"2024-09-14T11:56:48.804866+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'304","last_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_deep_scrub":"263'304","last_deep_scrub_stamp":"2024-09-14T11:56:48.804714+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.804714+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:17.990480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1119,"num_write":460,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.721340+0000","last_change":"2024-09-14T11:56:49.721287+0000","last_active":"2024-09-14T11:56:49.721340+0000","last_peered":"2024-09-14T11:56:49.721340+0000","last_clean":"2024-09-14T11:56:49.721340+0000","last_became_active":"2024-09-14T11:14:12.154856+0000","last_became_peered":"2024-09-14T11:14:12.154856+0000","last_unstale":"2024-09-14T11:56:49.721340+0000","last_undegraded":"2024-09-14T11:56:49.721340+0000","last_fullsized":"2024-09-14T11:56:49.721340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:49.721199+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.721199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:44.981198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'121","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.188503+0000","last_change":"2024-09-14T11:56:58.188503+0000","last_active":"2024-09-14T11:56:58.188503+0000","last_peered":"2024-09-14T11:56:58.188503+0000","last_clean":"2024-09-14T11:56:58.188503+0000","last_became_active":"2024-09-14T11:14:14.161316+0000","last_became_peered":"2024-09-14T11:14:14.161316+0000","last_unstale":"2024-09-14T11:56:58.188503+0000","last_undegraded":"2024-09-14T11:56:58.188503+0000","last_fullsized":"2024-09-14T11:56:58.188503+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-14T11:56:58.188428+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.188428+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.813037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'1644","reported_seq":3317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.715896+0000","last_change":"2024-09-14T11:56:29.715837+0000","last_active":"2024-09-14T11:56:29.715896+0000","last_peered":"2024-09-14T11:56:29.715896+0000","last_clean":"2024-09-14T11:56:29.715896+0000","last_became_active":"2024-09-14T11:14:06.121020+0000","last_became_peered":"2024-09-14T11:14:06.121020+0000","last_unstale":"2024-09-14T11:56:29.715896+0000","last_undegraded":"2024-09-14T11:56:29.715896+0000","last_fullsized":"2024-09-14T11:56:29.715896+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1644","last_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_deep_scrub":"263'1644","last_deep_scrub_stamp":"2024-09-14T11:56:29.715743+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.715743+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":1600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:27.695414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7423,"num_read_kb":6483,"num_write":2364,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'415","reported_seq":1117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.234015+0000","last_change":"2024-09-14T11:56:27.233890+0000","last_active":"2024-09-14T11:56:27.234015+0000","last_peered":"2024-09-14T11:56:27.234015+0000","last_clean":"2024-09-14T11:56:27.234015+0000","last_became_active":"2024-09-14T11:14:04.126233+0000","last_became_peered":"2024-09-14T11:14:04.126233+0000","last_unstale":"2024-09-14T11:56:27.234015+0000","last_undegraded":"2024-09-14T11:56:27.234015+0000","last_fullsized":"2024-09-14T11:56:27.234015+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:27.233781+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.233781+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.725234+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":810,"num_read_kb":104030,"num_write":1260,"num_write_kb":54862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.740043+0000","last_change":"2024-09-14T11:56:37.739989+0000","last_active":"2024-09-14T11:56:37.740043+0000","last_peered":"2024-09-14T11:56:37.740043+0000","last_clean":"2024-09-14T11:56:37.740043+0000","last_became_active":"2024-09-14T11:14:08.137251+0000","last_became_peered":"2024-09-14T11:14:08.137251+0000","last_unstale":"2024-09-14T11:56:37.740043+0000","last_undegraded":"2024-09-14T11:56:37.740043+0000","last_fullsized":"2024-09-14T11:56:37.740043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.739899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.739899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:13.301117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'300","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.857750+0000","last_change":"2024-09-14T11:56:39.857685+0000","last_active":"2024-09-14T11:56:39.857750+0000","last_peered":"2024-09-14T11:56:39.857750+0000","last_clean":"2024-09-14T11:56:39.857750+0000","last_became_active":"2024-09-14T11:14:10.147304+0000","last_became_peered":"2024-09-14T11:14:10.147304+0000","last_unstale":"2024-09-14T11:56:39.857750+0000","last_undegraded":"2024-09-14T11:56:39.857750+0000","last_fullsized":"2024-09-14T11:56:39.857750+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:39.857592+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.857592+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:20.652302+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69648,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":1150,"num_write":402,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'761","reported_seq":2587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.903028+0000","last_change":"2024-09-14T11:56:43.902970+0000","last_active":"2024-09-14T11:56:43.903028+0000","last_peered":"2024-09-14T11:56:43.903028+0000","last_clean":"2024-09-14T11:56:43.903028+0000","last_became_active":"2024-09-14T11:14:12.149965+0000","last_became_peered":"2024-09-14T11:14:12.149965+0000","last_unstale":"2024-09-14T11:56:43.903028+0000","last_undegraded":"2024-09-14T11:56:43.903028+0000","last_fullsized":"2024-09-14T11:56:43.903028+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:56:43.902864+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.902864+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:03.704298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'149","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.887413+0000","last_change":"2024-09-14T11:56:45.887413+0000","last_active":"2024-09-14T11:56:45.887413+0000","last_peered":"2024-09-14T11:56:45.887413+0000","last_clean":"2024-09-14T11:56:45.887413+0000","last_became_active":"2024-09-14T11:14:14.152182+0000","last_became_peered":"2024-09-14T11:14:14.152182+0000","last_unstale":"2024-09-14T11:56:45.887413+0000","last_undegraded":"2024-09-14T11:56:45.887413+0000","last_fullsized":"2024-09-14T11:56:45.887413+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:56:45.887303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.887303+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:14.811741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1268,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":185,"num_write":375,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'773","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.721963+0000","last_change":"2024-09-14T11:56:30.721902+0000","last_active":"2024-09-14T11:56:30.721963+0000","last_peered":"2024-09-14T11:56:30.721963+0000","last_clean":"2024-09-14T11:56:30.721963+0000","last_became_active":"2024-09-14T11:14:06.129315+0000","last_became_peered":"2024-09-14T11:14:06.129315+0000","last_unstale":"2024-09-14T11:56:30.721963+0000","last_undegraded":"2024-09-14T11:56:30.721963+0000","last_fullsized":"2024-09-14T11:56:30.721963+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-14T11:56:30.721816+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.721816+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:19.890041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3608,"num_read_kb":3253,"num_write":1009,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.691571+0000","last_change":"2024-09-14T11:56:24.691511+0000","last_active":"2024-09-14T11:56:24.691571+0000","last_peered":"2024-09-14T11:56:24.691571+0000","last_clean":"2024-09-14T11:56:24.691571+0000","last_became_active":"2024-09-14T11:14:04.120671+0000","last_became_peered":"2024-09-14T11:14:04.120671+0000","last_unstale":"2024-09-14T11:56:24.691571+0000","last_undegraded":"2024-09-14T11:56:24.691571+0000","last_fullsized":"2024-09-14T11:56:24.691571+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:24.691405+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.691405+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:19.223818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":76885,"num_write":1076,"num_write_kb":37822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.724992+0000","last_change":"2024-09-14T11:56:44.724907+0000","last_active":"2024-09-14T11:56:44.724992+0000","last_peered":"2024-09-14T11:56:44.724992+0000","last_clean":"2024-09-14T11:56:44.724992+0000","last_became_active":"2024-09-14T11:14:08.137469+0000","last_became_peered":"2024-09-14T11:14:08.137469+0000","last_unstale":"2024-09-14T11:56:44.724992+0000","last_undegraded":"2024-09-14T11:56:44.724992+0000","last_fullsized":"2024-09-14T11:56:44.724992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:56:44.724814+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.724814+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:32.377727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.309336+0000","last_change":"2024-09-14T11:56:45.309271+0000","last_active":"2024-09-14T11:56:45.309336+0000","last_peered":"2024-09-14T11:56:45.309336+0000","last_clean":"2024-09-14T11:56:45.309336+0000","last_became_active":"2024-09-14T11:14:10.153072+0000","last_became_peered":"2024-09-14T11:14:10.153072+0000","last_unstale":"2024-09-14T11:56:45.309336+0000","last_undegraded":"2024-09-14T11:56:45.309336+0000","last_fullsized":"2024-09-14T11:56:45.309336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'84","last_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_deep_scrub":"263'84","last_deep_scrub_stamp":"2024-09-14T11:56:45.309168+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.309168+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:20.217748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.230892+0000","last_change":"2024-09-14T11:56:40.230789+0000","last_active":"2024-09-14T11:56:40.230892+0000","last_peered":"2024-09-14T11:56:40.230892+0000","last_clean":"2024-09-14T11:56:40.230892+0000","last_became_active":"2024-09-14T11:14:12.154131+0000","last_became_peered":"2024-09-14T11:14:12.154131+0000","last_unstale":"2024-09-14T11:56:40.230892+0000","last_undegraded":"2024-09-14T11:56:40.230892+0000","last_fullsized":"2024-09-14T11:56:40.230892+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:40.230641+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.230641+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:25.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'118","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.829596+0000","last_change":"2024-09-14T11:56:54.829596+0000","last_active":"2024-09-14T11:56:54.829596+0000","last_peered":"2024-09-14T11:56:54.829596+0000","last_clean":"2024-09-14T11:56:54.829596+0000","last_became_active":"2024-09-14T11:14:14.156891+0000","last_became_peered":"2024-09-14T11:14:14.156891+0000","last_unstale":"2024-09-14T11:56:54.829596+0000","last_undegraded":"2024-09-14T11:56:54.829596+0000","last_fullsized":"2024-09-14T11:56:54.829596+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T11:56:54.829506+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.829506+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.125183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":183,"num_write":281,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'513","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.782342+0000","last_change":"2024-09-14T11:56:31.782245+0000","last_active":"2024-09-14T11:56:31.782342+0000","last_peered":"2024-09-14T11:56:31.782342+0000","last_clean":"2024-09-14T11:56:31.782342+0000","last_became_active":"2024-09-14T11:14:06.118395+0000","last_became_peered":"2024-09-14T11:14:06.118395+0000","last_unstale":"2024-09-14T11:56:31.782342+0000","last_undegraded":"2024-09-14T11:56:31.782342+0000","last_fullsized":"2024-09-14T11:56:31.782342+0000","mapping_epoch":27,"log_start":"263'501","ondisk_log_start":"263'501","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-14T11:56:31.782127+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.782127+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:24.425090+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2836,"num_read_kb":2659,"num_write":663,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2260,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.073657+0000","last_change":"2024-09-14T11:56:23.073606+0000","last_active":"2024-09-14T11:56:23.073657+0000","last_peered":"2024-09-14T11:56:23.073657+0000","last_clean":"2024-09-14T11:56:23.073657+0000","last_became_active":"2024-09-14T11:14:04.114374+0000","last_became_peered":"2024-09-14T11:14:04.114374+0000","last_unstale":"2024-09-14T11:56:23.073657+0000","last_undegraded":"2024-09-14T11:56:23.073657+0000","last_fullsized":"2024-09-14T11:56:23.073657+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'330","last_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_deep_scrub":"263'330","last_deep_scrub_stamp":"2024-09-14T11:56:23.073522+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.073522+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.269212+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":638,"num_read_kb":524,"num_write":1137,"num_write_kb":6236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.769196+0000","last_change":"2024-09-14T11:56:41.769107+0000","last_active":"2024-09-14T11:56:41.769196+0000","last_peered":"2024-09-14T11:56:41.769196+0000","last_clean":"2024-09-14T11:56:41.769196+0000","last_became_active":"2024-09-14T11:14:08.136165+0000","last_became_peered":"2024-09-14T11:14:08.136165+0000","last_unstale":"2024-09-14T11:56:41.769196+0000","last_undegraded":"2024-09-14T11:56:41.769196+0000","last_fullsized":"2024-09-14T11:56:41.769196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.769011+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.769011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:59.511302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'367","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.736493+0000","last_change":"2024-09-14T11:56:50.736433+0000","last_active":"2024-09-14T11:56:50.736493+0000","last_peered":"2024-09-14T11:56:50.736493+0000","last_clean":"2024-09-14T11:56:50.736493+0000","last_became_active":"2024-09-14T11:14:10.153165+0000","last_became_peered":"2024-09-14T11:14:10.153165+0000","last_unstale":"2024-09-14T11:56:50.736493+0000","last_undegraded":"2024-09-14T11:56:50.736493+0000","last_fullsized":"2024-09-14T11:56:50.736493+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:56:50.736341+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.736341+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.594821+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54413,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1203,"num_read_kb":1831,"num_write":1724,"num_write_kb":1594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.232608+0000","last_change":"2024-09-14T11:56:39.232538+0000","last_active":"2024-09-14T11:56:39.232608+0000","last_peered":"2024-09-14T11:56:39.232608+0000","last_clean":"2024-09-14T11:56:39.232608+0000","last_became_active":"2024-09-14T11:14:12.154426+0000","last_became_peered":"2024-09-14T11:14:12.154426+0000","last_unstale":"2024-09-14T11:56:39.232608+0000","last_undegraded":"2024-09-14T11:56:39.232608+0000","last_fullsized":"2024-09-14T11:56:39.232608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.232412+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.232412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:21.945586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'187","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.935345+0000","last_change":"2024-09-14T11:56:48.935345+0000","last_active":"2024-09-14T11:56:48.935345+0000","last_peered":"2024-09-14T11:56:48.935345+0000","last_clean":"2024-09-14T11:56:48.935345+0000","last_became_active":"2024-09-14T11:14:14.155587+0000","last_became_peered":"2024-09-14T11:14:14.155587+0000","last_unstale":"2024-09-14T11:56:48.935345+0000","last_undegraded":"2024-09-14T11:56:48.935345+0000","last_fullsized":"2024-09-14T11:56:48.935345+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:56:48.935254+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.935254+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:03.798486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":133,"num_write":402,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'466","reported_seq":1965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.229172+0000","last_change":"2024-09-14T11:56:31.229172+0000","last_active":"2024-09-14T11:56:31.229172+0000","last_peered":"2024-09-14T11:56:31.229172+0000","last_clean":"2024-09-14T11:56:31.229172+0000","last_became_active":"2024-09-14T11:14:06.128192+0000","last_became_peered":"2024-09-14T11:14:06.128192+0000","last_unstale":"2024-09-14T11:56:31.229172+0000","last_undegraded":"2024-09-14T11:56:31.229172+0000","last_fullsized":"2024-09-14T11:56:31.229172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'466","last_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_deep_scrub":"263'466","last_deep_scrub_stamp":"2024-09-14T11:56:31.229089+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.229089+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:26.332777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2346,"num_read_kb":2194,"num_write":549,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.479532+0000","last_change":"2024-09-14T11:56:23.479532+0000","last_active":"2024-09-14T11:56:23.479532+0000","last_peered":"2024-09-14T11:56:23.479532+0000","last_clean":"2024-09-14T11:56:23.479532+0000","last_became_active":"2024-09-14T11:13:46.583469+0000","last_became_peered":"2024-09-14T11:13:46.583469+0000","last_unstale":"2024-09-14T11:56:23.479532+0000","last_undegraded":"2024-09-14T11:56:23.479532+0000","last_fullsized":"2024-09-14T11:56:23.479532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:56:23.479446+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.479446+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.972281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.780699+0000","last_change":"2024-09-14T11:56:23.780627+0000","last_active":"2024-09-14T11:56:23.780699+0000","last_peered":"2024-09-14T11:56:23.780699+0000","last_clean":"2024-09-14T11:56:23.780699+0000","last_became_active":"2024-09-14T11:13:53.058755+0000","last_became_peered":"2024-09-14T11:13:53.058755+0000","last_unstale":"2024-09-14T11:56:23.780699+0000","last_undegraded":"2024-09-14T11:56:23.780699+0000","last_fullsized":"2024-09-14T11:56:23.780699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:23.780539+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.780539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:19.285862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00042705599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.893049+0000","last_change":"2024-09-14T11:56:23.893049+0000","last_active":"2024-09-14T11:56:23.893049+0000","last_peered":"2024-09-14T11:56:23.893049+0000","last_clean":"2024-09-14T11:56:23.893049+0000","last_became_active":"2024-09-14T11:14:38.194124+0000","last_became_peered":"2024-09-14T11:14:38.194124+0000","last_unstale":"2024-09-14T11:56:23.893049+0000","last_undegraded":"2024-09-14T11:56:23.893049+0000","last_fullsized":"2024-09-14T11:56:23.893049+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:23.892977+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.892977+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:13.522054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":748,"num_read_kb":7472,"num_write":1023,"num_write_kb":28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.580695+0000","last_change":"2024-09-14T11:56:40.580695+0000","last_active":"2024-09-14T11:56:40.580695+0000","last_peered":"2024-09-14T11:56:40.580695+0000","last_clean":"2024-09-14T11:56:40.580695+0000","last_became_active":"2024-09-14T11:14:08.126783+0000","last_became_peered":"2024-09-14T11:14:08.126783+0000","last_unstale":"2024-09-14T11:56:40.580695+0000","last_undegraded":"2024-09-14T11:56:40.580695+0000","last_fullsized":"2024-09-14T11:56:40.580695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.580600+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.580600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:27.866173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'753","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.718618+0000","last_change":"2024-09-14T11:56:48.718557+0000","last_active":"2024-09-14T11:56:48.718618+0000","last_peered":"2024-09-14T11:56:48.718618+0000","last_clean":"2024-09-14T11:56:48.718618+0000","last_became_active":"2024-09-14T11:14:10.148935+0000","last_became_peered":"2024-09-14T11:14:10.148935+0000","last_unstale":"2024-09-14T11:56:48.718618+0000","last_undegraded":"2024-09-14T11:56:48.718618+0000","last_fullsized":"2024-09-14T11:56:48.718618+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'753","last_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_deep_scrub":"263'753","last_deep_scrub_stamp":"2024-09-14T11:56:48.718471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.718471+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:07.067523+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250783,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1481,"num_read_kb":3591,"num_write":1406,"num_write_kb":1352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107204,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.733188+0000","last_change":"2024-09-14T11:56:48.733094+0000","last_active":"2024-09-14T11:56:48.733188+0000","last_peered":"2024-09-14T11:56:48.733188+0000","last_clean":"2024-09-14T11:56:48.733188+0000","last_became_active":"2024-09-14T11:14:12.152778+0000","last_became_peered":"2024-09-14T11:14:12.152778+0000","last_unstale":"2024-09-14T11:56:48.733188+0000","last_undegraded":"2024-09-14T11:56:48.733188+0000","last_fullsized":"2024-09-14T11:56:48.733188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:48.732990+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.732990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:44.026156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.209327+0000","last_change":"2024-09-14T11:56:46.209235+0000","last_active":"2024-09-14T11:56:46.209327+0000","last_peered":"2024-09-14T11:56:46.209327+0000","last_clean":"2024-09-14T11:56:46.209327+0000","last_became_active":"2024-09-14T11:14:14.160625+0000","last_became_peered":"2024-09-14T11:14:14.160625+0000","last_unstale":"2024-09-14T11:56:46.209327+0000","last_undegraded":"2024-09-14T11:56:46.209327+0000","last_fullsized":"2024-09-14T11:56:46.209327+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-14T11:56:46.209118+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.209118+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:05.425542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":413,"num_write":373,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'1366","reported_seq":3145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.521625+0000","last_change":"2024-09-14T11:56:30.521567+0000","last_active":"2024-09-14T11:56:30.521625+0000","last_peered":"2024-09-14T11:56:30.521625+0000","last_clean":"2024-09-14T11:56:30.521625+0000","last_became_active":"2024-09-14T11:14:06.132286+0000","last_became_peered":"2024-09-14T11:14:06.132286+0000","last_unstale":"2024-09-14T11:56:30.521625+0000","last_undegraded":"2024-09-14T11:56:30.521625+0000","last_fullsized":"2024-09-14T11:56:30.521625+0000","mapping_epoch":27,"log_start":"263'1300","ondisk_log_start":"263'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1366","last_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_deep_scrub":"263'1366","last_deep_scrub_stamp":"2024-09-14T11:56:30.521471+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.521471+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:00.605893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6373,"num_read_kb":5621,"num_write":1914,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.538138+0000","last_change":"2024-09-14T11:56:26.538138+0000","last_active":"2024-09-14T11:56:26.538138+0000","last_peered":"2024-09-14T11:56:26.538138+0000","last_clean":"2024-09-14T11:56:26.538138+0000","last_became_active":"2024-09-14T11:13:53.053708+0000","last_became_peered":"2024-09-14T11:13:53.053708+0000","last_unstale":"2024-09-14T11:56:26.538138+0000","last_undegraded":"2024-09-14T11:56:26.538138+0000","last_fullsized":"2024-09-14T11:56:26.538138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:26.538048+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.538048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:14.343027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041840099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'362","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.498768+0000","last_change":"2024-09-14T11:56:23.498768+0000","last_active":"2024-09-14T11:56:23.498768+0000","last_peered":"2024-09-14T11:56:23.498768+0000","last_clean":"2024-09-14T11:56:23.498768+0000","last_became_active":"2024-09-14T11:14:04.128905+0000","last_became_peered":"2024-09-14T11:14:04.128905+0000","last_unstale":"2024-09-14T11:56:23.498768+0000","last_undegraded":"2024-09-14T11:56:23.498768+0000","last_fullsized":"2024-09-14T11:56:23.498768+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:23.498682+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.498682+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:31.939526+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029253,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":615,"num_read_kb":6150,"num_write":1149,"num_write_kb":42094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.727765+0000","last_change":"2024-09-14T11:56:42.727701+0000","last_active":"2024-09-14T11:56:42.727765+0000","last_peered":"2024-09-14T11:56:42.727765+0000","last_clean":"2024-09-14T11:56:42.727765+0000","last_became_active":"2024-09-14T11:14:08.132190+0000","last_became_peered":"2024-09-14T11:14:08.132190+0000","last_unstale":"2024-09-14T11:56:42.727765+0000","last_undegraded":"2024-09-14T11:56:42.727765+0000","last_fullsized":"2024-09-14T11:56:42.727765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.727605+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.727605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:20.497909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1264","reported_seq":2712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.846115+0000","last_change":"2024-09-14T11:56:41.846115+0000","last_active":"2024-09-14T11:56:41.846115+0000","last_peered":"2024-09-14T11:56:41.846115+0000","last_clean":"2024-09-14T11:56:41.846115+0000","last_became_active":"2024-09-14T11:14:10.148872+0000","last_became_peered":"2024-09-14T11:14:10.148872+0000","last_unstale":"2024-09-14T11:56:41.846115+0000","last_undegraded":"2024-09-14T11:56:41.846115+0000","last_fullsized":"2024-09-14T11:56:41.846115+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1264","last_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_deep_scrub":"263'1264","last_deep_scrub_stamp":"2024-09-14T11:56:41.846014+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.846014+0000","objects_scrubbed":11,"log_size":64,"log_dups_size":1200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:37.873739+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1958,"num_read_kb":3608,"num_write":1054,"num_write_kb":891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.500818+0000","last_change":"2024-09-14T11:56:50.500818+0000","last_active":"2024-09-14T11:56:50.500818+0000","last_peered":"2024-09-14T11:56:50.500818+0000","last_clean":"2024-09-14T11:56:50.500818+0000","last_became_active":"2024-09-14T11:14:12.148117+0000","last_became_peered":"2024-09-14T11:14:12.148117+0000","last_unstale":"2024-09-14T11:56:50.500818+0000","last_undegraded":"2024-09-14T11:56:50.500818+0000","last_fullsized":"2024-09-14T11:56:50.500818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.500733+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.500733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:53.365887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'134","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.959632+0000","last_change":"2024-09-14T11:56:49.959545+0000","last_active":"2024-09-14T11:56:49.959632+0000","last_peered":"2024-09-14T11:56:49.959632+0000","last_clean":"2024-09-14T11:56:49.959632+0000","last_became_active":"2024-09-14T11:14:14.145616+0000","last_became_peered":"2024-09-14T11:14:14.145616+0000","last_unstale":"2024-09-14T11:56:49.959632+0000","last_undegraded":"2024-09-14T11:56:49.959632+0000","last_fullsized":"2024-09-14T11:56:49.959632+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-14T11:56:49.959435+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.959435+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.018062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":348,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'786","reported_seq":2316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.813606+0000","last_change":"2024-09-14T11:56:30.813513+0000","last_active":"2024-09-14T11:56:30.813606+0000","last_peered":"2024-09-14T11:56:30.813606+0000","last_clean":"2024-09-14T11:56:30.813606+0000","last_became_active":"2024-09-14T11:14:06.121016+0000","last_became_peered":"2024-09-14T11:14:06.121016+0000","last_unstale":"2024-09-14T11:56:30.813606+0000","last_undegraded":"2024-09-14T11:56:30.813606+0000","last_fullsized":"2024-09-14T11:56:30.813606+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'786","last_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_deep_scrub":"263'786","last_deep_scrub_stamp":"2024-09-14T11:56:30.813419+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.813419+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:18.621682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3759,"num_read_kb":3383,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.950000+0000","last_change":"2024-09-14T11:56:21.949954+0000","last_active":"2024-09-14T11:56:21.950000+0000","last_peered":"2024-09-14T11:56:21.950000+0000","last_clean":"2024-09-14T11:56:21.950000+0000","last_became_active":"2024-09-14T11:13:53.717023+0000","last_became_peered":"2024-09-14T11:13:53.717023+0000","last_unstale":"2024-09-14T11:56:21.950000+0000","last_undegraded":"2024-09-14T11:56:21.950000+0000","last_fullsized":"2024-09-14T11:56:21.950000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.949882+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.949882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:24.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030272300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'342","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.834358+0000","last_change":"2024-09-14T11:56:22.834358+0000","last_active":"2024-09-14T11:56:22.834358+0000","last_peered":"2024-09-14T11:56:22.834358+0000","last_clean":"2024-09-14T11:56:22.834358+0000","last_became_active":"2024-09-14T11:14:04.123700+0000","last_became_peered":"2024-09-14T11:14:04.123700+0000","last_unstale":"2024-09-14T11:56:22.834358+0000","last_undegraded":"2024-09-14T11:56:22.834358+0000","last_fullsized":"2024-09-14T11:56:22.834358+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:56:22.834283+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.834283+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":72010,"num_write":1138,"num_write_kb":26370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.862259+0000","last_change":"2024-09-14T11:56:35.862175+0000","last_active":"2024-09-14T11:56:35.862259+0000","last_peered":"2024-09-14T11:56:35.862259+0000","last_clean":"2024-09-14T11:56:35.862259+0000","last_became_active":"2024-09-14T11:14:08.136006+0000","last_became_peered":"2024-09-14T11:14:08.136006+0000","last_unstale":"2024-09-14T11:56:35.862259+0000","last_undegraded":"2024-09-14T11:56:35.862259+0000","last_fullsized":"2024-09-14T11:56:35.862259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:35.862069+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.862069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:42.054433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'260","reported_seq":1302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.536007+0000","last_change":"2024-09-14T11:56:45.536007+0000","last_active":"2024-09-14T11:56:45.536007+0000","last_peered":"2024-09-14T11:56:45.536007+0000","last_clean":"2024-09-14T11:56:45.536007+0000","last_became_active":"2024-09-14T11:14:10.150266+0000","last_became_peered":"2024-09-14T11:14:10.150266+0000","last_unstale":"2024-09-14T11:56:45.536007+0000","last_undegraded":"2024-09-14T11:56:45.536007+0000","last_fullsized":"2024-09-14T11:56:45.536007+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:56:45.535905+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.535905+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:52.905109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":180,"num_read_kb":170,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.695253+0000","last_change":"2024-09-14T11:56:47.695253+0000","last_active":"2024-09-14T11:56:47.695253+0000","last_peered":"2024-09-14T11:56:47.695253+0000","last_clean":"2024-09-14T11:56:47.695253+0000","last_became_active":"2024-09-14T11:14:12.151195+0000","last_became_peered":"2024-09-14T11:14:12.151195+0000","last_unstale":"2024-09-14T11:56:47.695253+0000","last_undegraded":"2024-09-14T11:56:47.695253+0000","last_fullsized":"2024-09-14T11:56:47.695253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.695169+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.695169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:22.244367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'269","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.161409+0000","last_change":"2024-09-14T11:56:56.161351+0000","last_active":"2024-09-14T11:56:56.161409+0000","last_peered":"2024-09-14T11:56:56.161409+0000","last_clean":"2024-09-14T11:56:56.161409+0000","last_became_active":"2024-09-14T11:14:14.160512+0000","last_became_peered":"2024-09-14T11:14:14.160512+0000","last_unstale":"2024-09-14T11:56:56.161409+0000","last_undegraded":"2024-09-14T11:56:56.161409+0000","last_fullsized":"2024-09-14T11:56:56.161409+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'269","last_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_deep_scrub":"263'269","last_deep_scrub_stamp":"2024-09-14T11:56:56.161261+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.161261+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:18.468810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":553,"num_write":603,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'432","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.782814+0000","last_change":"2024-09-14T11:56:29.782814+0000","last_active":"2024-09-14T11:56:29.782814+0000","last_peered":"2024-09-14T11:56:29.782814+0000","last_clean":"2024-09-14T11:56:29.782814+0000","last_became_active":"2024-09-14T11:14:06.126270+0000","last_became_peered":"2024-09-14T11:14:06.126270+0000","last_unstale":"2024-09-14T11:56:29.782814+0000","last_undegraded":"2024-09-14T11:56:29.782814+0000","last_fullsized":"2024-09-14T11:56:29.782814+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:56:29.782725+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.782725+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:08.803503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2728,"num_read_kb":2594,"num_write":515,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4595,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.822573+0000","last_change":"2024-09-14T11:56:22.822497+0000","last_active":"2024-09-14T11:56:22.822573+0000","last_peered":"2024-09-14T11:56:22.822573+0000","last_clean":"2024-09-14T11:56:22.822573+0000","last_became_active":"2024-09-14T11:13:53.057929+0000","last_became_peered":"2024-09-14T11:13:53.057929+0000","last_unstale":"2024-09-14T11:56:22.822573+0000","last_undegraded":"2024-09-14T11:56:22.822573+0000","last_fullsized":"2024-09-14T11:56:22.822573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:56:22.822377+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.822377+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:42.113203+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00096711099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'323","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.913200+0000","last_change":"2024-09-14T11:56:22.913200+0000","last_active":"2024-09-14T11:56:22.913200+0000","last_peered":"2024-09-14T11:56:22.913200+0000","last_clean":"2024-09-14T11:56:22.913200+0000","last_became_active":"2024-09-14T11:14:38.191796+0000","last_became_peered":"2024-09-14T11:14:38.191796+0000","last_unstale":"2024-09-14T11:56:22.913200+0000","last_undegraded":"2024-09-14T11:56:22.913200+0000","last_fullsized":"2024-09-14T11:56:22.913200+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T11:56:22.913114+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.913114+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:18.574527+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1238,"num_read_kb":7389,"num_write":1100,"num_write_kb":32073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.683004+0000","last_change":"2024-09-14T11:56:40.683004+0000","last_active":"2024-09-14T11:56:40.683004+0000","last_peered":"2024-09-14T11:56:40.683004+0000","last_clean":"2024-09-14T11:56:40.683004+0000","last_became_active":"2024-09-14T11:14:08.128555+0000","last_became_peered":"2024-09-14T11:14:08.128555+0000","last_unstale":"2024-09-14T11:56:40.683004+0000","last_undegraded":"2024-09-14T11:56:40.683004+0000","last_fullsized":"2024-09-14T11:56:40.683004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:40.682920+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.682920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:03.268737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'128","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.232407+0000","last_change":"2024-09-14T11:56:40.232307+0000","last_active":"2024-09-14T11:56:40.232407+0000","last_peered":"2024-09-14T11:56:40.232407+0000","last_clean":"2024-09-14T11:56:40.232407+0000","last_became_active":"2024-09-14T11:14:10.153699+0000","last_became_peered":"2024-09-14T11:14:10.153699+0000","last_unstale":"2024-09-14T11:56:40.232407+0000","last_undegraded":"2024-09-14T11:56:40.232407+0000","last_fullsized":"2024-09-14T11:56:40.232407+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:56:40.232198+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.232198+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:52.939121+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.237764+0000","last_change":"2024-09-14T11:56:38.237710+0000","last_active":"2024-09-14T11:56:38.237764+0000","last_peered":"2024-09-14T11:56:38.237764+0000","last_clean":"2024-09-14T11:56:38.237764+0000","last_became_active":"2024-09-14T11:14:12.155274+0000","last_became_peered":"2024-09-14T11:14:12.155274+0000","last_unstale":"2024-09-14T11:56:38.237764+0000","last_undegraded":"2024-09-14T11:56:38.237764+0000","last_fullsized":"2024-09-14T11:56:38.237764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.237609+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.237609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.821273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'83","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.770876+0000","last_change":"2024-09-14T11:56:55.770817+0000","last_active":"2024-09-14T11:56:55.770876+0000","last_peered":"2024-09-14T11:56:55.770876+0000","last_clean":"2024-09-14T11:56:55.770876+0000","last_became_active":"2024-09-14T11:14:14.159583+0000","last_became_peered":"2024-09-14T11:14:14.159583+0000","last_unstale":"2024-09-14T11:56:55.770876+0000","last_undegraded":"2024-09-14T11:56:55.770876+0000","last_fullsized":"2024-09-14T11:56:55.770876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'83","last_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_deep_scrub":"263'83","last_deep_scrub_stamp":"2024-09-14T11:56:55.770737+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.770737+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:18.262644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":173,"num_write":201,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'460","reported_seq":2026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.810118+0000","last_change":"2024-09-14T11:56:28.810118+0000","last_active":"2024-09-14T11:56:28.810118+0000","last_peered":"2024-09-14T11:56:28.810118+0000","last_clean":"2024-09-14T11:56:28.810118+0000","last_became_active":"2024-09-14T11:14:06.123122+0000","last_became_peered":"2024-09-14T11:14:06.123122+0000","last_unstale":"2024-09-14T11:56:28.810118+0000","last_undegraded":"2024-09-14T11:56:28.810118+0000","last_fullsized":"2024-09-14T11:56:28.810118+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:56:28.810021+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.810021+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:52.644059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2380,"num_read_kb":2240,"num_write":510,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'398","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.828138+0000","last_change":"2024-09-14T11:56:24.828138+0000","last_active":"2024-09-14T11:56:24.828138+0000","last_peered":"2024-09-14T11:56:24.828138+0000","last_clean":"2024-09-14T11:56:24.828138+0000","last_became_active":"2024-09-14T11:14:04.122041+0000","last_became_peered":"2024-09-14T11:14:04.122041+0000","last_unstale":"2024-09-14T11:56:24.828138+0000","last_undegraded":"2024-09-14T11:56:24.828138+0000","last_fullsized":"2024-09-14T11:56:24.828138+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:56:24.828029+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.828029+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:30.652084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":754,"num_read_kb":43585,"num_write":1255,"num_write_kb":27419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:20.916754+0000","last_change":"2024-09-14T11:56:20.916705+0000","last_active":"2024-09-14T11:56:20.916754+0000","last_peered":"2024-09-14T11:56:20.916754+0000","last_clean":"2024-09-14T11:56:20.916754+0000","last_became_active":"2024-09-14T11:13:53.046334+0000","last_became_peered":"2024-09-14T11:13:53.046334+0000","last_unstale":"2024-09-14T11:56:20.916754+0000","last_undegraded":"2024-09-14T11:56:20.916754+0000","last_fullsized":"2024-09-14T11:56:20.916754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:20.916627+0000","last_clean_scrub_stamp":"2024-09-14T11:56:20.916627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:12.576482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059036400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.649519+0000","last_change":"2024-09-14T11:56:39.649519+0000","last_active":"2024-09-14T11:56:39.649519+0000","last_peered":"2024-09-14T11:56:39.649519+0000","last_clean":"2024-09-14T11:56:39.649519+0000","last_became_active":"2024-09-14T11:14:08.132887+0000","last_became_peered":"2024-09-14T11:14:08.132887+0000","last_unstale":"2024-09-14T11:56:39.649519+0000","last_undegraded":"2024-09-14T11:56:39.649519+0000","last_fullsized":"2024-09-14T11:56:39.649519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.649433+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.649433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:03.443069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'547","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.668212+0000","last_change":"2024-09-14T11:56:42.668212+0000","last_active":"2024-09-14T11:56:42.668212+0000","last_peered":"2024-09-14T11:56:42.668212+0000","last_clean":"2024-09-14T11:56:42.668212+0000","last_became_active":"2024-09-14T11:14:10.148893+0000","last_became_peered":"2024-09-14T11:14:10.148893+0000","last_unstale":"2024-09-14T11:56:42.668212+0000","last_undegraded":"2024-09-14T11:56:42.668212+0000","last_fullsized":"2024-09-14T11:56:42.668212+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:56:42.668098+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.668098+0000","objects_scrubbed":10,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:32.877719+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":943,"num_read_kb":2151,"num_write":772,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.731164+0000","last_change":"2024-09-14T11:56:50.731164+0000","last_active":"2024-09-14T11:56:50.731164+0000","last_peered":"2024-09-14T11:56:50.731164+0000","last_clean":"2024-09-14T11:56:50.731164+0000","last_became_active":"2024-09-14T11:14:12.150873+0000","last_became_peered":"2024-09-14T11:14:12.150873+0000","last_unstale":"2024-09-14T11:56:50.731164+0000","last_undegraded":"2024-09-14T11:56:50.731164+0000","last_fullsized":"2024-09-14T11:56:50.731164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:50.731065+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.731065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:11.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'166","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.811282+0000","last_change":"2024-09-14T11:56:55.811222+0000","last_active":"2024-09-14T11:56:55.811282+0000","last_peered":"2024-09-14T11:56:55.811282+0000","last_clean":"2024-09-14T11:56:55.811282+0000","last_became_active":"2024-09-14T11:14:14.155574+0000","last_became_peered":"2024-09-14T11:14:14.155574+0000","last_unstale":"2024-09-14T11:56:55.811282+0000","last_undegraded":"2024-09-14T11:56:55.811282+0000","last_fullsized":"2024-09-14T11:56:55.811282+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:56:55.811129+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.811129+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.315887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":127,"num_write":375,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'755","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562539+0000","last_change":"2024-09-14T11:56:32.562539+0000","last_active":"2024-09-14T11:56:32.562539+0000","last_peered":"2024-09-14T11:56:32.562539+0000","last_clean":"2024-09-14T11:56:32.562539+0000","last_became_active":"2024-09-14T11:14:06.132854+0000","last_became_peered":"2024-09-14T11:14:06.132854+0000","last_unstale":"2024-09-14T11:56:32.562539+0000","last_undegraded":"2024-09-14T11:56:32.562539+0000","last_fullsized":"2024-09-14T11:56:32.562539+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:56:32.562454+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.562454+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:52.777172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3708,"num_read_kb":3340,"num_write":987,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'346","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.813989+0000","last_change":"2024-09-14T11:56:26.813989+0000","last_active":"2024-09-14T11:56:26.813989+0000","last_peered":"2024-09-14T11:56:26.813989+0000","last_clean":"2024-09-14T11:56:26.813989+0000","last_became_active":"2024-09-14T11:14:04.126123+0000","last_became_peered":"2024-09-14T11:14:04.126123+0000","last_unstale":"2024-09-14T11:56:26.813989+0000","last_undegraded":"2024-09-14T11:56:26.813989+0000","last_fullsized":"2024-09-14T11:56:26.813989+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-14T11:56:26.813888+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.813888+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:55.071316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":25654,"num_write":1001,"num_write_kb":38804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.485112+0000","last_change":"2024-09-14T11:56:34.485112+0000","last_active":"2024-09-14T11:56:34.485112+0000","last_peered":"2024-09-14T11:56:34.485112+0000","last_clean":"2024-09-14T11:56:34.485112+0000","last_became_active":"2024-09-14T11:13:53.053413+0000","last_became_peered":"2024-09-14T11:13:53.053413+0000","last_unstale":"2024-09-14T11:56:34.485112+0000","last_undegraded":"2024-09-14T11:56:34.485112+0000","last_fullsized":"2024-09-14T11:56:34.485112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:34.485023+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.485023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:53.746684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051079000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.247905+0000","last_change":"2024-09-14T11:56:35.247905+0000","last_active":"2024-09-14T11:56:35.247905+0000","last_peered":"2024-09-14T11:56:35.247905+0000","last_clean":"2024-09-14T11:56:35.247905+0000","last_became_active":"2024-09-14T11:14:08.129957+0000","last_became_peered":"2024-09-14T11:14:08.129957+0000","last_unstale":"2024-09-14T11:56:35.247905+0000","last_undegraded":"2024-09-14T11:56:35.247905+0000","last_fullsized":"2024-09-14T11:56:35.247905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:35.247811+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.247811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.168290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'188","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:40.826318+0000","last_change":"2024-09-14T11:56:40.826318+0000","last_active":"2024-09-14T11:56:40.826318+0000","last_peered":"2024-09-14T11:56:40.826318+0000","last_clean":"2024-09-14T11:56:40.826318+0000","last_became_active":"2024-09-14T11:14:10.139364+0000","last_became_peered":"2024-09-14T11:14:10.139364+0000","last_unstale":"2024-09-14T11:56:40.826318+0000","last_undegraded":"2024-09-14T11:56:40.826318+0000","last_fullsized":"2024-09-14T11:56:40.826318+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:56:40.826206+0000","last_clean_scrub_stamp":"2024-09-14T11:56:40.826206+0000","objects_scrubbed":8,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:23.195767+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":228,"num_read_kb":218,"num_write":190,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'811","reported_seq":2686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.732182+0000","last_change":"2024-09-14T11:56:52.732182+0000","last_active":"2024-09-14T11:56:52.732182+0000","last_peered":"2024-09-14T11:56:52.732182+0000","last_clean":"2024-09-14T11:56:52.732182+0000","last_became_active":"2024-09-14T11:14:12.147185+0000","last_became_peered":"2024-09-14T11:14:12.147185+0000","last_unstale":"2024-09-14T11:56:52.732182+0000","last_undegraded":"2024-09-14T11:56:52.732182+0000","last_fullsized":"2024-09-14T11:56:52.732182+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:56:52.732066+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.732066+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:54.882453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'95","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.164929+0000","last_change":"2024-09-14T11:56:57.164874+0000","last_active":"2024-09-14T11:56:57.164929+0000","last_peered":"2024-09-14T11:56:57.164929+0000","last_clean":"2024-09-14T11:56:57.164929+0000","last_became_active":"2024-09-14T11:14:14.156840+0000","last_became_peered":"2024-09-14T11:14:14.156840+0000","last_unstale":"2024-09-14T11:56:57.164929+0000","last_undegraded":"2024-09-14T11:56:57.164929+0000","last_fullsized":"2024-09-14T11:56:57.164929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:56:57.164782+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.164782+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:05.807030+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":91,"num_write":207,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'360","reported_seq":1842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.042831+0000","last_change":"2024-09-14T11:56:33.042831+0000","last_active":"2024-09-14T11:56:33.042831+0000","last_peered":"2024-09-14T11:56:33.042831+0000","last_clean":"2024-09-14T11:56:33.042831+0000","last_became_active":"2024-09-14T11:14:06.125415+0000","last_became_peered":"2024-09-14T11:14:06.125415+0000","last_unstale":"2024-09-14T11:56:33.042831+0000","last_undegraded":"2024-09-14T11:56:33.042831+0000","last_fullsized":"2024-09-14T11:56:33.042831+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:56:33.042715+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.042715+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:58.519932+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2016,"num_read_kb":1932,"num_write":410,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'336","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.879898+0000","last_change":"2024-09-14T11:56:24.879898+0000","last_active":"2024-09-14T11:56:24.879898+0000","last_peered":"2024-09-14T11:56:24.879898+0000","last_clean":"2024-09-14T11:56:24.879898+0000","last_became_active":"2024-09-14T11:14:38.192532+0000","last_became_peered":"2024-09-14T11:14:38.192532+0000","last_unstale":"2024-09-14T11:56:24.879898+0000","last_undegraded":"2024-09-14T11:56:24.879898+0000","last_fullsized":"2024-09-14T11:56:24.879898+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'336","last_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_deep_scrub":"263'336","last_deep_scrub_stamp":"2024-09-14T11:56:24.879817+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.879817+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:17.339902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":1407,"num_write":989,"num_write_kb":27609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.878597+0000","last_change":"2024-09-14T11:56:21.878547+0000","last_active":"2024-09-14T11:56:21.878597+0000","last_peered":"2024-09-14T11:56:21.878597+0000","last_clean":"2024-09-14T11:56:21.878597+0000","last_became_active":"2024-09-14T11:13:53.058404+0000","last_became_peered":"2024-09-14T11:13:53.058404+0000","last_unstale":"2024-09-14T11:56:21.878597+0000","last_undegraded":"2024-09-14T11:56:21.878597+0000","last_fullsized":"2024-09-14T11:56:21.878597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:21.878477+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.878477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:14.405917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.743031+0000","last_change":"2024-09-14T11:56:44.743031+0000","last_active":"2024-09-14T11:56:44.743031+0000","last_peered":"2024-09-14T11:56:44.743031+0000","last_clean":"2024-09-14T11:56:44.743031+0000","last_became_active":"2024-09-14T11:14:08.135383+0000","last_became_peered":"2024-09-14T11:14:08.135383+0000","last_unstale":"2024-09-14T11:56:44.743031+0000","last_undegraded":"2024-09-14T11:56:44.743031+0000","last_fullsized":"2024-09-14T11:56:44.743031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:44.742899+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.742899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:06.805443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'104","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.821602+0000","last_change":"2024-09-14T11:56:46.821602+0000","last_active":"2024-09-14T11:56:46.821602+0000","last_peered":"2024-09-14T11:56:46.821602+0000","last_clean":"2024-09-14T11:56:46.821602+0000","last_became_active":"2024-09-14T11:14:10.151299+0000","last_became_peered":"2024-09-14T11:14:10.151299+0000","last_unstale":"2024-09-14T11:56:46.821602+0000","last_undegraded":"2024-09-14T11:56:46.821602+0000","last_fullsized":"2024-09-14T11:56:46.821602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:56:46.821514+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.821514+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:20.188202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.198992+0000","last_change":"2024-09-14T11:56:52.198992+0000","last_active":"2024-09-14T11:56:52.198992+0000","last_peered":"2024-09-14T11:56:52.198992+0000","last_clean":"2024-09-14T11:56:52.198992+0000","last_became_active":"2024-09-14T11:14:12.153019+0000","last_became_peered":"2024-09-14T11:14:12.153019+0000","last_unstale":"2024-09-14T11:56:52.198992+0000","last_undegraded":"2024-09-14T11:56:52.198992+0000","last_fullsized":"2024-09-14T11:56:52.198992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-14T11:56:52.198904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.198904+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:24.378166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'332","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.747551+0000","last_change":"2024-09-14T11:56:53.747475+0000","last_active":"2024-09-14T11:56:53.747551+0000","last_peered":"2024-09-14T11:56:53.747551+0000","last_clean":"2024-09-14T11:56:53.747551+0000","last_became_active":"2024-09-14T11:14:14.156679+0000","last_became_peered":"2024-09-14T11:14:14.156679+0000","last_unstale":"2024-09-14T11:56:53.747551+0000","last_undegraded":"2024-09-14T11:56:53.747551+0000","last_fullsized":"2024-09-14T11:56:53.747551+0000","mapping_epoch":35,"log_start":"263'300","ondisk_log_start":"263'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:53.747387+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.747387+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.923900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":518,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'1138","reported_seq":2697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.720530+0000","last_change":"2024-09-14T11:56:26.720530+0000","last_active":"2024-09-14T11:56:26.720530+0000","last_peered":"2024-09-14T11:56:26.720530+0000","last_clean":"2024-09-14T11:56:26.720530+0000","last_became_active":"2024-09-14T11:14:06.126432+0000","last_became_peered":"2024-09-14T11:14:06.126432+0000","last_unstale":"2024-09-14T11:56:26.720530+0000","last_undegraded":"2024-09-14T11:56:26.720530+0000","last_fullsized":"2024-09-14T11:56:26.720530+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T11:56:26.720427+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.720427+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:26.572105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5384,"num_read_kb":4765,"num_write":1585,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'384","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:21.466271+0000","last_change":"2024-09-14T11:56:21.466221+0000","last_active":"2024-09-14T11:56:21.466271+0000","last_peered":"2024-09-14T11:56:21.466271+0000","last_clean":"2024-09-14T11:56:21.466271+0000","last_became_active":"2024-09-14T11:14:04.122504+0000","last_became_peered":"2024-09-14T11:14:04.122504+0000","last_unstale":"2024-09-14T11:56:21.466271+0000","last_undegraded":"2024-09-14T11:56:21.466271+0000","last_fullsized":"2024-09-14T11:56:21.466271+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T11:56:21.466142+0000","last_clean_scrub_stamp":"2024-09-14T11:56:21.466142+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:51.285530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":7233,"num_write":1301,"num_write_kb":47789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.096204+0000","last_change":"2024-09-14T11:56:23.096139+0000","last_active":"2024-09-14T11:56:23.096204+0000","last_peered":"2024-09-14T11:56:23.096204+0000","last_clean":"2024-09-14T11:56:23.096204+0000","last_became_active":"2024-09-14T11:13:53.058067+0000","last_became_peered":"2024-09-14T11:13:53.058067+0000","last_unstale":"2024-09-14T11:56:23.096204+0000","last_undegraded":"2024-09-14T11:56:23.096204+0000","last_fullsized":"2024-09-14T11:56:23.096204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:23.096056+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.096056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:44.997173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000542768,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.171745+0000","last_change":"2024-09-14T11:56:38.171745+0000","last_active":"2024-09-14T11:56:38.171745+0000","last_peered":"2024-09-14T11:56:38.171745+0000","last_clean":"2024-09-14T11:56:38.171745+0000","last_became_active":"2024-09-14T11:14:08.133386+0000","last_became_peered":"2024-09-14T11:14:08.133386+0000","last_unstale":"2024-09-14T11:56:38.171745+0000","last_undegraded":"2024-09-14T11:56:38.171745+0000","last_fullsized":"2024-09-14T11:56:38.171745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:38.171651+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.171651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'768","reported_seq":1481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:44.540722+0000","last_change":"2024-09-14T11:56:44.540722+0000","last_active":"2024-09-14T11:56:44.540722+0000","last_peered":"2024-09-14T11:56:44.540722+0000","last_clean":"2024-09-14T11:56:44.540722+0000","last_became_active":"2024-09-14T11:14:10.151099+0000","last_became_peered":"2024-09-14T11:14:10.151099+0000","last_unstale":"2024-09-14T11:56:44.540722+0000","last_undegraded":"2024-09-14T11:56:44.540722+0000","last_fullsized":"2024-09-14T11:56:44.540722+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:56:44.540620+0000","last_clean_scrub_stamp":"2024-09-14T11:56:44.540620+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:46.054100+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1362,"num_read_kb":3256,"num_write":1124,"num_write_kb":935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.237722+0000","last_change":"2024-09-14T11:56:51.237722+0000","last_active":"2024-09-14T11:56:51.237722+0000","last_peered":"2024-09-14T11:56:51.237722+0000","last_clean":"2024-09-14T11:56:51.237722+0000","last_became_active":"2024-09-14T11:14:12.151049+0000","last_became_peered":"2024-09-14T11:14:12.151049+0000","last_unstale":"2024-09-14T11:56:51.237722+0000","last_undegraded":"2024-09-14T11:56:51.237722+0000","last_fullsized":"2024-09-14T11:56:51.237722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.237634+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.237634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:59.694149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'106","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.795670+0000","last_change":"2024-09-14T11:56:56.795609+0000","last_active":"2024-09-14T11:56:56.795670+0000","last_peered":"2024-09-14T11:56:56.795670+0000","last_clean":"2024-09-14T11:56:56.795670+0000","last_became_active":"2024-09-14T11:14:14.163969+0000","last_became_peered":"2024-09-14T11:14:14.163969+0000","last_unstale":"2024-09-14T11:56:56.795670+0000","last_undegraded":"2024-09-14T11:56:56.795670+0000","last_fullsized":"2024-09-14T11:56:56.795670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:56:56.795524+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.795524+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:50.937930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.761145+0000","last_change":"2024-09-14T11:56:59.761145+0000","last_active":"2024-09-14T11:56:59.761145+0000","last_peered":"2024-09-14T11:56:59.761145+0000","last_clean":"2024-09-14T11:56:59.761145+0000","last_became_active":"2024-09-14T11:14:14.159889+0000","last_became_peered":"2024-09-14T11:14:14.159889+0000","last_unstale":"2024-09-14T11:56:59.761145+0000","last_undegraded":"2024-09-14T11:56:59.761145+0000","last_fullsized":"2024-09-14T11:56:59.761145+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:56:59.761046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.761046+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:42.719893+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":209,"num_read_kb":208,"num_write":348,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'433","reported_seq":2063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.757762+0000","last_change":"2024-09-14T11:56:31.757762+0000","last_active":"2024-09-14T11:56:31.757762+0000","last_peered":"2024-09-14T11:56:31.757762+0000","last_clean":"2024-09-14T11:56:31.757762+0000","last_became_active":"2024-09-14T11:14:06.128497+0000","last_became_peered":"2024-09-14T11:14:06.128497+0000","last_unstale":"2024-09-14T11:56:31.757762+0000","last_undegraded":"2024-09-14T11:56:31.757762+0000","last_fullsized":"2024-09-14T11:56:31.757762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:56:31.757652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.757652+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:26.947794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2465,"num_read_kb":2351,"num_write":494,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'355","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.662921+0000","last_change":"2024-09-14T11:56:23.662921+0000","last_active":"2024-09-14T11:56:23.662921+0000","last_peered":"2024-09-14T11:56:23.662921+0000","last_clean":"2024-09-14T11:56:23.662921+0000","last_became_active":"2024-09-14T11:14:04.130658+0000","last_became_peered":"2024-09-14T11:14:04.130658+0000","last_unstale":"2024-09-14T11:56:23.662921+0000","last_undegraded":"2024-09-14T11:56:23.662921+0000","last_fullsized":"2024-09-14T11:56:23.662921+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:56:23.662820+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.662820+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.362361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":46950,"num_write":1178,"num_write_kb":40155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.764130+0000","last_change":"2024-09-14T11:56:36.764130+0000","last_active":"2024-09-14T11:56:36.764130+0000","last_peered":"2024-09-14T11:56:36.764130+0000","last_clean":"2024-09-14T11:56:36.764130+0000","last_became_active":"2024-09-14T11:14:08.137148+0000","last_became_peered":"2024-09-14T11:14:08.137148+0000","last_unstale":"2024-09-14T11:56:36.764130+0000","last_undegraded":"2024-09-14T11:56:36.764130+0000","last_fullsized":"2024-09-14T11:56:36.764130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:56:36.764053+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.764053+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.131436+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'268","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.282675+0000","last_change":"2024-09-14T11:56:47.282675+0000","last_active":"2024-09-14T11:56:47.282675+0000","last_peered":"2024-09-14T11:56:47.282675+0000","last_clean":"2024-09-14T11:56:47.282675+0000","last_became_active":"2024-09-14T11:14:10.148800+0000","last_became_peered":"2024-09-14T11:14:10.148800+0000","last_unstale":"2024-09-14T11:56:47.282675+0000","last_undegraded":"2024-09-14T11:56:47.282675+0000","last_fullsized":"2024-09-14T11:56:47.282675+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'268","last_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_deep_scrub":"263'268","last_deep_scrub_stamp":"2024-09-14T11:56:47.282577+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.282577+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:35.922781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":993,"num_write":352,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.197057+0000","last_change":"2024-09-14T11:56:54.197057+0000","last_active":"2024-09-14T11:56:54.197057+0000","last_peered":"2024-09-14T11:56:54.197057+0000","last_clean":"2024-09-14T11:56:54.197057+0000","last_became_active":"2024-09-14T11:14:12.152399+0000","last_became_peered":"2024-09-14T11:14:12.152399+0000","last_unstale":"2024-09-14T11:56:54.197057+0000","last_undegraded":"2024-09-14T11:56:54.197057+0000","last_fullsized":"2024-09-14T11:56:54.197057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.196971+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.196971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:14.784761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'144","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:01.091259+0000","last_change":"2024-09-14T11:57:01.091259+0000","last_active":"2024-09-14T11:57:01.091259+0000","last_peered":"2024-09-14T11:57:01.091259+0000","last_clean":"2024-09-14T11:57:01.091259+0000","last_became_active":"2024-09-14T11:14:14.152897+0000","last_became_peered":"2024-09-14T11:14:14.152897+0000","last_unstale":"2024-09-14T11:57:01.091259+0000","last_undegraded":"2024-09-14T11:57:01.091259+0000","last_fullsized":"2024-09-14T11:57:01.091259+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T11:57:01.091173+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T11:57:01.091173+0000","last_clean_scrub_stamp":"2024-09-14T11:57:01.091173+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.186184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":170,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'784","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.737175+0000","last_change":"2024-09-14T11:56:32.737175+0000","last_active":"2024-09-14T11:56:32.737175+0000","last_peered":"2024-09-14T11:56:32.737175+0000","last_clean":"2024-09-14T11:56:32.737175+0000","last_became_active":"2024-09-14T11:14:06.128984+0000","last_became_peered":"2024-09-14T11:14:06.128984+0000","last_unstale":"2024-09-14T11:56:32.737175+0000","last_undegraded":"2024-09-14T11:56:32.737175+0000","last_fullsized":"2024-09-14T11:56:32.737175+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'784","last_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_deep_scrub":"263'784","last_deep_scrub_stamp":"2024-09-14T11:56:32.737071+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.737071+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:46.307192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3858,"num_read_kb":3492,"num_write":1033,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'373","reported_seq":1037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.476867+0000","last_change":"2024-09-14T11:56:30.476776+0000","last_active":"2024-09-14T11:56:30.476867+0000","last_peered":"2024-09-14T11:56:30.476867+0000","last_clean":"2024-09-14T11:56:30.476867+0000","last_became_active":"2024-09-14T11:14:04.135884+0000","last_became_peered":"2024-09-14T11:14:04.135884+0000","last_unstale":"2024-09-14T11:56:30.476867+0000","last_undegraded":"2024-09-14T11:56:30.476867+0000","last_fullsized":"2024-09-14T11:56:30.476867+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'373","last_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_deep_scrub":"263'373","last_deep_scrub_stamp":"2024-09-14T11:56:30.476624+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.476624+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:37.040267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":634,"num_read_kb":24187,"num_write":1164,"num_write_kb":45205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.301966+0000","last_change":"2024-09-14T11:56:43.301966+0000","last_active":"2024-09-14T11:56:43.301966+0000","last_peered":"2024-09-14T11:56:43.301966+0000","last_clean":"2024-09-14T11:56:43.301966+0000","last_became_active":"2024-09-14T11:14:08.132456+0000","last_became_peered":"2024-09-14T11:14:08.132456+0000","last_unstale":"2024-09-14T11:56:43.301966+0000","last_undegraded":"2024-09-14T11:56:43.301966+0000","last_fullsized":"2024-09-14T11:56:43.301966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.301874+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.301874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:11.795970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'51","reported_seq":556,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.677930+0000","last_change":"2024-09-14T11:56:45.677930+0000","last_active":"2024-09-14T11:56:45.677930+0000","last_peered":"2024-09-14T11:56:45.677930+0000","last_clean":"2024-09-14T11:56:45.677930+0000","last_became_active":"2024-09-14T11:14:10.147782+0000","last_became_peered":"2024-09-14T11:14:10.147782+0000","last_unstale":"2024-09-14T11:56:45.677930+0000","last_undegraded":"2024-09-14T11:56:45.677930+0000","last_fullsized":"2024-09-14T11:56:45.677930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T11:56:45.677854+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.677854+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:59.900722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.451629+0000","last_change":"2024-09-14T11:56:51.451629+0000","last_active":"2024-09-14T11:56:51.451629+0000","last_peered":"2024-09-14T11:56:51.451629+0000","last_clean":"2024-09-14T11:56:51.451629+0000","last_became_active":"2024-09-14T11:14:12.150585+0000","last_became_peered":"2024-09-14T11:14:12.150585+0000","last_unstale":"2024-09-14T11:56:51.451629+0000","last_undegraded":"2024-09-14T11:56:51.451629+0000","last_fullsized":"2024-09-14T11:56:51.451629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.451543+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.451543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.323082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.763278+0000","last_change":"2024-09-14T11:56:58.763278+0000","last_active":"2024-09-14T11:56:58.763278+0000","last_peered":"2024-09-14T11:56:58.763278+0000","last_clean":"2024-09-14T11:56:58.763278+0000","last_became_active":"2024-09-14T11:14:14.153505+0000","last_became_peered":"2024-09-14T11:14:14.153505+0000","last_unstale":"2024-09-14T11:56:58.763278+0000","last_undegraded":"2024-09-14T11:56:58.763278+0000","last_fullsized":"2024-09-14T11:56:58.763278+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:56:58.763192+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.763192+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:45.580829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":415,"num_read_kb":379,"num_write":505,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'917","reported_seq":2661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.036282+0000","last_change":"2024-09-14T11:56:29.036282+0000","last_active":"2024-09-14T11:56:29.036282+0000","last_peered":"2024-09-14T11:56:29.036282+0000","last_clean":"2024-09-14T11:56:29.036282+0000","last_became_active":"2024-09-14T11:14:06.125019+0000","last_became_peered":"2024-09-14T11:14:06.125019+0000","last_unstale":"2024-09-14T11:56:29.036282+0000","last_undegraded":"2024-09-14T11:56:29.036282+0000","last_fullsized":"2024-09-14T11:56:29.036282+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'917","last_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_deep_scrub":"263'917","last_deep_scrub_stamp":"2024-09-14T11:56:29.036185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.036185+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":900,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.766117+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4440,"num_read_kb":3991,"num_write":1215,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'372","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.816391+0000","last_change":"2024-09-14T11:56:25.816297+0000","last_active":"2024-09-14T11:56:25.816391+0000","last_peered":"2024-09-14T11:56:25.816391+0000","last_clean":"2024-09-14T11:56:25.816391+0000","last_became_active":"2024-09-14T11:14:04.125280+0000","last_became_peered":"2024-09-14T11:14:04.125280+0000","last_unstale":"2024-09-14T11:56:25.816391+0000","last_undegraded":"2024-09-14T11:56:25.816391+0000","last_fullsized":"2024-09-14T11:56:25.816391+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:56:25.816150+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.816150+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:23.901347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":794,"num_read_kb":3352,"num_write":1165,"num_write_kb":21828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.521539+0000","last_change":"2024-09-14T11:56:42.521539+0000","last_active":"2024-09-14T11:56:42.521539+0000","last_peered":"2024-09-14T11:56:42.521539+0000","last_clean":"2024-09-14T11:56:42.521539+0000","last_became_active":"2024-09-14T11:14:08.136131+0000","last_became_peered":"2024-09-14T11:14:08.136131+0000","last_unstale":"2024-09-14T11:56:42.521539+0000","last_undegraded":"2024-09-14T11:56:42.521539+0000","last_fullsized":"2024-09-14T11:56:42.521539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.521449+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.521449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:00.655304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'328","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:48.269584+0000","last_change":"2024-09-14T11:56:48.269584+0000","last_active":"2024-09-14T11:56:48.269584+0000","last_peered":"2024-09-14T11:56:48.269584+0000","last_clean":"2024-09-14T11:56:48.269584+0000","last_became_active":"2024-09-14T11:14:10.150912+0000","last_became_peered":"2024-09-14T11:14:10.150912+0000","last_unstale":"2024-09-14T11:56:48.269584+0000","last_undegraded":"2024-09-14T11:56:48.269584+0000","last_fullsized":"2024-09-14T11:56:48.269584+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:48.269489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:48.269489+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:55.281201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47586,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1120,"num_write":408,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.190118+0000","last_change":"2024-09-14T11:56:41.190118+0000","last_active":"2024-09-14T11:56:41.190118+0000","last_peered":"2024-09-14T11:56:41.190118+0000","last_clean":"2024-09-14T11:56:41.190118+0000","last_became_active":"2024-09-14T11:14:12.152376+0000","last_became_peered":"2024-09-14T11:14:12.152376+0000","last_unstale":"2024-09-14T11:56:41.190118+0000","last_undegraded":"2024-09-14T11:56:41.190118+0000","last_fullsized":"2024-09-14T11:56:41.190118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.190036+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.190036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:27.442628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.727430+0000","last_change":"2024-09-14T11:56:58.727430+0000","last_active":"2024-09-14T11:56:58.727430+0000","last_peered":"2024-09-14T11:56:58.727430+0000","last_clean":"2024-09-14T11:56:58.727430+0000","last_became_active":"2024-09-14T11:14:14.162473+0000","last_became_peered":"2024-09-14T11:14:14.162473+0000","last_unstale":"2024-09-14T11:56:58.727430+0000","last_undegraded":"2024-09-14T11:56:58.727430+0000","last_fullsized":"2024-09-14T11:56:58.727430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:56:58.727339+0000","last_clean_scrub_stamp":"2024-09-14T11:56:58.727339+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:00.229225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":147,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'565","reported_seq":2300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.144947+0000","last_change":"2024-09-14T11:56:36.144947+0000","last_active":"2024-09-14T11:56:36.144947+0000","last_peered":"2024-09-14T11:56:36.144947+0000","last_clean":"2024-09-14T11:56:36.144947+0000","last_became_active":"2024-09-14T11:14:06.114707+0000","last_became_peered":"2024-09-14T11:14:06.114707+0000","last_unstale":"2024-09-14T11:56:36.144947+0000","last_undegraded":"2024-09-14T11:56:36.144947+0000","last_fullsized":"2024-09-14T11:56:36.144947+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'565","last_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_deep_scrub":"263'565","last_deep_scrub_stamp":"2024-09-14T11:56:36.144850+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.144850+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:25.651462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3107,"num_read_kb":2898,"num_write":692,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'411","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.513516+0000","last_change":"2024-09-14T11:56:22.513418+0000","last_active":"2024-09-14T11:56:22.513516+0000","last_peered":"2024-09-14T11:56:22.513516+0000","last_clean":"2024-09-14T11:56:22.513516+0000","last_became_active":"2024-09-14T11:14:04.123347+0000","last_became_peered":"2024-09-14T11:14:04.123347+0000","last_unstale":"2024-09-14T11:56:22.513516+0000","last_undegraded":"2024-09-14T11:56:22.513516+0000","last_fullsized":"2024-09-14T11:56:22.513516+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:22.513319+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.513319+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:15.055131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":715,"num_read_kb":20814,"num_write":1368,"num_write_kb":35332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.285132+0000","last_change":"2024-09-14T11:56:36.285132+0000","last_active":"2024-09-14T11:56:36.285132+0000","last_peered":"2024-09-14T11:56:36.285132+0000","last_clean":"2024-09-14T11:56:36.285132+0000","last_became_active":"2024-09-14T11:14:08.137879+0000","last_became_peered":"2024-09-14T11:14:08.137879+0000","last_unstale":"2024-09-14T11:56:36.285132+0000","last_undegraded":"2024-09-14T11:56:36.285132+0000","last_fullsized":"2024-09-14T11:56:36.285132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:36.285037+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.285037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.139207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'270","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.491371+0000","last_change":"2024-09-14T11:56:47.491371+0000","last_active":"2024-09-14T11:56:47.491371+0000","last_peered":"2024-09-14T11:56:47.491371+0000","last_clean":"2024-09-14T11:56:47.491371+0000","last_became_active":"2024-09-14T11:14:10.151021+0000","last_became_peered":"2024-09-14T11:14:10.151021+0000","last_unstale":"2024-09-14T11:56:47.491371+0000","last_undegraded":"2024-09-14T11:56:47.491371+0000","last_fullsized":"2024-09-14T11:56:47.491371+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-14T11:56:47.491269+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.491269+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:00.619858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42187,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":1050,"num_write":364,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.764814+0000","last_change":"2024-09-14T11:56:52.764814+0000","last_active":"2024-09-14T11:56:52.764814+0000","last_peered":"2024-09-14T11:56:52.764814+0000","last_clean":"2024-09-14T11:56:52.764814+0000","last_became_active":"2024-09-14T11:14:12.149450+0000","last_became_peered":"2024-09-14T11:14:12.149450+0000","last_unstale":"2024-09-14T11:56:52.764814+0000","last_undegraded":"2024-09-14T11:56:52.764814+0000","last_fullsized":"2024-09-14T11:56:52.764814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.764702+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.764702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:01.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1274","reported_seq":2890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.194337+0000","last_change":"2024-09-14T11:56:32.194337+0000","last_active":"2024-09-14T11:56:32.194337+0000","last_peered":"2024-09-14T11:56:32.194337+0000","last_clean":"2024-09-14T11:56:32.194337+0000","last_became_active":"2024-09-14T11:14:06.128085+0000","last_became_peered":"2024-09-14T11:14:06.128085+0000","last_unstale":"2024-09-14T11:56:32.194337+0000","last_undegraded":"2024-09-14T11:56:32.194337+0000","last_fullsized":"2024-09-14T11:56:32.194337+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-14T11:56:32.194246+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.194246+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:46.983995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5809,"num_read_kb":5091,"num_write":1777,"num_write_kb":740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.027104+0000","last_change":"2024-09-14T11:56:24.027053+0000","last_active":"2024-09-14T11:56:24.027104+0000","last_peered":"2024-09-14T11:56:24.027104+0000","last_clean":"2024-09-14T11:56:24.027104+0000","last_became_active":"2024-09-14T11:14:04.124199+0000","last_became_peered":"2024-09-14T11:14:04.124199+0000","last_unstale":"2024-09-14T11:56:24.027104+0000","last_undegraded":"2024-09-14T11:56:24.027104+0000","last_fullsized":"2024-09-14T11:56:24.027104+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:24.026967+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.026967+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:04.386753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":1976,"num_write":1075,"num_write_kb":21127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.696720+0000","last_change":"2024-09-14T11:56:41.696720+0000","last_active":"2024-09-14T11:56:41.696720+0000","last_peered":"2024-09-14T11:56:41.696720+0000","last_clean":"2024-09-14T11:56:41.696720+0000","last_became_active":"2024-09-14T11:14:08.125601+0000","last_became_peered":"2024-09-14T11:14:08.125601+0000","last_unstale":"2024-09-14T11:56:41.696720+0000","last_undegraded":"2024-09-14T11:56:41.696720+0000","last_fullsized":"2024-09-14T11:56:41.696720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:41.696635+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.696635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:41.649777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'497","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.802546+0000","last_change":"2024-09-14T11:56:42.802546+0000","last_active":"2024-09-14T11:56:42.802546+0000","last_peered":"2024-09-14T11:56:42.802546+0000","last_clean":"2024-09-14T11:56:42.802546+0000","last_became_active":"2024-09-14T11:14:10.149332+0000","last_became_peered":"2024-09-14T11:14:10.149332+0000","last_unstale":"2024-09-14T11:56:42.802546+0000","last_undegraded":"2024-09-14T11:56:42.802546+0000","last_fullsized":"2024-09-14T11:56:42.802546+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:42.802453+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.802453+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:42.897670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100440,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":885,"num_read_kb":2109,"num_write":762,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.765021+0000","last_change":"2024-09-14T11:56:53.765021+0000","last_active":"2024-09-14T11:56:53.765021+0000","last_peered":"2024-09-14T11:56:53.765021+0000","last_clean":"2024-09-14T11:56:53.765021+0000","last_became_active":"2024-09-14T11:14:12.152013+0000","last_became_peered":"2024-09-14T11:14:12.152013+0000","last_unstale":"2024-09-14T11:56:53.765021+0000","last_undegraded":"2024-09-14T11:56:53.765021+0000","last_fullsized":"2024-09-14T11:56:53.765021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:53.764935+0000","last_clean_scrub_stamp":"2024-09-14T11:56:53.764935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:14.345255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'179","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:59.163408+0000","last_change":"2024-09-14T11:56:59.163408+0000","last_active":"2024-09-14T11:56:59.163408+0000","last_peered":"2024-09-14T11:56:59.163408+0000","last_clean":"2024-09-14T11:56:59.163408+0000","last_became_active":"2024-09-14T11:14:14.152881+0000","last_became_peered":"2024-09-14T11:14:14.152881+0000","last_unstale":"2024-09-14T11:56:59.163408+0000","last_undegraded":"2024-09-14T11:56:59.163408+0000","last_fullsized":"2024-09-14T11:56:59.163408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:56:59.163317+0000","last_clean_scrub_stamp":"2024-09-14T11:56:59.163317+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:15.030499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":224,"num_write":403,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'413","reported_seq":1954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.580724+0000","last_change":"2024-09-14T11:56:36.580724+0000","last_active":"2024-09-14T11:56:36.580724+0000","last_peered":"2024-09-14T11:56:36.580724+0000","last_clean":"2024-09-14T11:56:36.580724+0000","last_became_active":"2024-09-14T11:14:06.133040+0000","last_became_peered":"2024-09-14T11:14:06.133040+0000","last_unstale":"2024-09-14T11:56:36.580724+0000","last_undegraded":"2024-09-14T11:56:36.580724+0000","last_fullsized":"2024-09-14T11:56:36.580724+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:56:36.580630+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.580630+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:57.544918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2301,"num_read_kb":2179,"num_write":482,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'351","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.810076+0000","last_change":"2024-09-14T11:56:23.810015+0000","last_active":"2024-09-14T11:56:23.810076+0000","last_peered":"2024-09-14T11:56:23.810076+0000","last_clean":"2024-09-14T11:56:23.810076+0000","last_became_active":"2024-09-14T11:14:04.120000+0000","last_became_peered":"2024-09-14T11:14:04.120000+0000","last_unstale":"2024-09-14T11:56:23.810076+0000","last_undegraded":"2024-09-14T11:56:23.810076+0000","last_fullsized":"2024-09-14T11:56:23.810076+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:56:23.809947+0000","last_clean_scrub_stamp":"2024-09-14T11:56:23.809947+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:11.325976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":10770,"num_write":1202,"num_write_kb":20936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.246504+0000","last_change":"2024-09-14T11:56:37.246504+0000","last_active":"2024-09-14T11:56:37.246504+0000","last_peered":"2024-09-14T11:56:37.246504+0000","last_clean":"2024-09-14T11:56:37.246504+0000","last_became_active":"2024-09-14T11:14:08.136216+0000","last_became_peered":"2024-09-14T11:14:08.136216+0000","last_unstale":"2024-09-14T11:56:37.246504+0000","last_undegraded":"2024-09-14T11:56:37.246504+0000","last_fullsized":"2024-09-14T11:56:37.246504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:37.246409+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.246409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:58.990350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'329","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.490988+0000","last_change":"2024-09-14T11:56:49.490988+0000","last_active":"2024-09-14T11:56:49.490988+0000","last_peered":"2024-09-14T11:56:49.490988+0000","last_clean":"2024-09-14T11:56:49.490988+0000","last_became_active":"2024-09-14T11:14:10.152308+0000","last_became_peered":"2024-09-14T11:14:10.152308+0000","last_unstale":"2024-09-14T11:56:49.490988+0000","last_undegraded":"2024-09-14T11:56:49.490988+0000","last_fullsized":"2024-09-14T11:56:49.490988+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:49.490894+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.490894+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.716046+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45897,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1228,"num_write":458,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.821686+0000","last_change":"2024-09-14T11:56:43.821583+0000","last_active":"2024-09-14T11:56:43.821686+0000","last_peered":"2024-09-14T11:56:43.821686+0000","last_clean":"2024-09-14T11:56:43.821686+0000","last_became_active":"2024-09-14T11:14:12.153642+0000","last_became_peered":"2024-09-14T11:14:12.153642+0000","last_unstale":"2024-09-14T11:56:43.821686+0000","last_undegraded":"2024-09-14T11:56:43.821686+0000","last_fullsized":"2024-09-14T11:56:43.821686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.821463+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.821463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:44.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'239","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.190251+0000","last_change":"2024-09-14T11:56:45.190251+0000","last_active":"2024-09-14T11:56:45.190251+0000","last_peered":"2024-09-14T11:56:45.190251+0000","last_clean":"2024-09-14T11:56:45.190251+0000","last_became_active":"2024-09-14T11:14:14.159482+0000","last_became_peered":"2024-09-14T11:14:14.159482+0000","last_unstale":"2024-09-14T11:56:45.190251+0000","last_undegraded":"2024-09-14T11:56:45.190251+0000","last_fullsized":"2024-09-14T11:56:45.190251+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-14T11:56:45.190156+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.190156+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:19.971391+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":708,"num_read_kb":681,"num_write":579,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'497","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.133993+0000","last_change":"2024-09-14T11:56:35.133928+0000","last_active":"2024-09-14T11:56:35.133993+0000","last_peered":"2024-09-14T11:56:35.133993+0000","last_clean":"2024-09-14T11:56:35.133993+0000","last_became_active":"2024-09-14T11:14:06.115564+0000","last_became_peered":"2024-09-14T11:14:06.115564+0000","last_unstale":"2024-09-14T11:56:35.133993+0000","last_undegraded":"2024-09-14T11:56:35.133993+0000","last_fullsized":"2024-09-14T11:56:35.133993+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:56:35.133843+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.133843+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:47.774586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2791,"num_read_kb":2602,"num_write":642,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'356","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.633798+0000","last_change":"2024-09-14T11:56:22.633722+0000","last_active":"2024-09-14T11:56:22.633798+0000","last_peered":"2024-09-14T11:56:22.633798+0000","last_clean":"2024-09-14T11:56:22.633798+0000","last_became_active":"2024-09-14T11:14:04.123420+0000","last_became_peered":"2024-09-14T11:14:04.123420+0000","last_unstale":"2024-09-14T11:56:22.633798+0000","last_undegraded":"2024-09-14T11:56:22.633798+0000","last_fullsized":"2024-09-14T11:56:22.633798+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:56:22.633613+0000","last_clean_scrub_stamp":"2024-09-14T11:56:22.633613+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:24.515854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":733,"num_read_kb":72215,"num_write":1111,"num_write_kb":21584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:45.787436+0000","last_change":"2024-09-14T11:56:45.787436+0000","last_active":"2024-09-14T11:56:45.787436+0000","last_peered":"2024-09-14T11:56:45.787436+0000","last_clean":"2024-09-14T11:56:45.787436+0000","last_became_active":"2024-09-14T11:14:08.136726+0000","last_became_peered":"2024-09-14T11:14:08.136726+0000","last_unstale":"2024-09-14T11:56:45.787436+0000","last_undegraded":"2024-09-14T11:56:45.787436+0000","last_fullsized":"2024-09-14T11:56:45.787436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:45.787349+0000","last_clean_scrub_stamp":"2024-09-14T11:56:45.787349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:30.736106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.282345+0000","last_change":"2024-09-14T11:56:50.282345+0000","last_active":"2024-09-14T11:56:50.282345+0000","last_peered":"2024-09-14T11:56:50.282345+0000","last_clean":"2024-09-14T11:56:50.282345+0000","last_became_active":"2024-09-14T11:14:10.153589+0000","last_became_peered":"2024-09-14T11:14:10.153589+0000","last_unstale":"2024-09-14T11:56:50.282345+0000","last_undegraded":"2024-09-14T11:56:50.282345+0000","last_fullsized":"2024-09-14T11:56:50.282345+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:56:50.282250+0000","last_clean_scrub_stamp":"2024-09-14T11:56:50.282250+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.560895+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":1085,"num_write":390,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.917145+0000","last_change":"2024-09-14T11:56:46.917145+0000","last_active":"2024-09-14T11:56:46.917145+0000","last_peered":"2024-09-14T11:56:46.917145+0000","last_clean":"2024-09-14T11:56:46.917145+0000","last_became_active":"2024-09-14T11:14:12.149494+0000","last_became_peered":"2024-09-14T11:14:12.149494+0000","last_unstale":"2024-09-14T11:56:46.917145+0000","last_undegraded":"2024-09-14T11:56:46.917145+0000","last_fullsized":"2024-09-14T11:56:46.917145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:46.917046+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.917046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:41.568586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'148","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.748983+0000","last_change":"2024-09-14T11:56:57.748983+0000","last_active":"2024-09-14T11:56:57.748983+0000","last_peered":"2024-09-14T11:56:57.748983+0000","last_clean":"2024-09-14T11:56:57.748983+0000","last_became_active":"2024-09-14T11:14:14.161386+0000","last_became_peered":"2024-09-14T11:14:14.161386+0000","last_unstale":"2024-09-14T11:56:57.748983+0000","last_undegraded":"2024-09-14T11:56:57.748983+0000","last_fullsized":"2024-09-14T11:56:57.748983+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T11:56:57.748848+0000","last_clean_scrub_stamp":"2024-09-14T11:56:57.748848+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:22.383031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":116,"num_write":348,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'422","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832552+0000","last_change":"2024-09-14T11:56:27.832498+0000","last_active":"2024-09-14T11:56:27.832552+0000","last_peered":"2024-09-14T11:56:27.832552+0000","last_clean":"2024-09-14T11:56:27.832552+0000","last_became_active":"2024-09-14T11:14:06.123523+0000","last_became_peered":"2024-09-14T11:14:06.123523+0000","last_unstale":"2024-09-14T11:56:27.832552+0000","last_undegraded":"2024-09-14T11:56:27.832552+0000","last_fullsized":"2024-09-14T11:56:27.832552+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'422","last_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_deep_scrub":"263'422","last_deep_scrub_stamp":"2024-09-14T11:56:27.832415+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832415+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:22.843154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2394,"num_read_kb":2278,"num_write":482,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.528483+0000","last_change":"2024-09-14T11:56:24.528420+0000","last_active":"2024-09-14T11:56:24.528483+0000","last_peered":"2024-09-14T11:56:24.528483+0000","last_clean":"2024-09-14T11:56:24.528483+0000","last_became_active":"2024-09-14T11:14:04.131231+0000","last_became_peered":"2024-09-14T11:14:04.131231+0000","last_unstale":"2024-09-14T11:56:24.528483+0000","last_undegraded":"2024-09-14T11:56:24.528483+0000","last_fullsized":"2024-09-14T11:56:24.528483+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:56:24.528314+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.528314+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.890618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":46735,"num_write":1109,"num_write_kb":57394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:39.774071+0000","last_change":"2024-09-14T11:56:39.774007+0000","last_active":"2024-09-14T11:56:39.774071+0000","last_peered":"2024-09-14T11:56:39.774071+0000","last_clean":"2024-09-14T11:56:39.774071+0000","last_became_active":"2024-09-14T11:14:08.137279+0000","last_became_peered":"2024-09-14T11:14:08.137279+0000","last_unstale":"2024-09-14T11:56:39.774071+0000","last_undegraded":"2024-09-14T11:56:39.774071+0000","last_fullsized":"2024-09-14T11:56:39.774071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:39.773918+0000","last_clean_scrub_stamp":"2024-09-14T11:56:39.773918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:01.996446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'87","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.768704+0000","last_change":"2024-09-14T11:56:49.768704+0000","last_active":"2024-09-14T11:56:49.768704+0000","last_peered":"2024-09-14T11:56:49.768704+0000","last_clean":"2024-09-14T11:56:49.768704+0000","last_became_active":"2024-09-14T11:14:10.148228+0000","last_became_peered":"2024-09-14T11:14:10.148228+0000","last_unstale":"2024-09-14T11:56:49.768704+0000","last_undegraded":"2024-09-14T11:56:49.768704+0000","last_fullsized":"2024-09-14T11:56:49.768704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-14T11:56:49.768604+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.768604+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:52.138898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":60,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.229292+0000","last_change":"2024-09-14T11:56:43.229292+0000","last_active":"2024-09-14T11:56:43.229292+0000","last_peered":"2024-09-14T11:56:43.229292+0000","last_clean":"2024-09-14T11:56:43.229292+0000","last_became_active":"2024-09-14T11:14:12.151769+0000","last_became_peered":"2024-09-14T11:14:12.151769+0000","last_unstale":"2024-09-14T11:56:43.229292+0000","last_undegraded":"2024-09-14T11:56:43.229292+0000","last_fullsized":"2024-09-14T11:56:43.229292+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-14T11:56:43.229209+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.229209+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:29.015641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'116","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.420310+0000","last_change":"2024-09-14T11:56:54.420310+0000","last_active":"2024-09-14T11:56:54.420310+0000","last_peered":"2024-09-14T11:56:54.420310+0000","last_clean":"2024-09-14T11:56:54.420310+0000","last_became_active":"2024-09-14T11:14:14.161499+0000","last_became_peered":"2024-09-14T11:14:14.161499+0000","last_unstale":"2024-09-14T11:56:54.420310+0000","last_undegraded":"2024-09-14T11:56:54.420310+0000","last_fullsized":"2024-09-14T11:56:54.420310+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:54.420225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.420225+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:23.804109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":123,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'915","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.792157+0000","last_change":"2024-09-14T11:56:34.792073+0000","last_active":"2024-09-14T11:56:34.792157+0000","last_peered":"2024-09-14T11:56:34.792157+0000","last_clean":"2024-09-14T11:56:34.792157+0000","last_became_active":"2024-09-14T11:14:06.119882+0000","last_became_peered":"2024-09-14T11:14:06.119882+0000","last_unstale":"2024-09-14T11:56:34.792157+0000","last_undegraded":"2024-09-14T11:56:34.792157+0000","last_fullsized":"2024-09-14T11:56:34.792157+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'915","last_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_deep_scrub":"263'915","last_deep_scrub_stamp":"2024-09-14T11:56:34.791978+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.791978+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.186719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4294,"num_read_kb":3811,"num_write":1247,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'328","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.832779+0000","last_change":"2024-09-14T11:56:27.832718+0000","last_active":"2024-09-14T11:56:27.832779+0000","last_peered":"2024-09-14T11:56:27.832779+0000","last_clean":"2024-09-14T11:56:27.832779+0000","last_became_active":"2024-09-14T11:14:04.123079+0000","last_became_peered":"2024-09-14T11:14:04.123079+0000","last_unstale":"2024-09-14T11:56:27.832779+0000","last_undegraded":"2024-09-14T11:56:27.832779+0000","last_fullsized":"2024-09-14T11:56:27.832779+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:56:27.832588+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.832588+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:52.609553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":14579,"num_write":1052,"num_write_kb":25065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.517199+0000","last_change":"2024-09-14T11:56:43.517199+0000","last_active":"2024-09-14T11:56:43.517199+0000","last_peered":"2024-09-14T11:56:43.517199+0000","last_clean":"2024-09-14T11:56:43.517199+0000","last_became_active":"2024-09-14T11:14:08.138063+0000","last_became_peered":"2024-09-14T11:14:08.138063+0000","last_unstale":"2024-09-14T11:56:43.517199+0000","last_undegraded":"2024-09-14T11:56:43.517199+0000","last_fullsized":"2024-09-14T11:56:43.517199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.517088+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.517088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:06.786780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'307","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.686317+0000","last_change":"2024-09-14T11:56:51.686246+0000","last_active":"2024-09-14T11:56:51.686317+0000","last_peered":"2024-09-14T11:56:51.686317+0000","last_clean":"2024-09-14T11:56:51.686317+0000","last_became_active":"2024-09-14T11:14:10.148880+0000","last_became_peered":"2024-09-14T11:14:10.148880+0000","last_unstale":"2024-09-14T11:56:51.686317+0000","last_undegraded":"2024-09-14T11:56:51.686317+0000","last_fullsized":"2024-09-14T11:56:51.686317+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T11:56:51.686158+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.686158+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:06.242376+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":1090,"num_write":404,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.734741+0000","last_change":"2024-09-14T11:56:51.734741+0000","last_active":"2024-09-14T11:56:51.734741+0000","last_peered":"2024-09-14T11:56:51.734741+0000","last_clean":"2024-09-14T11:56:51.734741+0000","last_became_active":"2024-09-14T11:14:12.150336+0000","last_became_peered":"2024-09-14T11:14:12.150336+0000","last_unstale":"2024-09-14T11:56:51.734741+0000","last_undegraded":"2024-09-14T11:56:51.734741+0000","last_fullsized":"2024-09-14T11:56:51.734741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:51.734652+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.734652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:22.887452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'122","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.378277+0000","last_change":"2024-09-14T11:56:55.378277+0000","last_active":"2024-09-14T11:56:55.378277+0000","last_peered":"2024-09-14T11:56:55.378277+0000","last_clean":"2024-09-14T11:56:55.378277+0000","last_became_active":"2024-09-14T11:14:14.158998+0000","last_became_peered":"2024-09-14T11:14:14.158998+0000","last_unstale":"2024-09-14T11:56:55.378277+0000","last_undegraded":"2024-09-14T11:56:55.378277+0000","last_fullsized":"2024-09-14T11:56:55.378277+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:56:55.378185+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.378185+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:20.899163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'488","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.763122+0000","last_change":"2024-09-14T11:56:33.763020+0000","last_active":"2024-09-14T11:56:33.763122+0000","last_peered":"2024-09-14T11:56:33.763122+0000","last_clean":"2024-09-14T11:56:33.763122+0000","last_became_active":"2024-09-14T11:14:06.119935+0000","last_became_peered":"2024-09-14T11:14:06.119935+0000","last_unstale":"2024-09-14T11:56:33.763122+0000","last_undegraded":"2024-09-14T11:56:33.763122+0000","last_fullsized":"2024-09-14T11:56:33.763122+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:33.762877+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.762877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:10.689175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2569,"num_read_kb":2412,"num_write":556,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'370","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.799237+0000","last_change":"2024-09-14T11:56:28.799145+0000","last_active":"2024-09-14T11:56:28.799237+0000","last_peered":"2024-09-14T11:56:28.799237+0000","last_clean":"2024-09-14T11:56:28.799237+0000","last_became_active":"2024-09-14T11:14:04.127265+0000","last_became_peered":"2024-09-14T11:14:04.127265+0000","last_unstale":"2024-09-14T11:56:28.799237+0000","last_undegraded":"2024-09-14T11:56:28.799237+0000","last_fullsized":"2024-09-14T11:56:28.799237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:28.799019+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.799019+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.449897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":130241,"num_write":1190,"num_write_kb":33681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.755551+0000","last_change":"2024-09-14T11:56:47.755551+0000","last_active":"2024-09-14T11:56:47.755551+0000","last_peered":"2024-09-14T11:56:47.755551+0000","last_clean":"2024-09-14T11:56:47.755551+0000","last_became_active":"2024-09-14T11:14:08.133127+0000","last_became_peered":"2024-09-14T11:14:08.133127+0000","last_unstale":"2024-09-14T11:56:47.755551+0000","last_undegraded":"2024-09-14T11:56:47.755551+0000","last_fullsized":"2024-09-14T11:56:47.755551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:47.755450+0000","last_clean_scrub_stamp":"2024-09-14T11:56:47.755450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:19.691984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'267","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:46.650690+0000","last_change":"2024-09-14T11:56:46.650622+0000","last_active":"2024-09-14T11:56:46.650690+0000","last_peered":"2024-09-14T11:56:46.650690+0000","last_clean":"2024-09-14T11:56:46.650690+0000","last_became_active":"2024-09-14T11:14:10.151743+0000","last_became_peered":"2024-09-14T11:14:10.151743+0000","last_unstale":"2024-09-14T11:56:46.650690+0000","last_undegraded":"2024-09-14T11:56:46.650690+0000","last_fullsized":"2024-09-14T11:56:46.650690+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T11:56:46.650528+0000","last_clean_scrub_stamp":"2024-09-14T11:56:46.650528+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:11.329743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":976,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.218389+0000","last_change":"2024-09-14T11:56:42.218389+0000","last_active":"2024-09-14T11:56:42.218389+0000","last_peered":"2024-09-14T11:56:42.218389+0000","last_clean":"2024-09-14T11:56:42.218389+0000","last_became_active":"2024-09-14T11:14:12.151209+0000","last_became_peered":"2024-09-14T11:14:12.151209+0000","last_unstale":"2024-09-14T11:56:42.218389+0000","last_undegraded":"2024-09-14T11:56:42.218389+0000","last_fullsized":"2024-09-14T11:56:42.218389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:42.218303+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.218303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:15.862892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'146","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:00.141951+0000","last_change":"2024-09-14T11:57:00.141951+0000","last_active":"2024-09-14T11:57:00.141951+0000","last_peered":"2024-09-14T11:57:00.141951+0000","last_clean":"2024-09-14T11:57:00.141951+0000","last_became_active":"2024-09-14T11:14:14.152989+0000","last_became_peered":"2024-09-14T11:14:14.152989+0000","last_unstale":"2024-09-14T11:57:00.141951+0000","last_undegraded":"2024-09-14T11:57:00.141951+0000","last_fullsized":"2024-09-14T11:57:00.141951+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:57:00.141868+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:57:00.141868+0000","last_clean_scrub_stamp":"2024-09-14T11:57:00.141868+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:43.617119+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":225,"num_write":367,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'329","reported_seq":1768,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.031151+0000","last_change":"2024-09-14T11:56:32.031151+0000","last_active":"2024-09-14T11:56:32.031151+0000","last_peered":"2024-09-14T11:56:32.031151+0000","last_clean":"2024-09-14T11:56:32.031151+0000","last_became_active":"2024-09-14T11:14:06.118672+0000","last_became_peered":"2024-09-14T11:14:06.118672+0000","last_unstale":"2024-09-14T11:56:32.031151+0000","last_undegraded":"2024-09-14T11:56:32.031151+0000","last_fullsized":"2024-09-14T11:56:32.031151+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:32.031055+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.031055+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:39.902095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1936,"num_read_kb":1858,"num_write":369,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'364","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:28.015176+0000","last_change":"2024-09-14T11:56:28.015176+0000","last_active":"2024-09-14T11:56:28.015176+0000","last_peered":"2024-09-14T11:56:28.015176+0000","last_clean":"2024-09-14T11:56:28.015176+0000","last_became_active":"2024-09-14T11:14:04.123296+0000","last_became_peered":"2024-09-14T11:14:04.123296+0000","last_unstale":"2024-09-14T11:56:28.015176+0000","last_undegraded":"2024-09-14T11:56:28.015176+0000","last_fullsized":"2024-09-14T11:56:28.015176+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:56:28.015080+0000","last_clean_scrub_stamp":"2024-09-14T11:56:28.015080+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:02.166337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":584,"num_read_kb":1005,"num_write":1035,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.784105+0000","last_change":"2024-09-14T11:56:43.784036+0000","last_active":"2024-09-14T11:56:43.784105+0000","last_peered":"2024-09-14T11:56:43.784105+0000","last_clean":"2024-09-14T11:56:43.784105+0000","last_became_active":"2024-09-14T11:14:08.137135+0000","last_became_peered":"2024-09-14T11:14:08.137135+0000","last_unstale":"2024-09-14T11:56:43.784105+0000","last_undegraded":"2024-09-14T11:56:43.784105+0000","last_fullsized":"2024-09-14T11:56:43.784105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:43.783954+0000","last_clean_scrub_stamp":"2024-09-14T11:56:43.783954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:02.643027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'229","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.289568+0000","last_change":"2024-09-14T11:56:49.289568+0000","last_active":"2024-09-14T11:56:49.289568+0000","last_peered":"2024-09-14T11:56:49.289568+0000","last_clean":"2024-09-14T11:56:49.289568+0000","last_became_active":"2024-09-14T11:14:10.154719+0000","last_became_peered":"2024-09-14T11:14:10.154719+0000","last_unstale":"2024-09-14T11:56:49.289568+0000","last_undegraded":"2024-09-14T11:56:49.289568+0000","last_fullsized":"2024-09-14T11:56:49.289568+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'229","last_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_deep_scrub":"263'229","last_deep_scrub_stamp":"2024-09-14T11:56:49.289489+0000","last_clean_scrub_stamp":"2024-09-14T11:56:49.289489+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:54.229919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42562,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":375,"num_read_kb":904,"num_write":304,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.788551+0000","last_change":"2024-09-14T11:56:52.788551+0000","last_active":"2024-09-14T11:56:52.788551+0000","last_peered":"2024-09-14T11:56:52.788551+0000","last_clean":"2024-09-14T11:56:52.788551+0000","last_became_active":"2024-09-14T11:14:12.150374+0000","last_became_peered":"2024-09-14T11:14:12.150374+0000","last_unstale":"2024-09-14T11:56:52.788551+0000","last_undegraded":"2024-09-14T11:56:52.788551+0000","last_fullsized":"2024-09-14T11:56:52.788551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:52.788452+0000","last_clean_scrub_stamp":"2024-09-14T11:56:52.788452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:09.126403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:56.357385+0000","last_change":"2024-09-14T11:56:56.357385+0000","last_active":"2024-09-14T11:56:56.357385+0000","last_peered":"2024-09-14T11:56:56.357385+0000","last_clean":"2024-09-14T11:56:56.357385+0000","last_became_active":"2024-09-14T11:14:14.159078+0000","last_became_peered":"2024-09-14T11:14:14.159078+0000","last_unstale":"2024-09-14T11:56:56.357385+0000","last_undegraded":"2024-09-14T11:56:56.357385+0000","last_fullsized":"2024-09-14T11:56:56.357385+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-14T11:56:56.357285+0000","last_clean_scrub_stamp":"2024-09-14T11:56:56.357285+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:54.981854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":864,"num_read_kb":836,"num_write":358,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'776","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.730139+0000","last_change":"2024-09-14T11:56:32.730074+0000","last_active":"2024-09-14T11:56:32.730139+0000","last_peered":"2024-09-14T11:56:32.730139+0000","last_clean":"2024-09-14T11:56:32.730139+0000","last_became_active":"2024-09-14T11:14:06.129979+0000","last_became_peered":"2024-09-14T11:14:06.129979+0000","last_unstale":"2024-09-14T11:56:32.730139+0000","last_undegraded":"2024-09-14T11:56:32.730139+0000","last_fullsized":"2024-09-14T11:56:32.730139+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:56:32.729983+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.729983+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.217638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3431,"num_write":1024,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'335","reported_seq":998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.542389+0000","last_change":"2024-09-14T11:56:26.542389+0000","last_active":"2024-09-14T11:56:26.542389+0000","last_peered":"2024-09-14T11:56:26.542389+0000","last_clean":"2024-09-14T11:56:26.542389+0000","last_became_active":"2024-09-14T11:14:04.128421+0000","last_became_peered":"2024-09-14T11:14:04.128421+0000","last_unstale":"2024-09-14T11:56:26.542389+0000","last_undegraded":"2024-09-14T11:56:26.542389+0000","last_fullsized":"2024-09-14T11:56:26.542389+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T11:56:26.542240+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.542240+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:49.477686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":673,"num_read_kb":5062,"num_write":1074,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.726990+0000","last_change":"2024-09-14T11:56:38.726990+0000","last_active":"2024-09-14T11:56:38.726990+0000","last_peered":"2024-09-14T11:56:38.726990+0000","last_clean":"2024-09-14T11:56:38.726990+0000","last_became_active":"2024-09-14T11:14:08.133960+0000","last_became_peered":"2024-09-14T11:14:08.133960+0000","last_unstale":"2024-09-14T11:56:38.726990+0000","last_undegraded":"2024-09-14T11:56:38.726990+0000","last_fullsized":"2024-09-14T11:56:38.726990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:56:38.726904+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.726904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.234751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'320","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.751007+0000","last_change":"2024-09-14T11:56:51.751007+0000","last_active":"2024-09-14T11:56:51.751007+0000","last_peered":"2024-09-14T11:56:51.751007+0000","last_clean":"2024-09-14T11:56:51.751007+0000","last_became_active":"2024-09-14T11:14:10.151251+0000","last_became_peered":"2024-09-14T11:14:10.151251+0000","last_unstale":"2024-09-14T11:56:51.751007+0000","last_undegraded":"2024-09-14T11:56:51.751007+0000","last_fullsized":"2024-09-14T11:56:51.751007+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-14T11:56:51.750913+0000","last_clean_scrub_stamp":"2024-09-14T11:56:51.750913+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:18.147199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46942,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":1100,"num_write":410,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:54.790033+0000","last_change":"2024-09-14T11:56:54.790033+0000","last_active":"2024-09-14T11:56:54.790033+0000","last_peered":"2024-09-14T11:56:54.790033+0000","last_clean":"2024-09-14T11:56:54.790033+0000","last_became_active":"2024-09-14T11:14:12.149106+0000","last_became_peered":"2024-09-14T11:14:12.149106+0000","last_unstale":"2024-09-14T11:56:54.790033+0000","last_undegraded":"2024-09-14T11:56:54.790033+0000","last_fullsized":"2024-09-14T11:56:54.790033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:56:54.789942+0000","last_clean_scrub_stamp":"2024-09-14T11:56:54.789942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:54.043254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'116","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:55.881093+0000","last_change":"2024-09-14T11:56:55.881093+0000","last_active":"2024-09-14T11:56:55.881093+0000","last_peered":"2024-09-14T11:56:55.881093+0000","last_clean":"2024-09-14T11:56:55.881093+0000","last_became_active":"2024-09-14T11:14:14.159915+0000","last_became_peered":"2024-09-14T11:14:14.159915+0000","last_unstale":"2024-09-14T11:56:55.881093+0000","last_undegraded":"2024-09-14T11:56:55.881093+0000","last_fullsized":"2024-09-14T11:56:55.881093+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-14T11:56:55.881013+0000","last_clean_scrub_stamp":"2024-09-14T11:56:55.881013+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.948640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":91,"num_write":259,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'436","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.789997+0000","last_change":"2024-09-14T11:56:35.789928+0000","last_active":"2024-09-14T11:56:35.789997+0000","last_peered":"2024-09-14T11:56:35.789997+0000","last_clean":"2024-09-14T11:56:35.789997+0000","last_became_active":"2024-09-14T11:14:06.130029+0000","last_became_peered":"2024-09-14T11:14:06.130029+0000","last_unstale":"2024-09-14T11:56:35.789997+0000","last_undegraded":"2024-09-14T11:56:35.789997+0000","last_fullsized":"2024-09-14T11:56:35.789997+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:56:35.789837+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.789837+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:13.884434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2110,"num_write":514,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'388","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.147968+0000","last_change":"2024-09-14T11:56:25.147968+0000","last_active":"2024-09-14T11:56:25.147968+0000","last_peered":"2024-09-14T11:56:25.147968+0000","last_clean":"2024-09-14T11:56:25.147968+0000","last_became_active":"2024-09-14T11:14:04.137032+0000","last_became_peered":"2024-09-14T11:14:04.137032+0000","last_unstale":"2024-09-14T11:56:25.147968+0000","last_undegraded":"2024-09-14T11:56:25.147968+0000","last_fullsized":"2024-09-14T11:56:25.147968+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T11:56:25.147865+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.147865+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:36.906313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":31613,"num_write":1284,"num_write_kb":28706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'539","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.747410+0000","last_change":"2024-09-14T11:56:34.747353+0000","last_active":"2024-09-14T11:56:34.747410+0000","last_peered":"2024-09-14T11:56:34.747410+0000","last_clean":"2024-09-14T11:56:34.747410+0000","last_became_active":"2024-09-14T11:14:06.126842+0000","last_became_peered":"2024-09-14T11:14:06.126842+0000","last_unstale":"2024-09-14T11:56:34.747410+0000","last_undegraded":"2024-09-14T11:56:34.747410+0000","last_fullsized":"2024-09-14T11:56:34.747410+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'539","last_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_deep_scrub":"263'539","last_deep_scrub_stamp":"2024-09-14T11:56:34.747258+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.747258+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:30.313926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2920,"num_read_kb":2760,"num_write":661,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'380","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.841288+0000","last_change":"2024-09-14T11:56:25.841288+0000","last_active":"2024-09-14T11:56:25.841288+0000","last_peered":"2024-09-14T11:56:25.841288+0000","last_clean":"2024-09-14T11:56:25.841288+0000","last_became_active":"2024-09-14T11:14:04.118333+0000","last_became_peered":"2024-09-14T11:14:04.118333+0000","last_unstale":"2024-09-14T11:56:25.841288+0000","last_undegraded":"2024-09-14T11:56:25.841288+0000","last_fullsized":"2024-09-14T11:56:25.841288+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'380","last_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_deep_scrub":"263'380","last_deep_scrub_stamp":"2024-09-14T11:56:25.841167+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.841167+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:26.025310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":579,"num_read_kb":5548,"num_write":1128,"num_write_kb":24075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1192","reported_seq":2828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.736572+0000","last_change":"2024-09-14T11:56:38.736512+0000","last_active":"2024-09-14T11:56:38.736572+0000","last_peered":"2024-09-14T11:56:38.736572+0000","last_clean":"2024-09-14T11:56:38.736572+0000","last_became_active":"2024-09-14T11:14:06.123491+0000","last_became_peered":"2024-09-14T11:14:06.123491+0000","last_unstale":"2024-09-14T11:56:38.736572+0000","last_undegraded":"2024-09-14T11:56:38.736572+0000","last_fullsized":"2024-09-14T11:56:38.736572+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1192","last_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_deep_scrub":"263'1192","last_deep_scrub_stamp":"2024-09-14T11:56:38.736423+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.736423+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.672754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5426,"num_read_kb":4804,"num_write":1633,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'389","reported_seq":1098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:30.805721+0000","last_change":"2024-09-14T11:56:30.805721+0000","last_active":"2024-09-14T11:56:30.805721+0000","last_peered":"2024-09-14T11:56:30.805721+0000","last_clean":"2024-09-14T11:56:30.805721+0000","last_became_active":"2024-09-14T11:14:04.123986+0000","last_became_peered":"2024-09-14T11:14:04.123986+0000","last_unstale":"2024-09-14T11:56:30.805721+0000","last_undegraded":"2024-09-14T11:56:30.805721+0000","last_fullsized":"2024-09-14T11:56:30.805721+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:56:30.805550+0000","last_clean_scrub_stamp":"2024-09-14T11:56:30.805550+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:51.121985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":792,"num_read_kb":86471,"num_write":1353,"num_write_kb":42681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'463","reported_seq":2206,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.766981+0000","last_change":"2024-09-14T11:56:33.766924+0000","last_active":"2024-09-14T11:56:33.766981+0000","last_peered":"2024-09-14T11:56:33.766981+0000","last_clean":"2024-09-14T11:56:33.766981+0000","last_became_active":"2024-09-14T11:14:06.123924+0000","last_became_peered":"2024-09-14T11:14:06.123924+0000","last_unstale":"2024-09-14T11:56:33.766981+0000","last_undegraded":"2024-09-14T11:56:33.766981+0000","last_fullsized":"2024-09-14T11:56:33.766981+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-14T11:56:33.766839+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.766839+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:15.603752+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2719,"num_read_kb":2587,"num_write":516,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2774,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.568939+0000","last_change":"2024-09-14T11:56:25.568939+0000","last_active":"2024-09-14T11:56:25.568939+0000","last_peered":"2024-09-14T11:56:25.568939+0000","last_clean":"2024-09-14T11:56:25.568939+0000","last_became_active":"2024-09-14T11:14:04.123025+0000","last_became_peered":"2024-09-14T11:14:04.123025+0000","last_unstale":"2024-09-14T11:56:25.568939+0000","last_undegraded":"2024-09-14T11:56:25.568939+0000","last_fullsized":"2024-09-14T11:56:25.568939+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:56:25.568822+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.568822+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.874889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":9527,"num_write":1076,"num_write_kb":28490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'418","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:34.093331+0000","last_change":"2024-09-14T11:56:34.093331+0000","last_active":"2024-09-14T11:56:34.093331+0000","last_peered":"2024-09-14T11:56:34.093331+0000","last_clean":"2024-09-14T11:56:34.093331+0000","last_became_active":"2024-09-14T11:14:06.128108+0000","last_became_peered":"2024-09-14T11:14:06.128108+0000","last_unstale":"2024-09-14T11:56:34.093331+0000","last_undegraded":"2024-09-14T11:56:34.093331+0000","last_fullsized":"2024-09-14T11:56:34.093331+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-14T11:56:34.093235+0000","last_clean_scrub_stamp":"2024-09-14T11:56:34.093235+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:56.415972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2289,"num_read_kb":2188,"num_write":468,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'329","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.009924+0000","last_change":"2024-09-14T11:56:25.009840+0000","last_active":"2024-09-14T11:56:25.009924+0000","last_peered":"2024-09-14T11:56:25.009924+0000","last_clean":"2024-09-14T11:56:25.009924+0000","last_became_active":"2024-09-14T11:14:04.122487+0000","last_became_peered":"2024-09-14T11:14:04.122487+0000","last_unstale":"2024-09-14T11:56:25.009924+0000","last_undegraded":"2024-09-14T11:56:25.009924+0000","last_fullsized":"2024-09-14T11:56:25.009924+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:56:25.009692+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.009692+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:51.768321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":10973,"num_write":1149,"num_write_kb":34758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'781","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.772231+0000","last_change":"2024-09-14T11:56:35.772231+0000","last_active":"2024-09-14T11:56:35.772231+0000","last_peered":"2024-09-14T11:56:35.772231+0000","last_clean":"2024-09-14T11:56:35.772231+0000","last_became_active":"2024-09-14T11:14:06.129958+0000","last_became_peered":"2024-09-14T11:14:06.129958+0000","last_unstale":"2024-09-14T11:56:35.772231+0000","last_undegraded":"2024-09-14T11:56:35.772231+0000","last_fullsized":"2024-09-14T11:56:35.772231+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T11:56:35.772148+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.772148+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:57.596143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3734,"num_read_kb":3357,"num_write":1042,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'404","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:24.849831+0000","last_change":"2024-09-14T11:56:24.849765+0000","last_active":"2024-09-14T11:56:24.849831+0000","last_peered":"2024-09-14T11:56:24.849831+0000","last_clean":"2024-09-14T11:56:24.849831+0000","last_became_active":"2024-09-14T11:14:04.112158+0000","last_became_peered":"2024-09-14T11:14:04.112158+0000","last_unstale":"2024-09-14T11:56:24.849831+0000","last_undegraded":"2024-09-14T11:56:24.849831+0000","last_fullsized":"2024-09-14T11:56:24.849831+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:56:24.849561+0000","last_clean_scrub_stamp":"2024-09-14T11:56:24.849561+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:56:14.537929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":959,"num_read_kb":11029,"num_write":1184,"num_write_kb":37060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'411","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.179313+0000","last_change":"2024-09-14T11:56:37.179313+0000","last_active":"2024-09-14T11:56:37.179313+0000","last_peered":"2024-09-14T11:56:37.179313+0000","last_clean":"2024-09-14T11:56:37.179313+0000","last_became_active":"2024-09-14T11:14:06.116620+0000","last_became_peered":"2024-09-14T11:14:06.116620+0000","last_unstale":"2024-09-14T11:56:37.179313+0000","last_undegraded":"2024-09-14T11:56:37.179313+0000","last_fullsized":"2024-09-14T11:56:37.179313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T11:56:37.179225+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.179225+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:59.876690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2207,"num_read_kb":2106,"num_write":475,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'401","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.896659+0000","last_change":"2024-09-14T11:56:33.896659+0000","last_active":"2024-09-14T11:56:33.896659+0000","last_peered":"2024-09-14T11:56:33.896659+0000","last_clean":"2024-09-14T11:56:33.896659+0000","last_became_active":"2024-09-14T11:14:38.341536+0000","last_became_peered":"2024-09-14T11:14:38.341536+0000","last_unstale":"2024-09-14T11:56:33.896659+0000","last_undegraded":"2024-09-14T11:56:33.896659+0000","last_fullsized":"2024-09-14T11:56:33.896659+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:56:33.896569+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.896569+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:18.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":972,"num_read_kb":685,"num_write":1240,"num_write_kb":25586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'544","reported_seq":2170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.194969+0000","last_change":"2024-09-14T11:56:33.194969+0000","last_active":"2024-09-14T11:56:33.194969+0000","last_peered":"2024-09-14T11:56:33.194969+0000","last_clean":"2024-09-14T11:56:33.194969+0000","last_became_active":"2024-09-14T11:14:06.128782+0000","last_became_peered":"2024-09-14T11:14:06.128782+0000","last_unstale":"2024-09-14T11:56:33.194969+0000","last_undegraded":"2024-09-14T11:56:33.194969+0000","last_fullsized":"2024-09-14T11:56:33.194969+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T11:56:33.194868+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.194868+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.778340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2892,"num_read_kb":2667,"num_write":679,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'301","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:25.998316+0000","last_change":"2024-09-14T11:56:25.998258+0000","last_active":"2024-09-14T11:56:25.998316+0000","last_peered":"2024-09-14T11:56:25.998316+0000","last_clean":"2024-09-14T11:56:25.998316+0000","last_became_active":"2024-09-14T11:14:04.135921+0000","last_became_peered":"2024-09-14T11:14:04.135921+0000","last_unstale":"2024-09-14T11:56:25.998316+0000","last_undegraded":"2024-09-14T11:56:25.998316+0000","last_fullsized":"2024-09-14T11:56:25.998316+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:56:25.998152+0000","last_clean_scrub_stamp":"2024-09-14T11:56:25.998152+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:52.475288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":918,"num_read_kb":80980,"num_write":1012,"num_write_kb":55118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'491","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.541399+0000","last_change":"2024-09-14T11:56:35.541399+0000","last_active":"2024-09-14T11:56:35.541399+0000","last_peered":"2024-09-14T11:56:35.541399+0000","last_clean":"2024-09-14T11:56:35.541399+0000","last_became_active":"2024-09-14T11:14:06.133811+0000","last_became_peered":"2024-09-14T11:14:06.133811+0000","last_unstale":"2024-09-14T11:56:35.541399+0000","last_undegraded":"2024-09-14T11:56:35.541399+0000","last_fullsized":"2024-09-14T11:56:35.541399+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:56:35.541315+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.541315+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:49.815826+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2698,"num_read_kb":2541,"num_write":586,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'332","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.804469+0000","last_change":"2024-09-14T11:56:29.804378+0000","last_active":"2024-09-14T11:56:29.804469+0000","last_peered":"2024-09-14T11:56:29.804469+0000","last_clean":"2024-09-14T11:56:29.804469+0000","last_became_active":"2024-09-14T11:14:04.120411+0000","last_became_peered":"2024-09-14T11:14:04.120411+0000","last_unstale":"2024-09-14T11:56:29.804469+0000","last_undegraded":"2024-09-14T11:56:29.804469+0000","last_fullsized":"2024-09-14T11:56:29.804469+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:56:29.804272+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.804272+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:56.088992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":85643,"num_write":979,"num_write_kb":27924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'423","reported_seq":1938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.710966+0000","last_change":"2024-09-14T11:56:37.710966+0000","last_active":"2024-09-14T11:56:37.710966+0000","last_peered":"2024-09-14T11:56:37.710966+0000","last_clean":"2024-09-14T11:56:37.710966+0000","last_became_active":"2024-09-14T11:14:06.120785+0000","last_became_peered":"2024-09-14T11:14:06.120785+0000","last_unstale":"2024-09-14T11:56:37.710966+0000","last_undegraded":"2024-09-14T11:56:37.710966+0000","last_fullsized":"2024-09-14T11:56:37.710966+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'423","last_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_deep_scrub":"263'423","last_deep_scrub_stamp":"2024-09-14T11:56:37.710871+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.710871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:32.054722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2219,"num_read_kb":2099,"num_write":461,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'365","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.007712+0000","last_change":"2024-09-14T11:56:27.007610+0000","last_active":"2024-09-14T11:56:27.007712+0000","last_peered":"2024-09-14T11:56:27.007712+0000","last_clean":"2024-09-14T11:56:27.007712+0000","last_became_active":"2024-09-14T11:14:04.117937+0000","last_became_peered":"2024-09-14T11:14:04.117937+0000","last_unstale":"2024-09-14T11:56:27.007712+0000","last_undegraded":"2024-09-14T11:56:27.007712+0000","last_fullsized":"2024-09-14T11:56:27.007712+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'365","last_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_deep_scrub":"263'365","last_deep_scrub_stamp":"2024-09-14T11:56:27.007472+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.007472+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:43.410193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":571,"num_read_kb":30121,"num_write":1035,"num_write_kb":44036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'415","reported_seq":1913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:29.869970+0000","last_change":"2024-09-14T11:56:29.869913+0000","last_active":"2024-09-14T11:56:29.869970+0000","last_peered":"2024-09-14T11:56:29.869970+0000","last_clean":"2024-09-14T11:56:29.869970+0000","last_became_active":"2024-09-14T11:14:06.131980+0000","last_became_peered":"2024-09-14T11:14:06.131980+0000","last_unstale":"2024-09-14T11:56:29.869970+0000","last_undegraded":"2024-09-14T11:56:29.869970+0000","last_fullsized":"2024-09-14T11:56:29.869970+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-14T11:56:29.869818+0000","last_clean_scrub_stamp":"2024-09-14T11:56:29.869818+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:11.490799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2261,"num_write":501,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'339","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:31.844135+0000","last_change":"2024-09-14T11:56:31.844066+0000","last_active":"2024-09-14T11:56:31.844135+0000","last_peered":"2024-09-14T11:56:31.844135+0000","last_clean":"2024-09-14T11:56:31.844135+0000","last_became_active":"2024-09-14T11:14:04.131352+0000","last_became_peered":"2024-09-14T11:14:04.131352+0000","last_unstale":"2024-09-14T11:56:31.844135+0000","last_undegraded":"2024-09-14T11:56:31.844135+0000","last_fullsized":"2024-09-14T11:56:31.844135+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:56:31.843966+0000","last_clean_scrub_stamp":"2024-09-14T11:56:31.843966+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:29.756203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":61948,"num_write":1043,"num_write_kb":25037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'816","reported_seq":2408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.728869+0000","last_change":"2024-09-14T11:56:36.728783+0000","last_active":"2024-09-14T11:56:36.728869+0000","last_peered":"2024-09-14T11:56:36.728869+0000","last_clean":"2024-09-14T11:56:36.728869+0000","last_became_active":"2024-09-14T11:14:06.130023+0000","last_became_peered":"2024-09-14T11:14:06.130023+0000","last_unstale":"2024-09-14T11:56:36.728869+0000","last_undegraded":"2024-09-14T11:56:36.728869+0000","last_fullsized":"2024-09-14T11:56:36.728869+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'816","last_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_deep_scrub":"263'816","last_deep_scrub_stamp":"2024-09-14T11:56:36.728665+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.728665+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:46.867994+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4116,"num_read_kb":3725,"num_write":1100,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'300","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.563332+0000","last_change":"2024-09-14T11:56:27.563220+0000","last_active":"2024-09-14T11:56:27.563332+0000","last_peered":"2024-09-14T11:56:27.563332+0000","last_clean":"2024-09-14T11:56:27.563332+0000","last_became_active":"2024-09-14T11:14:04.136744+0000","last_became_peered":"2024-09-14T11:14:04.136744+0000","last_unstale":"2024-09-14T11:56:27.563332+0000","last_undegraded":"2024-09-14T11:56:27.563332+0000","last_fullsized":"2024-09-14T11:56:27.563332+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:56:27.563050+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.563050+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.198569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":411,"num_read_kb":33889,"num_write":889,"num_write_kb":39055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'382","reported_seq":1844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:36.559856+0000","last_change":"2024-09-14T11:56:36.559792+0000","last_active":"2024-09-14T11:56:36.559856+0000","last_peered":"2024-09-14T11:56:36.559856+0000","last_clean":"2024-09-14T11:56:36.559856+0000","last_became_active":"2024-09-14T11:14:06.129825+0000","last_became_peered":"2024-09-14T11:14:06.129825+0000","last_unstale":"2024-09-14T11:56:36.559856+0000","last_undegraded":"2024-09-14T11:56:36.559856+0000","last_fullsized":"2024-09-14T11:56:36.559856+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:56:36.559698+0000","last_clean_scrub_stamp":"2024-09-14T11:56:36.559698+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:41.726328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2064,"num_write":432,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'392","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:26.192131+0000","last_change":"2024-09-14T11:56:26.192037+0000","last_active":"2024-09-14T11:56:26.192131+0000","last_peered":"2024-09-14T11:56:26.192131+0000","last_clean":"2024-09-14T11:56:26.192131+0000","last_became_active":"2024-09-14T11:14:38.194752+0000","last_became_peered":"2024-09-14T11:14:38.194752+0000","last_unstale":"2024-09-14T11:56:26.192131+0000","last_undegraded":"2024-09-14T11:56:26.192131+0000","last_fullsized":"2024-09-14T11:56:26.192131+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:56:26.191880+0000","last_clean_scrub_stamp":"2024-09-14T11:56:26.191880+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:58.808289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":18574,"num_write":1251,"num_write_kb":31866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0],"acting":[6,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'501","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.513475+0000","last_change":"2024-09-14T11:56:33.513417+0000","last_active":"2024-09-14T11:56:33.513475+0000","last_peered":"2024-09-14T11:56:33.513475+0000","last_clean":"2024-09-14T11:56:33.513475+0000","last_became_active":"2024-09-14T11:14:06.124757+0000","last_became_peered":"2024-09-14T11:14:06.124757+0000","last_unstale":"2024-09-14T11:56:33.513475+0000","last_undegraded":"2024-09-14T11:56:33.513475+0000","last_fullsized":"2024-09-14T11:56:33.513475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'501","last_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_deep_scrub":"263'501","last_deep_scrub_stamp":"2024-09-14T11:56:33.513326+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.513326+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.516314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2658,"num_read_kb":2496,"num_write":603,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'488","reported_seq":1225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:35.533695+0000","last_change":"2024-09-14T11:56:35.533626+0000","last_active":"2024-09-14T11:56:35.533695+0000","last_peered":"2024-09-14T11:56:35.533695+0000","last_clean":"2024-09-14T11:56:35.533695+0000","last_became_active":"2024-09-14T11:14:04.135360+0000","last_became_peered":"2024-09-14T11:14:04.135360+0000","last_unstale":"2024-09-14T11:56:35.533695+0000","last_undegraded":"2024-09-14T11:56:35.533695+0000","last_fullsized":"2024-09-14T11:56:35.533695+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'488","last_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_deep_scrub":"263'488","last_deep_scrub_stamp":"2024-09-14T11:56:35.533523+0000","last_clean_scrub_stamp":"2024-09-14T11:56:35.533523+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.931408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1169,"num_read_kb":1914,"num_write":1411,"num_write_kb":36194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.265684+0000","last_change":"2024-09-14T11:56:42.265618+0000","last_active":"2024-09-14T11:56:42.265684+0000","last_peered":"2024-09-14T11:56:42.265684+0000","last_clean":"2024-09-14T11:56:42.265684+0000","last_became_active":"2024-09-14T11:14:06.128316+0000","last_became_peered":"2024-09-14T11:14:06.128316+0000","last_unstale":"2024-09-14T11:56:42.265684+0000","last_undegraded":"2024-09-14T11:56:42.265684+0000","last_fullsized":"2024-09-14T11:56:42.265684+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:56:42.265519+0000","last_clean_scrub_stamp":"2024-09-14T11:56:42.265519+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:45.913918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2699,"num_read_kb":2530,"num_write":566,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1365,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'370","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.845355+0000","last_change":"2024-09-14T11:56:38.845355+0000","last_active":"2024-09-14T11:56:38.845355+0000","last_peered":"2024-09-14T11:56:38.845355+0000","last_clean":"2024-09-14T11:56:38.845355+0000","last_became_active":"2024-09-14T11:14:04.117465+0000","last_became_peered":"2024-09-14T11:14:04.117465+0000","last_unstale":"2024-09-14T11:56:38.845355+0000","last_undegraded":"2024-09-14T11:56:38.845355+0000","last_fullsized":"2024-09-14T11:56:38.845355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:56:38.845248+0000","last_clean_scrub_stamp":"2024-09-14T11:56:38.845248+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:52.872233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":47810,"num_write":1093,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'445","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.440336+0000","last_change":"2024-09-14T11:56:33.440280+0000","last_active":"2024-09-14T11:56:33.440336+0000","last_peered":"2024-09-14T11:56:33.440336+0000","last_clean":"2024-09-14T11:56:33.440336+0000","last_became_active":"2024-09-14T11:14:06.122984+0000","last_became_peered":"2024-09-14T11:14:06.122984+0000","last_unstale":"2024-09-14T11:56:33.440336+0000","last_undegraded":"2024-09-14T11:56:33.440336+0000","last_fullsized":"2024-09-14T11:56:33.440336+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'445","last_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_deep_scrub":"263'445","last_deep_scrub_stamp":"2024-09-14T11:56:33.440166+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.440166+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:03.203426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2406,"num_read_kb":2255,"num_write":536,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'341","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.814186+0000","last_change":"2024-09-14T11:56:32.814186+0000","last_active":"2024-09-14T11:56:32.814186+0000","last_peered":"2024-09-14T11:56:32.814186+0000","last_clean":"2024-09-14T11:56:32.814186+0000","last_became_active":"2024-09-14T11:14:04.128391+0000","last_became_peered":"2024-09-14T11:14:04.128391+0000","last_unstale":"2024-09-14T11:56:32.814186+0000","last_undegraded":"2024-09-14T11:56:32.814186+0000","last_fullsized":"2024-09-14T11:56:32.814186+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:56:32.814090+0000","last_clean_scrub_stamp":"2024-09-14T11:56:32.814090+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:19.660032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":86520,"num_write":1169,"num_write_kb":47747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.824437+0000","last_change":"2024-09-14T11:56:33.824437+0000","last_active":"2024-09-14T11:56:33.824437+0000","last_peered":"2024-09-14T11:56:33.824437+0000","last_clean":"2024-09-14T11:56:33.824437+0000","last_became_active":"2024-09-14T11:14:38.193170+0000","last_became_peered":"2024-09-14T11:14:38.193170+0000","last_unstale":"2024-09-14T11:56:33.824437+0000","last_undegraded":"2024-09-14T11:56:33.824437+0000","last_fullsized":"2024-09-14T11:56:33.824437+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T11:56:33.824296+0000","last_clean_scrub_stamp":"2024-09-14T11:56:33.824296+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:37.946754+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603149,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":20028,"num_write":1055,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'502","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.620855+0000","last_change":"2024-09-14T11:56:37.620855+0000","last_active":"2024-09-14T11:56:37.620855+0000","last_peered":"2024-09-14T11:56:37.620855+0000","last_clean":"2024-09-14T11:56:37.620855+0000","last_became_active":"2024-09-14T11:14:06.133844+0000","last_became_peered":"2024-09-14T11:14:06.133844+0000","last_unstale":"2024-09-14T11:56:37.620855+0000","last_undegraded":"2024-09-14T11:56:37.620855+0000","last_fullsized":"2024-09-14T11:56:37.620855+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:56:37.620756+0000","last_clean_scrub_stamp":"2024-09-14T11:56:37.620756+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:34.911258+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2613,"num_write":584,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":928,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'359","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.767279+0000","last_change":"2024-09-14T11:56:27.767279+0000","last_active":"2024-09-14T11:56:27.767279+0000","last_peered":"2024-09-14T11:56:27.767279+0000","last_clean":"2024-09-14T11:56:27.767279+0000","last_became_active":"2024-09-14T11:14:04.121237+0000","last_became_peered":"2024-09-14T11:14:04.121237+0000","last_unstale":"2024-09-14T11:56:27.767279+0000","last_undegraded":"2024-09-14T11:56:27.767279+0000","last_fullsized":"2024-09-14T11:56:27.767279+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:56:27.767137+0000","last_clean_scrub_stamp":"2024-09-14T11:56:27.767137+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:02.709261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":694,"num_read_kb":183365,"num_write":1193,"num_write_kb":63775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'366","reported_seq":1854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:41.731881+0000","last_change":"2024-09-14T11:56:41.731802+0000","last_active":"2024-09-14T11:56:41.731881+0000","last_peered":"2024-09-14T11:56:41.731881+0000","last_clean":"2024-09-14T11:56:41.731881+0000","last_became_active":"2024-09-14T11:14:06.130611+0000","last_became_peered":"2024-09-14T11:14:06.130611+0000","last_unstale":"2024-09-14T11:56:41.731881+0000","last_undegraded":"2024-09-14T11:56:41.731881+0000","last_fullsized":"2024-09-14T11:56:41.731881+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T11:56:41.731720+0000","last_clean_scrub_stamp":"2024-09-14T11:56:41.731720+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:26.482405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2087,"num_read_kb":2014,"num_write":399,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10847,"num_read_kb":8934,"num_write":3117,"num_write_kb":1009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15275,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15156,"num_read_kb":14815,"num_write":17066,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2626,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1564,"ondisk_log_size":1564,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":647,"ondisk_log_size":647,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1608537,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17476,"num_read_kb":36987,"num_write":14663,"num_write_kb":11713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701800,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2260,"ondisk_log_size":2260,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220028,"num_read_kb":201384,"num_write":55747,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3642,"ondisk_log_size":3642,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":41776745,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44044,"num_read_kb":2244679,"num_write":72642,"num_write_kb":2215748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64241664,"data_stored":64241664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3767,"ondisk_log_size":3767,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174309,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174255,"num_write":154,"num_write_kb":115879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509972,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271740,"kb_used_data":10092,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94100100,"statfs":{"total":96636764160,"available":96358502400,"internally_reserved":0,"allocated":10334208,"data_stored":8385962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509973,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166396,"kb_used_data":13100,"kb_used_omap":1,"kb_used_meta":153278,"kb_avail":94205444,"statfs":{"total":96636764160,"available":96466374656,"internally_reserved":0,"allocated":13414400,"data_stored":11401393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":156957125},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509971,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110592,"kb_used_data":11376,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94261248,"statfs":{"total":96636764160,"available":96523517952,"internally_reserved":0,"allocated":11649024,"data_stored":9739557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542675,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300316,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94071524,"statfs":{"total":96636764160,"available":96329240576,"internally_reserved":0,"allocated":8335360,"data_stored":6347071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542678,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273604,"kb_used_data":11956,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098236,"statfs":{"total":96636764160,"available":96356593664,"internally_reserved":0,"allocated":12242944,"data_stored":10281542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267909575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542676,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98288,"kb_used_data":12960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94273552,"statfs":{"total":96636764160,"available":96536117248,"internally_reserved":0,"allocated":13271040,"data_stored":11361506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542675,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168732,"kb_used_data":11276,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94203108,"statfs":{"total":96636764160,"available":96463982592,"internally_reserved":0,"allocated":11546624,"data_stored":9590010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542674,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279572,"kb_used_data":17924,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94092268,"statfs":{"total":96636764160,"available":96350482432,"internally_reserved":0,"allocated":18354176,"data_stored":16376601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13529088,"data_stored":13529088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7331840,"data_stored":7331840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8024064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7483392,"data_stored":7483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9142272,"data_stored":9142272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3497984,"data_stored":3497984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:57:45.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:57:45.701 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:57:45.701 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:57:45.701 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:57:45.701 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:45.760 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:57:45.760 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:57:45.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:45.803 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:57:45.803 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:57:45.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:45.844 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:57:45.845 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:57:45.845 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:45.886 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:57:45.886 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T11:57:45.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:45.925 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T11:57:45.925 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T11:57:45.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.002 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T11:57:46.003 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T11:57:46.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.093 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T11:57:46.094 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T11:57:46.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.157 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T11:57:46.157 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:57:46.157 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T11:57:46.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.181 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T11:57:46.181 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:57:46.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.212 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:57:46.212 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:57:46.212 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:57:46.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.237 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:57:46.237 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T11:57:46.237 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.289 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T11:57:46.289 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T11:57:46.289 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:57:46.301 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T11:57:46.301 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:57:46.302 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T11:57:46.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:57:46.371 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:57:46.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:57:46.625 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:57:46.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:57:46.717 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:57:46.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:57:46.786 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:57:46.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:57:46.881 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T11:57:47.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:57:47.079 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T11:57:47.157 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:57:47.157 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T11:57:47.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:57:47.239 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T11:57:47.323 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:57:47.324 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/data/mon.a.tgz 2024-09-14T11:57:47.324 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-14T11:57:47.354 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.FCK5Qwrkki 2024-09-14T11:57:47.354 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FCK5Qwrkki 2024-09-14T11:57:47.534 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.FCK5Qwrkki 2024-09-14T11:57:47.644 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.FCK5Qwrkki is 449KB 2024-09-14T11:57:47.739 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.FCK5Qwrkki 2024-09-14T11:57:47.768 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/data/mon.c.tgz 2024-09-14T11:57:47.768 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-14T11:57:47.836 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.99C7dBPxCc 2024-09-14T11:57:47.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.99C7dBPxCc 2024-09-14T11:57:48.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.99C7dBPxCc 2024-09-14T11:57:48.116 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.99C7dBPxCc is 456KB 2024-09-14T11:57:48.216 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.99C7dBPxCc 2024-09-14T11:57:48.246 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/data/mon.b.tgz 2024-09-14T11:57:48.246 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-14T11:57:48.279 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.fyiM3UZy5Z 2024-09-14T11:57:48.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fyiM3UZy5Z 2024-09-14T11:57:48.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.fyiM3UZy5Z 2024-09-14T11:57:48.595 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.fyiM3UZy5Z is 456KB 2024-09-14T11:57:48.694 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.fyiM3UZy5Z 2024-09-14T11:57:48.723 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:57:48.723 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:57:48.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:57:48.832 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:57:48.870 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:57:48.870 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:57:48.872 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi094/crash 2024-09-14T11:57:48.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:57:48.912 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi131/crash 2024-09-14T11:57:48.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:57:48.950 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:57:48.950 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:57:48.956 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:57:48.992 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:57:49.044 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32703.log 2024-09-14T11:57:49.044 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-09-14T11:57:49.044 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32703.log.gz 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32747.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr: 28.6% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32890.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32890.log.gz 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32934.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.32934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32934.log.gz 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.5.log: 90.9% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph.log: 2024-09-14T11:57:49.045 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32615.log 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32615.log: /var/log/ceph/ceph-mon.b.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32615.log.gz 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.32659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz 2024-09-14T11:57:49.046 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:57:49.117 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2024-09-14T11:57:49.117 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169348.log 2024-09-14T11:57:49.117 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140662.log 2024-09-14T11:57:49.117 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.169348.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2024-09-14T11:57:49.117 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143018.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.169348.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.140662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191791.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.140662.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188392.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187732.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191791.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188392.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188392.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47376.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111212.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187732.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.143018.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182933.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.47376.log.gz 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.111212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69198.log 2024-09-14T11:57:49.118 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.182933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160713.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111212.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182933.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.69198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164884.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.160713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88829.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.160713.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38146.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.164884.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135361.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.88829.log: /var/log/ceph/ceph-client.admin.38146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107677.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38146.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88829.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.135361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97664.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135361.log.gz 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.107677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131827.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.97664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37560.log 2024-09-14T11:57:49.119 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97664.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.131827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77164.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37560.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.131827.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37653.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37560.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107677.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.77164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57485.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.77164.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37653.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81761.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146552.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57485.log: /var/log/ceph/ceph-client.admin.81761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38401.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.57485.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.146552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82350.log 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81761.log.gz 2024-09-14T11:57:49.120 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146552.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181715.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38401.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.82350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164295.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82350.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.181715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.181715.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64864.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164295.log: /var/log/ceph/ceph-client.admin.39271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102376.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.164295.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.64864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178061.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.102376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123581.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102376.log.gz 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.178061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49143.log 2024-09-14T11:57:49.121 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.123581.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178061.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67959.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123581.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.49143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103554.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.49143.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187120.log/var/log/ceph/ceph-client.admin.67959.log: 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.103554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115335.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103554.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187120.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.187120.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.115335.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.175594.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.1.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.115335.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68578.log 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.175594.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67959.log.gz 2024-09-14T11:57:49.122 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.68578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166699.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75795.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.166699.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166699.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68578.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70436.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.175594.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.75795.log: -- /var/log/ceph/ceph-client.admin.188416.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.70436.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.75795.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38520.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106499.log 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38520.log: /var/log/ceph/ceph-client.admin.188416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188416.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38520.log.gz 2024-09-14T11:57:49.123 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187780.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70436.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.106499.log: --verbose -- /var/log/ceph/ceph-client.admin.38767.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187780.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.106499.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108266.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187780.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38767.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38767.log.gz /var/log/ceph/ceph-client.admin.157746.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.108266.log: -- /var/log/ceph/ceph-client.admin.163682.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.157746.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.108266.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63304.log 82.1% -- replaced with /var/log/ceph/ceph-client.admin.157746.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163682.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129471.log 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63304.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63304.log.gz 2024-09-14T11:57:49.124 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.0.181106.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.129471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161891.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.129471.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.181106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135950.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.181106.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.161891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160692.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.161891.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.135950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49780.log 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135950.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.160692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160692.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40514.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.49780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49780.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40514.log: gzip -5 81.0% --verbose -- /var/log/ceph/ceph-client.admin.81172.log 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.40514.log.gz 2024-09-14T11:57:49.125 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64864.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.54540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82939.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.81172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38152.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.82939.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.81172.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124759.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82939.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38152.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152443.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37801.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.124759.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.124759.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.152443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118280.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.152443.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37801.log.gz 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110034.log 2024-09-14T11:57:49.126 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158335.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.118280.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118280.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.69198.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58711.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.110034.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.158335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53951.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58711.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158335.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132416.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58711.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.53951.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.53951.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.132416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52773.log 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.132416.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-09-14T11:57:49.127 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122403.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148909.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52773.log: /var/log/ceph/ceph-client.admin.122403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97075.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.52773.log.gz/var/log/ceph/ceph-client.admin.148909.log: 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165473.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.148909.log.gz 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.97075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180497.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.97075.log.gz 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.165473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170911.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165473.log.gz 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122403.log.gz 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.180497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98842.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180497.log.gz 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77930.log 2024-09-14T11:57:49.128 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170911.log: /var/log/ceph/ceph-client.admin.98842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179888.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170911.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.98842.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141251.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.77930.log: /var/log/ceph/ceph-client.0.179888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154211.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.179888.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.141251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63500.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141251.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.154211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191057.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.154211.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133005.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191057.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.63500.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191057.log.gz 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.189878.log 2024-09-14T11:57:49.129 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145374.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.189878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133005.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90596.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.145374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191011.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145374.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.90596.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77930.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62995.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90596.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191011.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134183.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50958.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62995.log: 52.3% -- replaced with /var/log/ceph/ceph-client.admin.62995.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.134183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59889.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134183.log.gz 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.50958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163706.log 2024-09-14T11:57:49.130 INFO:teuthology.orchestra.run.smithi094.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50958.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186531.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163706.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59889.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176841.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163706.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.186531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115924.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.186531.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71057.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.176841.log: /var/log/ceph/ceph-client.admin.115924.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.176841.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.71057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126526.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115924.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.126526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88240.log 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126526.log.gz 2024-09-14T11:57:49.131 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71057.log.gz/var/log/ceph/ceph-client.admin.39091.log: 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130649.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.88240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150676.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88240.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.130649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.150676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83528.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150676.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165497.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.46461.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130649.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.83528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172882.log 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83528.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.165497.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165497.log.gz 2024-09-14T11:57:49.132 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.76386.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.172882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74022.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.76386.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.172882.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.76386.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38512.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74022.log: /var/log/ceph/ceph-client.admin.38512.log: 84.0% 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.38512.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.112390.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74022.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158924.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.53362.log: /var/log/ceph/ceph-client.admin.112390.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125348.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.158924.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112390.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182324.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.158924.log.gz 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161302.log 2024-09-14T11:57:49.133 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.125348.log: /var/log/ceph/ceph-client.0.182324.log: 85.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165521.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125348.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182324.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.161302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41768.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.165521.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161302.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.191103.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.41768.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165521.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191471.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.41768.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.191103.log: --verbose -- /var/log/ceph/ceph-client.admin.55718.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191103.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191471.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117691.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78539.log 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55718.log: /var/log/ceph/ceph-client.admin.117691.log: gzip -5 84.1% -- replaced with /var/log/ceph/ceph-client.admin.55718.log.gz 2024-09-14T11:57:49.134 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.120636.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117691.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.78539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64161.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.78539.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.120636.log: /var/log/ceph/ceph-client.admin.64161.log: gzip -5 19.5% -- replaced with /var/log/ceph/ceph-client.admin.64161.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120636.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.85295.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51547.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1%/var/log/ceph/ceph-client.admin.85295.log: -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95897.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85295.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51547.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.51547.log.gz 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.95897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173490.log 2024-09-14T11:57:49.135 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95897.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64275.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.173490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62602.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.173490.log.gz/var/log/ceph/ceph-client.admin.64275.log: 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79994.log 84.0% -- replaced with /var/log/ceph/ceph-client.admin.64275.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62602.log: 60.2% -- replaced with /var/log/ceph/ceph-client.admin.62602.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105910.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.79994.log: gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.79994.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.138895.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.105910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191655.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105910.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.138895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72341.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138895.log.gz 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.191655.log: -- /var/log/ceph/ceph-client.admin.190735.log 2024-09-14T11:57:49.136 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191655.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.72341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94130.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.72341.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190735.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69817.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63434.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94130.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.69817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58074.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63434.log: gzip -5 --verbose -- 57.3% -- replaced with /var/log/ceph/ceph-client.admin.63434.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.0.76555.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58074.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188489.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.76555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150087.log 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.76555.log.gz 2024-09-14T11:57:49.137 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188489.log: gzip -5 --verbose -- 84.4% -- replaced with /var/log/ceph/ceph-client.admin.188489.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.151265.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.69817.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.150087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191149.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.150087.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.151265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127115.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191149.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191149.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38151.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.127115.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127704.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.38151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38151.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.189878.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.151265.log.gz 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92363.log 2024-09-14T11:57:49.138 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190781.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127704.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.92363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92952.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190781.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.92363.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139484.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190781.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.92952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61115.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.139484.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92952.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.75204.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61115.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139484.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179279.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.75204.log: -- replaced with /var/log/ceph/ceph-client.admin.61115.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: 81.1%/var/log/ceph/ceph-client.admin.49756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125937.log 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75204.log.gz 2024-09-14T11:57:49.139 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.179279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104143.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.179279.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.125937.log: /var/log/ceph/ceph-client.admin.104143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176202.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.125937.log.gz/var/log/ceph/ceph-client.admin.37717.log: 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104143.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101787.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.176202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52160.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.101787.log: gzip -5 92.3% --verbose -- /var/log/ceph/ceph-client.admin.172127.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.176202.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.101787.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52160.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52160.log.gz 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.144785.log 2024-09-14T11:57:49.140 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.172127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84706.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172127.log.gz 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.144785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134772.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144785.log.gz/var/log/ceph/ceph-client.admin.84706.log: 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120047.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.134772.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84706.log.gz 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108855.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.120047.log: --verbose -- /var/log/ceph/ceph-client.admin.37893.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9%/var/log/ceph/ceph-client.admin.108855.log: -- replaced with /var/log/ceph/ceph-client.admin.120047.log.gz 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191333.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.108855.log.gz 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56307.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37893.log.gz 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.134772.log.gz/var/log/ceph/ceph-client.admin.191333.log: 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50369.log 2024-09-14T11:57:49.141 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191333.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73433.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.56307.log: /var/log/ceph/ceph-client.admin.50369.log: gzip 85.1% -- replaced with /var/log/ceph/ceph-client.admin.56307.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.177450.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50369.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.73433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38813.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.73433.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.177450.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26682.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.177450.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.38813.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38813.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.190643.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.tmp-client.admin.26682.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26682.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153622.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190689.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190643.log.gz 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.153622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110623.log 2024-09-14T11:57:49.142 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190689.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.153622.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190689.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.151854.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155389.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110623.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.151854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63368.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.151854.log.gz/var/log/ceph/ceph-client.admin.155389.log: 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96486.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155389.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100609.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.96486.log: gzip 81.7% -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96486.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80583.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.100609.log.gz 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38515.log 2024-09-14T11:57:49.143 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.80583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171519.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.80583.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38515.log: -- /var/log/ceph/ceph-client.admin.188440.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38515.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.171519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87062.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188440.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.171519.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122992.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137128.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87062.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.122992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47965.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.137128.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122992.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137128.log.gz 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142429.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116513.log 2024-09-14T11:57:49.144 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47965.log: /var/log/ceph/ceph-client.admin.142429.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47965.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.142429.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184151.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100020.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.184151.log: /var/log/ceph/ceph-client.admin.116513.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116513.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.184151.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189185.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100020.log: gzip -5 --verbose -- 81.9% /var/log/ceph/ceph-client.admin.159513.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100020.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147141.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.189185.log: /var/log/ceph/ceph-client.admin.159513.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.189185.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.159513.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.42377.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41123.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.147141.log: /var/log/ceph/ceph-client.0.42377.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42377.log.gz 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86473.log 2024-09-14T11:57:49.145 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.41123.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41123.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140073.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.147141.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.86473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71677.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.86473.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.140073.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61704.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140073.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.71677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191563.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61704.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.61704.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63368.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191563.log.gz 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191241.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67340.log 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191241.log: /var/log/ceph/ceph-osd.2.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191241.log.gz 91.8% 2024-09-14T11:57:49.146 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71677.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60502.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.67340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144196.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60502.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.67340.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39911.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.144196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168740.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.39911.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.144196.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.39911.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112979.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.168740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187756.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.112979.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112979.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168740.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101198.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160102.log 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187756.log.gz 2024-09-14T11:57:49.147 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.101198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155978.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2%/var/log/ceph/ceph-client.admin.160102.log: -- replaced with /var/log/ceph/ceph-client.admin.101198.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.160102.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.155978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94719.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mgr.y.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.155978.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191195.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94719.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94719.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38400.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191195.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153033.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38400.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117102.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.153033.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153033.log.gz 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62877.log 2024-09-14T11:57:49.148 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.117102.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.117102.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136539.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62877.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.62877.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95308.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.136539.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136539.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44186.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.95308.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95308.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.44186.log: 44.6% -- replaced with /var/log/ceph/ceph-client.0.44186.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191379.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66721.log 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191379.log.gz 2024-09-14T11:57:49.149 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188370.log 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.66721.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66721.log.gz 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114746.log 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188370.log: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.188370.log.gz 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166110.log 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.114746.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.114746.log.gz 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128882.log 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.166110.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.166110.log.gz 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38721.log 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.128882.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.128882.log.gz 2024-09-14T11:57:49.194 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121814.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38721.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149498.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.121814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7%/var/log/ceph/ceph-client.admin.149498.log: -- replaced with /var/log/ceph/ceph-client.admin.121814.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.149498.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93541.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45866.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.93541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119458.log 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93541.log.gz/var/log/ceph/ceph-client.admin.45866.log: 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.45866.log.gz 2024-09-14T11:57:49.195 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190827.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.119458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168091.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9%/var/log/ceph/ceph-client.admin.190827.log: -- replaced with /var/log/ceph/ceph-client.admin.119458.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190827.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184760.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.168091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32774.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.184760.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.168091.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191425.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.184760.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32774.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191425.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.38153.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191425.log.gz 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38518.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.113568.log 2024-09-14T11:57:49.196 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38153.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.91774.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38153.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.113568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190919.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.113568.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.91774.log: 81.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.91774.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.105321.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118869.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190919.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.105321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190965.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105321.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.118869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178670.log 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118869.log.gz 2024-09-14T11:57:49.197 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39181.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190965.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.178670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147730.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.178670.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145963.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39181.log: /var/log/ceph/ceph-client.admin.147730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121225.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39181.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9%/var/log/ceph/ceph-client.admin.145963.log: -- replaced with /var/log/ceph/ceph-client.admin.147730.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145963.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.121225.log: /var/log/ceph/ceph-client.admin.154800.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38389.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121225.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187710.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.154800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59300.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138306.log 2024-09-14T11:57:49.198 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187710.log: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.187710.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63223.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.59300.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.138306.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154800.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138306.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188465.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114157.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63223.log: /var/log/ceph/ceph-client.admin.188465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37847.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188465.log.gz 90.6% 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63223.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.114157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87651.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37847.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39135.log 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87651.log.gz 2024-09-14T11:57:49.199 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52136.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.114157.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91185.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98253.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39135.log: /var/log/ceph/ceph-client.admin.91185.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39135.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.98253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191609.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98253.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58122.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.91185.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137717.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148319.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191609.log: /var/log/ceph/ceph-client.admin.137717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131238.log 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191609.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8%/var/log/ceph/ceph-client.admin.148319.log: -- replaced with /var/log/ceph/ceph-client.admin.137717.log.gz 2024-09-14T11:57:49.200 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185369.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.148319.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190873.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.131238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43583.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131238.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.185369.log: /var/log/ceph/ceph-client.admin.190873.log: 0.0%gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190873.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.185369.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.43583.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43583.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90007.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37742.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.90007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191747.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.90007.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37742.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37742.log.gz 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.191287.log 2024-09-14T11:57:49.201 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174706.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191747.log: /var/log/ceph/ceph-client.admin.191287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191747.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191287.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64095.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.174706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124170.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174706.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.64095.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.64095.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65483.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.124170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174098.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124170.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.65483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107088.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.174098.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174098.log.gz 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65483.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38143.log 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89418.log/var/log/ceph/ceph-client.admin.107088.log: 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.107088.log.gz 2024-09-14T11:57:49.202 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38143.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42980.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38143.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.89418.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89418.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109445.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42980.log: 43.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163069.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.42980.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170303.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.109445.log: /var/log/ceph/ceph-client.admin.163069.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109445.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39294.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.163069.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102965.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.39294.log: 95.9% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.170303.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.0.39294.log.gz 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60478.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.102965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141840.log 2024-09-14T11:57:49.203 INFO:teuthology.orchestra.run.smithi094.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.102965.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163658.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60478.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.141840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85884.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163658.log: 0.0% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141840.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.163658.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56896.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.85884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156568.log 81.9% 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85884.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143607.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.56896.log: /var/log/ceph/ceph-client.admin.156568.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.56896.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.156568.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162480.log 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143607.log.gz 2024-09-14T11:57:49.204 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183542.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162480.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.162480.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79405.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.183542.log: /var/log/ceph/ceph-client.admin.38150.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183542.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157157.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.79405.log: /var/log/ceph/ceph-client.admin.157157.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79405.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.157157.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111801.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58098.log 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.111801.log: /var/log/ceph/ceph-client.admin.33112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.111801.log.gz 2024-09-14T11:57:49.205 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.58098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58098.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99431.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66102.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.99431.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.99431.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128293.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.66102.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66102.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.128293.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.128293.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104732.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.49732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60526.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.104732.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104732.log.gz 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191517.log 2024-09-14T11:57:49.206 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60526.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.60526.log.gz 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130060.log 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191517.log.gz 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191701.log 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.130060.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130060.log.gz 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38140.log 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191701.log.gz 2024-09-14T11:57:49.207 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38521.log 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38140.log.gz 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77874.log 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38521.log.gz 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133594.log 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.77874.log: 47.3% -- replaced with /var/log/ceph/ceph-client.admin.77874.log.gz 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74614.log 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133594.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133594.log.gz 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84117.log 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74614.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74614.log.gz 2024-09-14T11:57:49.209 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.84117.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.84117.log.gz 2024-09-14T11:57:49.325 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:57:49.881 INFO:teuthology.orchestra.run.smithi094.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T11:57:50.074 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T11:57:50.825 INFO:teuthology.orchestra.run.smithi094.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:57:52.512 INFO:teuthology.orchestra.run.smithi094.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:57:57.292 INFO:teuthology.orchestra.run.smithi094.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:57:59.867 INFO:teuthology.orchestra.run.smithi094.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:58:00.063 INFO:teuthology.orchestra.run.smithi131.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T11:58:00.422 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T11:58:01.571 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T11:58:04.485 INFO:teuthology.orchestra.run.smithi094.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:58:07.332 INFO:teuthology.orchestra.run.smithi131.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T11:58:07.334 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-09-14T11:58:07.334 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m18.314s 2024-09-14T11:58:07.334 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m52.544s 2024-09-14T11:58:07.334 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m1.981s 2024-09-14T11:58:11.524 INFO:teuthology.orchestra.run.smithi094.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:58:11.526 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-14T11:58:11.526 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m22.544s 2024-09-14T11:58:11.526 INFO:teuthology.orchestra.run.smithi094.stderr:user 1m0.977s 2024-09-14T11:58:11.527 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m2.404s 2024-09-14T11:58:11.527 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:58:11.527 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi094/log 2024-09-14T11:58:11.528 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:58:19.375 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi131/log 2024-09-14T11:58:19.376 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:58:26.166 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:58:26.176 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:58:26.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:58:26.179 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:58:26.287 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:58:26.297 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:58:26.297 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:58:26.300 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:58:26.329 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:58:26.331 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:58:26.333 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:58:26.333 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-14T11:58:26.333 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +1913us[+1915us] +/- 41ms 2024-09-14T11:58:26.334 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 +2576us[+2578us] +/- 57ms 2024-09-14T11:58:26.334 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -10ms[ -10ms] +/- 101ms 2024-09-14T11:58:26.334 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:58:26.335 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:58:26.335 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-14T11:58:26.335 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +2242us[+2163us] +/- 41ms 2024-09-14T11:58:26.335 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 +2903us[+2825us] +/- 57ms 2024-09-14T11:58:26.335 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 18 -9876us[-9954us] +/- 101ms 2024-09-14T11:58:26.336 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:58:26.336 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:58:26.345 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:58:26.346 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:58:26.355 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:58:26.458 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:58:26.538 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:58:26.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:58:26.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:58:26.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:58:26.624 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:58:26.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:58:26.645 INFO:teuthology.task.internal:Duration was 3090.583704 seconds 2024-09-14T11:58:26.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:58:26.655 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:58:26.655 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:58:26.658 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:58:26.709 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:58:26.717 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:58:27.071 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:58:27.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-14T11:58:27.071 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:58:27.105 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-09-14T11:58:27.105 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:58:27.151 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:58:27.151 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:58:27.154 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:58:27.193 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:58:27.193 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:58:27.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:58:27.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:58:27.361 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:58:27.361 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:58:27.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:58:27.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:58:27.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:58:27.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:58:27.487 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-14T11:58:27.516 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-09-14T11:58:27.571 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:58:27.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:58:27.600 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:58:27.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:58:27.639 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:58:27.651 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:58:27.651 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi094 2024-09-14T11:58:27.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:58:27.701 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904175/remote/smithi131 2024-09-14T11:58:27.701 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:58:27.747 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:58:27.747 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:58:27.749 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:58:27.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:58:27.822 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:58:27.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:58:27.833 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:58:27.833 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:58:27.835 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:58:27.861 INFO:teuthology.orchestra.run.smithi094.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:58 /home/ubuntu/cephtest 2024-09-14T11:58:27.877 INFO:teuthology.orchestra.run.smithi131.stdout: 265979 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:58 /home/ubuntu/cephtest 2024-09-14T11:58:27.878 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:58:27.889 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:58:27.913 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3090.583703517914 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:58:27.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:58:27.983 INFO:teuthology.run:pass